-- Logs begin at Sat 2022-10-01 20:01:15 UTC, end at Sat 2022-10-01 22:24:50 UTC. -- Oct 01 20:37:54.303677 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 01 20:37:54.312711 ncdv-master-1 devstack@n-api.service[124026]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 1 20:37:54 2022] *** Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: nodename: ncdv-master-1 Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: machine: x86_64 Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: clock source: unix Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: pcre jit disabled Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: detected number of CPU cores: 4 Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: current working directory: / Oct 01 20:37:54.314706 ncdv-master-1 devstack@n-api.service[124026]: detected binary path: /usr/bin/uwsgi-core Oct 01 20:37:54.315381 ncdv-master-1 devstack@n-api.service[124026]: your processes number limit is 47680 Oct 01 20:37:54.315381 ncdv-master-1 devstack@n-api.service[124026]: your memory page size is 4096 bytes Oct 01 20:37:54.315381 ncdv-master-1 devstack@n-api.service[124026]: detected max file descriptor number: 2048 Oct 01 20:37:54.315381 ncdv-master-1 devstack@n-api.service[124026]: lock engine: pthread robust mutexes Oct 01 20:37:54.315381 ncdv-master-1 devstack@n-api.service[124026]: thunder lock: enabled Oct 01 20:37:54.315381 ncdv-master-1 devstack@n-api.service[124026]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 01 20:37:54.315381 ncdv-master-1 devstack@n-api.service[124026]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 01 20:37:54.359331 ncdv-master-1 devstack@n-api.service[124026]: Python main interpreter initialized at 0x55766de869c0 Oct 01 20:37:54.359331 ncdv-master-1 devstack@n-api.service[124026]: python threads support enabled Oct 01 20:37:54.359331 ncdv-master-1 devstack@n-api.service[124026]: your server socket listen backlog is limited to 100 connections Oct 01 20:37:54.359331 ncdv-master-1 devstack@n-api.service[124026]: your mercy for graceful operations on workers is 90 seconds Oct 01 20:37:54.359653 ncdv-master-1 devstack@n-api.service[124026]: mapped 403077 bytes (393 KB) for 2 cores Oct 01 20:37:54.359740 ncdv-master-1 devstack@n-api.service[124026]: *** Operational MODE: preforking *** Oct 01 20:37:54.359963 ncdv-master-1 devstack@n-api.service[124026]: *** uWSGI is running in multiple interpreter mode *** Oct 01 20:37:54.359963 ncdv-master-1 devstack@n-api.service[124026]: spawned uWSGI master process (pid: 124026) Oct 01 20:37:54.360142 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 01 20:37:54.362414 ncdv-master-1 devstack@n-api.service[124026]: spawned uWSGI worker 1 (pid: 124027, cores: 1) Oct 01 20:37:54.362414 ncdv-master-1 devstack@n-api.service[124026]: spawned uWSGI worker 2 (pid: 124028, cores: 1) Oct 01 20:37:54.362414 ncdv-master-1 devstack@n-api.service[124026]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 01 20:37:55.665432 ncdv-master-1 devstack@n-api.service[124028]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 01 20:37:55.692329 ncdv-master-1 devstack@n-api.service[124027]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 01 20:37:56.345296 ncdv-master-1 devstack@n-api.service[124028]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:37:56.345296 ncdv-master-1 devstack@n-api.service[124028]: from cryptography.utils import int_from_bytes Oct 01 20:37:56.345545 ncdv-master-1 devstack@n-api.service[124028]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:37:56.345545 ncdv-master-1 devstack@n-api.service[124028]: from cryptography.utils import int_from_bytes Oct 01 20:37:56.350828 ncdv-master-1 devstack@n-api.service[124027]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:37:56.350828 ncdv-master-1 devstack@n-api.service[124027]: from cryptography.utils import int_from_bytes Oct 01 20:37:56.351206 ncdv-master-1 devstack@n-api.service[124027]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:37:56.351206 ncdv-master-1 devstack@n-api.service[124027]: from cryptography.utils import int_from_bytes Oct 01 20:37:58.912577 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 20:37:58.913130 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 20:37:58.913328 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 20:37:58.913709 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 20:37:58.913964 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 20:37:58.914347 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.914692 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.915011 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.915324 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.915649 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.915956 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.916273 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.916590 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.916908 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.917163 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.917476 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.917563 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 20:37:58.917929 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 20:37:58.918010 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.918089 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.918244 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 20:37:58.918392 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.918631 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 20:37:58.918722 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.918885 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 20:37:58.919038 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.919264 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.919394 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.919586 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.919722 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.919903 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.920046 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.920218 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.920399 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.920561 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.921673 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.921905 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.922095 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.922282 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.922523 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.922714 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.922902 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.923114 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.923114 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.923435 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.923652 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.923852 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.924048 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.924227 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.924419 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.924604 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.924806 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.924994 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.925203 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.925384 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.925578 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.925773 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.925973 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.926124 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.926355 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.926539 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.926698 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.926825 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.926993 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.927134 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.927274 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.927432 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.927555 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.927688 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.927813 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.927936 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.928086 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.928224 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.928356 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.928490 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.928620 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.928814 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.928943 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.929068 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.929206 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.929874 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.930004 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.930134 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.930268 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.930405 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.930405 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.930673 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.930807 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.930933 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.931057 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.931189 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.931322 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.931446 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.931582 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.931715 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.931841 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.931965 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.932095 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.932221 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.932357 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.932510 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.932673 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.932806 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.932931 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.933071 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.933197 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.933197 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.933447 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.933578 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.933716 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.933931 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.934060 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.934197 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.934323 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.934446 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.934596 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.934729 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.934854 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.934986 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.935110 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.935233 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.935366 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.935491 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.935614 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.935745 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.935875 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.935875 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.936117 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.936242 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.936365 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.936496 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.936632 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.936757 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.936893 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.936893 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.937140 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.937140 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.937376 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.937523 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.937651 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.937775 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.937898 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.938029 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.938155 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.938287 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.938423 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.938577 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.938706 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.938843 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.939045 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.939187 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.939313 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.939444 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.939577 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.939703 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.939840 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.939961 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.940091 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.940224 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.940349 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.940480 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.940615 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.940748 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.940873 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.940996 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.941120 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.941244 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.941381 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.941507 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.941630 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.941761 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.941886 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.942017 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.942150 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.942286 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.942411 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.942557 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.942684 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.942821 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.942954 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.943079 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.943203 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.943327 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.943457 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.943594 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.943720 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.943851 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.943975 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.944099 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.944229 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.944363 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.944488 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.944611 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.944734 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.944887 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.945569 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.945984 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.946123 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.946249 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.946373 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.946525 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.946653 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.946791 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.946919 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.947099 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.947228 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.947399 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.947536 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.947700 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.947829 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.947999 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.948129 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.948296 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.948434 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.948595 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.948729 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.948894 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.949039 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.949230 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.949372 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.949499 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.949622 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.949768 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.949897 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.950068 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.950211 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.950367 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.950574 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.950703 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.950849 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.950976 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.951114 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.951262 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.951392 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.951577 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.951706 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.951875 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.952012 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.952178 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.952305 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.952475 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.952609 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.952770 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.952912 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.953065 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.953200 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.953362 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.953491 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.953659 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.953801 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.953956 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.954083 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.954252 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.954388 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.954573 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.954712 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.954869 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.955005 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.955179 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.955308 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.955480 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.955610 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.955780 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.955907 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.956079 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.956208 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.956373 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.956501 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.956673 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.956811 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.956985 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.957115 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.957286 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.957426 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.957584 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.957713 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.957881 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.958024 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.958179 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.958310 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.958476 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.958674 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.958801 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.959003 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.959129 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.959267 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.959457 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.959586 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.959710 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.959844 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.959970 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.960102 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.960234 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.960359 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.960548 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.960730 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.960866 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.961063 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.961192 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.961379 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.961516 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:37:58.961707 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.961836 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.962019 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.962148 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.962328 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.962466 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.962717 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.962845 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.963035 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.963162 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.963348 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.963490 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.963645 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.963784 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.963947 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.964084 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.964257 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.964399 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.964581 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.964712 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.964887 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.965015 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.965194 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.965332 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.965498 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.965627 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.965808 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.965936 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.966113 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.966241 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.966418 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.966577 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.966748 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.966885 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.967073 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.967203 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.967379 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.967507 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.967681 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.967808 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.967992 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.968121 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.968297 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.968424 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.968613 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.968741 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.968915 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.969044 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.969218 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.969345 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.969548 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.969684 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.969828 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.969955 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.970113 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.970243 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.970440 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.970615 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.970777 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.970905 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.971079 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.971206 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.971381 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.971518 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.971687 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.971813 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.971998 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.972127 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.972302 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.972441 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.972605 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.972812 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.972943 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.973067 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.973192 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.973325 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.973477 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.973613 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.973776 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.973914 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.974079 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.974209 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.974376 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.974535 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.974701 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.974840 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.975026 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.975155 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.975327 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.975457 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.975642 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.975770 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.975943 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.976071 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.976269 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.976396 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.976573 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.976701 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.976875 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.977003 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.977173 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.977302 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.977474 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.977611 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.977773 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.977902 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.978071 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.978200 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.978366 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.978550 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.978690 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.978824 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.978975 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.979104 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.979286 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.979425 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.979659 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.979797 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.979922 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.980047 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.980171 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.980305 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.980473 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.980604 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.980773 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.980901 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.981104 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.981230 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.981355 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.981479 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.981655 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.981782 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.981958 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.982098 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.982262 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.982390 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.982583 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.982715 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.982902 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.983034 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.983210 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.983338 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.983512 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.983642 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.983827 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.983958 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.984128 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.984257 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.984425 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.984561 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.984728 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.984857 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.985027 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.985163 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.985325 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.985465 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.985622 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.985761 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.985925 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.986053 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.986223 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.986362 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.986550 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.986680 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.986817 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.986943 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.987118 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.987253 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.987417 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.987553 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.987736 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.987866 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.988041 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.988173 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.988340 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.988475 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.988637 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.988766 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.988933 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.989064 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.989238 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.989373 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.989545 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.989675 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.989890 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.990028 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.990154 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.990285 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.990410 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.990557 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.990728 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.990867 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.991028 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.991167 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.991326 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.991463 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.991622 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.991751 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.992441 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.992572 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.992762 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.992900 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.993067 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.993196 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.993365 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.993494 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.993661 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.993800 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.993958 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.994088 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.994293 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.994420 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.994613 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.994754 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.994932 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.995063 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.995239 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.995368 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.995540 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.995687 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.995851 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.995981 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.996185 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.996314 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.996514 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.996645 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.996825 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.996953 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.997141 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.997271 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.997447 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.997576 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.997749 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.997885 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.998053 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.998180 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.998354 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.998510 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.998682 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.998825 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.998985 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.999113 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.999297 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.999433 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.999598 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.999733 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:58.999940 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.000083 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.000210 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.000334 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.000498 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.000626 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.000807 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.000943 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.001118 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.001247 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.001424 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.001563 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.001735 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.001873 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.002040 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.002167 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.002349 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.002533 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.002663 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.002801 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.002974 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.003102 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.003280 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.003416 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.003585 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.003714 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.003889 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.004018 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.004192 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.004319 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.004490 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.004619 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.004789 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.004917 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.005093 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.005222 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.005402 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.005531 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.005708 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.005837 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.006006 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.006133 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.006304 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.006432 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.006639 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.006769 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.006943 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.007084 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.007242 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.007372 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.008086 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.008221 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.008398 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.008537 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.008718 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.008847 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.009020 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.009155 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.009327 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.009469 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.009628 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.009769 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.009928 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.010132 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.010268 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.010472 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.010656 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.010780 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.010917 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.011051 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.011176 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.011308 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.011434 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.011556 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.011689 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.011813 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.012004 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.012140 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.012303 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.012439 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.012600 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.012729 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.012906 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.013037 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.013218 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.013394 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.013521 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.013644 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.013815 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.013951 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.014118 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.014247 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.014413 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.014559 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.014738 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.014869 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.015059 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.015186 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.015361 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.015498 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.015660 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.015789 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.015959 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.016088 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.016256 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.016386 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.016559 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.016687 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.016875 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.017011 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.017171 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.017300 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.017472 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.017606 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.017775 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.017905 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.018072 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.018211 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.018374 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.018534 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.018702 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.018831 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.019006 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.019259 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.019388 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.019587 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.019717 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.019898 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.020035 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.020243 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.020378 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.020504 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.020629 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.020787 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.020926 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.021093 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.021230 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.021410 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.021539 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.021713 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.021841 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.022015 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.022145 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.022318 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.022447 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.022637 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.022766 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.022937 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.023086 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.023269 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.023433 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.023570 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.023858 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.024157 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.024332 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.024462 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.024744 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.024870 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.025043 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.025165 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.025418 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.025547 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.025664 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.025781 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.025939 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.026068 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.026238 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.026353 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.026566 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.026698 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.026869 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.026994 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.027189 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.027312 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.027494 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.027618 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.027792 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.027915 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.028152 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.028274 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.028381 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.028487 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.028711 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.028838 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.029008 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.029123 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.029317 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.029431 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.029698 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.030131 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.030537 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.030881 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.031088 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.031286 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.031513 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.031715 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.031920 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.031920 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.032314 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.032510 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.032729 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.032936 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.033135 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.033342 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.033548 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.033752 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.033974 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.034271 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.034470 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.034716 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.034926 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.035153 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.035360 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.035566 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.035770 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.035973 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.036179 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.036501 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.036707 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.036910 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.037119 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.037324 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.037525 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.037756 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.037964 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.038184 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.038389 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.038700 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.038915 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.039118 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.039306 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.039485 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.039672 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.039864 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.040026 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.040137 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.040244 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.040361 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.040692 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.040890 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.041036 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.041146 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.041253 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.041375 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.041483 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.041596 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.041713 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.041822 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.041937 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.042044 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.042157 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.042265 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.042381 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.042505 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.042622 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.042729 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.042834 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.042957 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.043074 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.043182 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.043287 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.043395 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.044057 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.044189 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.044314 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.044440 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.044565 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.044689 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.044826 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.044952 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.045077 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.045208 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.045333 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.045458 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.045591 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.045717 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.045841 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.045965 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.046095 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.046224 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.046350 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.046481 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.046637 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.046762 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.046898 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.047035 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.047173 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.047298 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.047429 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.047555 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.047686 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.047819 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.047952 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.048083 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.048216 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.048341 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.048475 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.048610 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.048735 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.048858 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.048982 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.049119 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.049253 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.049378 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.049501 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.049625 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.049758 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.049883 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.050015 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.050140 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.050271 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.050401 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.050541 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.050749 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.050893 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.051020 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.051145 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.051268 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.051393 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.051524 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.051663 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.051798 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.051924 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.052048 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.052172 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.052305 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.052431 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.052555 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.052688 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.052688 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.052925 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.053058 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.053184 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.053308 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.053432 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.053546 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.053651 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.053783 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.053910 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.054034 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.054158 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.054822 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.054968 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.055110 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.055235 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.055369 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.055496 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.055619 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.055743 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.055743 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.055995 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.056119 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.056242 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.056374 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.056511 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.056637 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.056760 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.056884 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.057008 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.057132 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.057264 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.057389 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.057512 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.057643 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.057775 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.057899 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.058031 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.058157 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.058288 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.058412 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.058561 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.058688 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.058826 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.058952 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.059077 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.059200 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.059324 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.059457 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.059582 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.059706 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.059829 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.059953 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.060084 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.060227 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.060357 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.060482 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.060617 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.060757 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.060956 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.061095 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.061230 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.061363 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.061497 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.061622 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.061746 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.061883 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.062016 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.062142 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.062274 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.062399 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.062654 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.062791 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.062924 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.063057 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.063182 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.063307 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.063439 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.063564 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.063678 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.063678 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.063893 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.064016 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.064148 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.064273 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.064398 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.064528 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.064652 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.064775 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.064907 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.065032 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.065163 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.065329 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.065460 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.065633 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.065764 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.065933 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.066070 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.066243 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.066372 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.066566 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.066709 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.066885 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.067029 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.067184 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.067347 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.067487 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.067656 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.067900 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.068030 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.068208 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.068338 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.068511 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.068642 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.068842 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.068969 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.069150 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.069289 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.069451 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.069581 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.069808 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.069984 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.070994 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.071147 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.071289 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.071416 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.071567 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.071705 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.071868 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.072011 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.072168 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.072296 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.072475 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.072602 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.072795 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.072932 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.073095 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.073224 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.073395 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.073543 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.073747 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.073865 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.074003 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.074138 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.074271 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.074404 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.074605 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.074737 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.074928 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.075065 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.075321 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.075448 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.075622 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.075752 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.075931 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.076069 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.076246 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.076383 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.076567 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.076698 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.076870 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.077053 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.077181 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.077303 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.077460 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.077595 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.077760 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.077891 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.078060 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.078198 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.078377 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.078551 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.078704 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.078834 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.079013 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.079154 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.079320 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.079461 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.079623 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.079750 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.079923 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.080066 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.080221 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.080359 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.080537 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.080666 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.080835 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.080964 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.081174 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.081312 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.081439 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.081563 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.081760 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.081901 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.082075 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.082207 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.082375 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.082531 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.082719 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.082849 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.083025 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.083156 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.083325 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.083455 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.083626 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.083756 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.083923 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.084061 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.084223 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.084354 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.084540 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.084669 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.084886 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.085030 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.085155 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.085287 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.085413 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.085566 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.085748 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.085877 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.086052 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.086180 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.086350 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.086533 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.086689 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.086830 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.086988 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.087124 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.087306 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.087445 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.087615 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.087745 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.087933 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.088049 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.088239 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.088364 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.088537 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.088651 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.088835 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.088949 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.089134 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.089251 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.089429 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.089551 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.089728 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.089843 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.090024 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.090140 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.090324 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.090441 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.090648 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.090764 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.090966 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.091084 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.091279 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.091584 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.091720 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.092135 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.092283 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.092469 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.092602 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.092860 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.093045 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.093356 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.093484 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.093662 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.093798 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.094044 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.094248 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.094377 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.094600 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.094737 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.094864 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.094989 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.095300 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.095457 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.095587 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.095875 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.096129 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.096263 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.096371 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.096487 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.096596 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.096789 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.096905 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.097101 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.097327 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.097443 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.097636 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.097758 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.097957 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.098076 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.098233 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.098358 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.098574 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.098696 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.098881 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.099183 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.099313 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.099494 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.099608 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.099794 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.099908 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.100093 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.100217 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.100391 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.100514 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.100700 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.100832 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.101010 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.101142 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.101382 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.101522 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.101639 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.101763 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.101949 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.102083 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.102256 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.102387 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.102597 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.102728 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.102934 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.103064 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.103198 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.103324 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.103512 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.103657 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.103824 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.103954 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.104135 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.104268 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.104442 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.104579 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.104752 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.104881 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.105064 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.105199 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.105380 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.105520 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.105687 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.105930 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.106061 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.106260 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.106400 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.106595 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.106728 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.106905 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.107034 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.107208 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.107352 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.107516 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.107653 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.107821 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.107950 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.108127 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.108268 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.108429 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.108565 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.108731 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.108867 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.109038 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.109169 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.109355 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.109492 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.109672 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.109786 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.109987 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.110109 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.110296 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.110410 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.110629 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.110745 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.110938 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.111054 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.111247 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.111490 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.111625 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.111744 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.111896 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.112072 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.112205 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.112392 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.112522 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.112712 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.112843 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.113021 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.113158 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.113335 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.113549 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.113681 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.113815 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.113942 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.114066 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.114233 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.114358 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.114562 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.114695 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.114870 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.115007 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.115168 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.115305 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.115472 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.115601 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.115781 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.115909 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.116081 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.116220 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.116396 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.116530 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.116700 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.117353 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.117543 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.117751 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.117868 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.118098 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.118228 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.118409 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.118666 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.118808 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.118979 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.119117 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.119309 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.119440 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.119631 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.119762 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.119951 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.120088 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.120252 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.120365 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.120554 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.120671 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.120864 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.120994 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.121164 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.121301 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.121462 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.121673 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.121803 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.121927 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.122053 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.122185 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.122341 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.122478 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.122739 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.122863 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.122987 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.123127 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.123255 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.123379 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.123560 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.123690 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.123864 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.124003 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.124190 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.124385 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.124516 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.124728 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.124867 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.125039 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.125169 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.125353 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.125481 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.125654 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.125792 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.125953 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.126082 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.126258 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.126394 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.126581 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.126730 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.126886 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.127015 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.127186 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.127322 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.127490 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.127618 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.127790 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.127918 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.128089 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.128227 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.128390 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.128521 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.128694 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.128836 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.128996 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.129134 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.129296 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.129426 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.129598 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.129726 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.129896 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.130026 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.130212 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.130352 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.130527 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.130671 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.130830 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.130960 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.131131 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.131263 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.131437 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.131575 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.131783 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.131997 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.132128 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.132295 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.132445 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.133168 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.133299 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.133478 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.133610 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.133781 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.133910 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.134089 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.134218 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.134391 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.134541 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.134729 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.134861 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.135061 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.135198 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.135370 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.135501 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.135670 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.135807 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.135973 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.136110 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.136279 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.136423 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.136579 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.136709 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.136882 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.137020 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.137187 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.137316 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.137493 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.137623 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.137797 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.137936 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.138101 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.138232 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.138564 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.138706 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.138848 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.138985 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.139114 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.139278 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.139408 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.139606 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.139743 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.139920 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.140048 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.140243 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.140379 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.140555 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.140699 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.140858 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.140988 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.141162 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.141292 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.141466 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.141598 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.141771 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.141949 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.142077 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.142201 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.142375 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.142537 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.142705 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.142836 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.143014 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.143144 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.143321 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.143452 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.143621 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.143749 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.143925 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.144229 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.144367 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.144536 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.144666 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.144843 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.144981 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.145149 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.145280 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.145453 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.145583 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.145760 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.145898 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.146065 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.146197 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.146374 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.146554 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.146741 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.146885 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.147058 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.147196 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.147371 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.147501 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.147683 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.147823 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.147997 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.148154 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.148342 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.148471 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.148687 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.148832 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.148959 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.149092 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.149224 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.149357 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.149525 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.149668 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.149840 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.149970 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.150147 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.150281 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.150448 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.150612 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.150773 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.151079 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.151215 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.151380 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.151520 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.151682 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.151818 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.151990 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.152119 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.152290 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.152430 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.152596 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.152725 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.152896 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.153033 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.153196 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.153327 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.153497 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.153634 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.153798 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.153928 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.154098 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.154238 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.154398 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.154573 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.154731 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.154860 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.155033 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.155172 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.155336 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.155465 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.155634 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.155770 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.155934 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.156064 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.156232 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.156363 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.156559 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.156698 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.156892 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.157022 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.157204 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.157341 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.157526 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.157664 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.157833 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.157962 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.158134 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.158274 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.158436 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.158600 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.158745 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.158936 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.159064 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.159191 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.159342 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.159486 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.159643 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.159774 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.159945 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.160075 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.160247 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.160378 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.160548 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.160685 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.160848 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.160977 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.161183 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.161313 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.161445 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.161577 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.161724 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.161857 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.162024 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.162163 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.162322 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.162444 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.162691 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.162829 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.162961 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.163088 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.163253 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.163383 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.163580 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.163740 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.163920 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.164050 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.164229 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.164360 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.164534 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.164675 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.164849 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.164977 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.165152 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.165287 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.165457 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.165594 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.165766 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.165895 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.166073 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.166211 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.166378 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.166532 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.166709 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.166838 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.167016 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.167147 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.167321 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.167458 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.167628 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.167758 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.167932 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.168062 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.168237 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.168369 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.168542 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.168680 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.168863 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.169079 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.169211 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.169334 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.169459 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.169584 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.169779 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.169920 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.170093 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.170225 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.170410 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.170588 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.170746 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.170889 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.171053 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.171185 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.171351 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.171480 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.171613 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 20:37:59.171748 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.171965 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.172270 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.172579 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.172887 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.173200 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.173506 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.173811 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.174124 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.174435 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.174786 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.175109 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.175416 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.175738 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.176060 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.176403 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.176716 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.177056 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.177383 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.177693 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.178001 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.178303 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:37:59.178565 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 20:37:59.237256 ncdv-master-1 devstack@n-api.service[124028]: INFO dbcounter [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Registered counter for database nova_api Oct 01 20:37:59.244729 ncdv-master-1 devstack@n-api.service[124027]: INFO dbcounter [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Registered counter for database nova_api Oct 01 20:37:59.258912 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_db.sqlalchemy.engines [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:37:59.264115 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_db.sqlalchemy.engines [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:37:59.265595 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writer thread running {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:37:59.270381 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writer thread running {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:37:59.322061 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.context [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2663fce6-13d1-4945-900e-d818f7f389c0(cell1) {{(pid=124028) load_cells /opt/stack/nova/nova/context.py:464}} Oct 01 20:37:59.325559 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:37:59.326023 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:37:59.326642 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.context [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2663fce6-13d1-4945-900e-d818f7f389c0(cell1) {{(pid=124027) load_cells /opt/stack/nova/nova/context.py:464}} Oct 01 20:37:59.327610 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:37:59.328335 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:37:59.328774 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:37:59.330417 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_concurrency.lockutils [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:37:59.330769 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:37:59.330908 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_concurrency.lockutils [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:37:59.332454 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_concurrency.lockutils [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:37:59.332727 ncdv-master-1 devstack@n-api.service[124028]: INFO dbcounter [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Registered counter for database nova_cell0 Oct 01 20:37:59.333172 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_concurrency.lockutils [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:37:59.333614 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_concurrency.lockutils [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:37:59.335638 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_concurrency.lockutils [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:37:59.336712 ncdv-master-1 devstack@n-api.service[124028]: INFO dbcounter [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Registered counter for database nova_cell1 Oct 01 20:37:59.337580 ncdv-master-1 devstack@n-api.service[124027]: INFO dbcounter [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Registered counter for database nova_cell0 Oct 01 20:37:59.341774 ncdv-master-1 devstack@n-api.service[124027]: INFO dbcounter [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Registered counter for database nova_cell1 Oct 01 20:37:59.343938 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_db.sqlalchemy.engines [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:37:59.346701 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_db.sqlalchemy.engines [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:37:59.348477 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_db.sqlalchemy.engines [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:37:59.353414 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writer thread running {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:37:59.353754 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writer thread running {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:37:59.353945 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writer thread running {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:37:59.354682 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_db.sqlalchemy.engines [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:37:59.493329 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writer thread running {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:37:59.497387 ncdv-master-1 devstack@n-api.service[124028]: INFO dbcounter [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Registered counter for database nova_cell0 Oct 01 20:37:59.502217 ncdv-master-1 devstack@n-api.service[124027]: INFO dbcounter [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Registered counter for database nova_cell0 Oct 01 20:37:59.506302 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_db.sqlalchemy.engines [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:37:59.511176 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writer thread running {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:37:59.511302 ncdv-master-1 devstack@n-api.service[124027]: DEBUG oslo_db.sqlalchemy.engines [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:37:59.516064 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writer thread running {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:37:59.965072 ncdv-master-1 devstack@n-api.service[124028]: WARNING keystonemiddleware.auth_token [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 20:37:59.967703 ncdv-master-1 devstack@n-api.service[124027]: WARNING keystonemiddleware.auth_token [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 20:37:59.972322 ncdv-master-1 devstack@n-api.service[124028]: WARNING keystonemiddleware.auth_token [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 20:37:59.975188 ncdv-master-1 devstack@n-api.service[124027]: WARNING keystonemiddleware.auth_token [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 20:38:00.195214 ncdv-master-1 devstack@n-api.service[124028]: WARNING keystonemiddleware.auth_token [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 20:38:00.201435 ncdv-master-1 devstack@n-api.service[124028]: WARNING keystonemiddleware.auth_token [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 20:38:00.203165 ncdv-master-1 devstack@n-api.service[124027]: WARNING keystonemiddleware.auth_token [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 20:38:00.206678 ncdv-master-1 devstack@n-api.service[124028]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55766de869c0 pid: 124028 (default app) Oct 01 20:38:00.208720 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:38:00.209215 ncdv-master-1 devstack@n-api.service[124027]: WARNING keystonemiddleware.auth_token [None req-953ae7e4-d6ef-4a19-90a9-51db74517af8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 20:38:00.209873 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001681 Oct 01 20:38:00.210275 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Sat Oct 1 20:38:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:38:00.214463 ncdv-master-1 devstack@n-api.service[124027]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55766de869c0 pid: 124027 (default app) Oct 01 20:39:28.437283 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:28.439025 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Oct 01 20:39:28.439624 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:39:28.456128 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writing DB stats nova_api:SELECT=3 {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:28.457057 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writing DB stats nova_cell0:SELECT=3 {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:28.458629 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writing DB stats nova_cell1:SELECT=3 {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:28.459473 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:29.477697 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-aef1b639-e4b5-49bd-a640-1b05dea0422c admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:29.510009 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-aef1b639-e4b5-49bd-a640-1b05dea0422c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.062867 Oct 01 20:39:29.510988 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Oct 1 20:39:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:39:32.496098 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:32.497029 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-fab1ed15-de60-40fd-8f17-3727e686ea1f None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 01 20:39:32.497429 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:39:32.929490 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-a24f3637-3a0a-428e-b4e1-63b5009cd861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:32.980027 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-a24f3637-3a0a-428e-b4e1-63b5009cd861 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.475952 Oct 01 20:39:32.980590 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:39:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 20:39:32.995292 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_api:SELECT=3 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:32.996504 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_cell0:SELECT=3 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:32.997514 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_cell1:SELECT=3 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:32.998284 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:33.203402 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-49d4d6e5-54e1-4f00-8ea9-b6227e9211e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:33.273087 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-49d4d6e5-54e1-4f00-8ea9-b6227e9211e1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282914 Oct 01 20:39:33.273906 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Oct 1 20:39:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:39:36.274149 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-a24f3637-3a0a-428e-b4e1-63b5009cd861 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:36.275442 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-a24f3637-3a0a-428e-b4e1-63b5009cd861 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Oct 01 20:39:36.276096 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:39:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:39:37.364443 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-00635550-9a98-47f7-bfd7-35be71c97eb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:37.364443 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-00635550-9a98-47f7-bfd7-35be71c97eb5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.950122 Oct 01 20:39:37.364443 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:39:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:39:37.367970 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e6e05cda-af67-4f52-8447-b49844031bda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:37.367970 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-e6e05cda-af67-4f52-8447-b49844031bda admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044192 Oct 01 20:39:37.367970 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Oct 1 20:39:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:39:40.746714 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-00635550-9a98-47f7-bfd7-35be71c97eb5 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:40.748453 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-00635550-9a98-47f7-bfd7-35be71c97eb5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002337 Oct 01 20:39:40.749052 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:39:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:39:41.199040 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-16aa4864-f202-43c0-8c51-927a457f1eb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "disk": 10}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:41.217725 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-16aa4864-f202-43c0-8c51-927a457f1eb9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461018 Oct 01 20:39:41.218268 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:39:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:39:41.230924 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-2c01161a-695c-4b47-bd2e-e8cc3ef32442 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:41.255784 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-2c01161a-695c-4b47-bd2e-e8cc3ef32442 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028605 Oct 01 20:39:41.266589 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Oct 1 20:39:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:39:44.476940 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-16aa4864-f202-43c0-8c51-927a457f1eb9 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:44.477945 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-16aa4864-f202-43c0-8c51-927a457f1eb9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 01 20:39:44.478343 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:39:44.901705 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-ffab26f7-0266-4617-a190-4cb5998dc604 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "name": "ds2G"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:44.925260 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-ffab26f7-0266-4617-a190-4cb5998dc604 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440590 Oct 01 20:39:44.925820 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:39:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:39:44.938297 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-a84cc6c3-3cf0-497d-b81b-f0f1cf2dcb61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:44.965829 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-a84cc6c3-3cf0-497d-b81b-f0f1cf2dcb61 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031192 Oct 01 20:39:44.966404 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Oct 1 20:39:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:39:47.897692 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-ffab26f7-0266-4617-a190-4cb5998dc604 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:47.898726 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-ffab26f7-0266-4617-a190-4cb5998dc604 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 01 20:39:47.899117 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:39:48.353322 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-1b38e719-8a94-4e1a-ae26-284f0302e898 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G"}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:48.373538 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-1b38e719-8a94-4e1a-ae26-284f0302e898 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468211 Oct 01 20:39:48.374372 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:39:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:39:48.387313 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-37727a79-9d92-4edc-a4b1-5957c59de1d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:48.411596 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-37727a79-9d92-4edc-a4b1-5957c59de1d0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028261 Oct 01 20:39:48.412520 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Oct 1 20:39:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:39:51.488472 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-1b38e719-8a94-4e1a-ae26-284f0302e898 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:51.489497 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-1b38e719-8a94-4e1a-ae26-284f0302e898 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 01 20:39:51.489909 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:39:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:39:51.938052 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-1e7d87f7-6766-4998-89c6-6cbc99378ad7 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:51.969555 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-1e7d87f7-6766-4998-89c6-6cbc99378ad7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.473287 Oct 01 20:39:51.970270 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Oct 1 20:39:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:39:55.042683 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-1b38e719-8a94-4e1a-ae26-284f0302e898 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:55.043685 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-1b38e719-8a94-4e1a-ae26-284f0302e898 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 01 20:39:55.044074 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:39:55.490055 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-a245ad81-b44a-4f33-943f-fe5696dacd85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:55.511393 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-a245ad81-b44a-4f33-943f-fe5696dacd85 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.460426 Oct 01 20:39:55.512107 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:39:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:39:55.525184 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-6b419baa-2665-4ae4-8896-7506a03ead60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:55.569101 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-6b419baa-2665-4ae4-8896-7506a03ead60 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047704 Oct 01 20:39:55.569695 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Oct 1 20:39:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:39:58.589601 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-a245ad81-b44a-4f33-943f-fe5696dacd85 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:39:58.590666 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-a245ad81-b44a-4f33-943f-fe5696dacd85 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 01 20:39:58.591070 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:39:58.969437 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-82e5931c-5d3e-42e1-8b88-7fa5447bd09c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:58.975719 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:39:58.990638 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-82e5931c-5d3e-42e1-8b88-7fa5447bd09c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.393331 Oct 01 20:39:58.991273 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:39:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:39:59.003579 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-a4297c65-6e24-4d09-97a5-05f0b5bcfd0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:39:59.027872 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-a4297c65-6e24-4d09-97a5-05f0b5bcfd0d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028019 Oct 01 20:39:59.028554 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Oct 1 20:39:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:40:02.002164 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-82e5931c-5d3e-42e1-8b88-7fa5447bd09c admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:02.004431 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-82e5931c-5d3e-42e1-8b88-7fa5447bd09c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Oct 01 20:40:02.004828 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:02.467747 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-482ef13c-8d43-4687-9d6a-ad277bca5b61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:02.490756 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-482ef13c-8d43-4687-9d6a-ad277bca5b61 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.479880 Oct 01 20:40:02.491589 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:40:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:40:02.505610 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-37cb2142-8b41-41e4-9f8b-6c7011d94627 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:02.531716 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-37cb2142-8b41-41e4-9f8b-6c7011d94627 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031148 Oct 01 20:40:02.532410 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Oct 1 20:40:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:40:05.483590 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-482ef13c-8d43-4687-9d6a-ad277bca5b61 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:05.484583 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-482ef13c-8d43-4687-9d6a-ad277bca5b61 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 01 20:40:05.484979 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:05.952514 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-5f39d8c5-942e-4658-bb5e-92013d8ae0a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "disk": 80, "vcpus": 4}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:05.974184 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-5f39d8c5-942e-4658-bb5e-92013d8ae0a4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.482748 Oct 01 20:40:05.978599 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:40:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:40:05.987022 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-d701d198-cc89-49a3-8ccf-2b40990ebe17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:05.993304 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:40:06.017573 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-d701d198-cc89-49a3-8ccf-2b40990ebe17 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034212 Oct 01 20:40:06.030725 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Oct 1 20:40:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:40:08.962886 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-5f39d8c5-942e-4658-bb5e-92013d8ae0a4 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:08.964550 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-5f39d8c5-942e-4658-bb5e-92013d8ae0a4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002135 Oct 01 20:40:08.965195 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:09.485828 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-64d7add5-7c94-46a2-a22f-912dbfd04246 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:09.508536 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-64d7add5-7c94-46a2-a22f-912dbfd04246 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.537229 Oct 01 20:40:09.509567 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Oct 1 20:40:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:40:09.522631 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-368acef1-4446-45c7-8257-aa4b597832a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:09.556342 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-368acef1-4446-45c7-8257-aa4b597832a7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038130 Oct 01 20:40:09.557251 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Oct 1 20:40:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:40:28.211721 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-64d7add5-7c94-46a2-a22f-912dbfd04246 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:28.212724 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-64d7add5-7c94-46a2-a22f-912dbfd04246 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 01 20:40:28.213128 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:28.223441 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:40:28.597747 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-f111089d-7ef8-44c7-960b-5a9c2e9fd778 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:28.615775 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-f111089d-7ef8-44c7-960b-5a9c2e9fd778 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396733 Oct 01 20:40:28.616301 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Oct 1 20:40:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:40:30.492748 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-64d7add5-7c94-46a2-a22f-912dbfd04246 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:30.493748 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-64d7add5-7c94-46a2-a22f-912dbfd04246 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 01 20:40:30.494140 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:31.093710 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e245aea3-f0fa-4a04-af85-2564112e7bec admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:31.099094 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.wsgi [None req-e245aea3-f0fa-4a04-af85-2564112e7bec admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e245aea3-f0fa-4a04-af85-2564112e7bec admin admin] Request method failure captured: Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: Accept: application/json Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: Accept-Encoding: gzip, deflate Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: Connection: keep-alive Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: Content-Length: 0 Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: Host: 10.222.0.17 Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: Openstack-Api-Version: compute 2.92 Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: Openstack-System-Scope: None Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: User-Agent: python-novaclient Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Auth-Token: gAAAAABjOKW-ALiFlzqsscUwr_puHNEa9DE6DBt_YNCtwdQBKGciRlK-MeKBlpED6ZxIOnzExYDxRi1IjC4q5JBQlBcwWOSuEuCfdqu4S_L_6iUj4RyRXGgCbRzbv61_dsH9RVzOe5UrxG2DzoyiSNYDOv37QfWGK3qe6agvkPTUTQDMxQZAkOU Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Domain-Id: None Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Domain-Name: None Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Identity-Status: Confirmed Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Is-Admin-Project: True Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Domain-Id: default Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Domain-Name: Default Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Name: admin Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Role: member,admin,reader Oct 01 20:40:31.111151 ncdv-master-1 devstack@n-api.service[124027]: X-Roles: member,admin,reader Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_549fa0b49ffd4207961a9dc3298560fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}] Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: X-Tenant: admin Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: X-Tenant-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: X-Tenant-Name: admin Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: X-User: admin Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: X-User-Domain-Id: default Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: X-User-Domain-Name: Default Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: X-User-Id: a9033d8c4ef14e3eaead57cd2b91f40f Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: X-User-Name: admin Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: method: > Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: exception: Flavor 42 could not be found. Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: action_args: {'id': '42'} Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:40:31.113122 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:31.114299 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.115905 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e245aea3-f0fa-4a04-af85-2564112e7bec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:40:31.117199 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-e245aea3-f0fa-4a04-af85-2564112e7bec admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399305 Oct 01 20:40:31.117199 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Oct 1 20:40:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:31.122737 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-071f0134-6b95-4c4c-9719-5a7f858fc0d3 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:31.126773 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:40:31.146947 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-071f0134-6b95-4c4c-9719-5a7f858fc0d3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027734 Oct 01 20:40:31.147479 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Oct 1 20:40:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:40:31.158003 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-4f6a1ce6-341d-471f-9bfa-352b28bd3e58 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:31.183532 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-4f6a1ce6-341d-471f-9bfa-352b28bd3e58 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029940 Oct 01 20:40:31.184098 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Oct 1 20:40:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:40:31.194908 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-be269892-7cb8-455e-af97-cb296654525b admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:31.201353 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.wsgi [None req-be269892-7cb8-455e-af97-cb296654525b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-be269892-7cb8-455e-af97-cb296654525b admin admin] Request method failure captured: Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: Accept: application/json Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: Accept-Encoding: gzip, deflate Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: Connection: keep-alive Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: Content-Length: 0 Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: Host: 10.222.0.17 Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: Openstack-Api-Version: compute 2.92 Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: Openstack-System-Scope: None Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: User-Agent: python-novaclient Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Auth-Token: gAAAAABjOKW-ALiFlzqsscUwr_puHNEa9DE6DBt_YNCtwdQBKGciRlK-MeKBlpED6ZxIOnzExYDxRi1IjC4q5JBQlBcwWOSuEuCfdqu4S_L_6iUj4RyRXGgCbRzbv61_dsH9RVzOe5UrxG2DzoyiSNYDOv37QfWGK3qe6agvkPTUTQDMxQZAkOU Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Id: None Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Name: None Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Identity-Status: Confirmed Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Is-Admin-Project: True Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Id: default Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Name: Default Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Name: admin Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Role: member,admin,reader Oct 01 20:40:31.204610 ncdv-master-1 devstack@n-api.service[124028]: X-Roles: member,admin,reader Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_549fa0b49ffd4207961a9dc3298560fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}] Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant: admin Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Name: admin Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: X-User: admin Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Id: default Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Name: Default Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: X-User-Id: a9033d8c4ef14e3eaead57cd2b91f40f Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: X-User-Name: admin Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: method: > Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: exception: Flavor 42 could not be found. Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: action_args: {'id': '42'} Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:40:31.206184 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:31.207194 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:31.208322 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-be269892-7cb8-455e-af97-cb296654525b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:40:31.209316 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-be269892-7cb8-455e-af97-cb296654525b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016121 Oct 01 20:40:31.209316 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Oct 1 20:40:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:32.996345 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-4f6a1ce6-341d-471f-9bfa-352b28bd3e58 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:32.997350 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-4f6a1ce6-341d-471f-9bfa-352b28bd3e58 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 01 20:40:32.997777 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:33.526923 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-5cc80948-e21b-43bf-8d74-4ebb0fda7446 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:33.531918 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.wsgi [None req-5cc80948-e21b-43bf-8d74-4ebb0fda7446 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-5cc80948-e21b-43bf-8d74-4ebb0fda7446 admin admin] Request method failure captured: Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: Accept: application/json Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: Accept-Encoding: gzip, deflate Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: Connection: keep-alive Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: Content-Length: 0 Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: Host: 10.222.0.17 Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: Openstack-Api-Version: compute 2.92 Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: Openstack-System-Scope: None Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: User-Agent: python-novaclient Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Auth-Token: gAAAAABjOKXAcuoUqSUvsR_-8q3v5Us2G_zvYxYMtScxbjXhE0k7KM1lA3h6X183y-zLCZ2GSTYwCM7EiNJDwGcy-aDXf4ZhpuSWPoVjsqvx1GDec7efL2ZEiwpxXluy_OwRV_mb00MhJ1aqgejnTB7Hj0FgnMnb2sxex9r_3ndv0uHoRPLalyM Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Id: None Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Name: None Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Identity-Status: Confirmed Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Is-Admin-Project: True Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Id: default Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Name: Default Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Name: admin Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Role: member,admin,reader Oct 01 20:40:33.533413 ncdv-master-1 devstack@n-api.service[124028]: X-Roles: member,admin,reader Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_549fa0b49ffd4207961a9dc3298560fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}] Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant: admin Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Name: admin Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: X-User: admin Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Id: default Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Name: Default Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: X-User-Id: a9033d8c4ef14e3eaead57cd2b91f40f Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: X-User-Name: admin Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: method: > Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: exception: Flavor 84 could not be found. Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: action_args: {'id': '84'} Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:40:33.535059 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:33.536077 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.537473 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-5cc80948-e21b-43bf-8d74-4ebb0fda7446 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:40:33.538750 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-5cc80948-e21b-43bf-8d74-4ebb0fda7446 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392164 Oct 01 20:40:33.538750 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Oct 1 20:40:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:33.544421 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-0cf0483b-8400-458b-9631-616887f21058 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:33.559682 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-0cf0483b-8400-458b-9631-616887f21058 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018782 Oct 01 20:40:33.560256 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Oct 1 20:40:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:40:33.569699 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-428fea32-0b2b-476d-9de8-2db344ea2048 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:33.586119 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-428fea32-0b2b-476d-9de8-2db344ea2048 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019702 Oct 01 20:40:33.586652 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Oct 1 20:40:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:40:33.595782 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-2b412b33-7d5f-4319-8bc2-febc20eeb18a admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:33.600769 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.wsgi [None req-2b412b33-7d5f-4319-8bc2-febc20eeb18a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-2b412b33-7d5f-4319-8bc2-febc20eeb18a admin admin] Request method failure captured: Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: Accept: application/json Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: Accept-Encoding: gzip, deflate Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: Connection: keep-alive Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: Content-Length: 0 Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: Host: 10.222.0.17 Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: Openstack-Api-Version: compute 2.92 Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: Openstack-System-Scope: None Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: User-Agent: python-novaclient Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Auth-Token: gAAAAABjOKXAcuoUqSUvsR_-8q3v5Us2G_zvYxYMtScxbjXhE0k7KM1lA3h6X183y-zLCZ2GSTYwCM7EiNJDwGcy-aDXf4ZhpuSWPoVjsqvx1GDec7efL2ZEiwpxXluy_OwRV_mb00MhJ1aqgejnTB7Hj0FgnMnb2sxex9r_3ndv0uHoRPLalyM Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Domain-Id: None Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Domain-Name: None Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Identity-Status: Confirmed Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Is-Admin-Project: True Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Domain-Id: default Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Domain-Name: Default Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Name: admin Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Role: member,admin,reader Oct 01 20:40:33.602296 ncdv-master-1 devstack@n-api.service[124027]: X-Roles: member,admin,reader Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_549fa0b49ffd4207961a9dc3298560fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}] Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: X-Tenant: admin Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: X-Tenant-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: X-Tenant-Name: admin Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: X-User: admin Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: X-User-Domain-Id: default Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: X-User-Domain-Name: Default Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: X-User-Id: a9033d8c4ef14e3eaead57cd2b91f40f Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: X-User-Name: admin Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: method: > Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: exception: Flavor 84 could not be found. Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: action_args: {'id': '84'} Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:40:33.603650 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:33.604627 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:33.605928 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-2b412b33-7d5f-4319-8bc2-febc20eeb18a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:40:33.607276 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-2b412b33-7d5f-4319-8bc2-febc20eeb18a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011453 Oct 01 20:40:33.607276 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Oct 1 20:40:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:35.374139 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-428fea32-0b2b-476d-9de8-2db344ea2048 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:35.375183 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-428fea32-0b2b-476d-9de8-2db344ea2048 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 01 20:40:35.375576 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:35.906379 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-130543bc-96e3-4ffc-b4b1-93f26ab2455b admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:35.912174 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.wsgi [None req-130543bc-96e3-4ffc-b4b1-93f26ab2455b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-130543bc-96e3-4ffc-b4b1-93f26ab2455b admin admin] Request method failure captured: Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: Accept: application/json Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: Accept-Encoding: gzip, deflate Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: Connection: keep-alive Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: Content-Length: 0 Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: Host: 10.222.0.17 Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: Openstack-Api-Version: compute 2.92 Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: Openstack-System-Scope: None Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: User-Agent: python-novaclient Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Auth-Token: gAAAAABjOKXDRlhp0UK9ijX6hF2nbVhVapS1fnnvJn4ziab9vgiGbULs6SBSpuh7SNxVsR3QqMK5nmAoXsGBlhrWQy9eWOFiBwjleCPBXzkZOyi-P9_1ZtIsdTnn7S9Em2B0pLHtRx8EzGVBL7OMW7bqdCa6hzDNPwwlziAKrHDAtCHjk96Q5gI Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Domain-Id: None Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Domain-Name: None Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Identity-Status: Confirmed Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Is-Admin-Project: True Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Domain-Id: default Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Domain-Name: Default Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Project-Name: admin Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Role: member,admin,reader Oct 01 20:40:35.913650 ncdv-master-1 devstack@n-api.service[124027]: X-Roles: member,admin,reader Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_549fa0b49ffd4207961a9dc3298560fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}] Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: X-Tenant: admin Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: X-Tenant-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: X-Tenant-Name: admin Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: X-User: admin Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: X-User-Domain-Id: default Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: X-User-Domain-Name: Default Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: X-User-Id: a9033d8c4ef14e3eaead57cd2b91f40f Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: X-User-Name: admin Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: method: > Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: exception: Flavor 451 could not be found. Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: action_args: {'id': '451'} Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:40:35.915253 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:35.916332 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.917732 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-130543bc-96e3-4ffc-b4b1-93f26ab2455b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:40:35.919043 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-130543bc-96e3-4ffc-b4b1-93f26ab2455b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389851 Oct 01 20:40:35.919043 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Oct 1 20:40:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:35.925199 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-ffcf9b20-b547-45fa-8adb-ebeef8cf1f83 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:35.939677 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-ffcf9b20-b547-45fa-8adb-ebeef8cf1f83 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018588 Oct 01 20:40:35.940727 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Oct 1 20:40:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:40:35.950197 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:35.964767 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018069 Oct 01 20:40:35.965305 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Oct 1 20:40:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:40:35.974570 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-0441b961-a645-459c-a49a-a80532401773 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:35.979393 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.wsgi [None req-0441b961-a645-459c-a49a-a80532401773 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-0441b961-a645-459c-a49a-a80532401773 admin admin] Request method failure captured: Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: Accept: application/json Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: Accept-Encoding: gzip, deflate Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: Connection: keep-alive Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: Content-Length: 0 Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: Host: 10.222.0.17 Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: Openstack-Api-Version: compute 2.92 Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: Openstack-System-Scope: None Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: User-Agent: python-novaclient Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Auth-Token: gAAAAABjOKXDRlhp0UK9ijX6hF2nbVhVapS1fnnvJn4ziab9vgiGbULs6SBSpuh7SNxVsR3QqMK5nmAoXsGBlhrWQy9eWOFiBwjleCPBXzkZOyi-P9_1ZtIsdTnn7S9Em2B0pLHtRx8EzGVBL7OMW7bqdCa6hzDNPwwlziAKrHDAtCHjk96Q5gI Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Id: None Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Name: None Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Identity-Status: Confirmed Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Is-Admin-Project: True Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Id: default Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Name: Default Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Name: admin Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Role: member,admin,reader Oct 01 20:40:35.980858 ncdv-master-1 devstack@n-api.service[124028]: X-Roles: member,admin,reader Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_549fa0b49ffd4207961a9dc3298560fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/549fa0b49ffd4207961a9dc3298560fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/549fa0b49ffd4207961a9dc3298560fa"}]}] Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant: admin Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Id: 549fa0b49ffd4207961a9dc3298560fa Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Name: admin Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: X-User: admin Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Id: default Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Name: Default Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: X-User-Id: a9033d8c4ef14e3eaead57cd2b91f40f Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: X-User-Name: admin Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: method: > Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: exception: Flavor 451 could not be found. Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: action_args: {'id': '451'} Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:40:35.982521 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:35.983544 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Oct 01 20:40:35.984816 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-0441b961-a645-459c-a49a-a80532401773 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:40:35.986056 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-0441b961-a645-459c-a49a-a80532401773 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011532 Oct 01 20:40:35.986056 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Oct 1 20:40:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:40:37.758887 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:37.759899 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 01 20:40:37.760287 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:38.300759 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-8751c111-c7b8-4a8a-997b-19f06b520bc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:38.320275 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-8751c111-c7b8-4a8a-997b-19f06b520bc0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.411405 Oct 01 20:40:38.321059 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Oct 1 20:40:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:40:40.089666 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:40.090708 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 01 20:40:40.091102 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:40.633016 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-b35b2ce5-97ff-4b15-9853-4777f1da7f46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:40.651420 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-b35b2ce5-97ff-4b15-9853-4777f1da7f46 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408743 Oct 01 20:40:40.651937 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Oct 1 20:40:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:40:42.418739 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:42.419742 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 01 20:40:42.420275 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:42.968257 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-4d11a4af-c954-4383-89ec-a3583e9b4780 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:42.986480 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-4d11a4af-c954-4383-89ec-a3583e9b4780 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.412310 Oct 01 20:40:42.987025 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Oct 1 20:40:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:40:44.761522 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:44.762546 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 01 20:40:44.762933 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:45.288203 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-739a7309-3f23-401a-8d20-7a87c367318a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:40:45.306571 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-739a7309-3f23-401a-8d20-7a87c367318a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396871 Oct 01 20:40:45.307109 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Oct 1 20:40:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:40:47.059669 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:47.060698 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 01 20:40:47.061100 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:40:47.593754 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-3c2fe16b-24f2-46dc-b6bb-b9beffc525f3 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:40:47.614211 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-3c2fe16b-24f2-46dc-b6bb-b9beffc525f3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405659 Oct 01 20:40:47.614777 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Sat Oct 1 20:40:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:41:52.541119 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:41:52.542128 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-e0f712f5-dc99-4995-b88a-8d3d038ff60f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 01 20:41:52.542554 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Sat Oct 1 20:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:41:52.550388 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:41:52.938468 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-4f9769fd-8d83-46ae-b210-6e4e4747c1ff admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:41:52.959381 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-4f9769fd-8d83-46ae-b210-6e4e4747c1ff admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410416 Oct 01 20:41:52.959913 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Oct 1 20:41:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:41:52.981259 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writing DB stats nova_api:SELECT=14 {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:41:52.985318 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-c0817783-bc16-439f-9a0a-a692020f3160 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:41:52.992568 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-c0817783-bc16-439f-9a0a-a692020f3160 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012728 Oct 01 20:41:52.993089 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Sat Oct 1 20:41:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:41:53.004488 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-99a75c22-1c7c-4498-a20e-f34f73f1d78c admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:41:53.011744 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-99a75c22-1c7c-4498-a20e-f34f73f1d78c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010840 Oct 01 20:41:53.012245 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Sat Oct 1 20:41:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:41:53.023717 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-301ab9d6-f31c-44a0-8887-67175b854264 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:41:53.031516 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-301ab9d6-f31c-44a0-8887-67175b854264 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010540 Oct 01 20:41:53.032049 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Sat Oct 1 20:41:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:41:53.043502 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-85b6803b-bba0-42f3-b4e7-d195b9034cde admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:41:53.050776 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-85b6803b-bba0-42f3-b4e7-d195b9034cde admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010873 Oct 01 20:41:53.051290 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Sat Oct 1 20:41:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:47:05.738017 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-301ab9d6-f31c-44a0-8887-67175b854264 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:47:05.739674 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-301ab9d6-f31c-44a0-8887-67175b854264 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Oct 01 20:47:05.740063 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:47:05.888679 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_api:SELECT=6 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:47:06.028332 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-50dd1397-d8e2-4ef9-ba52-dbe732af3e9b admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:47:06.033121 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-50dd1397-d8e2-4ef9-ba52-dbe732af3e9b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:47:06.033594 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-50dd1397-d8e2-4ef9-ba52-dbe732af3e9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:47:06.034022 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-50dd1397-d8e2-4ef9-ba52-dbe732af3e9b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:47:06.034833 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-50dd1397-d8e2-4ef9-ba52-dbe732af3e9b admin admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:47:06.035282 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-50dd1397-d8e2-4ef9-ba52-dbe732af3e9b admin admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:47:06.036271 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-50dd1397-d8e2-4ef9-ba52-dbe732af3e9b admin admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:47:06.073541 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-50dd1397-d8e2-4ef9-ba52-dbe732af3e9b admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.186104 Oct 01 20:47:06.074101 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Oct 1 20:47:05 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:47:07.728618 ncdv-master-1 devstack@n-api.service[124027]: DEBUG nova.api.openstack.wsgi [None req-301ab9d6-f31c-44a0-8887-67175b854264 admin admin] Calling method '>' {{(pid=124027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:47:07.729620 ncdv-master-1 devstack@n-api.service[124027]: INFO nova.api.openstack.requestlog [None req-301ab9d6-f31c-44a0-8887-67175b854264 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 01 20:47:07.730018 ncdv-master-1 devstack@n-api.service[124027]: [pid: 124027|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Oct 1 20:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:47:07.927039 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-d9d62b93-491f-46d7-95e4-68bd10dea70e admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:47:07.930341 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-d9d62b93-491f-46d7-95e4-68bd10dea70e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:47:07.930836 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-d9d62b93-491f-46d7-95e4-68bd10dea70e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:47:07.931541 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-d9d62b93-491f-46d7-95e4-68bd10dea70e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:47:07.932248 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-d9d62b93-491f-46d7-95e4-68bd10dea70e admin admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:47:07.932691 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-d9d62b93-491f-46d7-95e4-68bd10dea70e admin admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:47:07.933103 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-d9d62b93-491f-46d7-95e4-68bd10dea70e admin admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:47:07.956380 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-d9d62b93-491f-46d7-95e4-68bd10dea70e admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.080382 Oct 01 20:47:07.956910 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Oct 1 20:47:07 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:47:53.086067 ncdv-master-1 devstack@n-api.service[124026]: Sat Oct 1 20:47:53 2022 - graceful shutdown triggered... Oct 01 20:47:53.086605 ncdv-master-1 devstack@n-api.service[124027]: Gracefully killing worker 1 (pid: 124027)... Oct 01 20:47:53.087003 ncdv-master-1 devstack@n-api.service[124028]: Gracefully killing worker 2 (pid: 124028)... Oct 01 20:47:53.087665 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 01 20:47:53.223815 ncdv-master-1 devstack@n-api.service[124027]: DEBUG dbcounter [-] [124027] Writing DB stats nova_api:SELECT=4 {{(pid=124027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:47:54.087181 ncdv-master-1 devstack@n-api.service[124026]: worker 1 buried after 1 seconds Oct 01 20:47:54.087653 ncdv-master-1 devstack@n-api.service[124026]: worker 2 buried after 1 seconds Oct 01 20:47:54.087653 ncdv-master-1 devstack@n-api.service[124026]: goodbye to uWSGI. Oct 01 20:47:54.088809 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 01 20:47:54.089981 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 01 20:47:54.092767 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 01 20:47:54.130931 ncdv-master-1 devstack@n-api.service[140423]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 1 20:47:54 2022] *** Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: nodename: ncdv-master-1 Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: machine: x86_64 Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: clock source: unix Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: pcre jit disabled Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: detected number of CPU cores: 4 Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: current working directory: / Oct 01 20:47:54.132953 ncdv-master-1 devstack@n-api.service[140423]: detected binary path: /usr/bin/uwsgi-core Oct 01 20:47:54.133736 ncdv-master-1 devstack@n-api.service[140423]: your processes number limit is 47680 Oct 01 20:47:54.133736 ncdv-master-1 devstack@n-api.service[140423]: your memory page size is 4096 bytes Oct 01 20:47:54.133736 ncdv-master-1 devstack@n-api.service[140423]: detected max file descriptor number: 2048 Oct 01 20:47:54.133736 ncdv-master-1 devstack@n-api.service[140423]: lock engine: pthread robust mutexes Oct 01 20:47:54.133736 ncdv-master-1 devstack@n-api.service[140423]: thunder lock: enabled Oct 01 20:47:54.133736 ncdv-master-1 devstack@n-api.service[140423]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 01 20:47:54.133736 ncdv-master-1 devstack@n-api.service[140423]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 01 20:47:54.179304 ncdv-master-1 devstack@n-api.service[140423]: Python main interpreter initialized at 0x559f669f79c0 Oct 01 20:47:54.179304 ncdv-master-1 devstack@n-api.service[140423]: python threads support enabled Oct 01 20:47:54.179304 ncdv-master-1 devstack@n-api.service[140423]: your server socket listen backlog is limited to 100 connections Oct 01 20:47:54.179304 ncdv-master-1 devstack@n-api.service[140423]: your mercy for graceful operations on workers is 90 seconds Oct 01 20:47:54.179773 ncdv-master-1 devstack@n-api.service[140423]: mapped 403077 bytes (393 KB) for 2 cores Oct 01 20:47:54.179773 ncdv-master-1 devstack@n-api.service[140423]: *** Operational MODE: preforking *** Oct 01 20:47:54.179976 ncdv-master-1 devstack@n-api.service[140423]: *** uWSGI is running in multiple interpreter mode *** Oct 01 20:47:54.179976 ncdv-master-1 devstack@n-api.service[140423]: spawned uWSGI master process (pid: 140423) Oct 01 20:47:54.180182 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 01 20:47:54.181569 ncdv-master-1 devstack@n-api.service[140423]: spawned uWSGI worker 1 (pid: 140437, cores: 1) Oct 01 20:47:54.181569 ncdv-master-1 devstack@n-api.service[140423]: spawned uWSGI worker 2 (pid: 140438, cores: 1) Oct 01 20:47:54.181569 ncdv-master-1 devstack@n-api.service[140423]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 01 20:47:55.502710 ncdv-master-1 devstack@n-api.service[140438]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 01 20:47:55.510076 ncdv-master-1 devstack@n-api.service[140437]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 01 20:47:56.251597 ncdv-master-1 devstack@n-api.service[140438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:47:56.251597 ncdv-master-1 devstack@n-api.service[140438]: from cryptography.utils import int_from_bytes Oct 01 20:47:56.251956 ncdv-master-1 devstack@n-api.service[140438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:47:56.251956 ncdv-master-1 devstack@n-api.service[140438]: from cryptography.utils import int_from_bytes Oct 01 20:47:56.275068 ncdv-master-1 devstack@n-api.service[140437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:47:56.275068 ncdv-master-1 devstack@n-api.service[140437]: from cryptography.utils import int_from_bytes Oct 01 20:47:56.275479 ncdv-master-1 devstack@n-api.service[140437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 20:47:56.275479 ncdv-master-1 devstack@n-api.service[140437]: from cryptography.utils import int_from_bytes Oct 01 20:47:58.778010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 20:47:58.778677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 20:47:58.778846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 20:47:58.779228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 20:47:58.779494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 20:47:58.779892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.780230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.780562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.780889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.781097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 20:47:58.781576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.781576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.781850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.782180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.782434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 20:47:58.782584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.782797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.783123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.783457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.783717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 20:47:58.783836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.784097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.784418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.784597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 20:47:58.784742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.785045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.785170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 20:47:58.785377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.785696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.785819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.785932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.786197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.786315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.786597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.787001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.787345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.787678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.787866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.788191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.788312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.788521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.788640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.788788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.788922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.789208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.789544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.789666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.789867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.790007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.790290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.790477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.790634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.790941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.791271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.791451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.791581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.791795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.791956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.792253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.793144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.793335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.793476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.793814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.794256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.794394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.794619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.794728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.794915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.795057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.795376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.795536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.795731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.796058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.796359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.796488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.796695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.796803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.797036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.797144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.797375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.797498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.797716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.797826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.798051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.798163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.798368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.798477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.798726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.798834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.799050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.799159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.799382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.799519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.799703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.800022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.800117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.800342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.800438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.800583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.800719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.801069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.801204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.801375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.801712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.801854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.802040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.802356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.802460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.802649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.802865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.803024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.803198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.803354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.803513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.803658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.803802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.803951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.804094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.804236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.804402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.804547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.804762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.804928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.805079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.805236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.805391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.805543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.805693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.805843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.805994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.806156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.806392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.806596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.806756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.806910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.807076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.807236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.807390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.807584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.807733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.807917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.808082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.808233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.808386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.808537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.808687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.808860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.809016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.809159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.810325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.810516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.810685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.810838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.810997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.811173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.811319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.811520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.811679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.811830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.811982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.812127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.812278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.812750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.812911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.813071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.813219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.813373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.813373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.813661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.813825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.813978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.814142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.814965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.815131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.815278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.815422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.815584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.815736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.815887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.816030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.816172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.816327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.816484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.816634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.816785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.816935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.817078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.817229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.817663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.817812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.817961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.818146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.818294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.818446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.818623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.818768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.818910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.819063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.819207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.819381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.819762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.819921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.820074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.820258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.820518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.820684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.820830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.821030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.821191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.821346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.821498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.821657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.821802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.821952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.822104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.822247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.822389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.822580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.823079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.823235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.823401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.823552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.823705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.823848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.823998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.824156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.824300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.824449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.824592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.824742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.824892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.825691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.825989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.826161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.826314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.826464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.826464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.826787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.826939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.827083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.827225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.827376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.827533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.827729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.827886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.828049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.828201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.828355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.828499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.828641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.828790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.828950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.829094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.829236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.829386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.829536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.829943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.830111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.830282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.830437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.830745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.830897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.831042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.831198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.831343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.831496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.831646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.831788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.831930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.832083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.832237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.832391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.832534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.832676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.833176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.833338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.833483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.833633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.833783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.833925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.834077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.834222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.834374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.834612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.834762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.834914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.834914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.835271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.835271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.835540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.835706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.835931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.836089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.836241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.836384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.836534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.836695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.836847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.836998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.837141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 20:47:58.837293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.837436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.837585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.837782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.837958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.838194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.838349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.838578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.838739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.838903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.839049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.839682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.839990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.840177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.840421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.840579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.840751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.840989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.841139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.841281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.841435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.841601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.841759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.841903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.842054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.842198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.842340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.842520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.842685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.842830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.843319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.843471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.843625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.843780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.843942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.844087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.844239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.844382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.844525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.844677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.844830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.844990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.845142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.845285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.845428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.845584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.845781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.845963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.846192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.846192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.846505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.846669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.846976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.847141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.847305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.847568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.847742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.847941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.848090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.848245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.848388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.848539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.848691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.848843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.848993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.849145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.849299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.849450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.849607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.849751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.849922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.850948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.851332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.851509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.851671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.851816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.851960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.852110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.852254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.852406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.852557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.852710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.852854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.852998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.852998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.854311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.854468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.854647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.854862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.855028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.855657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.855816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.855969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.856115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.856437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.856589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.856748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.856901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.857062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.857214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.857364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.857511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.857666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.857817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.858009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.858157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.858308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.858612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.858778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.858924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.859076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.859240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.859386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.859531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.859689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.859834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.859988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.860325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.860489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.860636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.860803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.860968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.861224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.861542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.861706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.861864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.862010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.862162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.862308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.862462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.862657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.862819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.863017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.863166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.863496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.863657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.863820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.864521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.864725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.864879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.865030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.865183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.865334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.865493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.865645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.865870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.866035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.866187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.866365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.866628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.866787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.866948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.867100 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.867251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.867560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.867823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.868137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.868389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.868664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.869040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.869299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.869299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.869803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.870066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.870805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.871079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.871518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.871931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.872181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.872425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.872681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.872947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.873192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.873737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.874021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.874266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.874799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.875068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.875320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.875569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.875804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.876067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.876315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.876558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.877789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.878051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.878284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.878463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.878651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.879142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.879325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.879481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.879639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.879791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.879956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.880107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.880267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.880425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.880605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.880960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.881145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.881300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.881478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.881747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.881928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.882333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.882569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.882729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.882879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.883040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.883200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.883351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.883513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.883700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.883700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.884193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.884345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.884517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.885041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.885201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.885361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.885526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.885677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.885837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.886022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.886192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.886344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.886520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.886680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.886842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.887090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.887272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.887528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.887700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.887861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.888024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.888183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.888382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.888550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.888708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.888867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.889073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.889320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.889483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.889641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.889800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.889959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.890117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.890410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.890610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.890774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.891089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.891258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.891417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.891568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.891733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.891970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.892134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.892310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.892552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.892716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.892716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.893003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.893003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.893003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.893464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.893621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.893771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.893922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.894264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.894431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.894616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.894769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.895020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.895249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.895414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.895571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.895741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.895892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.896049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.896199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.896363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.896521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.896678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.896829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.896979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.897217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.897383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.897535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.897692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.897861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.898012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.898176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.898334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.898575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.898746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.898905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.899056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.899220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.899467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.899632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.899784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.899952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.900103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.900267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.900418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.900586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.900737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.900899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.901199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.901371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.901532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.902299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.902459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.902733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.902912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.903071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.903229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.903380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.903531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.903681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.903848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.904009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.904176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.904478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.904636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.904786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.904958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.905222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.905444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.905600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.905600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.905894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.905894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.906204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.906361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.906602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.906772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.907004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.907157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.907398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.907581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.907739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.907899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.908058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.908209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.908365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.908558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.908713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.908863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.909026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.909184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.909343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.909589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.909746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.910013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.910198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.910362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.910530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.910700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.910859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.911025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.911324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.911480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.911630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.911792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.911954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.911954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.912252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.912504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.912661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.912909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.913072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.913237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.913388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.913545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.913702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.913857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.914016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.914185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.914337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.914679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.914852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.915016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.915190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.915431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.915669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.915835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.916002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.916153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.916311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.916462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.916625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.916784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.916945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.917101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.917919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.918170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.918328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.918554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.918717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.918717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.919025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.919176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.919344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.919508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.919751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.919908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.920059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.920210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.920359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.920520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.920520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.920827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.920992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.921151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.921445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.921622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.921781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.921932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.922096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.922263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.922414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.922679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.922845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.923094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.923266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.923425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.923575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.923726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.923887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.924045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.924207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.924369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.924369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.924804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.924969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.925134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.925134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.925456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.925696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.925914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.926082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.927085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.927267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.927545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.927705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.927866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.928018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.928197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.928429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.928587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.928805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.928973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.929125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.929296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.929454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.929606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.929787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.930016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.930182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.930333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.930507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.930666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.930832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.930986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.931143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.931318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.931634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.931791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.931951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.932110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.932261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.932413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.932570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.932925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.933116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.933366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.933531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.933683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.933853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.934016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.934176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.934334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.934565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.934754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.935086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.935254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.935413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.935574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.935816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.936037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.936202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.936380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.936541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.936704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.936864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.937022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.937182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.937332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.937491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.937738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.937836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.937836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.938073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.938235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.938423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.938754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.939966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.940952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.941045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.941140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.941226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.941310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.941406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.941491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.941756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.941851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.941851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.942024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.942024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.942203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.942587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.942693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.942693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.942858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.942952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.943989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.944081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.944172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.944463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.944555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.944649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.944748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.944842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.944960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.945047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.945138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.945298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.945386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.945477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.945569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.945652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.945736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.946998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.947930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.948021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.948114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.948200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.948283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.948367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.948450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.948563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.948820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.948923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.949978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.950991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.951361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.951458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.951545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.951655 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.951878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.951983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.952990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.953910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.954975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.955930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.956975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.957943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.958992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.959966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.960934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.961023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.961118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.961210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.961302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.961387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.961470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.961559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.961753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.961905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.962911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.963215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.963310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.963396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.963480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.963563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.963660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.963753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.963845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.963971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.964064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.964717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.964862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.964993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.965106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.965199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.965283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.965416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.965535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.965645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.965754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.965909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.966027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.966147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.966260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.966373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.966483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.966657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.966798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.966999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.967116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.967236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.967348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.967466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.967585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.967706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.967818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.967936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.968057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.968182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.968182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.968408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.968518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.968628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.968737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.968846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.968969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.969090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.969203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.969320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.969433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.969550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.969677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.969788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.969907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.970019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.970135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.970254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.970373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.970485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.970632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.970753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.970865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.970984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.971103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.971223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.971335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.971447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.971557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.971694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.971893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.972980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.973990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.974071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.974143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.974225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.974225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.974377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.974473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.974702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.974806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.974943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.975958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.976967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.977052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.977245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.977360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.977613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.977885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.977988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.978233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.978374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.978575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.978698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.978906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.979034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.979241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.979397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.979549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.979653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.980433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.980540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.980767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.980877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.981132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:58.981228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.005466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.005611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.005686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.005744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.005798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.005863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.005918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.005972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.006965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.007019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.007072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.007200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.007259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.007314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.007367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.007421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.007483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.007539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.008906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.009001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.009001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.009218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.009368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.009502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.009613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.009716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.009811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.009906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.010901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.011833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.012911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.013982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014655 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.014986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.015055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.015123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.015123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.022654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.022787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.022858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.022919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.022978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.023988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.024988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.025986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.026044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.026100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.026157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.026215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.026215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.026328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.026386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.026442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.026529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.027980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.028982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.029985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.030042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.030098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.030154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.030218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.030286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.030344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.030400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.030457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.032776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.032925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.033975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.034993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.035720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.036962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.037044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.037174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.037517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.037813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.037884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.038202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.038397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.038469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.038618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.038929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.039002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.039272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.039510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.039675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.039754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.039975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.040045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.040386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.040465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.040673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.040763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.041004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.041086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.041306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.041384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.045255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.045365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.045433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.045491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.045549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.045606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.045663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.045728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.045788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.046579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.046735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.046875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.047013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.047162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.047300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.047435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.047571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.047707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.047852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.047990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.048126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.048261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.048396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.048554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.048706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.048843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.048979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.049170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.049309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.049451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.049614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.049753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.049970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.050159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.050305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.050305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.050660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.050799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.051561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.051722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.051863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.051985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.052928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.053906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.054075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.054223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.054363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.054515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.054655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.054787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.054916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.055114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.055193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.055265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.055434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.055587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.055749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.055893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.056047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.056359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.056494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.056626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.056756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.056885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.057992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.058064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.058135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.058243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.058321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.058550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.058646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.058801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.058901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.058998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.059088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.059171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.059245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.059379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.059633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.059803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.059975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.060076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.060174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.060392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.060513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.060732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.060896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.061096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.061266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.061438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.061607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.061763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.061980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.062109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.062351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.062430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.062529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.062761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.062872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.062998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 20:47:59.063095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.063437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.063758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.064081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.064393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 20:47:59.064642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 20:47:59.131239 ncdv-master-1 devstack@n-api.service[140437]: INFO dbcounter [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Registered counter for database nova_api Oct 01 20:47:59.131409 ncdv-master-1 devstack@n-api.service[140438]: INFO dbcounter [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Registered counter for database nova_api Oct 01 20:47:59.152774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_db.sqlalchemy.engines [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:47:59.155143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_db.sqlalchemy.engines [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:47:59.160583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writer thread running {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:47:59.161807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writer thread running {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:47:59.219946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.context [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2663fce6-13d1-4945-900e-d818f7f389c0(cell1) {{(pid=140438) load_cells /opt/stack/nova/nova/context.py:464}} Oct 01 20:47:59.220155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.context [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2663fce6-13d1-4945-900e-d818f7f389c0(cell1) {{(pid=140437) load_cells /opt/stack/nova/nova/context.py:464}} Oct 01 20:47:59.223846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:47:59.223951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:47:59.224331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:47:59.224432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:47:59.225922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:47:59.226034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:47:59.226688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:47:59.226784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:47:59.227143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:47:59.227233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:47:59.229166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:47:59.229261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:47:59.231351 ncdv-master-1 devstack@n-api.service[140437]: INFO dbcounter [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Registered counter for database nova_cell0 Oct 01 20:47:59.231447 ncdv-master-1 devstack@n-api.service[140438]: INFO dbcounter [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Registered counter for database nova_cell0 Oct 01 20:47:59.235521 ncdv-master-1 devstack@n-api.service[140437]: INFO dbcounter [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Registered counter for database nova_cell1 Oct 01 20:47:59.235724 ncdv-master-1 devstack@n-api.service[140438]: INFO dbcounter [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Registered counter for database nova_cell1 Oct 01 20:47:59.243070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_db.sqlalchemy.engines [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:47:59.246796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_db.sqlalchemy.engines [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:47:59.248485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_db.sqlalchemy.engines [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:47:59.248803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_db.sqlalchemy.engines [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:47:59.252330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writer thread running {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:47:59.255035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writer thread running {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:47:59.256932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writer thread running {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:47:59.397890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writer thread running {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:47:59.406333 ncdv-master-1 devstack@n-api.service[140438]: INFO dbcounter [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Registered counter for database nova_cell0 Oct 01 20:47:59.407499 ncdv-master-1 devstack@n-api.service[140437]: INFO dbcounter [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Registered counter for database nova_cell0 Oct 01 20:47:59.413099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_db.sqlalchemy.engines [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:47:59.414778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_db.sqlalchemy.engines [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 20:47:59.417711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writer thread running {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:47:59.419272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writer thread running {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 20:47:59.854079 ncdv-master-1 devstack@n-api.service[140438]: WARNING keystonemiddleware.auth_token [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 20:47:59.861759 ncdv-master-1 devstack@n-api.service[140437]: WARNING keystonemiddleware.auth_token [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 20:47:59.862190 ncdv-master-1 devstack@n-api.service[140438]: WARNING keystonemiddleware.auth_token [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 20:47:59.869277 ncdv-master-1 devstack@n-api.service[140437]: WARNING keystonemiddleware.auth_token [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 20:48:00.085386 ncdv-master-1 devstack@n-api.service[140438]: WARNING keystonemiddleware.auth_token [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 20:48:00.092233 ncdv-master-1 devstack@n-api.service[140438]: WARNING keystonemiddleware.auth_token [None req-0de2d110-5144-4c45-bd72-aeda312fa311 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 20:48:00.097647 ncdv-master-1 devstack@n-api.service[140438]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f669f79c0 pid: 140438 (default app) Oct 01 20:48:00.098097 ncdv-master-1 devstack@n-api.service[140437]: WARNING keystonemiddleware.auth_token [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 20:48:00.104235 ncdv-master-1 devstack@n-api.service[140437]: WARNING keystonemiddleware.auth_token [None req-80ae6658-e3a0-4c47-a97a-7c0574374711 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 20:48:00.109517 ncdv-master-1 devstack@n-api.service[140437]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f669f79c0 pid: 140437 (default app) Oct 01 20:48:42.406546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:42.411524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:42.412578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:42.415039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:42.728177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:42.729685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:42.731181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:42.733080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:43.974013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a07f2d01-cb64-4c9c-9cf2-4abec4551d4d tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2007612316", "id": 241043902, "os-flavor-access:is_public": "False"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:44.036205 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a07f2d01-cb64-4c9c-9cf2-4abec4551d4d tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 1.650140 Oct 01 20:48:44.047761 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:42 2022] POST /compute/v2.1/flavors => generated 428 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:44.516607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '.version_select at 0x7f41792e5ee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:44.534024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2663fce6-13d1-4945-900e-d818f7f389c0(cell1) {{(pid=140438) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 01 20:48:44.537349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:44.538424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:44.541098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:44.604641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:44.607195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:44.609810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:44.644227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:44.646812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:44.649187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:44.664326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0793c9a6-43ac-4f00-bd0b-9d725227079d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.614802 Oct 01 20:48:44.682703 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2/2] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Oct 1 20:48:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:44.971057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-08cb7a80-849e-4095-9d0d-5723e3695a5b tempest-FlavorsV261TestJSON-1306291235 tempest-FlavorsV261TestJSON-1306291235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-42886206", "id": 1821823174, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:45.107958 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-08cb7a80-849e-4095-9d0d-5723e3695a5b tempest-FlavorsV261TestJSON-1306291235 tempest-FlavorsV261TestJSON-1306291235-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 466 microversion: 2.61 time: 2.391040 Oct 01 20:48:45.120373 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1/3] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:48:42 2022] POST /compute/v2.1/flavors => generated 466 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:48:45.128403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-00664ee8-f649-418e-93f2-f9a5949d45d8 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8fb1cc925cc241d291826e2a79e9c2db"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:45.158054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Calling method '.version_select at 0x7f4179130430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:45.160265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:45.160768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:45.161211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:45.188366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:45.188862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:45.189307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:45.219369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:45.219889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:45.220806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:45.239108 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe9d4a0c-0a93-4b0d-8508-832a5d95ea60 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.554901 Oct 01 20:48:45.240025 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3/4] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:45.469403 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-00664ee8-f649-418e-93f2-f9a5949d45d8 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/241043902/action" status: 200 len: 96 microversion: 2.1 time: 0.346347 Oct 01 20:48:45.470333 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2/5] 10.222.0.17 () {60 vars in 1197 bytes} [Sat Oct 1 20:48:45 2022] POST /compute/v2.1/flavors/241043902/action => generated 96 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:45.481647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ada87f3a-fd43-4274-8749-4d1db658c37e tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-420679187", "name": "tempest-test_aggregate-268191349"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:45.513341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-ada87f3a-fd43-4274-8749-4d1db658c37e tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Generated uuid 9a48f840-7542-4c28-9d63-8a9f06455524 for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:48:45.647885 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ada87f3a-fd43-4274-8749-4d1db658c37e tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.176163 Oct 01 20:48:45.651938 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 3/6] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Oct 1 20:48:45 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:45.655528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-794d5348-6be9-422e-9eec-654d534e2a4b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Calling method '.version_select at 0x7f417915ab80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:45.659581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794d5348-6be9-422e-9eec-654d534e2a4b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:45.664532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794d5348-6be9-422e-9eec-654d534e2a4b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:45.665217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794d5348-6be9-422e-9eec-654d534e2a4b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:45.666308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794d5348-6be9-422e-9eec-654d534e2a4b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:45.667006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794d5348-6be9-422e-9eec-654d534e2a4b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:45.668164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794d5348-6be9-422e-9eec-654d534e2a4b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:45.727850 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-794d5348-6be9-422e-9eec-654d534e2a4b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.486522 Oct 01 20:48:45.736313 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Oct 1 20:48:45 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:45.899652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4ba48cc7-f0cc-456e-ac3e-b684fb848a6b tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-312827137", "id": 1565466072, "os-flavor-access:is_public": "False"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:45.934874 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4ba48cc7-f0cc-456e-ac3e-b684fb848a6b tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.280689 Oct 01 20:48:45.936007 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 4/8] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:45 2022] POST /compute/v2.1/flavors => generated 438 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:45.943449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Calling method '.version_select at 0x7f41790bb160>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:45.957048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2663fce6-13d1-4945-900e-d818f7f389c0(cell1) {{(pid=140437) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 01 20:48:45.957833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:45.958794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:45.961662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.012420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.013074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.013259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-931e1071-4576-4a8d-922c-e72084da354e tempest-FlavorsV261TestJSON-983364335 tempest-FlavorsV261TestJSON-983364335-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:46.013517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.043723 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-931e1071-4576-4a8d-922c-e72084da354e tempest-FlavorsV261TestJSON-983364335 tempest-FlavorsV261TestJSON-983364335-project] 10.222.0.17 "GET /compute/v2.1/flavors/1821823174" status: 200 len: 466 microversion: 2.61 time: 0.306239 Oct 01 20:48:46.061017 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 5/9] 10.222.0.17 () {60 vars in 1199 bytes} [Sat Oct 1 20:48:45 2022] GET /compute/v2.1/flavors/1821823174 => generated 466 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:48:46.103739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.106168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.107066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.125952 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5470b613-eb84-4bab-bf96-749d6e1e36d2 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.188326 Oct 01 20:48:46.134635 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1212 bytes} [Sat Oct 1 20:48:45 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 104 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:46.142119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3f2a6dc1-0a63-4fe9-88fe-2c00067b7430 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:46.194355 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3f2a6dc1-0a63-4fe9-88fe-2c00067b7430 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.058294 Oct 01 20:48:46.197188 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:48:46 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:46.209019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3a05b262-874f-4436-ae64-e15925a1a28b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Calling method '.version_select at 0x7f41790bb820>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:46.217146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a05b262-874f-4436-ae64-e15925a1a28b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.217873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a05b262-874f-4436-ae64-e15925a1a28b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.219137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a05b262-874f-4436-ae64-e15925a1a28b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.226724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a05b262-874f-4436-ae64-e15925a1a28b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.227246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a05b262-874f-4436-ae64-e15925a1a28b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.227687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a05b262-874f-4436-ae64-e15925a1a28b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.318309 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3a05b262-874f-4436-ae64-e15925a1a28b tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.119933 Oct 01 20:48:46.318971 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 7/12] 10.222.0.17 () {58 vars in 1139 bytes} [Sat Oct 1 20:48:46 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:46.330824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-964cba5e-009f-4415-bb5d-793a0e8bbf8e tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:46.420960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83ef5775-7394-4c03-8fd5-3159fc3c8f0f tempest-FlavorsAccessTestJSON-1586887428 tempest-FlavorsAccessTestJSON-1586887428-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:46.477224 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-83ef5775-7394-4c03-8fd5-3159fc3c8f0f tempest-FlavorsAccessTestJSON-1586887428 tempest-FlavorsAccessTestJSON-1586887428-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5825 microversion: 2.1 time: 0.414852 Oct 01 20:48:46.479305 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 6/13] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:46 2022] GET /compute/v2.1/flavors/detail => generated 5825 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:46.484185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a258bfa-64ea-4de2-b8e0-aabcb96d168a tempest-FlavorsV261TestJSON-1306291235 tempest-FlavorsV261TestJSON-1306291235-project-admin] Action: 'update', calling method: .version_select at 0x7f417969b670>, body: {"flavor": {"description": "new"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:46.552027 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a258bfa-64ea-4de2-b8e0-aabcb96d168a tempest-FlavorsV261TestJSON-1306291235 tempest-FlavorsV261TestJSON-1306291235-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1821823174" status: 200 len: 467 microversion: 2.61 time: 0.072340 Oct 01 20:48:46.558844 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 7/14] 10.222.0.17 () {62 vars in 1219 bytes} [Sat Oct 1 20:48:46 2022] PUT /compute/v2.1/flavors/1821823174 => generated 467 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:48:46.574789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Calling method '.version_select at 0x7f41790ba820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:46.578647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.579380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.580028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.602086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.602594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.603039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.614785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.615277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.615718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.623445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-93e6d604-bd0b-4dff-acb2-47fa0c6014df tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.063289 Oct 01 20:48:46.624331 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:46.633687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a463d0d-a183-4867-87fa-7d0fd06b1676 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:46.673715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a463d0d-a183-4867-87fa-7d0fd06b1676 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.674441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a463d0d-a183-4867-87fa-7d0fd06b1676 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.675803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a463d0d-a183-4867-87fa-7d0fd06b1676 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.958265 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-964cba5e-009f-4415-bb5d-793a0e8bbf8e tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1565466072/action" status: 200 len: 97 microversion: 2.1 time: 0.637453 Oct 01 20:48:46.959747 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 8/16] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Oct 1 20:48:46 2022] POST /compute/v2.1/flavors/1565466072/action => generated 97 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:46.965436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3f55e626-565c-4c6f-a85d-b40e02e806b9 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Calling method '.version_select at 0x7f41788a2e50>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:46.969257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f55e626-565c-4c6f-a85d-b40e02e806b9 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.969791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f55e626-565c-4c6f-a85d-b40e02e806b9 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.970236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f55e626-565c-4c6f-a85d-b40e02e806b9 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:46.971206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f55e626-565c-4c6f-a85d-b40e02e806b9 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:46.972001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f55e626-565c-4c6f-a85d-b40e02e806b9 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:46.972446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f55e626-565c-4c6f-a85d-b40e02e806b9 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:47.000593 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3f55e626-565c-4c6f-a85d-b40e02e806b9 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.039512 Oct 01 20:48:47.002993 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 9/17] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Oct 1 20:48:46 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:47.010992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8cb5bc22-0d54-4260-99f3-d6c816069923 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8fb1cc925cc241d291826e2a79e9c2db"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:47.298887 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8cb5bc22-0d54-4260-99f3-d6c816069923 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/241043902/action" status: 200 len: 21 microversion: 2.1 time: 0.296024 Oct 01 20:48:47.299883 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 10/18] 10.222.0.17 () {60 vars in 1197 bytes} [Sat Oct 1 20:48:47 2022] POST /compute/v2.1/flavors/241043902/action => generated 21 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:47.320931 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0a463d0d-a183-4867-87fa-7d0fd06b1676 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 0.695242 Oct 01 20:48:47.321795 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 9/19] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Oct 1 20:48:46 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:47.327106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-74502de4-cf30-44a5-8969-9cb75c1d6190 tempest-FlavorsV261TestJSON-983364335 tempest-FlavorsV261TestJSON-983364335-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:47.360188 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-74502de4-cf30-44a5-8969-9cb75c1d6190 tempest-FlavorsV261TestJSON-983364335 tempest-FlavorsV261TestJSON-983364335-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6248 microversion: 2.61 time: 0.036747 Oct 01 20:48:47.361547 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Oct 1 20:48:47 2022] GET /compute/v2.1/flavors/detail => generated 6248 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:48:47.366012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7268b119-12b6-406c-95b6-4a8936d41a64 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Calling method '.version_select at 0x7f41787ebc10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:47.369016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7268b119-12b6-406c-95b6-4a8936d41a64 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:47.369647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7268b119-12b6-406c-95b6-4a8936d41a64 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:47.370400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7268b119-12b6-406c-95b6-4a8936d41a64 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:47.393978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7268b119-12b6-406c-95b6-4a8936d41a64 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:47.394473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7268b119-12b6-406c-95b6-4a8936d41a64 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:47.394943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7268b119-12b6-406c-95b6-4a8936d41a64 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:47.403362 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7268b119-12b6-406c-95b6-4a8936d41a64 tempest-HypervisorAdminUnderV252Test-1995928228 tempest-HypervisorAdminUnderV252Test-1995928228-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.040473 Oct 01 20:48:47.411878 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 11/21] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Oct 1 20:48:47 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:47.418220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b4ea75b-18d8-44df-83fd-6b1e50b22d24 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:47.602383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4e1d64df-34d6-442a-a4d9-ce82d1804bee tempest-AZAdminNegativeTestJSON-1062019671 tempest-AZAdminNegativeTestJSON-1062019671-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:47.606275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4e1d64df-34d6-442a-a4d9-ce82d1804bee tempest-AZAdminNegativeTestJSON-1062019671 tempest-AZAdminNegativeTestJSON-1062019671-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'f921d61f3bbb49a39a5bb998f6e09012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94df346c1d9645d3831ede450f4da091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4e1d64df-34d6-442a-a4d9-ce82d1804bee tempest-AZAdminNegativeTestJSON-1062019671 tempest-AZAdminNegativeTestJSON-1062019671-project] Request method failure captured: Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKet4DWzDTNn87BPRw5rwLYVUj_0gUcG1fvc66adjf0w1NbunfcISBCCyG98S0zgO4SuMzKORkVBhSii6xSqR1I6WVvUWpcv9YARyGi2e2r6TrOaRJ_88sHJAGZYuW3YqxshfcZgwWjOBU5X_KxfJgpHpIXo86LfURH6RInxrFzRghU Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 94df346c1d9645d3831ede450f4da091 Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1062019671 Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:48:47.612857 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_94df346c1d9645d3831ede450f4da091", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/94df346c1d9645d3831ede450f4da091"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/94df346c1d9645d3831ede450f4da091"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/94df346c1d9645d3831ede450f4da091"}]}] Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AZAdminNegativeTestJSON-1062019671 Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 94df346c1d9645d3831ede450f4da091 Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1062019671 Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AZAdminNegativeTestJSON-1062019671-project Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f921d61f3bbb49a39a5bb998f6e09012 Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AZAdminNegativeTestJSON-1062019671-project Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 01 20:48:47.614229 ncdv-master-1 devstack@n-api.service[140437]: action_args: {} Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:48:47.615149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 01 20:48:47.616412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.622026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4e1d64df-34d6-442a-a4d9-ce82d1804bee tempest-AZAdminNegativeTestJSON-1062019671 tempest-AZAdminNegativeTestJSON-1062019671-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:48:47.625526 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4e1d64df-34d6-442a-a4d9-ce82d1804bee tempest-AZAdminNegativeTestJSON-1062019671 tempest-AZAdminNegativeTestJSON-1062019671-project] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.323774 Oct 01 20:48:47.626653 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 11/22] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Oct 1 20:48:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 326 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:48:47.633333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8614ddbc-9883-43fe-a2a1-af14ae2de0ec tempest-FlavorsAccessTestJSON-1586887428 tempest-FlavorsAccessTestJSON-1586887428-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:47.678933 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8614ddbc-9883-43fe-a2a1-af14ae2de0ec tempest-FlavorsAccessTestJSON-1586887428 tempest-FlavorsAccessTestJSON-1586887428-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5407 microversion: 2.1 time: 0.049908 Oct 01 20:48:47.681112 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:47 2022] GET /compute/v2.1/flavors/detail => generated 5407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:47.688069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60ad23d9-524e-40f3-a400-55ffc45f672e tempest-FlavorsV261TestJSON-983364335 tempest-FlavorsV261TestJSON-983364335-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:47.712890 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-60ad23d9-524e-40f3-a400-55ffc45f672e tempest-FlavorsV261TestJSON-983364335 tempest-FlavorsV261TestJSON-983364335-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 3155 microversion: 2.61 time: 0.030429 Oct 01 20:48:47.722705 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 13/24] 10.222.0.17 () {60 vars in 1166 bytes} [Sat Oct 1 20:48:47 2022] GET /compute/v2.1/flavors => generated 3155 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:48:47.857860 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-4b4ea75b-18d8-44df-83fd-6b1e50b22d24 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 2b38d7f557db4bfeacdd4e958cec9557 combination. Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b4ea75b-18d8-44df-83fd-6b1e50b22d24 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Request method failure captured: Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/flavors/1565466072/action HTTP/1.1 Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 67 Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKerU0S7-djN2R_Ew1ETjQvJ37gUn3kB-VJyHbReQCarTp8X4fkj1ub9CjiHMJkBDaYctnyXKNRAmWFlAUS7jdgDD4fMgdXjogPDR3m9CF1fk5nhvOvhLttkkGOa_9aHZ0MSS233zvklloiK6WqCuOMPXHDCVQsMTXOG5vef5WmEW40 Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 08b6602ad13646c195ab1f3be7aa0e72 Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1821884549 Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:48:47.891571 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08b6602ad13646c195ab1f3be7aa0e72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08b6602ad13646c195ab1f3be7aa0e72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08b6602ad13646c195ab1f3be7aa0e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08b6602ad13646c195ab1f3be7aa0e72"}]}] Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1821884549 Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 08b6602ad13646c195ab1f3be7aa0e72 Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1821884549 Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3e0503d20ac74f9ebe516009ddf320a5 Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: {"addTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} Oct 01 20:48:47.892709 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: exception: Flavor access already exists for flavor 17 and project 2b38d7f557db4bfeacdd4e958cec9557 combination. Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1565466072', 'body': {'addTenantAccess': {'tenant': '2b38d7f557db4bfeacdd4e958cec9557'}}} Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result.read() Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:48:47.893363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-2b38d7f557db4bfeacdd4e958cec9557' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi session.flush() Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 01 20:48:47.894243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 01 20:48:47.895192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:48:47.896169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result.read() Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-2b38d7f557db4bfeacdd4e958cec9557' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 1, 20, 48, 47, 847509), 'updated_at': None, 'flavor_id': 17, 'project_id': '2b38d7f557db4bfeacdd4e958cec9557'}] Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:48:47.897323 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project 2b38d7f557db4bfeacdd4e958cec9557 combination. Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:48:47.898472 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project 2b38d7f557db4bfeacdd4e958cec9557 combination. Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:48:47.900045 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:48:47.902923 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project 2b38d7f557db4bfeacdd4e958cec9557 combination. Oct 01 20:48:47.902923 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:47.907185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b4ea75b-18d8-44df-83fd-6b1e50b22d24 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 2b38d7f557db4bfeacdd4e958cec9557 combination. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:48:47.909207 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b4ea75b-18d8-44df-83fd-6b1e50b22d24 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1565466072/action" status: 409 len: 152 microversion: 2.1 time: 0.495906 Oct 01 20:48:47.911618 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 12/25] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Oct 1 20:48:47 2022] POST /compute/v2.1/flavors/1565466072/action => generated 152 bytes in 498 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:48:47.917690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da5a0551-b20e-4481-9f1f-a99cdb4c3e75 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:47.954446 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da5a0551-b20e-4481-9f1f-a99cdb4c3e75 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/241043902" status: 202 len: 0 microversion: 2.1 time: 0.040885 Oct 01 20:48:47.958936 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 20:48:47 2022] DELETE /compute/v2.1/flavors/241043902 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:48:47.971164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b531c44d-71fa-4da4-be6e-9b3ecf41330c tempest-FlavorsV261TestJSON-1306291235 tempest-FlavorsV261TestJSON-1306291235-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:47.999057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b531c44d-71fa-4da4-be6e-9b3ecf41330c tempest-FlavorsV261TestJSON-1306291235 tempest-FlavorsV261TestJSON-1306291235-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1821823174" status: 202 len: 0 microversion: 2.61 time: 0.038195 Oct 01 20:48:48.001201 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 14/27] 10.222.0.17 () {60 vars in 1202 bytes} [Sat Oct 1 20:48:47 2022] DELETE /compute/v2.1/flavors/1821823174 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:48:48.015855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06304115-5cb0-4bd0-acb6-ead35f49ba99 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:48.097116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1524516894", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "availability_zone": "tempest-test_az-420679187"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:48.128441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:48.129480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:48.130702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:48.133458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:48.133931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:48.134730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:48.449365 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06304115-5cb0-4bd0-acb6-ead35f49ba99 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1565466072/action" status: 200 len: 21 microversion: 2.1 time: 0.442052 Oct 01 20:48:48.454829 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 15/28] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Oct 1 20:48:48 2022] POST /compute/v2.1/flavors/1565466072/action => generated 21 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:48.465260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b6513f25-d576-408f-9e16-07958fdf3891 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:48.520628 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b6513f25-d576-408f-9e16-07958fdf3891 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069270 Oct 01 20:48:48.536202 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 16/29] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:48.541875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a957020b-b096-445e-91cc-08da4a42dd00 tempest-FlavorsV261TestJSON-1306291235 tempest-FlavorsV261TestJSON-1306291235-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:48.592017 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a957020b-b096-445e-91cc-08da4a42dd00 tempest-FlavorsV261TestJSON-1306291235 tempest-FlavorsV261TestJSON-1306291235-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.050205 Oct 01 20:48:48.593057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 17/30] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Oct 1 20:48:48 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:48:48.600313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7df22877-fec8-44d0-8d15-d3376a98a2e6 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:48.671722 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7df22877-fec8-44d0-8d15-d3376a98a2e6 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1565466072" status: 202 len: 0 microversion: 2.1 time: 0.077365 Oct 01 20:48:48.675422 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 18/31] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:48:48 2022] DELETE /compute/v2.1/flavors/1565466072 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:48:48.689368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2a42a57-0f94-489f-a80a-bf21c5b60e95 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-844753902", "id": 1029558143, "os-flavor-access:is_public": "False"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:48.744714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c2a42a57-0f94-489f-a80a-bf21c5b60e95 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.066169 Oct 01 20:48:48.748688 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 19/32] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:48 2022] POST /compute/v2.1/flavors => generated 430 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:48.759700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-63057aef-34f8-4926-9f8b-27057d00eae9 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:48.789832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-63057aef-34f8-4926-9f8b-27057d00eae9 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039619 Oct 01 20:48:48.802518 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 20/33] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:48.802518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c58e410-d85d-42ec-b9f0-0e0e876621d7 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:48.814525 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c58e410-d85d-42ec-b9f0-0e0e876621d7 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1029558143/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.021604 Oct 01 20:48:48.815774 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 21/34] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Oct 1 20:48:48 2022] GET /compute/v2.1/flavors/1029558143/os-flavor-access => generated 21 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:48.824793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0723edf0-1e4c-42e3-8d96-ab92fefac32a tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1666714964", "id": 1101916459, "os-flavor-access:is_public": "True"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:48.852573 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0723edf0-1e4c-42e3-8d96-ab92fefac32a tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.035623 Oct 01 20:48:48.854365 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 22/35] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:48 2022] POST /compute/v2.1/flavors => generated 438 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:48.860431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1bb8e26b-d9d7-45fc-a383-221fdd927d2b tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:48.871452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=11 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:48.896084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:48:48.903321 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1bb8e26b-d9d7-45fc-a383-221fdd927d2b tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1029558143" status: 202 len: 0 microversion: 2.1 time: 0.047390 Oct 01 20:48:48.903913 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 23/36] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:48:48 2022] DELETE /compute/v2.1/flavors/1029558143 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:48:48.916223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-026fb746-0958-46ec-85c2-81a3d5aefff4 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:48.924376 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-026fb746-0958-46ec-85c2-81a3d5aefff4 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-026fb746-0958-46ec-85c2-81a3d5aefff4 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Request method failure captured: Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/flavors/1101916459/os-flavor-access HTTP/1.1 Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKerU0S7-djN2R_Ew1ETjQvJ37gUn3kB-VJyHbReQCarTp8X4fkj1ub9CjiHMJkBDaYctnyXKNRAmWFlAUS7jdgDD4fMgdXjogPDR3m9CF1fk5nhvOvhLttkkGOa_9aHZ0MSS233zvklloiK6WqCuOMPXHDCVQsMTXOG5vef5WmEW40 Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 08b6602ad13646c195ab1f3be7aa0e72 Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1821884549 Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:48:48.925922 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08b6602ad13646c195ab1f3be7aa0e72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08b6602ad13646c195ab1f3be7aa0e72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08b6602ad13646c195ab1f3be7aa0e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08b6602ad13646c195ab1f3be7aa0e72"}]}] Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1821884549 Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 08b6602ad13646c195ab1f3be7aa0e72 Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1821884549 Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3e0503d20ac74f9ebe516009ddf320a5 Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: exception: Access list not available for public flavors. Oct 01 20:48:48.927037 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'flavor_id': '1101916459'} Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 01 20:48:48.927670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:48.929791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-026fb746-0958-46ec-85c2-81a3d5aefff4 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:48:48.930884 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-026fb746-0958-46ec-85c2-81a3d5aefff4 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1101916459/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.019786 Oct 01 20:48:48.932066 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 24/37] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Oct 1 20:48:48 2022] GET /compute/v2.1/flavors/1101916459/os-flavor-access => generated 91 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:48:48.939039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-943e4191-53e6-403c-907a-7d3d5dca01c8 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:48.964232 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-943e4191-53e6-403c-907a-7d3d5dca01c8 tempest-FlavorsAccessTestJSON-1602123528 tempest-FlavorsAccessTestJSON-1602123528-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5419 microversion: 2.1 time: 0.029813 Oct 01 20:48:48.979391 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 25/38] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:48 2022] GET /compute/v2.1/flavors/detail => generated 5419 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:48.985472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6e636455-1ccc-49f6-83e7-bf2d77797611 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:49.008196 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6e636455-1ccc-49f6-83e7-bf2d77797611 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1101916459" status: 202 len: 0 microversion: 2.1 time: 0.027461 Oct 01 20:48:49.009227 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 26/39] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:48:48 2022] DELETE /compute/v2.1/flavors/1101916459 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:48:49.027952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07a0df21-ced8-4045-b362-150ff1ced863 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:49.099289 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07a0df21-ced8-4045-b362-150ff1ced863 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081383 Oct 01 20:48:49.113699 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 27/40] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:49.128922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc0b195d-9296-4333-9969-e1cfcc919631 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1480165862", "id": 545512575, "os-flavor-access:is_public": "False"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:49.161197 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc0b195d-9296-4333-9969-e1cfcc919631 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.036911 Oct 01 20:48:49.162303 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 28/41] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:49 2022] POST /compute/v2.1/flavors => generated 436 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:48:49.288916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:48:49.289738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:48:49.290595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:48:49.291213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:48:49.291837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:48:49.322314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:49.324848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:49.325632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:49.327377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:49.328866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:49.334216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:49.392405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Getting quotas for project 207636159f8a4318b3d141a828b16260. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:48:49.406187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Getting quotas for user 07638141e5f34ee783ebfe4f577be214 and project 207636159f8a4318b3d141a828b16260. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:48:49.431350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:48:49.435246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:48:49.540576 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-db6f6743-5677-4da5-b165-860553fe6d1d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815982 Oct 01 20:48:49.544633 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 14/42] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:48:49.563734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-88128dc7-3e2c-4216-b593-8b2549c31f0f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:49.567161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-88128dc7-3e2c-4216-b593-8b2549c31f0f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:48:49.746516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-88128dc7-3e2c-4216-b593-8b2549c31f0f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:48:49.780579 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-88128dc7-3e2c-4216-b593-8b2549c31f0f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1242 microversion: 2.1 time: 0.227721 Oct 01 20:48:49.786891 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 15/43] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:48:49 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1242 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:48:49.839734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e1213a1-35a9-4fd8-a159-86156d9dddb9 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:49.843750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1e1213a1-35a9-4fd8-a159-86156d9dddb9 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd658c70488c74cedbee2bafdde3fe047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b38d7f557db4bfeacdd4e958cec9557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e1213a1-35a9-4fd8-a159-86156d9dddb9 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] Request method failure captured: Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/flavors/545512575/action HTTP/1.1 Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 67 Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKeoPEdKyScTDE-4N6JiI21y3hc2eDZaRQeZPeZtIcnHErGMvBTeuUqayD_TX6-BAXURCfZnzlP29f8v0l3q8TNR_D0PqxhMQ64FRwzTn5ya3mFTymR0KOMYlDE12EfS9Jz2Jw8iutwHOtKY7iJwV-SxDqpttWF8wPCOaAe9DSP9bBY Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 2b38d7f557db4bfeacdd4e958cec9557 Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1786195492 Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:48:49.856193 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b38d7f557db4bfeacdd4e958cec9557", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b38d7f557db4bfeacdd4e958cec9557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b38d7f557db4bfeacdd4e958cec9557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b38d7f557db4bfeacdd4e958cec9557"}]}] Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1786195492 Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 2b38d7f557db4bfeacdd4e958cec9557 Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1786195492 Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FlavorsAccessNegativeTestJSON-1786195492-project Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d658c70488c74cedbee2bafdde3fe047 Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1786195492-project Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: {"addTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} Oct 01 20:48:49.857302 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '545512575', 'body': {'addTenantAccess': {'tenant': '2b38d7f557db4bfeacdd4e958cec9557'}}} Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:48:49.857971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 01 20:48:49.858918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:49.862384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e1213a1-35a9-4fd8-a159-86156d9dddb9 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:48:49.866727 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e1213a1-35a9-4fd8-a159-86156d9dddb9 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] 10.222.0.17 "POST /compute/v2.1/flavors/545512575/action" status: 403 len: 130 microversion: 2.1 time: 0.695883 Oct 01 20:48:49.871198 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 29/44] 10.222.0.17 () {60 vars in 1197 bytes} [Sat Oct 1 20:48:49 2022] POST /compute/v2.1/flavors/545512575/action => generated 130 bytes in 701 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:48:49.881455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1fdba93-6d5b-40d7-9ea0-f7fcc53c59f4 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:49.933899 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b1fdba93-6d5b-40d7-9ea0-f7fcc53c59f4 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/545512575" status: 202 len: 0 microversion: 2.1 time: 0.057389 Oct 01 20:48:49.935691 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 16/45] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 20:48:49 2022] DELETE /compute/v2.1/flavors/545512575 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:48:49.947774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef268d2b-b44d-4ee3-850f-8a4ce226750a tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:50.043120 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef268d2b-b44d-4ee3-850f-8a4ce226750a tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077815 Oct 01 20:48:50.046883 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 30/46] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:50.069224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b4f8de15-a191-4b48-85a1-b954b577e927 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1846759297", "id": 1888478276, "os-flavor-access:is_public": "False"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:50.106523 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b4f8de15-a191-4b48-85a1-b954b577e927 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.041578 Oct 01 20:48:50.107855 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 17/47] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:50 2022] POST /compute/v2.1/flavors => generated 439 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:50.130604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3711aef9-a426-4a6c-84d8-35ccffc1c188 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:50.749172 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3711aef9-a426-4a6c-84d8-35ccffc1c188 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1888478276/action" status: 200 len: 97 microversion: 2.1 time: 0.623228 Oct 01 20:48:50.757381 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 31/48] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Oct 1 20:48:50 2022] POST /compute/v2.1/flavors/1888478276/action => generated 97 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:50.763415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8243d6d7-963d-4287-938e-4c5ccab39ef2 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:50.768663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8243d6d7-963d-4287-938e-4c5ccab39ef2 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd658c70488c74cedbee2bafdde3fe047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b38d7f557db4bfeacdd4e958cec9557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8243d6d7-963d-4287-938e-4c5ccab39ef2 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] Request method failure captured: Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/flavors/1888478276/action HTTP/1.1 Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 70 Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKeoPEdKyScTDE-4N6JiI21y3hc2eDZaRQeZPeZtIcnHErGMvBTeuUqayD_TX6-BAXURCfZnzlP29f8v0l3q8TNR_D0PqxhMQ64FRwzTn5ya3mFTymR0KOMYlDE12EfS9Jz2Jw8iutwHOtKY7iJwV-SxDqpttWF8wPCOaAe9DSP9bBY Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 2b38d7f557db4bfeacdd4e958cec9557 Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1786195492 Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:48:50.779857 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b38d7f557db4bfeacdd4e958cec9557", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b38d7f557db4bfeacdd4e958cec9557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b38d7f557db4bfeacdd4e958cec9557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b38d7f557db4bfeacdd4e958cec9557"}]}] Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1786195492 Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 2b38d7f557db4bfeacdd4e958cec9557 Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1786195492 Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FlavorsAccessNegativeTestJSON-1786195492-project Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: d658c70488c74cedbee2bafdde3fe047 Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1786195492-project Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: {"removeTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} Oct 01 20:48:50.781073 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '1888478276', 'body': {'removeTenantAccess': {'tenant': '2b38d7f557db4bfeacdd4e958cec9557'}}} Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can( Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:48:50.781680 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 01 20:48:50.782993 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:48:50.783924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8243d6d7-963d-4287-938e-4c5ccab39ef2 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:48:50.783924 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8243d6d7-963d-4287-938e-4c5ccab39ef2 tempest-FlavorsAccessNegativeTestJSON-1786195492 tempest-FlavorsAccessNegativeTestJSON-1786195492-project] 10.222.0.17 "POST /compute/v2.1/flavors/1888478276/action" status: 403 len: 133 microversion: 2.1 time: 0.024165 Oct 01 20:48:50.788144 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 18/49] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Oct 1 20:48:50 2022] POST /compute/v2.1/flavors/1888478276/action => generated 133 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:48:50.796824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f9a6303a-a2ad-4150-852c-87025a5030b1 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2b38d7f557db4bfeacdd4e958cec9557"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:50.815819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-43e8f7dd-17a7-4ad6-abc0-e70b214363bb tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:50.818381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-43e8f7dd-17a7-4ad6-abc0-e70b214363bb tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:48:51.103038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-43e8f7dd-17a7-4ad6-abc0-e70b214363bb tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:48:51.126881 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-43e8f7dd-17a7-4ad6-abc0-e70b214363bb tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1242 microversion: 2.1 time: 0.311314 Oct 01 20:48:51.129703 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 19/50] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:48:50 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1242 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:51.808329 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f9a6303a-a2ad-4150-852c-87025a5030b1 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1888478276/action" status: 200 len: 21 microversion: 2.1 time: 1.015405 Oct 01 20:48:51.815304 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 32/51] 10.222.0.17 () {60 vars in 1200 bytes} [Sat Oct 1 20:48:50 2022] POST /compute/v2.1/flavors/1888478276/action => generated 21 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:51.820789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-26f6cf7e-5512-434d-8769-6edd56636351 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:51.866689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:DELETE=7 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:51.876537 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-26f6cf7e-5512-434d-8769-6edd56636351 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1888478276" status: 202 len: 0 microversion: 2.1 time: 0.060629 Oct 01 20:48:51.878661 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 20/52] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:48:51 2022] DELETE /compute/v2.1/flavors/1888478276 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 20:48:51.887201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94940bc3-deb2-47a5-9aa2-32aaabcecc02 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:51.969629 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94940bc3-deb2-47a5-9aa2-32aaabcecc02 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087504 Oct 01 20:48:51.991904 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 33/53] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:52.001822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-18bffd1e-d144-4814-bee4-efa31d9854b0 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1788088057", "id": 103902248, "os-flavor-access:is_public": "False"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:52.063194 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-18bffd1e-d144-4814-bee4-efa31d9854b0 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.062440 Oct 01 20:48:52.074449 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 21/54] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:51 2022] POST /compute/v2.1/flavors => generated 436 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:52.079164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-544d6abb-96aa-4bff-8d64-d2f39e9be723 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "02be8fe6f40b42a684054e8a3a7ebf9e"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:52.153303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:52.153992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:48:52.170125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:52.172103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:52.175923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:52.178980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:52.179849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:52.180500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:53.128632 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-544d6abb-96aa-4bff-8d64-d2f39e9be723 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] HTTP exception thrown: Flavor access not found for 22 / 02be8fe6f40b42a684054e8a3a7ebf9e combination. Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-544d6abb-96aa-4bff-8d64-d2f39e9be723 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Request method failure captured: Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/flavors/103902248/action HTTP/1.1 Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 70 Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKerU0S7-djN2R_Ew1ETjQvJ37gUn3kB-VJyHbReQCarTp8X4fkj1ub9CjiHMJkBDaYctnyXKNRAmWFlAUS7jdgDD4fMgdXjogPDR3m9CF1fk5nhvOvhLttkkGOa_9aHZ0MSS233zvklloiK6WqCuOMPXHDCVQsMTXOG5vef5WmEW40 Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 08b6602ad13646c195ab1f3be7aa0e72 Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1821884549 Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:48:53.140542 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08b6602ad13646c195ab1f3be7aa0e72", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08b6602ad13646c195ab1f3be7aa0e72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08b6602ad13646c195ab1f3be7aa0e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08b6602ad13646c195ab1f3be7aa0e72"}]}] Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1821884549 Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 08b6602ad13646c195ab1f3be7aa0e72 Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1821884549 Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3e0503d20ac74f9ebe516009ddf320a5 Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: {"removeTenantAccess": {"tenant": "02be8fe6f40b42a684054e8a3a7ebf9e"}} Oct 01 20:48:53.141720 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: exception: Flavor access not found for 22 / 02be8fe6f40b42a684054e8a3a7ebf9e combination. Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '103902248', 'body': {'removeTenantAccess': {'tenant': '02be8fe6f40b42a684054e8a3a7ebf9e'}}} Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 01 20:48:53.142346 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / 02be8fe6f40b42a684054e8a3a7ebf9e combination. Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / 02be8fe6f40b42a684054e8a3a7ebf9e combination. Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:53.143286 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:48:53.144284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:48:53.144284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:48:53.144284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:48:53.144284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:48:53.144284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / 02be8fe6f40b42a684054e8a3a7ebf9e combination. Oct 01 20:48:53.144284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:48:53.144284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-544d6abb-96aa-4bff-8d64-d2f39e9be723 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Returning 404 to user: Flavor access not found for 22 / 02be8fe6f40b42a684054e8a3a7ebf9e combination. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:48:53.144904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:48:53.151468 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-544d6abb-96aa-4bff-8d64-d2f39e9be723 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/103902248/action" status: 404 len: 124 microversion: 2.1 time: 1.077765 Oct 01 20:48:53.154911 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 34/55] 10.222.0.17 () {60 vars in 1197 bytes} [Sat Oct 1 20:48:52 2022] POST /compute/v2.1/flavors/103902248/action => generated 124 bytes in 1082 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:48:53.163592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71d1fcf3-929e-4eff-a049-7c22f3164016 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:53.170827 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e23522f2-7d4e-4e51-8c5f-8d94ec60c190 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1242 microversion: 2.1 time: 1.021423 Oct 01 20:48:53.171416 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 22/56] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:48:52 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1242 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:53.212487 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71d1fcf3-929e-4eff-a049-7c22f3164016 tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/103902248" status: 202 len: 0 microversion: 2.1 time: 0.052365 Oct 01 20:48:53.217690 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 35/57] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 20:48:53 2022] DELETE /compute/v2.1/flavors/103902248 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:48:53.225267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f56fda26-7eba-428e-adc1-9bfe84b7a4ae tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:53.308757 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f56fda26-7eba-428e-adc1-9bfe84b7a4ae tempest-FlavorsAccessNegativeTestJSON-1821884549 tempest-FlavorsAccessNegativeTestJSON-1821884549-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085626 Oct 01 20:48:53.312169 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 23/58] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:48:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:54.194672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:54.196069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:48:54.236676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:54.237402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:54.239835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:54.243052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:54.243579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:54.244029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:55.684261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:56.965208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:48:57.003053 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-93c8c033-1048-4556-a987-3d9c1f6c2569 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 2.813561 Oct 01 20:48:57.003638 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 36/59] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:48:54 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 2815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:48:58.035336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a2cf3c2e-acbc-4fef-a773-e6a4bbf76d0c tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:58.047565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:58.049598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:48:58.054960 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a2cf3c2e-acbc-4fef-a773-e6a4bbf76d0c tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.025022 Oct 01 20:48:58.058629 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 24/60] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:48:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:58.076315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:58.077633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:58.078374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:58.079357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:58.080036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:58.080890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:58.344702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:48:58.359038 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8e8ddb0a-74d2-4c8f-b164-d660b7f1c5ec tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.318051 Oct 01 20:48:58.360372 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 37/61] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:48:58 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:48:59.065310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ea4cdfa3-ae8d-46a3-b1bf-33b4c05d75a0 tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1678579297", "id": 657278611, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:59.108175 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ea4cdfa3-ae8d-46a3-b1bf-33b4c05d75a0 tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 1.033694 Oct 01 20:48:59.108175 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 25/62] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:58 2022] POST /compute/v2.1/flavors => generated 422 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:59.123469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b816e7a1-16e1-4f94-bc8b-eb0d8b5cb1c8 tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:59.151652 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b816e7a1-16e1-4f94-bc8b-eb0d8b5cb1c8 tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035327 Oct 01 20:48:59.153906 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 38/63] 10.222.0.17 () {58 vars in 1182 bytes} [Sat Oct 1 20:48:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:59.173071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0f4975f0-8631-4cad-b053-a4f21d617986 tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2052443233", "id": 1440176315, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:59.212589 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0f4975f0-8631-4cad-b053-a4f21d617986 tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.049668 Oct 01 20:48:59.213693 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 26/64] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:48:59 2022] POST /compute/v2.1/flavors => generated 425 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:59.226807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d12ad53a-2ee0-4ce2-b2bf-1a9f3590d07e tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:59.247447 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d12ad53a-2ee0-4ce2-b2bf-1a9f3590d07e tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024286 Oct 01 20:48:59.248837 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 39/65] 10.222.0.17 () {58 vars in 1182 bytes} [Sat Oct 1 20:48:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:48:59.266115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8998a3a4-a333-4c1c-9623-77c4c12db40b tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Action: 'create', calling method: .version_select at 0x7f41786c5820>, body: {"keypair": {"name": "tempest-keypair-1903102010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm8cAW0it7TKRkSrad9sYSVUdvKUDz4UaItWnGwnKM5Ht0CUtfQI94Mr7EzGRf15FLBbhBO+tKtqZVtdr0sS7c0835ay9Zt0rTwyBnbG8hVgNL1xNLf/iCC/c1ark+iww=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:48:59.331501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8998a3a4-a333-4c1c-9623-77c4c12db40b tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Getting quotas for project 6741e5e1d01343dbb0889a1de15d6302. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:48:59.351007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8998a3a4-a333-4c1c-9623-77c4c12db40b tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Getting quotas for user f40f50783d9f417a8f84fab11b0d10d0 and project 6741e5e1d01343dbb0889a1de15d6302. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:48:59.356749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:48:59.382349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:48:59.383267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:48:59.395730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:59.396664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:59.402113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:59.406780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:48:59.407884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:48:59.408585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:48:59.421263 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8998a3a4-a333-4c1c-9623-77c4c12db40b tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154180 Oct 01 20:48:59.446675 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 27/66] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:48:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:48:59.683966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:48:59.699987 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87679c84-b0ce-4581-bd14-a044cd0ceb82 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.320267 Oct 01 20:48:59.702944 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 40/67] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:48:59 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:49:00.745577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:00.747959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:00.773604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:00.774704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:00.776061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:00.779273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:00.781813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:00.784101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:01.192259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:01.210047 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-566fd6e1-f64a-4bac-b4e7-8c76166c76fc tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.488496 Oct 01 20:49:01.215118 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 28/68] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:00 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:02.006785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6791f077-18cc-4935-8ff8-2e51bb1eecd3 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Action: 'create', calling method: .version_select at 0x7f41784484c0>, body: {"keypair": {"name": "tempest-keypair-645196704", "type": "ssh", "user_id": "d6d3ae72992a48709e3d58930ccd6b52", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpvDx8nBKNvr2l/vfehlSJQhdiVFvy7886WOS3Ef86whPPXBa0e4oLgHqcyYOJ70dWM2n12N6lln1JzqWHxZSqGMz5WPxRY0p6Iwd3Ax77HgK6j1SsJIyfDx87dRXYR4g=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:02.091928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6791f077-18cc-4935-8ff8-2e51bb1eecd3 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Getting quotas for project 51f59d1267df48309fe64b4d960720bb. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:02.115254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6791f077-18cc-4935-8ff8-2e51bb1eecd3 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Getting quotas for user 6cbdb512aa12495b96d80f245efb6012 and project 51f59d1267df48309fe64b4d960720bb. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:02.208839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6791f077-18cc-4935-8ff8-2e51bb1eecd3 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 1.271755 Oct 01 20:49:02.211969 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 41/69] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Oct 1 20:49:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1276 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 01 20:49:02.226406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c8468246-fa66-43a7-a2c2-1f87fcab803c tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Action: 'create', calling method: .version_select at 0x7f417848f5e0>, body: {"keypair": {"name": "tempest-keypair-1078925211", "type": "ssh", "user_id": "d6d3ae72992a48709e3d58930ccd6b52", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYf642b3H/bFWvIJF0YTcLrQ0oNIZl4K28g92ixveINy1qMP8iV1Txt5qq27JlELCcqrwoEpU+EzU80+br34NUW5KaUZwmJP1M8hScT0kAziS5IjY/+RJ+Gm4Kre9FjFg=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:02.530629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1945941465", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:02.695560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c8468246-fa66-43a7-a2c2-1f87fcab803c tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Getting quotas for project 51f59d1267df48309fe64b4d960720bb. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:02.700327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c8468246-fa66-43a7-a2c2-1f87fcab803c tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Getting quotas for user 6cbdb512aa12495b96d80f245efb6012 and project 51f59d1267df48309fe64b4d960720bb. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:02.706035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:49:02.764497 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c8468246-fa66-43a7-a2c2-1f87fcab803c tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.541897 Oct 01 20:49:02.769864 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 42/70] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Oct 1 20:49:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 547 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 01 20:49:02.791052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:02.793214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:02.842589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:02.843834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:02.845688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:02.848398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:02.851902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:02.853797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:03.508391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:03.520057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b747188-d524-4328-baea-fbe2ca751b10 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.746588 Oct 01 20:49:03.543025 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 43/71] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:02 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:03.712356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:49:03.712898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:49:03.713308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:49:03.714375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:49:03.714869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:49:03.734741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:03.736664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:03.737327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:03.738270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:03.741441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:03.742455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:03.801857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Getting quotas for project e93dcf30e02b41178c6cde6e50a41e17. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:03.815651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Getting quotas for user 7ef35c15f9d541ac90239c3713f9f5e6 and project e93dcf30e02b41178c6cde6e50a41e17. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:03.843808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:49:03.857027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:49:03.909815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-28151645-b296-4535-9056-7f14ab30f898 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Calling method '.version_select at 0x7f4178468670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:03.918094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28151645-b296-4535-9056-7f14ab30f898 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:03.918813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28151645-b296-4535-9056-7f14ab30f898 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:03.919650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28151645-b296-4535-9056-7f14ab30f898 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:03.921586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28151645-b296-4535-9056-7f14ab30f898 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:03.923417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28151645-b296-4535-9056-7f14ab30f898 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:03.924668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28151645-b296-4535-9056-7f14ab30f898 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:03.961910 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9f0c0b7f-d52c-45b8-b98b-6b5a47d6a2a8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.968518 Oct 01 20:49:03.964440 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 29/72] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:49:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:49:04.001717 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-28151645-b296-4535-9056-7f14ab30f898 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 400 microversion: 2.1 time: 0.457343 Oct 01 20:49:04.007245 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 44/73] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Oct 1 20:49:03 2022] GET /compute/v2.1/os-hosts => generated 400 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:04.022800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d55ffb43-22ef-4dae-8a67-7de9b196843d tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Calling method '.version_select at 0x7f417915ab80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:04.061123 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d55ffb43-22ef-4dae-8a67-7de9b196843d tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-645196704?user_id=d6d3ae72992a48709e3d58930ccd6b52" status: 200 len: 511 microversion: 2.10 time: 0.051330 Oct 01 20:49:04.063469 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 45/74] 10.222.0.17 () {60 vars in 1337 bytes} [Sat Oct 1 20:49:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-645196704?user_id=d6d3ae72992a48709e3d58930ccd6b52 => generated 511 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:04.077487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1754294800", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "1440176315", "adminPass": "***", "networks": [{"uuid": "717cf1be-00b6-4edb-85b1-17a561c83f04"}], "security_groups": [{"name": "tempest-securitygroup--573574117"}], "key_name": "tempest-keypair-1903102010", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:04.346665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Calling method '.version_select at 0x7f41786b6160>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:04.350837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:04.351675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:04.352126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:04.413337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:04.413539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:04.413935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:04.429634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] validate_networks() for [('717cf1be-00b6-4edb-85b1-17a561c83f04', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:49:04.490989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:04.491551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:04.492015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:04.511138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:04.511668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:04.512374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:04.546214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:04.548268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:04.549334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:04.579477 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cee2a0f1-a869-438d-9596-9147601abc60 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.613839 Oct 01 20:49:04.581916 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 30/75] 10.222.0.17 () {60 vars in 1243 bytes} [Sat Oct 1 20:49:03 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:04.595322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a4794362-4461-4553-a77f-a6b49b92a215 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:04.595976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a4794362-4461-4553-a77f-a6b49b92a215 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:04.836109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a4794362-4461-4553-a77f-a6b49b92a215 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:04.852057 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a4794362-4461-4553-a77f-a6b49b92a215 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1220 microversion: 2.1 time: 0.267870 Oct 01 20:49:04.852822 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 31/76] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:04 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1220 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:05.420575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89772cf5-0216-42a0-8cc2-c80513b3c2ed tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Calling method '.version_select at 0x7f417865f5e0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:05.431848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-89772cf5-0216-42a0-8cc2-c80513b3c2ed tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '35e45ec47cd648649829660999769d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b331e32eb5964145bde96b9dce962819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89772cf5-0216-42a0-8cc2-c80513b3c2ed tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Request method failure captured: Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe5GHk7LBgBLH0buUkox6wqVRxxj9VwTrETUF5OLqmmeZxPgyHyCrMnLhv5W_tNHlo3EFBoDMzd2tw4xCOUMT6OR3t8aWusTX4CUvKIH2BhT-Lhdc0K9rbfruoT9Wtf-NTdJ5nBorANYZAIx47MLL-GA1Vo15eH75Ky72uh61oSdk4 Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:05.436356 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b331e32eb5964145bde96b9dce962819", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b331e32eb5964145bde96b9dce962819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}] Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35e45ec47cd648649829660999769d0c Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: action_args: {} Oct 01 20:49:05.437720 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:05.438460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 01 20:49:05.439701 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:05.442710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89772cf5-0216-42a0-8cc2-c80513b3c2ed tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:05.449676 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-89772cf5-0216-42a0-8cc2-c80513b3c2ed tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.594326 Oct 01 20:49:05.450611 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 32/77] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Oct 1 20:49:04 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 597 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:05.461910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dc8e6958-5b2e-4e8c-91de-0551450b6a1f tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Action: 'create', calling method: .version_select at 0x7f4178727820>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-458309312", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhRgR4jsHe+ifi2bra/MWwJS7rWMdptPlNaHhuCTaCbE90m4KX3WDceAEGpH1guOQWo+o6r2nrtR5KphoGeVMaono7ekrjG+XSoP9fMf9ismL73F8T9e7qZBjZyDy89ow=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:05.502440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-dc8e6958-5b2e-4e8c-91de-0551450b6a1f tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Getting quotas for project 51f59d1267df48309fe64b4d960720bb. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:05.508695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-dc8e6958-5b2e-4e8c-91de-0551450b6a1f tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Getting quotas for user 6cbdb512aa12495b96d80f245efb6012 and project 51f59d1267df48309fe64b4d960720bb. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:05.543888 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dc8e6958-5b2e-4e8c-91de-0551450b6a1f tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.091810 Oct 01 20:49:05.553532 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 33/78] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Oct 1 20:49:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 01 20:49:05.664700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-59d953e5-a087-46a6-973b-6db24c1dddb0 req-bbca4d58-edb2-4677-9be0-a423f315e741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58df1e80-a139-4db6-82ac-a57e15ac2153", "tag": "e6d8d0f0-0257-41fb-9a76-0fd1ce638fe6"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:05.695021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-59d953e5-a087-46a6-973b-6db24c1dddb0 req-bbca4d58-edb2-4677-9be0-a423f315e741 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:05.697052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-59d953e5-a087-46a6-973b-6db24c1dddb0 req-bbca4d58-edb2-4677-9be0-a423f315e741 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:05.697774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-59d953e5-a087-46a6-973b-6db24c1dddb0 req-bbca4d58-edb2-4677-9be0-a423f315e741 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:05.723457 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-59d953e5-a087-46a6-973b-6db24c1dddb0 req-bbca4d58-edb2-4677-9be0-a423f315e741 service nova] Creating event network-changed:e6d8d0f0-0257-41fb-9a76-0fd1ce638fe6 for instance 58df1e80-a139-4db6-82ac-a57e15ac2153 on nch1-master-1 Oct 01 20:49:05.724663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-59d953e5-a087-46a6-973b-6db24c1dddb0 req-bbca4d58-edb2-4677-9be0-a423f315e741 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:49:05.725365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-59d953e5-a087-46a6-973b-6db24c1dddb0 req-bbca4d58-edb2-4677-9be0-a423f315e741 service nova] Acquired lock "compute-rpcapi-router" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:49:05.726744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6ecdde9-b132-4bfb-9851-e2f5b9ea6cea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:05.727475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6ecdde9-b132-4bfb-9851-e2f5b9ea6cea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:05.728206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6ecdde9-b132-4bfb-9851-e2f5b9ea6cea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:05.729335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6ecdde9-b132-4bfb-9851-e2f5b9ea6cea None None] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:05.730033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6ecdde9-b132-4bfb-9851-e2f5b9ea6cea None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:05.730799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6ecdde9-b132-4bfb-9851-e2f5b9ea6cea None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:05.741619 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.compute.rpcapi [None req-f6ecdde9-b132-4bfb-9851-e2f5b9ea6cea None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 01 20:49:05.744639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6ecdde9-b132-4bfb-9851-e2f5b9ea6cea None None] Releasing lock "compute-rpcapi-router" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:49:05.773516 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f6ecdde9-b132-4bfb-9851-e2f5b9ea6cea None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213690 Oct 01 20:49:05.774009 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 34/79] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:05.784834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:05.786015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:05.797764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:05.800267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:05.800867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:05.801674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:05.802145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:05.802812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.057267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:06.066292 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-214cddfe-42a9-48f9-86b0-caa84df66c7d tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.289366 Oct 01 20:49:06.067147 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 35/80] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:05 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:06.071686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Calling method '.version_select at 0x7f417865f550>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.075982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.076902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.076902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.084542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:49:06.085095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:49:06.085520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:49:06.085941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:49:06.086361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:49:06.091500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.091989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.092428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.096045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.096532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.096972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.097707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.098171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.098701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.110723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.111208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.111640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.121423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Getting quotas for project 6741e5e1d01343dbb0889a1de15d6302. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:06.121650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.122128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.122591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.123674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:06.126047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Getting quotas for user f40f50783d9f417a8f84fab11b0d10d0 and project 6741e5e1d01343dbb0889a1de15d6302. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:06.140239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:49:06.142211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.142761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.143089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:49:06.143219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.149210 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3942228e-b025-4c2c-831a-d4101df560f9 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.081114 Oct 01 20:49:06.149791 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 36/81] 10.222.0.17 () {60 vars in 1222 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:06.203479 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eab7a5dc-901d-4793-9ab3-ce7344a23f8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.137964 Oct 01 20:49:06.204074 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 46/82] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:49:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:49:06.211915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a7379c5-5bdc-4647-9371-bc113f7b9141 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Calling method '.version_select at 0x7f4178448e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.213129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-364e1372-e8be-4ca1-bcf8-cc454c21910c tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2000919381", "ram": 512, "vcpus": 1, "disk": 10, "id": 1747187802, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:06.213879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a7379c5-5bdc-4647-9371-bc113f7b9141 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '35e45ec47cd648649829660999769d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b331e32eb5964145bde96b9dce962819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a7379c5-5bdc-4647-9371-bc113f7b9141 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Request method failure captured: Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKe5GHk7LBgBLH0buUkox6wqVRxxj9VwTrETUF5OLqmmeZxPgyHyCrMnLhv5W_tNHlo3EFBoDMzd2tw4xCOUMT6OR3t8aWusTX4CUvKIH2BhT-Lhdc0K9rbfruoT9Wtf-NTdJ5nBorANYZAIx47MLL-GA1Vo15eH75Ky72uh61oSdk4 Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:06.216009 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b331e32eb5964145bde96b9dce962819", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b331e32eb5964145bde96b9dce962819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}] Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 35e45ec47cd648649829660999769d0c Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'ncdv-master-1'} Oct 01 20:49:06.217192 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:06.217894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 01 20:49:06.218954 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.219891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a7379c5-5bdc-4647-9371-bc113f7b9141 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.219891 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a7379c5-5bdc-4647-9371-bc113f7b9141 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.012046 Oct 01 20:49:06.223445 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 47/83] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:06.228640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb89881d-a08f-4fc1-8c10-fb5eb559aea6 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Calling method '.version_select at 0x7f417840ae50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.232599 ncdv-master-1 devstack@n-api.service[140438]: WARNING oslo_db.sqlalchemy.utils [None req-eb89881d-a08f-4fc1-8c10-fb5eb559aea6 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 01 20:49:06.235630 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-364e1372-e8be-4ca1-bcf8-cc454c21910c tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.084756 Oct 01 20:49:06.236413 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 37/84] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:49:06 2022] POST /compute/v2.1/flavors => generated 416 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:06.241067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.241688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:06.248126 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb89881d-a08f-4fc1-8c10-fb5eb559aea6 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] 10.222.0.17 "GET /compute/v2.1/os-keypairs?user_id=d6d3ae72992a48709e3d58930ccd6b52" status: 200 len: 725 microversion: 2.10 time: 0.023678 Oct 01 20:49:06.254587 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 48/85] 10.222.0.17 () {60 vars in 1259 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-keypairs?user_id=d6d3ae72992a48709e3d58930ccd6b52 => generated 725 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:06.254746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.254746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.254746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.254746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.255280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.255280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.267534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0632b9f9-15db-4654-a358-8ec1a42ab4e1 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Calling method '.version_select at 0x7f417840a700>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.271089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0632b9f9-15db-4654-a358-8ec1a42ab4e1 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.272247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0632b9f9-15db-4654-a358-8ec1a42ab4e1 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.272699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0632b9f9-15db-4654-a358-8ec1a42ab4e1 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.306963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0632b9f9-15db-4654-a358-8ec1a42ab4e1 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:06.306963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0632b9f9-15db-4654-a358-8ec1a42ab4e1 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:06.306963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0632b9f9-15db-4654-a358-8ec1a42ab4e1 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:06.317275 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0632b9f9-15db-4654-a358-8ec1a42ab4e1 tempest-HypervisorAdminV253TestBase-36884548 tempest-HypervisorAdminV253TestBase-36884548-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/3c7ee482-8a7f-402e-8c42-cdc3743fa3ea" status: 200 len: 792 microversion: 2.53 time: 0.066582 Oct 01 20:49:06.318063 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 49/86] 10.222.0.17 () {60 vars in 1298 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hypervisors/3c7ee482-8a7f-402e-8c42-cdc3743fa3ea => generated 792 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:06.324235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2122865d-fdbb-43f2-a1e6-1a0aebd39c02 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.325453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2122865d-fdbb-43f2-a1e6-1a0aebd39c02 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:06.389149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:06.397521 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b882906c-6d59-4bea-b2e5-51736dde7913 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1272 microversion: 2.1 time: 0.160251 Oct 01 20:49:06.411177 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 38/87] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:06.421490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2122865d-fdbb-43f2-a1e6-1a0aebd39c02 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:06.421626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f210f6cc-ab95-458f-a5d7-aa8f77a57038 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Calling method '.version_select at 0x7f41786c5820>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.437005 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-f210f6cc-ab95-458f-a5d7-aa8f77a57038 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f210f6cc-ab95-458f-a5d7-aa8f77a57038 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Request method failure captured: Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe-qtx7NlHOiIfNxgBjbliU8m1opiHwLZiwx1Pj3Sgi5S-Qks_t1W_Q36zfiQr3zW4517etqCBtFEK3jIuBPSFRovqczNIpuU60drmJZBBaffMf_10z_a2EumCknZcQ2IlLG2eKgw9Ya0ZY9-qbiL3mJDzM8ZwycLePs3nnukIGlsQ Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:06.445497 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_479f3dd136484b2f8cf66d951ce0ee58", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}] Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e27033a708c40c8b262464105e126e6 Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'nonexistent_hostname'} Oct 01 20:49:06.446664 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:06.448423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 01 20:49:06.449500 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.450976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f210f6cc-ab95-458f-a5d7-aa8f77a57038 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.451658 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2122865d-fdbb-43f2-a1e6-1a0aebd39c02 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1265 microversion: 2.1 time: 0.127204 Oct 01 20:49:06.451658 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 50/88] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:06.451799 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f210f6cc-ab95-458f-a5d7-aa8f77a57038 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.035687 Oct 01 20:49:06.456874 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 39/89] 10.222.0.17 () {58 vars in 1212 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:06.467779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2d084171-f061-47d5-89f9-9fb17c75ebb7 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Calling method '.version_select at 0x7f41784b4a60>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.525169 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2d084171-f061-47d5-89f9-9fb17c75ebb7 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-458309312" status: 204 len: 0 microversion: 2.10 time: 0.066822 Oct 01 20:49:06.526991 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 40/90] 10.222.0.17 () {60 vars in 1322 bytes} [Sat Oct 1 20:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-458309312 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:49:06.533794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8a0b7f87-b360-4120-ab5e-ced4d4afedd6 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Calling method '.version_select at 0x7f41786b6c10>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.538892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8a0b7f87-b360-4120-ab5e-ced4d4afedd6 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '35e45ec47cd648649829660999769d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b331e32eb5964145bde96b9dce962819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8a0b7f87-b360-4120-ab5e-ced4d4afedd6 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Request method failure captured: Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe5GHk7LBgBLH0buUkox6wqVRxxj9VwTrETUF5OLqmmeZxPgyHyCrMnLhv5W_tNHlo3EFBoDMzd2tw4xCOUMT6OR3t8aWusTX4CUvKIH2BhT-Lhdc0K9rbfruoT9Wtf-NTdJ5nBorANYZAIx47MLL-GA1Vo15eH75Ky72uh61oSdk4 Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:06.544964 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b331e32eb5964145bde96b9dce962819", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b331e32eb5964145bde96b9dce962819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}] Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35e45ec47cd648649829660999769d0c Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ncdv-master-1'} Oct 01 20:49:06.546074 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:06.546808 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 01 20:49:06.547777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.550881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8a0b7f87-b360-4120-ab5e-ced4d4afedd6 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.552022 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8a0b7f87-b360-4120-ab5e-ced4d4afedd6 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.023969 Oct 01 20:49:06.559305 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 41/91] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:06.565190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89f41d08-c322-4f5b-bbee-10d700ce5413 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Calling method '.version_select at 0x7f41784e6d30>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.585204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:06.601609 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-89f41d08-c322-4f5b-bbee-10d700ce5413 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078925211?user_id=d6d3ae72992a48709e3d58930ccd6b52" status: 204 len: 0 microversion: 2.10 time: 0.039878 Oct 01 20:49:06.607144 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 42/92] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Oct 1 20:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078925211?user_id=d6d3ae72992a48709e3d58930ccd6b52 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:49:06.616628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0d232698-360d-4d71-ac8d-e36048684e57 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Calling method '.version_select at 0x7f41784e7b80>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.626716 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-0d232698-360d-4d71-ac8d-e36048684e57 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0d232698-360d-4d71-ac8d-e36048684e57 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Request method failure captured: Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe-qtx7NlHOiIfNxgBjbliU8m1opiHwLZiwx1Pj3Sgi5S-Qks_t1W_Q36zfiQr3zW4517etqCBtFEK3jIuBPSFRovqczNIpuU60drmJZBBaffMf_10z_a2EumCknZcQ2IlLG2eKgw9Ya0ZY9-qbiL3mJDzM8ZwycLePs3nnukIGlsQ Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:06.629049 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_479f3dd136484b2f8cf66d951ce0ee58", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}] Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e27033a708c40c8b262464105e126e6 Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'nonexistent_hostname'} Oct 01 20:49:06.630200 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.631044 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.631977 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.634368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0d232698-360d-4d71-ac8d-e36048684e57 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.636597 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0d232698-360d-4d71-ac8d-e36048684e57 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.026785 Oct 01 20:49:06.637422 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 43/93] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:06.650281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f107d48e-a304-47b1-a42b-c814c57b7fe7 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] Calling method '.version_select at 0x7f41784e6940>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.702766 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f107d48e-a304-47b1-a42b-c814c57b7fe7 tempest-KeyPairsV210TestJSON-1061345841 tempest-KeyPairsV210TestJSON-1061345841-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645196704?user_id=d6d3ae72992a48709e3d58930ccd6b52" status: 204 len: 0 microversion: 2.10 time: 0.063934 Oct 01 20:49:06.716201 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 44/94] 10.222.0.17 () {60 vars in 1340 bytes} [Sat Oct 1 20:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645196704?user_id=d6d3ae72992a48709e3d58930ccd6b52 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:49:06.725345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb236113-6f59-4be8-89f0-59ecec09fddc tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.739548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-08e346a2-31ee-481a-963b-51fc835e4ffa tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Calling method '.version_select at 0x7f41784b4940>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.744205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-08e346a2-31ee-481a-963b-51fc835e4ffa tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '35e45ec47cd648649829660999769d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b331e32eb5964145bde96b9dce962819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-08e346a2-31ee-481a-963b-51fc835e4ffa tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Request method failure captured: Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe5GHk7LBgBLH0buUkox6wqVRxxj9VwTrETUF5OLqmmeZxPgyHyCrMnLhv5W_tNHlo3EFBoDMzd2tw4xCOUMT6OR3t8aWusTX4CUvKIH2BhT-Lhdc0K9rbfruoT9Wtf-NTdJ5nBorANYZAIx47MLL-GA1Vo15eH75Ky72uh61oSdk4 Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:06.749897 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b331e32eb5964145bde96b9dce962819", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b331e32eb5964145bde96b9dce962819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}] Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35e45ec47cd648649829660999769d0c Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ncdv-master-1'} Oct 01 20:49:06.752715 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:06.753525 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 01 20:49:06.754735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.755802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-08e346a2-31ee-481a-963b-51fc835e4ffa tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.756387 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-08e346a2-31ee-481a-963b-51fc835e4ffa tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.039007 Oct 01 20:49:06.763618 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 45/95] 10.222.0.17 () {58 vars in 1197 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:06.766924 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-bb236113-6f59-4be8-89f0-59ecec09fddc tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] HTTP exception thrown: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb236113-6f59-4be8-89f0-59ecec09fddc tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Request method failure captured: Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/flavors/1747187802/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKe_YCSdESPB0L5dxs_cV5LqcvMTSaRRivHhHuFR6sI08RMSfpHRfi0sLGfAu2IlG2PliQDG-zlAWSifjLxDfEdXzy7zARTyf2LpD7oiRlCyC33J_pNgXMa-3jCrU8AOU758Vmo6LeQ-IDJDEGENlVzrqPlliiGxgVdOLsWs2FfnhBI Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9e5c6bc240b64b589182038270f9f088 Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:06.772410 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e5c6bc240b64b589182038270f9f088", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e5c6bc240b64b589182038270f9f088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e5c6bc240b64b589182038270f9f088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e5c6bc240b64b589182038270f9f088"}]}] Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9e5c6bc240b64b589182038270f9f088 Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7a686affea6c4a75a559464b1bd7abac Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:06.773785 ncdv-master-1 devstack@n-api.service[140438]: exception: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'flavor_id': '1747187802', 'id': 'hw:cpu_thread_policy'} Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.774893 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.777278 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.777278 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.777278 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.777278 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:06.777278 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:06.777278 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. Oct 01 20:49:06.777278 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.777278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb236113-6f59-4be8-89f0-59ecec09fddc tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Returning 404 to user: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.777278 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bb236113-6f59-4be8-89f0-59ecec09fddc tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] 10.222.0.17 "GET /compute/v2.1/flavors/1747187802/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.327033 Oct 01 20:49:06.779173 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 51/96] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/flavors/1747187802/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:06.784851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6706c60d-5c81-4130-9cfd-12f1e5ad8a84 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Calling method '.version_select at 0x7f417865faf0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.793380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b9bf906-3f80-4cd6-8585-9d4a1d314bf3 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:06.793639 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-6706c60d-5c81-4130-9cfd-12f1e5ad8a84 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6706c60d-5c81-4130-9cfd-12f1e5ad8a84 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Request method failure captured: Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe-qtx7NlHOiIfNxgBjbliU8m1opiHwLZiwx1Pj3Sgi5S-Qks_t1W_Q36zfiQr3zW4517etqCBtFEK3jIuBPSFRovqczNIpuU60drmJZBBaffMf_10z_a2EumCknZcQ2IlLG2eKgw9Ya0ZY9-qbiL3mJDzM8ZwycLePs3nnukIGlsQ Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:06.795660 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_479f3dd136484b2f8cf66d951ce0ee58", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}] Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e27033a708c40c8b262464105e126e6 Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'nonexistent_hostname'} Oct 01 20:49:06.796804 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:06.797453 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 01 20:49:06.799047 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.800068 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.802277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6706c60d-5c81-4130-9cfd-12f1e5ad8a84 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.803473 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6706c60d-5c81-4130-9cfd-12f1e5ad8a84 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.038499 Oct 01 20:49:06.804720 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 46/97] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:06.807001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4b9bf906-3f80-4cd6-8585-9d4a1d314bf3 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '7a686affea6c4a75a559464b1bd7abac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5c6bc240b64b589182038270f9f088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b9bf906-3f80-4cd6-8585-9d4a1d314bf3 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Request method failure captured: Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/flavors/1747187802/os-extra_specs HTTP/1.1 Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 66 Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKe_YCSdESPB0L5dxs_cV5LqcvMTSaRRivHhHuFR6sI08RMSfpHRfi0sLGfAu2IlG2PliQDG-zlAWSifjLxDfEdXzy7zARTyf2LpD7oiRlCyC33J_pNgXMa-3jCrU8AOU758Vmo6LeQ-IDJDEGENlVzrqPlliiGxgVdOLsWs2FfnhBI Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9e5c6bc240b64b589182038270f9f088 Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:06.808433 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e5c6bc240b64b589182038270f9f088", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e5c6bc240b64b589182038270f9f088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e5c6bc240b64b589182038270f9f088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e5c6bc240b64b589182038270f9f088"}]}] Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9e5c6bc240b64b589182038270f9f088 Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7a686affea6c4a75a559464b1bd7abac Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 01 20:49:06.809632 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'flavor_id': '1747187802', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:06.810343 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 01 20:49:06.811535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.812535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b9bf906-3f80-4cd6-8585-9d4a1d314bf3 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.812535 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b9bf906-3f80-4cd6-8585-9d4a1d314bf3 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] 10.222.0.17 "POST /compute/v2.1/flavors/1747187802/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.025857 Oct 01 20:49:06.812535 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 52/98] 10.222.0.17 () {60 vars in 1224 bytes} [Sat Oct 1 20:49:06 2022] POST /compute/v2.1/flavors/1747187802/os-extra_specs => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:06.819801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b4dce92-a38f-481b-8eec-e31e8685ed93 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Calling method '.version_select at 0x7f41784e63a0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.823413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0b4dce92-a38f-481b-8eec-e31e8685ed93 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '35e45ec47cd648649829660999769d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b331e32eb5964145bde96b9dce962819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b4dce92-a38f-481b-8eec-e31e8685ed93 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Request method failure captured: Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe5GHk7LBgBLH0buUkox6wqVRxxj9VwTrETUF5OLqmmeZxPgyHyCrMnLhv5W_tNHlo3EFBoDMzd2tw4xCOUMT6OR3t8aWusTX4CUvKIH2BhT-Lhdc0K9rbfruoT9Wtf-NTdJ5nBorANYZAIx47MLL-GA1Vo15eH75Ky72uh61oSdk4 Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:06.825658 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b331e32eb5964145bde96b9dce962819", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b331e32eb5964145bde96b9dce962819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}] Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35e45ec47cd648649829660999769d0c Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ncdv-master-1'} Oct 01 20:49:06.827039 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:06.828015 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 01 20:49:06.829074 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.830083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dd618216-939d-41d7-8e52-047ff9a1e427 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:06.832113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b4dce92-a38f-481b-8eec-e31e8685ed93 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.834049 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b4dce92-a38f-481b-8eec-e31e8685ed93 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.019090 Oct 01 20:49:06.839592 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 47/99] 10.222.0.17 () {58 vars in 1194 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:06.865777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d0edde52-4e12-4a8c-9201-1d0834ff9e01 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Calling method '.version_select at 0x7f41784e7160>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.907356 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-d0edde52-4e12-4a8c-9201-1d0834ff9e01 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.916039 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dd618216-939d-41d7-8e52-047ff9a1e427 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1747187802/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.095619 Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d0edde52-4e12-4a8c-9201-1d0834ff9e01 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Request method failure captured: Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe-qtx7NlHOiIfNxgBjbliU8m1opiHwLZiwx1Pj3Sgi5S-Qks_t1W_Q36zfiQr3zW4517etqCBtFEK3jIuBPSFRovqczNIpuU60drmJZBBaffMf_10z_a2EumCknZcQ2IlLG2eKgw9Ya0ZY9-qbiL3mJDzM8ZwycLePs3nnukIGlsQ Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:06.916307 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_479f3dd136484b2f8cf66d951ce0ee58", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}] Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e27033a708c40c8b262464105e126e6 Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'nonexistent_hostname'} Oct 01 20:49:06.918001 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:06.918869 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 01 20:49:06.921511 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d0edde52-4e12-4a8c-9201-1d0834ff9e01 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d0edde52-4e12-4a8c-9201-1d0834ff9e01 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.073139 Oct 01 20:49:06.922578 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 48/100] 10.222.0.17 () {58 vars in 1215 bytes} [Sat Oct 1 20:49:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 01 20:49:06.927352 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 53/101] 10.222.0.17 () {60 vars in 1224 bytes} [Sat Oct 1 20:49:06 2022] POST /compute/v2.1/flavors/1747187802/os-extra_specs => generated 66 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:49:06.931284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff95d75f-8fc1-44c4-a13a-729edbe0e0ad tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Action: 'update', calling method: .version_select at 0x7f41784e6a60>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:06.945106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0752345-355f-44bb-81bb-9096a8b336aa tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff95d75f-8fc1-44c4-a13a-729edbe0e0ad tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Request method failure captured: Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 51 Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe-qtx7NlHOiIfNxgBjbliU8m1opiHwLZiwx1Pj3Sgi5S-Qks_t1W_Q36zfiQr3zW4517etqCBtFEK3jIuBPSFRovqczNIpuU60drmJZBBaffMf_10z_a2EumCknZcQ2IlLG2eKgw9Ya0ZY9-qbiL3mJDzM8ZwycLePs3nnukIGlsQ Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:06.950009 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_479f3dd136484b2f8cf66d951ce0ee58", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}] Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e27033a708c40c8b262464105e126e6 Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: {"status": "enable", "maintenance_mode": "invalid"} Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:06.952003 ncdv-master-1 devstack@n-api.service[140437]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'disable', Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'Enable', Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'Disable', Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi On instance: Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'invalid' Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.952692 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.954057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.955204 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.955204 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:49:06.955204 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:49:06.955204 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 01 20:49:06.955204 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.955204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff95d75f-8fc1-44c4-a13a-729edbe0e0ad tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.955204 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ff95d75f-8fc1-44c4-a13a-729edbe0e0ad tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.026747 Oct 01 20:49:06.955204 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 49/102] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Oct 1 20:49:06 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:49:06.956489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f0752345-355f-44bb-81bb-9096a8b336aa tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '7a686affea6c4a75a559464b1bd7abac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5c6bc240b64b589182038270f9f088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0752345-355f-44bb-81bb-9096a8b336aa tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Request method failure captured: Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKe_YCSdESPB0L5dxs_cV5LqcvMTSaRRivHhHuFR6sI08RMSfpHRfi0sLGfAu2IlG2PliQDG-zlAWSifjLxDfEdXzy7zARTyf2LpD7oiRlCyC33J_pNgXMa-3jCrU8AOU758Vmo6LeQ-IDJDEGENlVzrqPlliiGxgVdOLsWs2FfnhBI Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9e5c6bc240b64b589182038270f9f088 Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:06.956921 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e5c6bc240b64b589182038270f9f088", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e5c6bc240b64b589182038270f9f088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e5c6bc240b64b589182038270f9f088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e5c6bc240b64b589182038270f9f088"}]}] Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9e5c6bc240b64b589182038270f9f088 Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7a686affea6c4a75a559464b1bd7abac Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:06.958473 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'flavor_id': '1747187802', 'id': 'hw:numa_nodes'} Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:06.959267 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:06.961119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0752345-355f-44bb-81bb-9096a8b336aa tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:06.964275 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f0752345-355f-44bb-81bb-9096a8b336aa tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] 10.222.0.17 "DELETE /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022131 Oct 01 20:49:06.968549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-246b95d5-5244-40a9-887b-cb96fbd292e9 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Action: 'update', calling method: .version_select at 0x7f41784e74c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:06.969720 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 54/103] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 20:49:06 2022] DELETE /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:06.999458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76404f26-46f1-4ae8-b389-bd550d327a92 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-246b95d5-5244-40a9-887b-cb96fbd292e9 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Request method failure captured: Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 51 Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe-qtx7NlHOiIfNxgBjbliU8m1opiHwLZiwx1Pj3Sgi5S-Qks_t1W_Q36zfiQr3zW4517etqCBtFEK3jIuBPSFRovqczNIpuU60drmJZBBaffMf_10z_a2EumCknZcQ2IlLG2eKgw9Ya0ZY9-qbiL3mJDzM8ZwycLePs3nnukIGlsQ Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:07.007549 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_479f3dd136484b2f8cf66d951ce0ee58", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}] Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e27033a708c40c8b262464105e126e6 Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: {"status": "invalid", "maintenance_mode": "enable"} Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:07.008685 ncdv-master-1 devstack@n-api.service[140437]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'disable', Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'Enable', Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'Disable', Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi On instance: Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'invalid' Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.009372 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.011752 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.014272 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.014272 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:49:07.014272 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:49:07.014272 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 01 20:49:07.014272 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.014272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-246b95d5-5244-40a9-887b-cb96fbd292e9 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:07.018737 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-246b95d5-5244-40a9-887b-cb96fbd292e9 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.056043 Oct 01 20:49:07.018737 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 50/104] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Oct 1 20:49:06 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:49:07.033209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d05f4215-945a-4be3-aa87-e731d35dc563 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Action: 'update', calling method: .version_select at 0x7f41784b45e0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:07.045215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d05f4215-945a-4be3-aa87-e731d35dc563 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '35e45ec47cd648649829660999769d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b331e32eb5964145bde96b9dce962819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d05f4215-945a-4be3-aa87-e731d35dc563 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Request method failure captured: Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 50 Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe5GHk7LBgBLH0buUkox6wqVRxxj9VwTrETUF5OLqmmeZxPgyHyCrMnLhv5W_tNHlo3EFBoDMzd2tw4xCOUMT6OR3t8aWusTX4CUvKIH2BhT-Lhdc0K9rbfruoT9Wtf-NTdJ5nBorANYZAIx47MLL-GA1Vo15eH75Ky72uh61oSdk4 Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:07.047019 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b331e32eb5964145bde96b9dce962819", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b331e32eb5964145bde96b9dce962819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b331e32eb5964145bde96b9dce962819"}]}] Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: b331e32eb5964145bde96b9dce962819 Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2056599995 Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35e45ec47cd648649829660999769d0c Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2056599995-project Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: {"status": "enable", "maintenance_mode": "enable"} Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 01 20:49:07.048351 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:07.049956 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 01 20:49:07.051198 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.053936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d05f4215-945a-4be3-aa87-e731d35dc563 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:07.055010 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d05f4215-945a-4be3-aa87-e731d35dc563 tempest-HostsAdminNegativeTestJSON-2056599995 tempest-HostsAdminNegativeTestJSON-2056599995-project] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.026067 Oct 01 20:49:07.059477 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 51/105] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Oct 1 20:49:07 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:07.080665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-91a8c75f-4f6c-48c6-9644-1cd4784b64e2 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Action: 'update', calling method: .version_select at 0x7f4178600af0>, body: {"status": null, "maintenance_mode": null} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:07.086118 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76404f26-46f1-4ae8-b389-bd550d327a92 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1747187802/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.102584 Oct 01 20:49:07.096470 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 55/106] 10.222.0.17 () {60 vars in 1224 bytes} [Sat Oct 1 20:49:06 2022] POST /compute/v2.1/flavors/1747187802/os-extra_specs => generated 66 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-91a8c75f-4f6c-48c6-9644-1cd4784b64e2 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Request method failure captured: Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 42 Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe-qtx7NlHOiIfNxgBjbliU8m1opiHwLZiwx1Pj3Sgi5S-Qks_t1W_Q36zfiQr3zW4517etqCBtFEK3jIuBPSFRovqczNIpuU60drmJZBBaffMf_10z_a2EumCknZcQ2IlLG2eKgw9Ya0ZY9-qbiL3mJDzM8ZwycLePs3nnukIGlsQ Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:07.098964 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_479f3dd136484b2f8cf66d951ce0ee58", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}] Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e27033a708c40c8b262464105e126e6 Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: {"status": null, "maintenance_mode": null} Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 01 20:49:07.100121 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'disable', Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'Enable', Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'Disable', Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi On instance: Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi None Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.100958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.102369 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.105961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:49:07.105961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:49:07.105961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 01 20:49:07.105961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.105961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-91a8c75f-4f6c-48c6-9644-1cd4784b64e2 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:07.108145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:07.108775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:07.110319 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-91a8c75f-4f6c-48c6-9644-1cd4784b64e2 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.046112 Oct 01 20:49:07.110938 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 52/107] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Oct 1 20:49:07 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 01 20:49:07.118902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f805b50-1693-4e13-9d7d-332473e75d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:07.136542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:07.142198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1f805b50-1693-4e13-9d7d-332473e75d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '7a686affea6c4a75a559464b1bd7abac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5c6bc240b64b589182038270f9f088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:07.143366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:07.147624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:07.150685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:07.157601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:07.159105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f805b50-1693-4e13-9d7d-332473e75d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Request method failure captured: Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 22 Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe_YCSdESPB0L5dxs_cV5LqcvMTSaRRivHhHuFR6sI08RMSfpHRfi0sLGfAu2IlG2PliQDG-zlAWSifjLxDfEdXzy7zARTyf2LpD7oiRlCyC33J_pNgXMa-3jCrU8AOU758Vmo6LeQ-IDJDEGENlVzrqPlliiGxgVdOLsWs2FfnhBI Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9e5c6bc240b64b589182038270f9f088 Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:07.161449 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e5c6bc240b64b589182038270f9f088", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e5c6bc240b64b589182038270f9f088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e5c6bc240b64b589182038270f9f088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e5c6bc240b64b589182038270f9f088"}]}] Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9e5c6bc240b64b589182038270f9f088 Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 7a686affea6c4a75a559464b1bd7abac Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: {"hw:numa_nodes": "1"} Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:07.162660 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'flavor_id': '1747187802', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:07.163421 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 01 20:49:07.164443 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.166388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f805b50-1693-4e13-9d7d-332473e75d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:07.170605 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1f805b50-1693-4e13-9d7d-332473e75d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850 tempest-FlavorsExtraSpecsNegativeTestJSON-1640473850-project] 10.222.0.17 "PUT /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.055499 Oct 01 20:49:07.171244 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 53/108] 10.222.0.17 () {60 vars in 1265 bytes} [Sat Oct 1 20:49:07 2022] PUT /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes => generated 124 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:07.211229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e7e92814-3aae-49e6-bf98-63e0e247d046 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Action: 'update', calling method: .version_select at 0x7f417865f040>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:07.228974 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.hosts [None req-e7e92814-3aae-49e6-bf98-63e0e247d046 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Enabling host nonexistent_hostname. Oct 01 20:49:07.259089 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-e7e92814-3aae-49e6-bf98-63e0e247d046 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e7e92814-3aae-49e6-bf98-63e0e247d046 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Request method failure captured: Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 50 Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe-qtx7NlHOiIfNxgBjbliU8m1opiHwLZiwx1Pj3Sgi5S-Qks_t1W_Q36zfiQr3zW4517etqCBtFEK3jIuBPSFRovqczNIpuU60drmJZBBaffMf_10z_a2EumCknZcQ2IlLG2eKgw9Ya0ZY9-qbiL3mJDzM8ZwycLePs3nnukIGlsQ Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:07.266362 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_479f3dd136484b2f8cf66d951ce0ee58", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/479f3dd136484b2f8cf66d951ce0ee58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/479f3dd136484b2f8cf66d951ce0ee58"}]}] Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 479f3dd136484b2f8cf66d951ce0ee58 Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1275701448 Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e27033a708c40c8b262464105e126e6 Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1275701448-project-admin Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: {"status": "enable", "maintenance_mode": "enable"} Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:07.267781 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 01 20:49:07.268689 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:07.270263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 01 20:49:07.271735 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.275123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e7e92814-3aae-49e6-bf98-63e0e247d046 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:07.278740 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e7e92814-3aae-49e6-bf98-63e0e247d046 tempest-HostsAdminNegativeTestJSON-1275701448 tempest-HostsAdminNegativeTestJSON-1275701448-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.102571 Oct 01 20:49:07.283840 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 54/109] 10.222.0.17 () {60 vars in 1211 bytes} [Sat Oct 1 20:49:07 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:07.300075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3abc449e-be36-4f66-ae1c-a3ca67a408bd tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:07.319820 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-3abc449e-be36-4f66-ae1c-a3ca67a408bd tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] HTTP exception thrown: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3abc449e-be36-4f66-ae1c-a3ca67a408bd tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Request method failure captured: Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/flavors/1747187802/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfAyjpFEQ__9_eJyEfGCnJxBT3aWSGrzSLWkbl1AlZHJ88QPTfALOdHzhLrv1S_qO5Va9yAUPnt2k4gN0dU5fTwFuDwm0enYF4CGyEcKNp_QIqUWkpqSIVEaCi_UDE95FSql4OQnxRpUURsauDLNXUEfaTt1vKKxTMaQY_TKS3-UBo Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 6de3b6487f874ce2a574f1ff93b7fb06 Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:07.322107 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6de3b6487f874ce2a574f1ff93b7fb06", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6de3b6487f874ce2a574f1ff93b7fb06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6de3b6487f874ce2a574f1ff93b7fb06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6de3b6487f874ce2a574f1ff93b7fb06"}]}] Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 6de3b6487f874ce2a574f1ff93b7fb06 Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f21b913012c84275bf815435145d15a9 Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:07.323980 ncdv-master-1 devstack@n-api.service[140437]: exception: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'flavor_id': '1747187802', 'id': 'hw:cpu_thread_policy'} Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.324697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.326747 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.326747 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.326747 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.326747 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:07.326747 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:07.326747 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. Oct 01 20:49:07.326747 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.330828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3abc449e-be36-4f66-ae1c-a3ca67a408bd tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Returning 404 to user: Flavor 1747187802 has no extra specs with key hw:cpu_thread_policy. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:07.335247 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3abc449e-be36-4f66-ae1c-a3ca67a408bd tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1747187802/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.049277 Oct 01 20:49:07.337598 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 55/110] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 20:49:07 2022] DELETE /compute/v2.1/flavors/1747187802/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:07.348379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f003f34-c23b-4270-8c5f-e30adaba19a8 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:07.353204 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-1f003f34-c23b-4270-8c5f-e30adaba19a8 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f003f34-c23b-4270-8c5f-e30adaba19a8 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Request method failure captured: Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 27 Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfAyjpFEQ__9_eJyEfGCnJxBT3aWSGrzSLWkbl1AlZHJ88QPTfALOdHzhLrv1S_qO5Va9yAUPnt2k4gN0dU5fTwFuDwm0enYF4CGyEcKNp_QIqUWkpqSIVEaCi_UDE95FSql4OQnxRpUURsauDLNXUEfaTt1vKKxTMaQY_TKS3-UBo Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 6de3b6487f874ce2a574f1ff93b7fb06 Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:07.364834 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6de3b6487f874ce2a574f1ff93b7fb06", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6de3b6487f874ce2a574f1ff93b7fb06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6de3b6487f874ce2a574f1ff93b7fb06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6de3b6487f874ce2a574f1ff93b7fb06"}]}] Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 6de3b6487f874ce2a574f1ff93b7fb06 Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f21b913012c84275bf815435145d15a9 Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: {"hw:cpu_policy": "shared"} Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:07.366108 ncdv-master-1 devstack@n-api.service[140437]: exception: Request body and URI mismatch Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'flavor_id': '1747187802', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.366838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.367968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:07.367968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:07.367968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 01 20:49:07.367968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.367968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f003f34-c23b-4270-8c5f-e30adaba19a8 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:07.367968 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1f003f34-c23b-4270-8c5f-e30adaba19a8 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.022855 Oct 01 20:49:07.367968 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 56/111] 10.222.0.17 () {60 vars in 1265 bytes} [Sat Oct 1 20:49:07 2022] PUT /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:49:07.393781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-608d8232-d7ca-4d8a-90e4-33862bf9d01d tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-608d8232-d7ca-4d8a-90e4-33862bf9d01d tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Request method failure captured: Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 49 Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfAyjpFEQ__9_eJyEfGCnJxBT3aWSGrzSLWkbl1AlZHJ88QPTfALOdHzhLrv1S_qO5Va9yAUPnt2k4gN0dU5fTwFuDwm0enYF4CGyEcKNp_QIqUWkpqSIVEaCi_UDE95FSql4OQnxRpUURsauDLNXUEfaTt1vKKxTMaQY_TKS3-UBo Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 6de3b6487f874ce2a574f1ff93b7fb06 Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:07.408619 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6de3b6487f874ce2a574f1ff93b7fb06", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6de3b6487f874ce2a574f1ff93b7fb06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6de3b6487f874ce2a574f1ff93b7fb06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6de3b6487f874ce2a574f1ff93b7fb06"}]}] Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 6de3b6487f874ce2a574f1ff93b7fb06 Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f21b913012c84275bf815435145d15a9 Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 01 20:49:07.409957 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'flavor_id': '1747187802', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi On instance: Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 01 20:49:07.410635 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.411898 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:07.414284 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:07.414284 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:07.414284 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:49:07.414284 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:49:07.414284 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 01 20:49:07.414284 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:07.414284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-608d8232-d7ca-4d8a-90e4-33862bf9d01d tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:07.414284 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-608d8232-d7ca-4d8a-90e4-33862bf9d01d tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026545 Oct 01 20:49:07.415383 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 57/112] 10.222.0.17 () {60 vars in 1265 bytes} [Sat Oct 1 20:49:07 2022] PUT /compute/v2.1/flavors/1747187802/os-extra_specs/hw:numa_nodes => generated 117 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:49:07.433643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2787360b-b3dd-48ac-a990-92617897e5be tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:07.500189 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2787360b-b3dd-48ac-a990-92617897e5be tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1747187802" status: 202 len: 0 microversion: 2.1 time: 0.074135 Oct 01 20:49:07.501057 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 58/113] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:49:07 2022] DELETE /compute/v2.1/flavors/1747187802 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:49:07.519108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:07.519773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:07.533952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:07.536659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:07.538548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:07.541497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:07.542774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:07.548675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:07.749020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:07.758335 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3a5fafe1-58fd-4142-a912-5391db7940bf tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1278 microversion: 2.1 time: 0.256186 Oct 01 20:49:07.759007 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 59/114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:07 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:07.778784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:07.780420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:07.797795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:07.798317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:07.798801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:07.799535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:07.802022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:07.802919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:07.823480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:07.833806 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8d79094a-65ae-4b73-b510-b0cf2bb88366 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.736147 Oct 01 20:49:07.839490 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 56/115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:07 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:07.848186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ea418cd-df1e-40a9-9e1e-a25dea96640f tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:07.947515 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ea418cd-df1e-40a9-9e1e-a25dea96640f tempest-FlavorsExtraSpecsNegativeTestJSON-489293480 tempest-FlavorsExtraSpecsNegativeTestJSON-489293480-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.094142 Oct 01 20:49:07.949760 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 57/116] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:49:07 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:07.996741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:08.007392 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fb4c4380-cc04-4f32-b8ad-e2310b0953ec tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1338 microversion: 2.1 time: 0.246415 Oct 01 20:49:08.021664 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 60/117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:07 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1338 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:08.785644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:08.788346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:08.806665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:08.808514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:08.809326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:08.811432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:08.812078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:08.812826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:08.868898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:08.872474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:08.892809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:08.893762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:08.894714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:08.897314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:08.898019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:08.899937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:09.513410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:09.526483 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6ed022f6-1631-4939-9b15-bd244887bcf0 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.671081 Oct 01 20:49:09.528758 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 61/118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:08 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:09.537472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:09.538241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:09.555551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:09.556051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:09.556485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:09.559468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:09.560153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:09.560766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:09.568800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:09.578888 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-508cca1b-1796-47de-a536-558360e795d1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1320 microversion: 2.1 time: 0.797336 Oct 01 20:49:09.585736 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 58/119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:08 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1320 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:09.800679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:09.810201 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-512e4e4a-8312-4d38-8c36-d229719c2975 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1344 microversion: 2.1 time: 0.280152 Oct 01 20:49:09.810658 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 62/120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:09 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1344 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:10.559869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:10.563680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:10.572771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:10.577047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:10.580680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:10.585315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:10.586567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:10.587825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:10.612658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:10.613427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:10.632829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:10.633568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:10.634422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:10.635604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:10.636384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:10.637917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:11.137060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:11.141851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:11.144557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:11.153611 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a07c579a-02c6-40d2-b4fa-657c76aab67f tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1320 microversion: 2.1 time: 0.544664 Oct 01 20:49:11.154336 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 63/121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:10 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1320 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:11.154782 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7f026ef-ea26-436f-8c1d-9bb728e8aa62 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.604099 Oct 01 20:49:11.156378 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 59/122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:10 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:11.169608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:11.171038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:11.201550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:11.202369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:11.205605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:11.207647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:11.209998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:11.211661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:11.304929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:11.313828 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3eed1724-9259-4aba-ac79-4d3f2bef80b3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1344 microversion: 2.1 time: 0.157190 Oct 01 20:49:11.328087 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 64/123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:11 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1344 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:12.186185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:12.188635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:12.190647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:12.191580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:12.206735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:12.209184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:12.209926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:12.210631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:12.211325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:12.212218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:12.213055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:12.214181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:12.214650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:12.216289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:12.216764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:12.217329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:12.725272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:12.729092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=83 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:12.735659 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff0f02e0-e029-49d6-8189-80bc657b18b8 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1320 microversion: 2.1 time: 0.556648 Oct 01 20:49:12.743251 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 60/124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:12 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1320 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:12.748318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:12.748931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:12.759128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:12.762445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:12.763779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:12.764286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:12.771944 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5313bf88-652c-4cf2-969d-e2798d7e0060 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.595674 Oct 01 20:49:12.772566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:12.777447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:12.778101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:12.787311 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 65/125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:12 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:12.821718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-821f2ab0-60a0-48f1-8062-b5402c2c88ed req-c6aaae32-1c8f-45e3-ae39-4532511a4fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e14cd883-3b04-49e9-9e08-002afa2fae2f", "tag": "e9b6f564-0714-46c8-bd67-3d043e15b73c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:12.842060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-821f2ab0-60a0-48f1-8062-b5402c2c88ed req-c6aaae32-1c8f-45e3-ae39-4532511a4fbb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:12.844332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-821f2ab0-60a0-48f1-8062-b5402c2c88ed req-c6aaae32-1c8f-45e3-ae39-4532511a4fbb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:12.845081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-821f2ab0-60a0-48f1-8062-b5402c2c88ed req-c6aaae32-1c8f-45e3-ae39-4532511a4fbb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:12.869232 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-821f2ab0-60a0-48f1-8062-b5402c2c88ed req-c6aaae32-1c8f-45e3-ae39-4532511a4fbb service nova] Creating event network-changed:e9b6f564-0714-46c8-bd67-3d043e15b73c for instance e14cd883-3b04-49e9-9e08-002afa2fae2f on nch1-master-1 Oct 01 20:49:12.875512 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-821f2ab0-60a0-48f1-8062-b5402c2c88ed req-c6aaae32-1c8f-45e3-ae39-4532511a4fbb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058167 Oct 01 20:49:12.876942 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 66/126] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:49:13.162611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:13.177534 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2aa504d-8065-482d-8de5-f168bd42f770 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1411 microversion: 2.1 time: 0.432824 Oct 01 20:49:13.180078 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 61/127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:12 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1411 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:13.770074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:13.771137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:13.779497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:13.780291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:13.780933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:13.782034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:13.782876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:13.783814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:13.799614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:13.800354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:13.812383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:13.812887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:13.813496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:13.814359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:13.815049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:13.815645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:14.049334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:14.059019 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-686e1f03-3ed3-4afb-9087-8b5705414cc4 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1320 microversion: 2.1 time: 0.294049 Oct 01 20:49:14.060247 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 67/128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:13 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:14.063597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:14.076915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-12925be1-ac90-4c76-949a-7ca1db6974f7 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.283551 Oct 01 20:49:14.095366 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 62/129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:13 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:14.207394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:14.208013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:14.215927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:14.219356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:14.220246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:14.221448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:14.222313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:14.223606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:14.490285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:14.498742 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-faf0f4b6-490a-47ae-a5ea-22ceb0031038 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1411 microversion: 2.1 time: 0.296248 Oct 01 20:49:14.499326 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 68/130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:14 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1411 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:14.670951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7c11c969-aeb2-4b40-b831-ed912f2ccdb4 req-ca30ff4f-2ea2-41c1-a63c-2fbcb5aa57cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f695f0f4-e9de-43e3-9d93-46705a83fa0a", "tag": "a4763c59-9cb6-42ad-ad87-2455247f8797"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:14.687695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c11c969-aeb2-4b40-b831-ed912f2ccdb4 req-ca30ff4f-2ea2-41c1-a63c-2fbcb5aa57cc service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:14.688629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c11c969-aeb2-4b40-b831-ed912f2ccdb4 req-ca30ff4f-2ea2-41c1-a63c-2fbcb5aa57cc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:14.689065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c11c969-aeb2-4b40-b831-ed912f2ccdb4 req-ca30ff4f-2ea2-41c1-a63c-2fbcb5aa57cc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:14.715479 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7c11c969-aeb2-4b40-b831-ed912f2ccdb4 req-ca30ff4f-2ea2-41c1-a63c-2fbcb5aa57cc service nova] Creating event network-changed:a4763c59-9cb6-42ad-ad87-2455247f8797 for instance f695f0f4-e9de-43e3-9d93-46705a83fa0a on nch2-master-1 Oct 01 20:49:14.716020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c11c969-aeb2-4b40-b831-ed912f2ccdb4 req-ca30ff4f-2ea2-41c1-a63c-2fbcb5aa57cc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:49:14.716564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c11c969-aeb2-4b40-b831-ed912f2ccdb4 req-ca30ff4f-2ea2-41c1-a63c-2fbcb5aa57cc service nova] Acquired lock "compute-rpcapi-router" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:49:14.717610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91124591-8ef8-48f8-9e87-b9aefaa9b6d9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:14.718256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91124591-8ef8-48f8-9e87-b9aefaa9b6d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:14.729438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91124591-8ef8-48f8-9e87-b9aefaa9b6d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:14.732727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91124591-8ef8-48f8-9e87-b9aefaa9b6d9 None None] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:14.733226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91124591-8ef8-48f8-9e87-b9aefaa9b6d9 None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:14.733659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91124591-8ef8-48f8-9e87-b9aefaa9b6d9 None None] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:14.742883 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.compute.rpcapi [None req-91124591-8ef8-48f8-9e87-b9aefaa9b6d9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 01 20:49:14.743784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91124591-8ef8-48f8-9e87-b9aefaa9b6d9 None None] Releasing lock "compute-rpcapi-router" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:49:14.769760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-91124591-8ef8-48f8-9e87-b9aefaa9b6d9 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.464942 Oct 01 20:49:14.771162 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 63/131] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:49:14.791935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-920830224", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": "none"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:14.862314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:49:14.862950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:49:14.863581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:49:14.864293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:49:14.864946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:49:14.873377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=27 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:14.878911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:14.879408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:14.879847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:14.880585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:14.881108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:14.881537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:14.902149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Getting quotas for project b2b9de2ad3ad459794059338dd371e0b. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:14.919189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Getting quotas for user b61faa86ae0d4eedb371407380c22bfe and project b2b9de2ad3ad459794059338dd371e0b. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:14.938664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:49:14.941139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:49:15.004158 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-964e725e-bf98-4cec-b784-5529170d5e5c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.494191 Oct 01 20:49:15.007086 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 69/132] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 20:49:15.131633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-479846522", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:15.182412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-3f6707f8-f944-4820-ad58-d1003536c07f req-a776dbaf-5328-449b-92d9-f50a2172c885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58df1e80-a139-4db6-82ac-a57e15ac2153", "name": "network-vif-plugged", "status": "completed", "tag": "e6d8d0f0-0257-41fb-9a76-0fd1ce638fe6"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:15.195565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:49:15.197623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3f6707f8-f944-4820-ad58-d1003536c07f req-a776dbaf-5328-449b-92d9-f50a2172c885 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:15.198458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3f6707f8-f944-4820-ad58-d1003536c07f req-a776dbaf-5328-449b-92d9-f50a2172c885 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:15.198573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3f6707f8-f944-4820-ad58-d1003536c07f req-a776dbaf-5328-449b-92d9-f50a2172c885 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:15.209244 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-3f6707f8-f944-4820-ad58-d1003536c07f req-a776dbaf-5328-449b-92d9-f50a2172c885 service nova] Creating event network-vif-plugged:e6d8d0f0-0257-41fb-9a76-0fd1ce638fe6 for instance 58df1e80-a139-4db6-82ac-a57e15ac2153 on nch1-master-1 Oct 01 20:49:15.215969 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-3f6707f8-f944-4820-ad58-d1003536c07f req-a776dbaf-5328-449b-92d9-f50a2172c885 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207503 Oct 01 20:49:15.216567 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 70/133] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:15.370418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6a054d14-28ff-4f9a-ad48-5c04ac8d5043 tempest-QuotaClassesAdmin257Test-1495271455 tempest-QuotaClassesAdmin257Test-1495271455-project-admin] Calling method '.version_select at 0x7f417865f040>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:15.394951 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6a054d14-28ff-4f9a-ad48-5c04ac8d5043 tempest-QuotaClassesAdmin257Test-1495271455 tempest-QuotaClassesAdmin257Test-1495271455-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.175553 Oct 01 20:49:15.404187 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 71/134] 10.222.0.17 () {60 vars in 1226 bytes} [Sat Oct 1 20:49:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:15.410448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-34df3aa8-a383-4495-b542-1f9e626e8ea5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:15.411295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-34df3aa8-a383-4495-b542-1f9e626e8ea5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:15.485681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-34df3aa8-a383-4495-b542-1f9e626e8ea5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:15.495431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-34df3aa8-a383-4495-b542-1f9e626e8ea5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:15.497761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-34df3aa8-a383-4495-b542-1f9e626e8ea5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:15.506869 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-34df3aa8-a383-4495-b542-1f9e626e8ea5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1452 microversion: 2.91 time: 0.100850 Oct 01 20:49:15.508258 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 72/135] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:15 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:15.521983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:15.522925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:15.535900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:15.536948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:15.537720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:15.538837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:15.539617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:15.540248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:15.559627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:49:15.560280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:49:15.560912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:49:15.561542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:49:15.561930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:49:15.572183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:15.573456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:15.574049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:15.574999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:15.575782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:15.576600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:15.600741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Getting quotas for project f7d124b2b3db49328d393be7be2e82d6. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:15.605648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Getting quotas for user 0980a1e24cdc491aa1a0202afc4fcd64 and project f7d124b2b3db49328d393be7be2e82d6. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:15.618623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:49:15.621429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:49:15.702247 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34f1f468-c51d-4479-a27d-3cbb45ad963d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928589 Oct 01 20:49:15.707488 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 64/136] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:49:15.716903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:15.730528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:15.744190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:15.745616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:15.746350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:15.747312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:15.747922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:15.748517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:15.865312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:15.875430 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1320 microversion: 2.1 time: 0.365829 Oct 01 20:49:15.877045 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 73/137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:15 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:15.878069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:15.879157 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fce12453-a090-40b9-b086-b4ab4ce12ed7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001309 Oct 01 20:49:15.879992 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 74/138] 10.222.0.17 () {56 vars in 886 bytes} [Sat Oct 1 20:49:15 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 01 20:49:15.893772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d43e9d57-2193-4ec1-9c45-be0f448cff5c tempest-QuotaClassesAdmin257Test-1495271455 tempest-QuotaClassesAdmin257Test-1495271455-project-admin] Action: 'update', calling method: .version_select at 0x7f41786c5310>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:15.986983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:16.005759 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15dd3b88-e597-44c9-86da-2df4983b652c tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.295105 Oct 01 20:49:16.006274 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 65/139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:15 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:16.013484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:16.014097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:16.020899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:16.021553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:16.022374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:16.023343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:16.024028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:16.024663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:16.162143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=4,nova_api:INSERT=9,nova_api:UPDATE=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:16.198723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:16.206377 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d43e9d57-2193-4ec1-9c45-be0f448cff5c tempest-QuotaClassesAdmin257Test-1495271455 tempest-QuotaClassesAdmin257Test-1495271455-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.325076 Oct 01 20:49:16.208798 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 75/140] 10.222.0.17 () {62 vars in 1247 bytes} [Sat Oct 1 20:49:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:16.215580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-82496005-15f7-4931-9add-27a7e7ae7f9b tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:16.216504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-82496005-15f7-4931-9add-27a7e7ae7f9b tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:16.220140 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-437906df-14ba-4903-b42d-b04f2e46701f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1411 microversion: 2.1 time: 0.200510 Oct 01 20:49:16.222164 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 66/141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:16 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1411 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:16.233188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3032a5b4-cfeb-4ebd-9d5e-a0b623321c49 tempest-QuotaClassesAdmin257Test-1495271455 tempest-QuotaClassesAdmin257Test-1495271455-project-admin] Calling method '.version_select at 0x7f417840aaf0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:16.268580 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3032a5b4-cfeb-4ebd-9d5e-a0b623321c49 tempest-QuotaClassesAdmin257Test-1495271455 tempest-QuotaClassesAdmin257Test-1495271455-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.043085 Oct 01 20:49:16.271329 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 67/142] 10.222.0.17 () {60 vars in 1226 bytes} [Sat Oct 1 20:49:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:16.287942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c187f653-e953-456c-9a6f-a6f2099ccc29 tempest-QuotaClassesAdmin257Test-1495271455 tempest-QuotaClassesAdmin257Test-1495271455-project-admin] Action: 'update', calling method: .version_select at 0x7f417840a8b0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:16.322213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-82496005-15f7-4931-9add-27a7e7ae7f9b tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:16.339514 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-82496005-15f7-4931-9add-27a7e7ae7f9b tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1221 microversion: 2.1 time: 0.126889 Oct 01 20:49:16.341599 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 76/143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:16 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:16.472143 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c187f653-e953-456c-9a6f-a6f2099ccc29 tempest-QuotaClassesAdmin257Test-1495271455 tempest-QuotaClassesAdmin257Test-1495271455-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.191262 Oct 01 20:49:16.483506 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 68/144] 10.222.0.17 () {62 vars in 1247 bytes} [Sat Oct 1 20:49:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:16.539153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:16.540092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:16.553139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:16.554314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:16.555684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:16.558013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:16.558639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:16.560947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:16.795677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:16.806705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:16.808742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:16.819153 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-20dd38cc-af1e-487c-88b3-f37893720d88 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1522 microversion: 2.91 time: 0.286243 Oct 01 20:49:16.823930 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 77/145] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:16 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:16.909607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:16.910238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:16.917982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:16.918645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:16.919108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:16.919806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:16.920305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:16.920785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:17.037614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:17.038771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:17.046042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:17.047609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:17.048662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:17.049391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:17.050236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:17.051459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:17.103308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:17.112641 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-67a9c374-9dc4-4c0b-a104-60411d1ce8e2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1320 microversion: 2.1 time: 0.206947 Oct 01 20:49:17.113240 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 69/146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:16 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:17.251760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:17.252429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:17.259938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:17.260449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:17.260885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:17.261718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:17.262034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:17.262474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:17.266167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:17.277255 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b1ba5864-da87-43dd-b1c0-b150c86c2fdf tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1338 microversion: 2.1 time: 0.244368 Oct 01 20:49:17.295761 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 78/147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:17 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1338 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:17.365965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:17.367103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:17.374467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:17.375238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:17.375928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:17.376655 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:17.377483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:17.378030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:17.457536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:17.465807 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-006d1551-4c59-415d-a66f-de153e36487d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1273 microversion: 2.1 time: 0.104910 Oct 01 20:49:17.467347 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 79/148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:17 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:49:17.491298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:17.500218 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-04bcd5c9-8215-46c0-a668-ec52bca9c445 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1411 microversion: 2.1 time: 0.253196 Oct 01 20:49:17.501578 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 70/149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:17 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1411 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:49:17.852974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:17.853602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:17.859885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:17.860519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:17.860964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:17.861661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:17.862122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:17.862573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:17.937989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:17.947274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:17.949331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:17.954753 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b65f702a-9b09-4d63-93b4-062519a6688a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1510 microversion: 2.91 time: 0.105931 Oct 01 20:49:17.955333 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 80/150] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:17 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1510 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:18.137257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:18.138189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:18.141325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=7 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:18.145313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.145812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.146259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.147004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.147467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.147899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.305459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:18.306323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:18.319058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.321700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.322535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.323856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.326450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.327418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.333172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:18.343377 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc6abbe1-bf93-4e07-94e4-f1db6cbb5c5a tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1320 microversion: 2.1 time: 0.210042 Oct 01 20:49:18.361298 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 71/151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:18 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:18.491168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:18.491822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:18.500222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.502530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.503295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.504316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.505170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.505988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.506342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:18.516257 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0d93096f-49d9-4638-ac5e-dd4b9de83dba tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1488 microversion: 2.1 time: 0.216535 Oct 01 20:49:18.518093 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 81/152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:18 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1488 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:18.524809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:18.525436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:18.532830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.533328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.533765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.534473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.535053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.535393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.592592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:18.603211 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe7e848b-7471-461f-9473-276c168b0463 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1273 microversion: 2.1 time: 0.116302 Oct 01 20:49:18.604060 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 72/153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:18 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:18.609382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a12d9ca3-18e7-430c-9853-c585ac41687c req-18c09a36-5a63-47cc-bd24-881e68ab4bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14cd883-3b04-49e9-9e08-002afa2fae2f", "name": "network-vif-plugged", "status": "completed", "tag": "e9b6f564-0714-46c8-bd67-3d043e15b73c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:18.624193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a12d9ca3-18e7-430c-9853-c585ac41687c req-18c09a36-5a63-47cc-bd24-881e68ab4bf5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.625118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a12d9ca3-18e7-430c-9853-c585ac41687c req-18c09a36-5a63-47cc-bd24-881e68ab4bf5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.625782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a12d9ca3-18e7-430c-9853-c585ac41687c req-18c09a36-5a63-47cc-bd24-881e68ab4bf5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.641464 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a12d9ca3-18e7-430c-9853-c585ac41687c req-18c09a36-5a63-47cc-bd24-881e68ab4bf5 service nova] Creating event network-vif-plugged:e9b6f564-0714-46c8-bd67-3d043e15b73c for instance e14cd883-3b04-49e9-9e08-002afa2fae2f on nch1-master-1 Oct 01 20:49:18.648548 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a12d9ca3-18e7-430c-9853-c585ac41687c req-18c09a36-5a63-47cc-bd24-881e68ab4bf5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042707 Oct 01 20:49:18.649484 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 73/154] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:18.655947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-227d6839-3fa5-4790-bf38-b97d0353ceea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:18.658093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-227d6839-3fa5-4790-bf38-b97d0353ceea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:18.673385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-227d6839-3fa5-4790-bf38-b97d0353ceea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.674388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-227d6839-3fa5-4790-bf38-b97d0353ceea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.675536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-227d6839-3fa5-4790-bf38-b97d0353ceea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.676620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-227d6839-3fa5-4790-bf38-b97d0353ceea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.677424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-227d6839-3fa5-4790-bf38-b97d0353ceea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.678057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-227d6839-3fa5-4790-bf38-b97d0353ceea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.795477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:18.812160 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-44127dd5-48b1-43ef-a941-d52ecae926c6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1411 microversion: 2.1 time: 0.287646 Oct 01 20:49:18.813051 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 82/155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:18 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1411 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:18.984699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:18.985511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:18.993790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:18.997206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:18.998260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:18.999686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.000442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.001581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.107444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:19.121249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:19.123116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:19.129372 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b34937e9-5209-4c8b-889b-1fef017f43bc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1510 microversion: 2.91 time: 0.149403 Oct 01 20:49:19.147788 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 83/156] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:18 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:49:19.186632 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-227d6839-3fa5-4790-bf38-b97d0353ceea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1639 microversion: 2.1 time: 0.534810 Oct 01 20:49:19.202764 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 74/157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:18 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1639 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:19.219013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:19.219812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:19.229454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.230211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.231345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.232464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.233222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.235658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.275438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:49:19.368878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:19.370437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:19.379756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.398145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.401112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.403310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.408037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.409675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.530982 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bd372f68-4b92-45b9-85c9-a4386e05494f tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "DELETE /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 204 len: 0 microversion: 2.1 time: 0.316626 Oct 01 20:49:19.535542 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 84/158] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:49:19 2022] DELETE /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:49:19.552378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:19.553244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:19.569687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.570424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.572741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.574101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.574595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.575259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.727973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:19.737251 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-325fe317-d98c-4841-a09a-a36c328741ae tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1320 microversion: 2.1 time: 0.372682 Oct 01 20:49:19.742222 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 75/159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:19 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:19.751308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:19.751929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:19.770957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.771466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.771912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.772638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.777170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.784276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.819101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:19.823715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:19.830657 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d259f1aa-b9fa-4ffb-9eab-9cf93122b919 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1494 microversion: 2.1 time: 0.289889 Oct 01 20:49:19.842528 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 85/160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:19 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1494 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:19.848974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:19.849354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:19.861638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.862168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.862676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.869785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:19.870840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:19.871302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:19.904281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:19.914359 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a2199ff8-070f-4898-a440-d2b7bd0c9bef tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1279 microversion: 2.1 time: 0.170897 Oct 01 20:49:19.916909 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 76/161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:19 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:20.085623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:20.096591 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-443b260f-46c6-4a52-a442-9a2c098f95cc tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1411 microversion: 2.1 time: 0.259975 Oct 01 20:49:20.099949 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 86/162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:19 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1411 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:20.162312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:20.163109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:20.172803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.173740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.176668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.177751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.178201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.178676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.334391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:20.346303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:20.348291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:20.359975 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d35ab116-a7d8-4b7e-a5d6-6297e31be044 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1531 microversion: 2.91 time: 0.202749 Oct 01 20:49:20.361311 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 77/163] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:20 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1531 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:20.524979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Calling method '.version_select at 0x7f41783bc8b0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:20.527120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.527863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.528456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.569502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.575547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.576338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.610346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.613401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.613863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.618265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:20.618917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:20.621056 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-45d98040-0435-407e-8d71-838b213889ff tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.432484 Oct 01 20:49:20.629018 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 87/164] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:49:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:49:20.629171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.629682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.630122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.636335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Calling method '.version_select at 0x7f41783bcee0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:20.636677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.637217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.637667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.638436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.639294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.639874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.656681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.657360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.658238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.670361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.671180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.671885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.678647 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c91a7719-8dd5-4b0b-8780-c3a1295017e2 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.047676 Oct 01 20:49:20.690936 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 88/165] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Oct 1 20:49:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:20.704126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Calling method '.version_select at 0x7f41783bcca0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:20.707890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.708533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.708981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.732633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.733129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.733737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.754337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.755135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.755719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.766069 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-07e3af62-dd10-407a-86df-3ad416d36684 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.072441 Oct 01 20:49:20.772354 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 89/166] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:49:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:20.772354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-bcddbcd7-a568-4dc1-aa4b-1fbf2dbdaa71 req-4a6d3d2c-db4c-435e-94e9-f255a87d5daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f695f0f4-e9de-43e3-9d93-46705a83fa0a", "name": "network-vif-plugged", "status": "completed", "tag": "a4763c59-9cb6-42ad-ad87-2455247f8797"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:20.781778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bcddbcd7-a568-4dc1-aa4b-1fbf2dbdaa71 req-4a6d3d2c-db4c-435e-94e9-f255a87d5daa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.782524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bcddbcd7-a568-4dc1-aa4b-1fbf2dbdaa71 req-4a6d3d2c-db4c-435e-94e9-f255a87d5daa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.783017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bcddbcd7-a568-4dc1-aa4b-1fbf2dbdaa71 req-4a6d3d2c-db4c-435e-94e9-f255a87d5daa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.795176 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-bcddbcd7-a568-4dc1-aa4b-1fbf2dbdaa71 req-4a6d3d2c-db4c-435e-94e9-f255a87d5daa service nova] Creating event network-vif-plugged:a4763c59-9cb6-42ad-ad87-2455247f8797 for instance f695f0f4-e9de-43e3-9d93-46705a83fa0a on nch2-master-1 Oct 01 20:49:20.807503 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-bcddbcd7-a568-4dc1-aa4b-1fbf2dbdaa71 req-4a6d3d2c-db4c-435e-94e9-f255a87d5daa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038819 Oct 01 20:49:20.808480 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 90/167] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:20.839816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lazy-loading 'services' on Instance uuid 88ff8817-cf9a-4f27-a93e-7c1e847eda21 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:49:20.918406 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c6779a77-dbea-42ac-b067-d65658abdc9f tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1936 microversion: 2.91 time: 0.531098 Oct 01 20:49:20.919993 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 78/168] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:20 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1936 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:49:20.924835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:20.925673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:20.943103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.944100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.944861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.945830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:20.946463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:20.947083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:20.993538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f8ac2393-f318-42ba-981c-55f1c52f33d4 tempest-QuotaClassesAdminTestJSON-162103791 tempest-QuotaClassesAdminTestJSON-162103791-project-admin] Calling method '.version_select at 0x7f41784254c0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:21.006700 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f8ac2393-f318-42ba-981c-55f1c52f33d4 tempest-QuotaClassesAdminTestJSON-162103791 tempest-QuotaClassesAdminTestJSON-162103791-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.197010 Oct 01 20:49:21.007462 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 91/169] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Oct 1 20:49:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:21.012150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2680e602-246d-494c-85dd-ddcf8e5cfb3c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Calling method '.version_select at 0x7f41783bc700>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:21.014326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2680e602-246d-494c-85dd-ddcf8e5cfb3c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.015014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2680e602-246d-494c-85dd-ddcf8e5cfb3c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.015601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2680e602-246d-494c-85dd-ddcf8e5cfb3c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.039012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2680e602-246d-494c-85dd-ddcf8e5cfb3c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.039740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2680e602-246d-494c-85dd-ddcf8e5cfb3c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.041626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2680e602-246d-494c-85dd-ddcf8e5cfb3c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.048902 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2680e602-246d-494c-85dd-ddcf8e5cfb3c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.040287 Oct 01 20:49:21.049510 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 92/170] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:21.054346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-0387c9d0-eedd-4f88-b2f1-64cef4de3ea0 req-1c5fe9f0-e015-4497-abab-a577dd5a2a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bff70c8-a206-4b32-8db9-aba1975bf1db", "tag": "2cc51466-d60f-4b61-9c90-acdd94cf1546"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:21.064530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0387c9d0-eedd-4f88-b2f1-64cef4de3ea0 req-1c5fe9f0-e015-4497-abab-a577dd5a2a28 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.065031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0387c9d0-eedd-4f88-b2f1-64cef4de3ea0 req-1c5fe9f0-e015-4497-abab-a577dd5a2a28 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.065443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0387c9d0-eedd-4f88-b2f1-64cef4de3ea0 req-1c5fe9f0-e015-4497-abab-a577dd5a2a28 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.079150 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-0387c9d0-eedd-4f88-b2f1-64cef4de3ea0 req-1c5fe9f0-e015-4497-abab-a577dd5a2a28 service nova] Creating event network-changed:2cc51466-d60f-4b61-9c90-acdd94cf1546 for instance 5bff70c8-a206-4b32-8db9-aba1975bf1db on nch2-master-1 Oct 01 20:49:21.084545 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-0387c9d0-eedd-4f88-b2f1-64cef4de3ea0 req-1c5fe9f0-e015-4497-abab-a577dd5a2a28 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033618 Oct 01 20:49:21.085393 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 93/171] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:21.090782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:21.091548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:21.098200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.098752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.099195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.099919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.100367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.100786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.232257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:21.240057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-684334dd-5ceb-4ad1-8622-2ef53c06e89d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1320 microversion: 2.1 time: 0.318900 Oct 01 20:49:21.240644 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 79/172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:20 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:21.245395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:21.246006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:21.251991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.252573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.253017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.253730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.254191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.254644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.641148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:21.648884 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1eb53ce0-6272-4319-b5e7-069ddf3d7227 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1494 microversion: 2.1 time: 0.562317 Oct 01 20:49:21.649458 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 94/173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:21 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1494 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:21.654426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:21.655050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:21.660885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.661378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.661810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.662518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.663914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.664349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.781854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:21.784466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:21.791151 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7aa2cd43-9241-4cc8-938e-a779a669deca tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1321 microversion: 2.1 time: 0.549536 Oct 01 20:49:21.791821 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 80/174] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:21 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:21.796229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8aa32caa-1f23-448c-8df8-057928d427c4 tempest-QuotaClassesAdminTestJSON-162103791 tempest-QuotaClassesAdminTestJSON-162103791-project-admin] Action: 'update', calling method: .version_select at 0x7f4178405430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:21.817008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lazy-loading 'services' on Instance uuid 88ff8817-cf9a-4f27-a93e-7c1e847eda21 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:49:21.879083 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ae373ba9-06e2-483b-8315-9ff0461fcd4e tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1936 microversion: 2.91 time: 0.228477 Oct 01 20:49:21.894745 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 95/175] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:21 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1936 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:21.894745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-20e437dd-1692-432f-aecc-9281b039c24c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Calling method '.version_select at 0x7f41783edf70>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:21.894745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20e437dd-1692-432f-aecc-9281b039c24c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.894745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20e437dd-1692-432f-aecc-9281b039c24c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.895177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20e437dd-1692-432f-aecc-9281b039c24c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.913887 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-20e437dd-1692-432f-aecc-9281b039c24c tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.033125 Oct 01 20:49:21.914523 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 96/176] 10.222.0.17 () {58 vars in 1179 bytes} [Sat Oct 1 20:49:21 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:21.919027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:21.919626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:21.927234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.928011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.929044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:21.929831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:21.930599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:21.931200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.040568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8aa32caa-1f23-448c-8df8-057928d427c4 tempest-QuotaClassesAdminTestJSON-162103791 tempest-QuotaClassesAdminTestJSON-162103791-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.247597 Oct 01 20:49:22.048358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 81/177] 10.222.0.17 () {60 vars in 1206 bytes} [Sat Oct 1 20:49:21 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:22.051911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cdeeb385-16a4-4425-8e48-032a292a293c tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.056060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdeeb385-16a4-4425-8e48-032a292a293c tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.057264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdeeb385-16a4-4425-8e48-032a292a293c tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.057264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdeeb385-16a4-4425-8e48-032a292a293c tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.058356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdeeb385-16a4-4425-8e48-032a292a293c tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.058470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdeeb385-16a4-4425-8e48-032a292a293c tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.058873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdeeb385-16a4-4425-8e48-032a292a293c tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.089883 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cdeeb385-16a4-4425-8e48-032a292a293c tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 519 microversion: 2.91 time: 0.046086 Oct 01 20:49:22.090505 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 82/178] 10.222.0.17 () {60 vars in 1217 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 519 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:22.094785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Calling method '.version_select at 0x7f417840aa60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.096577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.097022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.097545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.112996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.113502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.113970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.124062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.124548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.124987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.137365 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7cd525dd-2673-45e5-aed9-3b558041a025 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039440 Oct 01 20:49:22.137365 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 83/179] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:22.143914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9b849103-9744-499e-aa26-455ea4d54a8a tempest-QuotaClassesAdminTestJSON-162103791 tempest-QuotaClassesAdminTestJSON-162103791-project-admin] Calling method '.version_select at 0x7f4178345af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.160312 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9b849103-9744-499e-aa26-455ea4d54a8a tempest-QuotaClassesAdminTestJSON-162103791 tempest-QuotaClassesAdminTestJSON-162103791-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.026422 Oct 01 20:49:22.160312 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 84/180] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:22.164921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:22.165455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:22.172239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.172802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.173327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.174100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.175523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.178306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.218774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:22.229875 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aa633c49-2c57-4f28-a566-90b7561aaa6e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1611 microversion: 2.1 time: 0.314296 Oct 01 20:49:22.249084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lazy-loading 'flavor' on Instance uuid 88ff8817-cf9a-4f27-a93e-7c1e847eda21 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:49:22.254286 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 97/181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:21 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1611 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:22.271231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a8deff91-032e-4818-bd46-22c327510a01 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Calling method '.version_select at 0x7f41783bcf70>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.273104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8deff91-032e-4818-bd46-22c327510a01 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.273596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8deff91-032e-4818-bd46-22c327510a01 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.274033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8deff91-032e-4818-bd46-22c327510a01 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.295390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8deff91-032e-4818-bd46-22c327510a01 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.296110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8deff91-032e-4818-bd46-22c327510a01 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.296692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8deff91-032e-4818-bd46-22c327510a01 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.303858 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a8deff91-032e-4818-bd46-22c327510a01 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.036209 Oct 01 20:49:22.304475 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 98/182] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:22.309045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-28504d9c-63e3-4117-b1fd-83828e564028 tempest-QuotaClassesAdminTestJSON-162103791 tempest-QuotaClassesAdminTestJSON-162103791-project-admin] Action: 'update', calling method: .version_select at 0x7f417839e790>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:22.452422 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-28504d9c-63e3-4117-b1fd-83828e564028 tempest-QuotaClassesAdminTestJSON-162103791 tempest-QuotaClassesAdminTestJSON-162103791-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.146809 Oct 01 20:49:22.453549 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 99/183] 10.222.0.17 () {60 vars in 1206 bytes} [Sat Oct 1 20:49:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:22.466266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-efc59248-572d-489a-86fa-383c9c234fd3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.467058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-efc59248-572d-489a-86fa-383c9c234fd3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:22.470888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:UPDATE=14,nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:22.476867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efc59248-572d-489a-86fa-383c9c234fd3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.478195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efc59248-572d-489a-86fa-383c9c234fd3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.478961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efc59248-572d-489a-86fa-383c9c234fd3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.480076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efc59248-572d-489a-86fa-383c9c234fd3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.480706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efc59248-572d-489a-86fa-383c9c234fd3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.481279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efc59248-572d-489a-86fa-383c9c234fd3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.580904 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-efc59248-572d-489a-86fa-383c9c234fd3 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126034 Oct 01 20:49:22.581690 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 100/184] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:22.592594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.593310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:22.600274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.600835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.601260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.602026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.602604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.602947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.617671 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-035457e4-9839-473b-a6b2-8a2eafe1206a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "POST /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21/action" status: 202 len: 0 microversion: 2.91 time: 0.455852 Oct 01 20:49:22.618298 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 85/185] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:49:22 2022] POST /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:49:22.623304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf16b9f7-6f89-40f7-9274-7a92a22ed79b tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Calling method '.version_select at 0x7f4178331790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.625148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf16b9f7-6f89-40f7-9274-7a92a22ed79b tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.625626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf16b9f7-6f89-40f7-9274-7a92a22ed79b tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.626203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf16b9f7-6f89-40f7-9274-7a92a22ed79b tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.645278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf16b9f7-6f89-40f7-9274-7a92a22ed79b tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.645455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf16b9f7-6f89-40f7-9274-7a92a22ed79b tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.645914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf16b9f7-6f89-40f7-9274-7a92a22ed79b tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.653820 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf16b9f7-6f89-40f7-9274-7a92a22ed79b tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.034343 Oct 01 20:49:22.664588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 86/186] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:22.664588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-605aff48-7bcb-405c-a619-c30429163bfa req-f8447536-6247-4cbf-866c-c58e9c0dd9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58df1e80-a139-4db6-82ac-a57e15ac2153", "name": "network-vif-deleted", "tag": "e6d8d0f0-0257-41fb-9a76-0fd1ce638fe6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:22.674462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-605aff48-7bcb-405c-a619-c30429163bfa req-f8447536-6247-4cbf-866c-c58e9c0dd9d1 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.675097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-605aff48-7bcb-405c-a619-c30429163bfa req-f8447536-6247-4cbf-866c-c58e9c0dd9d1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.675541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-605aff48-7bcb-405c-a619-c30429163bfa req-f8447536-6247-4cbf-866c-c58e9c0dd9d1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.693418 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-605aff48-7bcb-405c-a619-c30429163bfa req-f8447536-6247-4cbf-866c-c58e9c0dd9d1 service nova] Creating event network-vif-deleted:e6d8d0f0-0257-41fb-9a76-0fd1ce638fe6 for instance 58df1e80-a139-4db6-82ac-a57e15ac2153 on nch1-master-1 Oct 01 20:49:22.699121 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-605aff48-7bcb-405c-a619-c30429163bfa req-f8447536-6247-4cbf-866c-c58e9c0dd9d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040356 Oct 01 20:49:22.700025 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 87/187] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:22.705492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.706137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:22.715169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.715667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.716108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.716814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.717269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.717693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.785681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:22.799166 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9ed115c1-9c48-41c3-883c-2b25ca564851 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1470 microversion: 2.1 time: 0.215908 Oct 01 20:49:22.814088 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 101/188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:22.814088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Calling method '.version_select at 0x7f417827c9d0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.814088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.814088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.814451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.817841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:22.827544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:22.828912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:22.830725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.831768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.832351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.835256 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e63d3adc-e989-4bc8-9cc1-9462e5c5eaac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.133794 Oct 01 20:49:22.836287 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 88/189] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:22.840911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.841588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:22.847886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.848451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.848693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.849039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.849577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.849872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.850403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.850888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.851010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.889865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.890606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.890974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.891505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lazy-loading 'fault' on Instance uuid 58df1e80-a139-4db6-82ac-a57e15ac2153 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:49:22.953444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07638141e5f34ee783ebfe4f577be214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207636159f8a4318b3d141a828b16260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:22.964903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-996b98a3-337a-4db3-9f00-7c81698d5956 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 200 len: 1328 microversion: 2.1 time: 0.127479 Oct 01 20:49:22.965683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 89/190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 1328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:22.970567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:22.971275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:22.978219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.978843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.979329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.980198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:22.980717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:22.982929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:22.984694 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3eb9d556-5a52-4cbb-9962-626ee2978241 tempest-HypervisorAdminTestJSON-524173384 tempest-HypervisorAdminTestJSON-524173384-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.182727 Oct 01 20:49:22.986059 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 102/191] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:23.323929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:23.324522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:23.333825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:23.335179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:23.337169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:23.340354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:23.341197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:23.342215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:23.423253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:49:23.490039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:23.499133 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0573971e-6191-4eb6-98b6-d58f7fdfae6c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1321 microversion: 2.1 time: 0.532609 Oct 01 20:49:23.503194 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 90/192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:22 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1321 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:23.573988 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-15d9de72-043f-426b-8444-48f67469fa06 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 204 len: 0 microversion: 2.1 time: 0.584721 Oct 01 20:49:23.575078 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 103/193] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:49:22 2022] DELETE /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:49:23.585740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:23.586582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:23.595285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:23.595725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:23.596195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:23.597362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:23.597818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:23.598727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:23.793826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:23.807826 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a0797105-29b8-4f1c-89f1-61e09bbd6aa0 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1476 microversion: 2.1 time: 0.226080 Oct 01 20:49:23.810978 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 91/194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:23 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:23.866779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:23.867485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:23.875039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:23.875468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:23.876235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:23.877128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:23.877583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:23.878011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:23.960229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:23.970122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:23.971710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:23.976742 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d158f32a-7f25-4b39-9889-57d63e797c6e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.114755 Oct 01 20:49:23.977504 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 104/195] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:23 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:23.990586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:23.991181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:23.998269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:23.999224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:23.999868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:24.000915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:24.001725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:24.002357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:24.021403 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] HTTP exception thrown: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Request method failure captured: Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 HTTP/1.1 Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKeoYgOUUwB0GRq80rZ1i3WpWKOke0Q6Q8qH-fxHt7lf2umH8HqSlSq523S24Hod10sHfyMnAMoK8fABmfxQqrBPwCviu3qAwj1Hxb8XS_L_MQttvyNuLFVRzHMKlizZtyE0YsxqXQNCKb-IiOZr8giGxjRu_MvMA4ua6ie6asfcgfM Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 207636159f8a4318b3d141a828b16260 Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminTestJSON-201321937 Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:24.026895 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_207636159f8a4318b3d141a828b16260", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/207636159f8a4318b3d141a828b16260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/207636159f8a4318b3d141a828b16260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/207636159f8a4318b3d141a828b16260"}]}] Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminTestJSON-201321937 Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 207636159f8a4318b3d141a828b16260 Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-201321937 Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminTestJSON-201321937-project Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 07638141e5f34ee783ebfe4f577be214 Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminTestJSON-201321937-project Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:24.028073 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '58df1e80-a139-4db6-82ac-a57e15ac2153'} Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:24.028734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:24.029762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:24.037322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Returning 404 to user: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:24.037322 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94cab0ea-e8d3-430b-8e34-15d7dc011139 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 404 len: 111 microversion: 2.1 time: 0.047641 Oct 01 20:49:24.037858 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 92/196] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:23 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:49:24.049612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7d2dfa82-d4bc-44ba-94dc-09fc7edcfa3d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:24.061666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d2dfa82-d4bc-44ba-94dc-09fc7edcfa3d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:24.063034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d2dfa82-d4bc-44ba-94dc-09fc7edcfa3d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:24.063737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d2dfa82-d4bc-44ba-94dc-09fc7edcfa3d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:24.093008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:24.487925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:24.488534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:24.497937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:INSERT=7 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:24.503715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:24.504205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:24.504633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:24.508300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:24.509029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:24.510578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:24.659955 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7d2dfa82-d4bc-44ba-94dc-09fc7edcfa3d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.621207 Oct 01 20:49:24.662402 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 105/197] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Oct 1 20:49:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:24.668524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a6beb902-8fc6-4e4b-a72d-2ffdc8896782 req-9973fcca-e1b4-4dda-a10b-9b69baaf8f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e14cd883-3b04-49e9-9e08-002afa2fae2f", "tag": "e9b6f564-0714-46c8-bd67-3d043e15b73c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:24.680701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a6beb902-8fc6-4e4b-a72d-2ffdc8896782 req-9973fcca-e1b4-4dda-a10b-9b69baaf8f3d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:24.681440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a6beb902-8fc6-4e4b-a72d-2ffdc8896782 req-9973fcca-e1b4-4dda-a10b-9b69baaf8f3d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:24.682865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a6beb902-8fc6-4e4b-a72d-2ffdc8896782 req-9973fcca-e1b4-4dda-a10b-9b69baaf8f3d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:24.697800 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a6beb902-8fc6-4e4b-a72d-2ffdc8896782 req-9973fcca-e1b4-4dda-a10b-9b69baaf8f3d service nova] Creating event network-changed:e9b6f564-0714-46c8-bd67-3d043e15b73c for instance e14cd883-3b04-49e9-9e08-002afa2fae2f on nch1-master-1 Oct 01 20:49:24.703763 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a6beb902-8fc6-4e4b-a72d-2ffdc8896782 req-9973fcca-e1b4-4dda-a10b-9b69baaf8f3d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039778 Oct 01 20:49:24.707680 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 106/198] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:24.720962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:24.722379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:24.745867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:24.746689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:24.747613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:24.748530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:24.749161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:24.749746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:24.857260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:24.868163 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0f26a58-948c-4850-af46-78659844168f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 200 len: 1611 microversion: 2.1 time: 0.383785 Oct 01 20:49:24.890836 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 93/199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:24 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 1611 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:24.892953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:24.897300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d074986a-779b-416e-8fec-b1803980f363 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:24.939047 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d074986a-779b-416e-8fec-b1803980f363 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.046585 Oct 01 20:49:24.942894 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 94/200] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:24 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:24.950478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:24.954131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:24.965109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:24.965776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:24.966456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:24.967371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:24.967977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:24.968591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:25.437719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:25.453907 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b6ab8310-fcef-4758-9747-1f0683dc072a tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1321 microversion: 2.1 time: 0.742839 Oct 01 20:49:25.455040 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 107/201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:24 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1321 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:25.461397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-145ac061-8305-472b-ad51-0c7b31582392 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1868753058"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:25.472067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-145ac061-8305-472b-ad51-0c7b31582392 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Generated uuid 5ef0d526-8a53-4a8a-a2ba-8e76b40a294c for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:25.517362 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-145ac061-8305-472b-ad51-0c7b31582392 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060479 Oct 01 20:49:25.518359 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 108/202] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:25.532968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:25.533639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:25.551820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:25.552570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:25.553372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:25.554449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:25.555286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:25.555916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:26.116643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:26.145332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:26.147067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:26.157007 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aef99326-820b-4289-965e-689dfd123772 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.636774 Oct 01 20:49:26.157615 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 109/203] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:25 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:26.162097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ec0f10cb-b04b-4e8d-9724-da9606228f96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:26.176064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:26.185044 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7478e1e-4c08-4e02-bc42-d0f41a871b36 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1476 microversion: 2.1 time: 1.239358 Oct 01 20:49:26.185713 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 95/204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:24 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1476 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:26.209458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec0f10cb-b04b-4e8d-9724-da9606228f96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:26.210032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec0f10cb-b04b-4e8d-9724-da9606228f96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:26.220366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec0f10cb-b04b-4e8d-9724-da9606228f96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:26.409053 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ec0f10cb-b04b-4e8d-9724-da9606228f96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.250388 Oct 01 20:49:26.409898 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 110/205] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Oct 1 20:49:26 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:26.421552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bebaa0b9-2144-4617-835c-818be0963ddb tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:26.432803 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bebaa0b9-2144-4617-835c-818be0963ddb tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.014760 Oct 01 20:49:26.450768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d6d086c9-b7e4-4572-af92-afd9563ed1b0 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:26.455043 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 96/206] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 20:49:26 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:26.462811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6d086c9-b7e4-4572-af92-afd9563ed1b0 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:26.463996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6d086c9-b7e4-4572-af92-afd9563ed1b0 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:26.464774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6d086c9-b7e4-4572-af92-afd9563ed1b0 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:26.476925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:26.478051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:26.489250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:26.490055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:26.490754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:26.491670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:26.494750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:26.495395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:26.727943 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d6d086c9-b7e4-4572-af92-afd9563ed1b0 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.280634 Oct 01 20:49:26.731190 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 111/207] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Oct 1 20:49:26 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:26.745278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d666e085-750a-4a5a-85fa-ee247dbdfb12 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:26.855087 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d666e085-750a-4a5a-85fa-ee247dbdfb12 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.117286 Oct 01 20:49:26.864916 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 112/208] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:26 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:26.872413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-344919be-9a4e-4039-a772-4c36337a5099 req-7428ef74-06f2-4e52-b8ac-9169cade0847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f695f0f4-e9de-43e3-9d93-46705a83fa0a", "name": "network-vif-deleted", "tag": "a4763c59-9cb6-42ad-ad87-2455247f8797"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:26.899208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-344919be-9a4e-4039-a772-4c36337a5099 req-7428ef74-06f2-4e52-b8ac-9169cade0847 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:26.902667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-344919be-9a4e-4039-a772-4c36337a5099 req-7428ef74-06f2-4e52-b8ac-9169cade0847 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:26.903336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-344919be-9a4e-4039-a772-4c36337a5099 req-7428ef74-06f2-4e52-b8ac-9169cade0847 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:26.925516 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-344919be-9a4e-4039-a772-4c36337a5099 req-7428ef74-06f2-4e52-b8ac-9169cade0847 service nova] Creating event network-vif-deleted:a4763c59-9cb6-42ad-ad87-2455247f8797 for instance f695f0f4-e9de-43e3-9d93-46705a83fa0a on nch2-master-1 Oct 01 20:49:26.939803 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-344919be-9a4e-4039-a772-4c36337a5099 req-7428ef74-06f2-4e52-b8ac-9169cade0847 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070062 Oct 01 20:49:26.952177 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 113/209] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:26.972943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-744178e9-8502-4043-99fa-55f821d62fcc tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-655123176"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:26.992094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-744178e9-8502-4043-99fa-55f821d62fcc tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Generated uuid a2983073-4744-4809-b15a-7558713c04d4 for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:27.035033 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-744178e9-8502-4043-99fa-55f821d62fcc tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.078159 Oct 01 20:49:27.063280 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 114/210] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:26 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:27.074897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3b65e1e2-a57c-4848-be59-e5b9c96f7597 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:27.083433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:27.098226 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38d1cf06-a23b-429d-8be5-68b0ac65d561 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1321 microversion: 2.1 time: 0.625103 Oct 01 20:49:27.103085 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 97/211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:26 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1321 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:49:27.110976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b65e1e2-a57c-4848-be59-e5b9c96f7597 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:27.113977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b65e1e2-a57c-4848-be59-e5b9c96f7597 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:27.114693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b65e1e2-a57c-4848-be59-e5b9c96f7597 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:27.189744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:27.192135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:27.203081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:27.211645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:27.213767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:27.215006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:27.217885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:27.219696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:27.377101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:27.384608 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3b65e1e2-a57c-4848-be59-e5b9c96f7597 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.319851 Oct 01 20:49:27.385504 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 115/212] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Oct 1 20:49:27 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:27.396966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:27.405182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:27.408593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:27.416511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:27.426044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:27.426571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:27.429475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:27.432181 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cef4a947-d94e-48d7-8293-f5552dae6443 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.246638 Oct 01 20:49:27.432835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:27.434147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:27.436194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:27.436953 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 98/213] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:27 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:27.483414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:27.483983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:27.484580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:27.485107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lazy-loading 'fault' on Instance uuid f695f0f4-e9de-43e3-9d93-46705a83fa0a {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:49:27.548576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:27.558014 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e574f0be-26e6-40f0-bb61-3c6e88bce185 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 200 len: 1310 microversion: 2.1 time: 0.171447 Oct 01 20:49:27.559225 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 116/214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:27 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 1310 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:27.565009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-61ea184f-7031-437e-89e8-b7bf6af9ca7a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:27.573917 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-61ea184f-7031-437e-89e8-b7bf6af9ca7a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.013309 Oct 01 20:49:27.574877 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 117/215] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:49:27 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:27.586990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5f0e729d-8cb1-48dc-b975-a48d71240d2b tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:27.601151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f0e729d-8cb1-48dc-b975-a48d71240d2b tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:27.602331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f0e729d-8cb1-48dc-b975-a48d71240d2b tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:27.602824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f0e729d-8cb1-48dc-b975-a48d71240d2b tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:27.854783 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5f0e729d-8cb1-48dc-b975-a48d71240d2b tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.271327 Oct 01 20:49:27.861762 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 118/216] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Oct 1 20:49:27 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:27.870626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-de455105-b9e9-4150-88be-193b3724a80a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:27.882811 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a462d3b6-cdf9-4ca4-91eb-fc782750c212 tempest-TenantUsagesNegativeTestJSON-7980197 tempest-TenantUsagesNegativeTestJSON-7980197-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-30T20%3A49%3A27.343844&end=2022-10-02T20%3A49%3A27.343844" status: 404 len: 112 microversion: - time: 0.444606 Oct 01 20:49:27.883330 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 99/217] 10.222.0.17 () {58 vars in 1316 bytes} [Sat Oct 1 20:49:27 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-30T20%3A49%3A27.343844&end=2022-10-02T20%3A49%3A27.343844 => generated 112 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 01 20:49:27.894780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60fe4aec-1fe4-4ce9-a132-bc5917abee2e tempest-TenantUsagesNegativeTestJSON-7980197 tempest-TenantUsagesNegativeTestJSON-7980197-project-admin] Calling method '.version_select at 0x7f4173ec79d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:27.905518 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-60fe4aec-1fe4-4ce9-a132-bc5917abee2e tempest-TenantUsagesNegativeTestJSON-7980197 tempest-TenantUsagesNegativeTestJSON-7980197-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60fe4aec-1fe4-4ce9-a132-bc5917abee2e tempest-TenantUsagesNegativeTestJSON-7980197 tempest-TenantUsagesNegativeTestJSON-7980197-project-admin] Request method failure captured: Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-simple-tenant-usage/158034e03ee1475fa3ef2fcd49191642?start=2022-10-02T20%3A49%3A27.343844&end=2022-09-30T20%3A49%3A27.343844 HTTP/1.1 Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfXi-9J3d37Yy0Ju3_vXjViJ-DUzRu7_RSKhojrrcRVnl89PF5FYmeva06cccU2wTgzGlruu_hmIXbPNMcBlH46vpmUSy4k-wIEEeVNpUSq-D-1i1lOASnPFb_NbVTvUq3b8fv9KMDz5veKsTbNBO4V3TC9ZDJmO5iMGuZndlSBphg Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 36ed5b8bf96d46889380bc1bd386552f Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-7980197 Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:27.909099 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_36ed5b8bf96d46889380bc1bd386552f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36ed5b8bf96d46889380bc1bd386552f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/36ed5b8bf96d46889380bc1bd386552f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36ed5b8bf96d46889380bc1bd386552f"}]}] Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-7980197 Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 36ed5b8bf96d46889380bc1bd386552f Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-7980197 Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TenantUsagesNegativeTestJSON-7980197-project-admin Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 212bd8ae4d5f41afb5793106cbf97170 Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-7980197-project-admin Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid start time. The start time cannot occur after the end time. Oct 01 20:49:27.910570 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '158034e03ee1475fa3ef2fcd49191642'} Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 01 20:49:27.911377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 01 20:49:27.912838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:27.915536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60fe4aec-1fe4-4ce9-a132-bc5917abee2e tempest-TenantUsagesNegativeTestJSON-7980197 tempest-TenantUsagesNegativeTestJSON-7980197-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:27.917489 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60fe4aec-1fe4-4ce9-a132-bc5917abee2e tempest-TenantUsagesNegativeTestJSON-7980197 tempest-TenantUsagesNegativeTestJSON-7980197-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/158034e03ee1475fa3ef2fcd49191642?start=2022-10-02T20%3A49%3A27.343844&end=2022-09-30T20%3A49%3A27.343844" status: 400 len: 111 microversion: 2.1 time: 0.027951 Oct 01 20:49:27.918036 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 100/218] 10.222.0.17 () {58 vars in 1412 bytes} [Sat Oct 1 20:49:27 2022] GET /compute/v2.1/os-simple-tenant-usage/158034e03ee1475fa3ef2fcd49191642?start=2022-10-02T20%3A49%3A27.343844&end=2022-09-30T20%3A49%3A27.343844 => generated 111 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:49:27.944846 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-de455105-b9e9-4150-88be-193b3724a80a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.079822 Oct 01 20:49:27.953521 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 119/219] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:27 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:27.964705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-43f23214-aa14-4710-a07b-341b64af8730 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1050488692"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:27.969759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-43f23214-aa14-4710-a07b-341b64af8730 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Generated uuid 3d7185bb-12e7-41f7-9574-ef1acda745d4 for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:27.998616 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-43f23214-aa14-4710-a07b-341b64af8730 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043917 Oct 01 20:49:27.999556 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 120/220] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:28.012536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a179eb2a-c276-450a-952c-ed2a73e5dd96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:28.030663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a179eb2a-c276-450a-952c-ed2a73e5dd96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.031743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a179eb2a-c276-450a-952c-ed2a73e5dd96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.032221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a179eb2a-c276-450a-952c-ed2a73e5dd96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.043086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:28.159949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-580fe370-d5bd-43c8-80ba-50b2999aab4c tempest-TenantUsagesNegativeTestJSON-1754956201 tempest-TenantUsagesNegativeTestJSON-1754956201-project] Calling method '.version_select at 0x7f41781f00d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.164354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-580fe370-d5bd-43c8-80ba-50b2999aab4c tempest-TenantUsagesNegativeTestJSON-1754956201 tempest-TenantUsagesNegativeTestJSON-1754956201-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '12d267ccfaad43b58d3fcfe77b295147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158034e03ee1475fa3ef2fcd49191642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-580fe370-d5bd-43c8-80ba-50b2999aab4c tempest-TenantUsagesNegativeTestJSON-1754956201 tempest-TenantUsagesNegativeTestJSON-1754956201-project] Request method failure captured: Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-30T20%3A49%3A27.343844&end=2022-10-02T20%3A49%3A27.343844&detailed=1 HTTP/1.1 Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfWuuaf96JsFGu6hl62sD0MtcUfhXVHg0Hys2_eQWJJuE8c7l1irYZQLo76btswG389zoETI3sIxHGdf2tP7F7VOC-S23YWqPaQFf9zHYuElw7mZxNlVzQ9LIdLP24YqBlQpkEgHxDEyhwUi8XuYX3zW_c4C-wZ5cJxLqvop-a-2FM Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 158034e03ee1475fa3ef2fcd49191642 Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1754956201 Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:28.166658 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_158034e03ee1475fa3ef2fcd49191642", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/158034e03ee1475fa3ef2fcd49191642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/158034e03ee1475fa3ef2fcd49191642"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/158034e03ee1475fa3ef2fcd49191642"}]}] Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1754956201 Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 158034e03ee1475fa3ef2fcd49191642 Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1754956201 Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TenantUsagesNegativeTestJSON-1754956201-project Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 12d267ccfaad43b58d3fcfe77b295147 Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1754956201-project Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: action_args: {} Oct 01 20:49:28.167809 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:28.168560 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:28.169667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:28.170708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 01 20:49:28.170708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.172853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-580fe370-d5bd-43c8-80ba-50b2999aab4c tempest-TenantUsagesNegativeTestJSON-1754956201 tempest-TenantUsagesNegativeTestJSON-1754956201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:28.173148 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a179eb2a-c276-450a-952c-ed2a73e5dd96 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.164600 Oct 01 20:49:28.173698 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-580fe370-d5bd-43c8-80ba-50b2999aab4c tempest-TenantUsagesNegativeTestJSON-1754956201 tempest-TenantUsagesNegativeTestJSON-1754956201-project] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-30T20%3A49%3A27.343844&end=2022-10-02T20%3A49%3A27.343844&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.238362 Oct 01 20:49:28.173816 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 121/221] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Oct 1 20:49:28 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:28.174677 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 101/222] 10.222.0.17 () {58 vars in 1335 bytes} [Sat Oct 1 20:49:27 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-30T20%3A49%3A27.343844&end=2022-10-02T20%3A49%3A27.343844&detailed=1 => generated 123 bytes in 240 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:28.179629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.180964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:28.189804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.190357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.190932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.191997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.192497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.193134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.329439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d84808be-1013-46c6-a92b-326d5831a808 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Calling method '.version_select at 0x7f41780775e0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.331628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d84808be-1013-46c6-a92b-326d5831a808 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b2b4c0f4f5d14963b4d64e87f7952152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23d8ef101154d23bda42171941e90b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d84808be-1013-46c6-a92b-326d5831a808 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Request method failure captured: Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfWpsQP06yauVqnzYkkvjkHW7zH8iCArbecK4FlmhFNSy4zHzBEtHW-Y3M7oV4UDGSKaIDfoWQXXekgR6lh6MVnjuo1ogMaeJuqy0w2Z7g5xlJE1DSgxj1gFrJgq1N6fMNBGAkm8AFcISGa4sqwxe7N0rom7fA6fwEFwDdA8nzMWUo Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:28.333724 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d23d8ef101154d23bda42171941e90b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}] Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: b2b4c0f4f5d14963b4d64e87f7952152 Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: action_args: {} Oct 01 20:49:28.334963 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:28.335670 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 01 20:49:28.336697 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.339054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d84808be-1013-46c6-a92b-326d5831a808 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:28.340039 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d84808be-1013-46c6-a92b-326d5831a808 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.165327 Oct 01 20:49:28.345262 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 122/223] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 171 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:28.350846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0195e9fb-5583-4b03-8782-4e4d50dc5dac tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:28.362708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0195e9fb-5583-4b03-8782-4e4d50dc5dac tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.363407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0195e9fb-5583-4b03-8782-4e4d50dc5dac tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.364036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0195e9fb-5583-4b03-8782-4e4d50dc5dac tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.423840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:28.435033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-330229fe-6911-4694-8dca-1debd6d95927 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1321 microversion: 2.1 time: 0.259107 Oct 01 20:49:28.435627 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 102/224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:28.441205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60a0fd58-fbb1-4304-ab2f-112b75f262dc tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Calling method '.version_select at 0x7f4173ec78b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.443967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60a0fd58-fbb1-4304-ab2f-112b75f262dc tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b2b4c0f4f5d14963b4d64e87f7952152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23d8ef101154d23bda42171941e90b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60a0fd58-fbb1-4304-ab2f-112b75f262dc tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Request method failure captured: Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfWpsQP06yauVqnzYkkvjkHW7zH8iCArbecK4FlmhFNSy4zHzBEtHW-Y3M7oV4UDGSKaIDfoWQXXekgR6lh6MVnjuo1ogMaeJuqy0w2Z7g5xlJE1DSgxj1gFrJgq1N6fMNBGAkm8AFcISGa4sqwxe7N0rom7fA6fwEFwDdA8nzMWUo Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:28.446223 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d23d8ef101154d23bda42171941e90b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}] Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: b2b4c0f4f5d14963b4d64e87f7952152 Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: action_args: {} Oct 01 20:49:28.448011 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:28.448800 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 01 20:49:28.449894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.453596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60a0fd58-fbb1-4304-ab2f-112b75f262dc tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:28.453596 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60a0fd58-fbb1-4304-ab2f-112b75f262dc tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.011458 Oct 01 20:49:28.453596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 103/225] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:28.461928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99cd1120-d082-4ebd-b8f5-a3702eb89253 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Calling method '.version_select at 0x7f4173f35790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.464382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-99cd1120-d082-4ebd-b8f5-a3702eb89253 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b2b4c0f4f5d14963b4d64e87f7952152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23d8ef101154d23bda42171941e90b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99cd1120-d082-4ebd-b8f5-a3702eb89253 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Request method failure captured: Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfWpsQP06yauVqnzYkkvjkHW7zH8iCArbecK4FlmhFNSy4zHzBEtHW-Y3M7oV4UDGSKaIDfoWQXXekgR6lh6MVnjuo1ogMaeJuqy0w2Z7g5xlJE1DSgxj1gFrJgq1N6fMNBGAkm8AFcISGa4sqwxe7N0rom7fA6fwEFwDdA8nzMWUo Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:28.466529 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d23d8ef101154d23bda42171941e90b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}] Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: b2b4c0f4f5d14963b4d64e87f7952152 Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: action_args: {} Oct 01 20:49:28.467721 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:28.468465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 01 20:49:28.470096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.471129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99cd1120-d082-4ebd-b8f5-a3702eb89253 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:28.471129 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99cd1120-d082-4ebd-b8f5-a3702eb89253 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.012029 Oct 01 20:49:28.471129 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 104/226] 10.222.0.17 () {58 vars in 1179 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:28.485866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.486907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:28.496005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.496794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.497464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.498345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.499071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.499771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.515808 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0195e9fb-5583-4b03-8782-4e4d50dc5dac tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.169071 Oct 01 20:49:28.516574 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 123/227] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Oct 1 20:49:28 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:28.582700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:28.592854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:28.595471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:28.601022 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4ade99c1-0639-417d-bb17-b1dd745df2fc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.131589 Oct 01 20:49:28.602217 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 105/228] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:28.623168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a67c5e35-689d-4b92-98ad-d2ae07152c0d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.661620 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a67c5e35-689d-4b92-98ad-d2ae07152c0d tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.048721 Oct 01 20:49:28.662647 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 106/229] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:28 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:28.672470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.673094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:28.679413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.679985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.680415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.681305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.681952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.682559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.698812 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] HTTP exception thrown: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Request method failure captured: Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a HTTP/1.1 Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKe51e_P6YvkkzbxVUeqFO4x7I7BSGu7qxvuNRbOs9Wrpa9VT8add7Sn8wzeX71lLEij1Z_WbVqb4tDM54OH1sxX6DdlC39LwzGXWlwM16RzjinnOHCAs5L9VZaDJjWBUYtzWsRPDFBbclf_DuIkFG4Hex8jFQr21Uo8XbqiXgD9qTk Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:28.700712 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e93dcf30e02b41178c6cde6e50a41e17", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}] Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7ef35c15f9d541ac90239c3713f9f5e6 Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:28.701920 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f695f0f4-e9de-43e3-9d93-46705a83fa0a'} Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:28.702628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:28.703704 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.706333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Returning 404 to user: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:28.710809 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9800b00-4a07-4cff-b0d2-f93f5f057741 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 404 len: 111 microversion: 2.1 time: 0.043801 Oct 01 20:49:28.711994 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 107/230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:28.717468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d73f6267-3ee7-4eda-a303-10395995a9d2 req-378cb94a-0995-421f-bd0c-2a44b8dd5fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bff70c8-a206-4b32-8db9-aba1975bf1db", "name": "network-vif-plugged", "status": "completed", "tag": "2cc51466-d60f-4b61-9c90-acdd94cf1546"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:28.729585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d73f6267-3ee7-4eda-a303-10395995a9d2 req-378cb94a-0995-421f-bd0c-2a44b8dd5fec service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.730345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d73f6267-3ee7-4eda-a303-10395995a9d2 req-378cb94a-0995-421f-bd0c-2a44b8dd5fec service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.731037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d73f6267-3ee7-4eda-a303-10395995a9d2 req-378cb94a-0995-421f-bd0c-2a44b8dd5fec service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.736654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:28.747910 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d73f6267-3ee7-4eda-a303-10395995a9d2 req-378cb94a-0995-421f-bd0c-2a44b8dd5fec service nova] Creating event network-vif-plugged:2cc51466-d60f-4b61-9c90-acdd94cf1546 for instance 5bff70c8-a206-4b32-8db9-aba1975bf1db on nch2-master-1 Oct 01 20:49:28.755216 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d73f6267-3ee7-4eda-a303-10395995a9d2 req-378cb94a-0995-421f-bd0c-2a44b8dd5fec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041846 Oct 01 20:49:28.756286 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 108/231] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:28.763940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef947540-1d60-4890-83d5-a6d3736dff76 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1229064584"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:28.767514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.aggregate [None req-ef947540-1d60-4890-83d5-a6d3736dff76 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Generated uuid e41f61cd-be76-4c4d-ae1e-f9906ea2b856 for aggregate {{(pid=140438) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:28.792393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Calling method '.version_select at 0x7f41781fe3a0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.794472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.795002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.795532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.821377 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef947540-1d60-4890-83d5-a6d3736dff76 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062055 Oct 01 20:49:28.823494 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 109/232] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:28.823613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.824173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.824681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.838856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e37a8c74-fcd5-46e4-9c0d-085092bff6e8 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Calling method '.version_select at 0x7f4173ec7b80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.842549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37a8c74-fcd5-46e4-9c0d-085092bff6e8 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.843071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37a8c74-fcd5-46e4-9c0d-085092bff6e8 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.843681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37a8c74-fcd5-46e4-9c0d-085092bff6e8 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.844561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37a8c74-fcd5-46e4-9c0d-085092bff6e8 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.845194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37a8c74-fcd5-46e4-9c0d-085092bff6e8 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.845756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37a8c74-fcd5-46e4-9c0d-085092bff6e8 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.850131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.850852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.851371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.852278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=11 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:28.861150 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-879dbd9a-a7ec-443f-9d97-d183735a646d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.343024 Oct 01 20:49:28.862558 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 124/233] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:28.875795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7a303a8b-96f1-4fba-a2d2-e262ec888e88 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.881687 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e37a8c74-fcd5-46e4-9c0d-085092bff6e8 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.057091 Oct 01 20:49:28.888899 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 110/234] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:28.895444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-719a1e76-32a5-4c95-b172-6234476f1a75 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Calling method '.version_select at 0x7f4178331af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.897839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-719a1e76-32a5-4c95-b172-6234476f1a75 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b2b4c0f4f5d14963b4d64e87f7952152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23d8ef101154d23bda42171941e90b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-719a1e76-32a5-4c95-b172-6234476f1a75 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Request method failure captured: Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfWpsQP06yauVqnzYkkvjkHW7zH8iCArbecK4FlmhFNSy4zHzBEtHW-Y3M7oV4UDGSKaIDfoWQXXekgR6lh6MVnjuo1ogMaeJuqy0w2Z7g5xlJE1DSgxj1gFrJgq1N6fMNBGAkm8AFcISGa4sqwxe7N0rom7fA6fwEFwDdA8nzMWUo Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:28.900608 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d23d8ef101154d23bda42171941e90b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}] Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: b2b4c0f4f5d14963b4d64e87f7952152 Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1'} Oct 01 20:49:28.902106 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:28.903084 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 01 20:49:28.904301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.906186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-719a1e76-32a5-4c95-b172-6234476f1a75 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:28.907166 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-719a1e76-32a5-4c95-b172-6234476f1a75 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.016328 Oct 01 20:49:28.907715 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 111/235] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:28.912190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9fdf9528-78de-464b-b67c-c6f35bd1dc0d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Calling method '.version_select at 0x7f4173ec7940>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.915722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fdf9528-78de-464b-b67c-c6f35bd1dc0d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.916808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fdf9528-78de-464b-b67c-c6f35bd1dc0d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.917269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fdf9528-78de-464b-b67c-c6f35bd1dc0d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.917981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fdf9528-78de-464b-b67c-c6f35bd1dc0d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:28.918433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fdf9528-78de-464b-b67c-c6f35bd1dc0d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:28.918881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fdf9528-78de-464b-b67c-c6f35bd1dc0d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:28.922723 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7a303a8b-96f1-4fba-a2d2-e262ec888e88 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.058770 Oct 01 20:49:28.926432 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 125/236] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:28 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:28.929868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1993331613", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:28.943775 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9fdf9528-78de-464b-b67c-c6f35bd1dc0d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.034961 Oct 01 20:49:28.947663 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 112/237] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:28.957346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc5b0010-5a9a-4f88-9605-e3af4808a74d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Calling method '.version_select at 0x7f4178331790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.960433 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-bc5b0010-5a9a-4f88-9605-e3af4808a74d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] HTTP exception thrown: Hypervisor with ID '17843de8-a404-4554-b457-a775d29b17d1' could not be found. Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc5b0010-5a9a-4f88-9605-e3af4808a74d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Request method failure captured: Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hypervisors/17843de8-a404-4554-b457-a775d29b17d1/uptime HTTP/1.1 Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfXqsnH-lgI3H2gYd9pTutwnfmJTU3ayhuFFOa0mtYJjqS1qFDy4JLxsvjws7iLXpm7SeHYenYC80rU6ljP-Q4u7VpyaGYKc1LcYe0KVBcYP0PDYiJ8S6dKgXFwoSjBRf4HuG2gkkejdsVkF00Q8OHU-Y2MK-IcTRfgrfEUki99_bA Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a68a43f9a1a44afdbe35ce9ce10e2279 Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-385954764 Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:28.971624 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a68a43f9a1a44afdbe35ce9ce10e2279", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a68a43f9a1a44afdbe35ce9ce10e2279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a68a43f9a1a44afdbe35ce9ce10e2279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a68a43f9a1a44afdbe35ce9ce10e2279"}]}] Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-385954764 Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a68a43f9a1a44afdbe35ce9ce10e2279 Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-385954764 Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: fa8ed9d260d64c6689104e50497dcfc9 Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: exception: Hypervisor with ID '17843de8-a404-4554-b457-a775d29b17d1' could not be found. Oct 01 20:49:28.972835 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '17843de8-a404-4554-b457-a775d29b17d1'} Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '17843de8-a404-4554-b457-a775d29b17d1' Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 01 20:49:28.973519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '17843de8-a404-4554-b457-a775d29b17d1' could not be found. Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:28.974698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '17843de8-a404-4554-b457-a775d29b17d1' could not be found. Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc5b0010-5a9a-4f88-9605-e3af4808a74d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Returning 404 to user: Hypervisor with ID '17843de8-a404-4554-b457-a775d29b17d1' could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc5b0010-5a9a-4f88-9605-e3af4808a74d tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/17843de8-a404-4554-b457-a775d29b17d1/uptime" status: 404 len: 123 microversion: 2.1 time: 0.024451 Oct 01 20:49:28.975902 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 113/238] 10.222.0.17 () {58 vars in 1278 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-hypervisors/17843de8-a404-4554-b457-a775d29b17d1/uptime => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:28.984611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0398e571-8ed0-4f98-95a5-6566c98418d1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:28.992009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:49:28.993640 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-0398e571-8ed0-4f98-95a5-6566c98418d1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0398e571-8ed0-4f98-95a5-6566c98418d1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Request method failure captured: Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKert5XScLeUx313JRYZUHttrepv3fqBlrh9G4UxYADEvtfOOVAtGcJVGHuROURd0uWBEpSil3qNtDCXWAtzBgXEEM9OdbmfpNb8r7z40EYxHm6qRoPgqtVguAO16x_6TFe8u3odtVgxkz6gY4fOm0iLnH4erm29xZb5QcqUr5NWREA Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 215471dd429642b3974741aade3aaba0 Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:28.995842 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_215471dd429642b3974741aade3aaba0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/215471dd429642b3974741aade3aaba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/215471dd429642b3974741aade3aaba0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/215471dd429642b3974741aade3aaba0"}]}] Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 215471dd429642b3974741aade3aaba0 Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminTestJSON-1310503968-project-admin Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7408e981e5404f7faeb1b018e345f741 Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminTestJSON-1310503968-project-admin Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: exception: Aggregate 5 could not be found. Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5'} Oct 01 20:49:28.997263 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.001447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 01 20:49:29.002549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.003568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0398e571-8ed0-4f98-95a5-6566c98418d1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:29.003568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0398e571-8ed0-4f98-95a5-6566c98418d1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.022376 Oct 01 20:49:29.003568 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 114/239] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:29.003568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2814697-85d4-4a7b-8a0d-2c011377764d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Calling method '.version_select at 0x7f4173f354c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.006582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2814697-85d4-4a7b-8a0d-2c011377764d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.007067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2814697-85d4-4a7b-8a0d-2c011377764d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.007588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2814697-85d4-4a7b-8a0d-2c011377764d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.008340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2814697-85d4-4a7b-8a0d-2c011377764d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.008795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2814697-85d4-4a7b-8a0d-2c011377764d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.009275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2814697-85d4-4a7b-8a0d-2c011377764d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.036042 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2814697-85d4-4a7b-8a0d-2c011377764d tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.037105 Oct 01 20:49:29.036854 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 115/240] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Oct 1 20:49:28 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:29.047600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Calling method '.version_select at 0x7f4178810430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.049245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.049725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.050194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.069320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.069912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.070344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.083262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.083844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.084289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.091374 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c16de7b-0fce-49f6-9d4f-9b923f0e86f7 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047596 Oct 01 20:49:29.091982 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 116/241] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:29.102480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f6202ca-c991-4a03-924b-b3c5ca50d6a1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.117836 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-0f6202ca-c991-4a03-924b-b3c5ca50d6a1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f6202ca-c991-4a03-924b-b3c5ca50d6a1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Request method failure captured: Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKert5XScLeUx313JRYZUHttrepv3fqBlrh9G4UxYADEvtfOOVAtGcJVGHuROURd0uWBEpSil3qNtDCXWAtzBgXEEM9OdbmfpNb8r7z40EYxHm6qRoPgqtVguAO16x_6TFe8u3odtVgxkz6gY4fOm0iLnH4erm29xZb5QcqUr5NWREA Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 215471dd429642b3974741aade3aaba0 Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:29.119859 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_215471dd429642b3974741aade3aaba0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/215471dd429642b3974741aade3aaba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/215471dd429642b3974741aade3aaba0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/215471dd429642b3974741aade3aaba0"}]}] Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 215471dd429642b3974741aade3aaba0 Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminTestJSON-1310503968-project-admin Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7408e981e5404f7faeb1b018e345f741 Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminTestJSON-1310503968-project-admin Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: exception: Aggregate 5 could not be found. Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5'} Oct 01 20:49:29.121099 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:29.121912 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.123038 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.127768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.127768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:29.127768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:29.127768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 01 20:49:29.127768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.127768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f6202ca-c991-4a03-924b-b3c5ca50d6a1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:29.127768 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f6202ca-c991-4a03-924b-b3c5ca50d6a1 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.022379 Oct 01 20:49:29.127768 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 117/242] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:29 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:29.131652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b6c7482-3654-4468-ac31-21b5e14c9b36 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Calling method '.version_select at 0x7f4173ec7ca0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.140397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b6c7482-3654-4468-ac31-21b5e14c9b36 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.140907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b6c7482-3654-4468-ac31-21b5e14c9b36 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.141352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b6c7482-3654-4468-ac31-21b5e14c9b36 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.166425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b6c7482-3654-4468-ac31-21b5e14c9b36 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.166834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b6c7482-3654-4468-ac31-21b5e14c9b36 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.167286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b6c7482-3654-4468-ac31-21b5e14c9b36 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.203261 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7b6c7482-3654-4468-ac31-21b5e14c9b36 tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.075538 Oct 01 20:49:29.203917 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 118/243] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:29.208526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7253eee-99e7-41e4-bd66-9007a06f3e89 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Calling method '.version_select at 0x7f4173ec74c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.210615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f7253eee-99e7-41e4-bd66-9007a06f3e89 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b2b4c0f4f5d14963b4d64e87f7952152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23d8ef101154d23bda42171941e90b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7253eee-99e7-41e4-bd66-9007a06f3e89 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Request method failure captured: Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfWpsQP06yauVqnzYkkvjkHW7zH8iCArbecK4FlmhFNSy4zHzBEtHW-Y3M7oV4UDGSKaIDfoWQXXekgR6lh6MVnjuo1ogMaeJuqy0w2Z7g5xlJE1DSgxj1gFrJgq1N6fMNBGAkm8AFcISGa4sqwxe7N0rom7fA6fwEFwDdA8nzMWUo Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:29.212184 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d23d8ef101154d23bda42171941e90b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d23d8ef101154d23bda42171941e90b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d23d8ef101154d23bda42171941e90b3"}]}] Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d23d8ef101154d23bda42171941e90b3 Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870 Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: b2b4c0f4f5d14963b4d64e87f7952152 Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1893627870-project Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1'} Oct 01 20:49:29.213984 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:29.214723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 01 20:49:29.216937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.220858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7253eee-99e7-41e4-bd66-9007a06f3e89 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:29.220858 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7253eee-99e7-41e4-bd66-9007a06f3e89 tempest-HypervisorAdminNegativeTestJSON-1893627870 tempest-HypervisorAdminNegativeTestJSON-1893627870-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009456 Oct 01 20:49:29.220858 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 119/244] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:29.223421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c904f10a-c388-421c-aace-878e1aa18c55 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1320330461", "name": "tempest-test_aggregate-2083508481"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:29.229441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:49:29.229950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:49:29.230678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:49:29.231174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:49:29.232005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:49:29.243202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.243769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.244481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.245214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.aggregate [None req-c904f10a-c388-421c-aace-878e1aa18c55 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Generated uuid a61db861-ac0b-4c7a-a10c-e33d9b4c31db for aggregate {{(pid=140438) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:29.245345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.245806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.246243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.265959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Getting quotas for project e93dcf30e02b41178c6cde6e50a41e17. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:29.271585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Getting quotas for user 7ef35c15f9d541ac90239c3713f9f5e6 and project e93dcf30e02b41178c6cde6e50a41e17. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:29.284394 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c904f10a-c388-421c-aace-878e1aa18c55 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.064481 Oct 01 20:49:29.285002 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 120/245] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Oct 1 20:49:29 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:29.286625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:49:29.289005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:49:29.294985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-789dc487-052e-4dec-a693-222c4c7ae2af tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Calling method '.version_select at 0x7f4173ec7c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.302114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-789dc487-052e-4dec-a693-222c4c7ae2af tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.302743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-789dc487-052e-4dec-a693-222c4c7ae2af tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.303534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-789dc487-052e-4dec-a693-222c4c7ae2af tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.318112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-789dc487-052e-4dec-a693-222c4c7ae2af tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.318625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-789dc487-052e-4dec-a693-222c4c7ae2af tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.319114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-789dc487-052e-4dec-a693-222c4c7ae2af tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.338286 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-789dc487-052e-4dec-a693-222c4c7ae2af tempest-HostsAdminTestJSON-1703980509 tempest-HostsAdminTestJSON-1703980509-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.052254 Oct 01 20:49:29.338890 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 121/246] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:29.343322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3fc1a58-1452-44a3-853b-941266cd6873 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Calling method '.version_select at 0x7f4173f35af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.345080 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fdeb741c-2844-482a-a7e0-29f8bf1bc15c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.420093 Oct 01 20:49:29.345481 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e3fc1a58-1452-44a3-853b-941266cd6873 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] HTTP exception thrown: Hypervisor with ID '758f3e14-d010-496e-86ac-16563984dfec' could not be found. Oct 01 20:49:29.346517 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 126/247] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3fc1a58-1452-44a3-853b-941266cd6873 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Request method failure captured: Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hypervisors/758f3e14-d010-496e-86ac-16563984dfec HTTP/1.1 Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfXqsnH-lgI3H2gYd9pTutwnfmJTU3ayhuFFOa0mtYJjqS1qFDy4JLxsvjws7iLXpm7SeHYenYC80rU6ljP-Q4u7VpyaGYKc1LcYe0KVBcYP0PDYiJ8S6dKgXFwoSjBRf4HuG2gkkejdsVkF00Q8OHU-Y2MK-IcTRfgrfEUki99_bA Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a68a43f9a1a44afdbe35ce9ce10e2279 Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-385954764 Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:29.347789 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a68a43f9a1a44afdbe35ce9ce10e2279", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a68a43f9a1a44afdbe35ce9ce10e2279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a68a43f9a1a44afdbe35ce9ce10e2279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a68a43f9a1a44afdbe35ce9ce10e2279"}]}] Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-385954764 Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a68a43f9a1a44afdbe35ce9ce10e2279 Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-385954764 Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: fa8ed9d260d64c6689104e50497dcfc9 Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: exception: Hypervisor with ID '758f3e14-d010-496e-86ac-16563984dfec' could not be found. Oct 01 20:49:29.349214 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '758f3e14-d010-496e-86ac-16563984dfec'} Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '758f3e14-d010-496e-86ac-16563984dfec' Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 01 20:49:29.349873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:49:29.351097 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '758f3e14-d010-496e-86ac-16563984dfec' could not be found. Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '758f3e14-d010-496e-86ac-16563984dfec' could not be found. Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3fc1a58-1452-44a3-853b-941266cd6873 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] Returning 404 to user: Hypervisor with ID '758f3e14-d010-496e-86ac-16563984dfec' could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3fc1a58-1452-44a3-853b-941266cd6873 tempest-HypervisorAdminNegativeTestJSON-385954764 tempest-HypervisorAdminNegativeTestJSON-385954764-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/758f3e14-d010-496e-86ac-16563984dfec" status: 404 len: 123 microversion: 2.1 time: 0.009192 Oct 01 20:49:29.352162 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 122/248] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/os-hypervisors/758f3e14-d010-496e-86ac-16563984dfec => generated 123 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:29.358280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-db04fc2a-7748-43dd-ab95-9eb1d3e87df9 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.358538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ed9eed33-8d51-45ff-b3d7-e26d4e3b1f13 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.359274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ed9eed33-8d51-45ff-b3d7-e26d4e3b1f13 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:29.387686 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-db04fc2a-7748-43dd-ab95-9eb1d3e87df9 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.040046 Oct 01 20:49:29.389107 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 127/249] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:29 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:29.398776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ae79969-19a2-4a87-9556-c7410a91da0a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.406919 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-9ae79969-19a2-4a87-9556-c7410a91da0a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ae79969-19a2-4a87-9556-c7410a91da0a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Request method failure captured: Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKert5XScLeUx313JRYZUHttrepv3fqBlrh9G4UxYADEvtfOOVAtGcJVGHuROURd0uWBEpSil3qNtDCXWAtzBgXEEM9OdbmfpNb8r7z40EYxHm6qRoPgqtVguAO16x_6TFe8u3odtVgxkz6gY4fOm0iLnH4erm29xZb5QcqUr5NWREA Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 215471dd429642b3974741aade3aaba0 Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:29.409428 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_215471dd429642b3974741aade3aaba0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/215471dd429642b3974741aade3aaba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/215471dd429642b3974741aade3aaba0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/215471dd429642b3974741aade3aaba0"}]}] Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 215471dd429642b3974741aade3aaba0 Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminTestJSON-1310503968-project-admin Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 7408e981e5404f7faeb1b018e345f741 Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminTestJSON-1310503968-project-admin Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: exception: Aggregate 6 could not be found. Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '6'} Oct 01 20:49:29.410610 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.411320 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 01 20:49:29.412343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.413352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ae79969-19a2-4a87-9556-c7410a91da0a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:29.413352 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9ae79969-19a2-4a87-9556-c7410a91da0a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.018054 Oct 01 20:49:29.413352 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 128/250] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 01 20:49:29.421270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ed9eed33-8d51-45ff-b3d7-e26d4e3b1f13 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:29.423456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-70364dc8-ae60-48d2-aa26-04e965bc0e54 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.423578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=7 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:29.434108 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ed9eed33-8d51-45ff-b3d7-e26d4e3b1f13 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1220 microversion: 2.1 time: 0.078791 Oct 01 20:49:29.434986 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 123/251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:29.436942 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-70364dc8-ae60-48d2-aa26-04e965bc0e54 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-70364dc8-ae60-48d2-aa26-04e965bc0e54 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Request method failure captured: Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKert5XScLeUx313JRYZUHttrepv3fqBlrh9G4UxYADEvtfOOVAtGcJVGHuROURd0uWBEpSil3qNtDCXWAtzBgXEEM9OdbmfpNb8r7z40EYxHm6qRoPgqtVguAO16x_6TFe8u3odtVgxkz6gY4fOm0iLnH4erm29xZb5QcqUr5NWREA Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 215471dd429642b3974741aade3aaba0 Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:29.438736 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_215471dd429642b3974741aade3aaba0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/215471dd429642b3974741aade3aaba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/215471dd429642b3974741aade3aaba0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/215471dd429642b3974741aade3aaba0"}]}] Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 215471dd429642b3974741aade3aaba0 Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1310503968 Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminTestJSON-1310503968-project-admin Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 7408e981e5404f7faeb1b018e345f741 Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminTestJSON-1310503968-project-admin Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: exception: Aggregate 6 could not be found. Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '6'} Oct 01 20:49:29.439905 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:29.440767 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:29.442019 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:29.444695 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:29.444695 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:29.444695 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:29.444695 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 01 20:49:29.444695 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:29.444695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-70364dc8-ae60-48d2-aa26-04e965bc0e54 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:29.446182 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-70364dc8-ae60-48d2-aa26-04e965bc0e54 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.028946 Oct 01 20:49:29.449777 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 129/252] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:29 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:29.460212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.461092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:29.466532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3b981997-7fab-4bcb-b008-5d838f2831ea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1680141184"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:29.473250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-3b981997-7fab-4bcb-b008-5d838f2831ea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Generated uuid d473371c-8cb1-44d8-831c-663ad62f7284 for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:29.477580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.478933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.479575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.480718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.481363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.481941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.503367 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3b981997-7fab-4bcb-b008-5d838f2831ea tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046158 Oct 01 20:49:29.510242 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 130/253] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:29.516914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c14591c2-c9fc-4ffc-9837-593a053d4ca2 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.526770 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c14591c2-c9fc-4ffc-9837-593a053d4ca2 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 227 microversion: 2.1 time: 0.014160 Oct 01 20:49:29.527590 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 131/254] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/os-aggregates/7 => generated 227 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:49:29.539261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-99d89cd7-a1b0-41b8-95f6-7143a024c9e8 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:29.570322 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-99d89cd7-a1b0-41b8-95f6-7143a024c9e8 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 265 microversion: 2.1 time: 0.034980 Oct 01 20:49:29.571622 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 132/255] 10.222.0.17 () {60 vars in 1191 bytes} [Sat Oct 1 20:49:29 2022] POST /compute/v2.1/os-aggregates/7/action => generated 265 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:49:29.605671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5f1211cc-449c-40d9-b916-232af0453674 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.649632 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5f1211cc-449c-40d9-b916-232af0453674 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 241 microversion: 2.1 time: 0.063535 Oct 01 20:49:29.657007 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 133/256] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/os-aggregates/7 => generated 241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:29.675595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.676016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:29.699530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.700057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.700542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.701301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:29.712370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:29.713451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:29.810154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:29.818483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:29.827045 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6da3add5-c1db-4883-b40f-2775ed84b096 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1321 microversion: 2.1 time: 0.373299 Oct 01 20:49:29.828682 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 124/257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:29.829673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:29.833100 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:29.833795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-69eba53e-575b-452e-88c1-64a8afdc9ab0 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:29.841358 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-64f1d3a4-93fb-43c5-8ab5-bbf0113c7925 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.183301 Oct 01 20:49:29.878529 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 134/258] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:29 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:29.893571 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-69eba53e-575b-452e-88c1-64a8afdc9ab0 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.063631 Oct 01 20:49:29.894168 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 125/259] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:29 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:29.911850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c28eea98-8d8e-4ed5-a8ec-8fd794cc39f4 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-902783461", "availability_zone": "tempest-test_az-2137631940"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:29.915525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-c28eea98-8d8e-4ed5-a8ec-8fd794cc39f4 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Generated uuid 0c553883-3f0d-4c21-bf62-d51417d5f9ca for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:29.975123 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c28eea98-8d8e-4ed5-a8ec-8fd794cc39f4 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.065885 Oct 01 20:49:29.976735 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 135/260] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Oct 1 20:49:29 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:29.988689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e755fe9-cca4-4c07-afbe-080e07d0990c tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-902783461_new", "availability_zone": "tempest-test_az-2137631940_new"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:30.116034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e755fe9-cca4-4c07-afbe-080e07d0990c tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.118687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e755fe9-cca4-4c07-afbe-080e07d0990c tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.119200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e755fe9-cca4-4c07-afbe-080e07d0990c tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.197820 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e755fe9-cca4-4c07-afbe-080e07d0990c tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/8" status: 200 len: 335 microversion: 2.1 time: 0.211702 Oct 01 20:49:30.199288 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 126/261] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:49:29 2022] PUT /compute/v2.1/os-aggregates/8 => generated 335 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:30.211995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e6266f37-045f-4f20-8a53-b3f98b9a516e tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:30.221505 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e6266f37-045f-4f20-8a53-b3f98b9a516e tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.014250 Oct 01 20:49:30.222082 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 136/262] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:49:30 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:49:30.234064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4d25124b-87d1-4d09-9cda-e2f490634c74 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:30.266251 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4d25124b-87d1-4d09-9cda-e2f490634c74 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.036367 Oct 01 20:49:30.267399 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 127/263] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:30 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:30.277013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ee934b0-027f-4e4f-9f0f-4944e1b058b6 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-308778794"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:30.280868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-9ee934b0-027f-4e4f-9f0f-4944e1b058b6 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Generated uuid 20be728a-dcdc-4673-bccc-5d96ecd1832b for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:30.327953 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9ee934b0-027f-4e4f-9f0f-4944e1b058b6 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054732 Oct 01 20:49:30.329578 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 137/264] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:30 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:30.341309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ca6fe94-573e-4ea3-b758-1b5dbe5ce67a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:30.344537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:30.361579 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1ca6fe94-573e-4ea3-b758-1b5dbe5ce67a tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 229 microversion: 2.1 time: 0.023154 Oct 01 20:49:30.361579 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 128/265] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:49:30 2022] GET /compute/v2.1/os-aggregates => generated 229 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:30.373261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5929e7cd-9114-450a-88e3-8e6c2abfba09 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:30.409243 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5929e7cd-9114-450a-88e3-8e6c2abfba09 tempest-AggregatesAdminTestJSON-1310503968 tempest-AggregatesAdminTestJSON-1310503968-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.039942 Oct 01 20:49:30.410456 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 138/266] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:49:30 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 01 20:49:30.420276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:30.420780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:30.429264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.430100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.430840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.432281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.432829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.433472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.452423 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] HTTP exception thrown: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Request method failure captured: Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 HTTP/1.1 Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKeoYgOUUwB0GRq80rZ1i3WpWKOke0Q6Q8qH-fxHt7lf2umH8HqSlSq523S24Hod10sHfyMnAMoK8fABmfxQqrBPwCviu3qAwj1Hxb8XS_L_MQttvyNuLFVRzHMKlizZtyE0YsxqXQNCKb-IiOZr8giGxjRu_MvMA4ua6ie6asfcgfM Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 207636159f8a4318b3d141a828b16260 Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminTestJSON-201321937 Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:30.454190 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_207636159f8a4318b3d141a828b16260", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/207636159f8a4318b3d141a828b16260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/207636159f8a4318b3d141a828b16260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/207636159f8a4318b3d141a828b16260"}]}] Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminTestJSON-201321937 Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 207636159f8a4318b3d141a828b16260 Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-201321937 Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminTestJSON-201321937-project Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 07638141e5f34ee783ebfe4f577be214 Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminTestJSON-201321937-project Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.456110 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '58df1e80-a139-4db6-82ac-a57e15ac2153'} Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:30.457214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.458426 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.461181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:30.461876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:30.463841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Returning 404 to user: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:30.464930 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-844f9020-79d5-48ad-b816-7a58fae5d662 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "DELETE /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 404 len: 111 microversion: 2.1 time: 0.049603 Oct 01 20:49:30.469812 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 129/267] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:49:30 2022] DELETE /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:30.475237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.475742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.475996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:30.476188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.476870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] [instance: 58df1e80-a139-4db6-82ac-a57e15ac2153] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:30.480270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.482075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.482824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.485304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.486135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.486785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.487759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.488613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.489444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.507275 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] HTTP exception thrown: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Request method failure captured: Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 HTTP/1.1 Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKeoYgOUUwB0GRq80rZ1i3WpWKOke0Q6Q8qH-fxHt7lf2umH8HqSlSq523S24Hod10sHfyMnAMoK8fABmfxQqrBPwCviu3qAwj1Hxb8XS_L_MQttvyNuLFVRzHMKlizZtyE0YsxqXQNCKb-IiOZr8giGxjRu_MvMA4ua6ie6asfcgfM Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 207636159f8a4318b3d141a828b16260 Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminTestJSON-201321937 Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:30.509265 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_207636159f8a4318b3d141a828b16260", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/207636159f8a4318b3d141a828b16260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/207636159f8a4318b3d141a828b16260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/207636159f8a4318b3d141a828b16260"}]}] Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminTestJSON-201321937 Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 207636159f8a4318b3d141a828b16260 Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-201321937 Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminTestJSON-201321937-project Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 07638141e5f34ee783ebfe4f577be214 Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminTestJSON-201321937-project Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.510671 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '58df1e80-a139-4db6-82ac-a57e15ac2153'} Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:30.511460 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. Oct 01 20:49:30.513096 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:30.515645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] Returning 404 to user: Instance 58df1e80-a139-4db6-82ac-a57e15ac2153 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:30.516861 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15cb05ef-3f45-4cd5-817c-46fae9fc2e47 tempest-AggregatesAdminTestJSON-201321937 tempest-AggregatesAdminTestJSON-201321937-project] 10.222.0.17 "GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153" status: 404 len: 111 microversion: 2.1 time: 0.045681 Oct 01 20:49:30.521314 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 130/268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:30 2022] GET /compute/v2.1/servers/58df1e80-a139-4db6-82ac-a57e15ac2153 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:30.596967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:30.608247 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0db415ca-3404-4e6e-81e7-48c58fb0b997 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1272 microversion: 2.1 time: 0.153202 Oct 01 20:49:30.611323 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 139/269] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:30 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:30.856613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:30.857528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:30.870158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.872380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.873110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.874619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.877077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:30.878077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.878592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.887510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:30.903017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.904109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.906671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:30.907709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:30.909050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:30.910225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:31.119928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:31.130976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:31.132605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:31.141416 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0ad4eaea-9003-41ef-97af-203e614a9c9c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.268100 Oct 01 20:49:31.142197 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 140/270] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:30 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:49:31.214181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:31.223378 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f2b2918-daf1-43b4-800c-01bc88cb949d tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1470 microversion: 2.1 time: 0.370366 Oct 01 20:49:31.226025 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 131/271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:30 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1470 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:31.633975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:31.634865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:31.649665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:31.653166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:31.655405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:31.658063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:31.659938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:31.666318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:31.807508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:31.820721 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88697b22-dedc-4710-9ccf-d6ec102a20a2 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1278 microversion: 2.1 time: 0.190848 Oct 01 20:49:31.822244 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 132/272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:31 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:31.901065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a16a9273-3004-4633-8a38-b04a54a8bb4e tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:31.901660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a16a9273-3004-4633-8a38-b04a54a8bb4e tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] [instance: d5912eaf-5c10-4b94-968d-7333a94d6c8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:31.909534 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-a16a9273-3004-4633-8a38-b04a54a8bb4e tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] HTTP exception thrown: Instance d5912eaf-5c10-4b94-968d-7333a94d6c8c could not be found. Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a16a9273-3004-4633-8a38-b04a54a8bb4e tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Request method failure captured: Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers/d5912eaf-5c10-4b94-968d-7333a94d6c8c/action HTTP/1.1 Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 15 Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfKe2mFYMVlpxNJZoTyLYq6s4RFv3sb3LT2qZ85DzTvHLy-78pOBinSlPApha3cTWyoSLp6WqLSoy9aguUCJWsfx8DFAknKjqL0stA-DPE8i7h6Ukx_Ziax2DFaekxBX3Nqz5TsucHUg-cSufuapoyFjrYK8NPZVHhWQRyqPf-BNEY Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:31.917092 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_219a096e44d4400c9513ada7e5acf85b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}] Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: c964ff61874f4e8f8713261701c34991 Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: {"migrate": {}} Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:31.918604 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance d5912eaf-5c10-4b94-968d-7333a94d6c8c could not be found. Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'd5912eaf-5c10-4b94-968d-7333a94d6c8c', 'body': {'migrate': {}}} Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5912eaf-5c10-4b94-968d-7333a94d6c8c could not be found. Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:31.919428 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5912eaf-5c10-4b94-968d-7333a94d6c8c could not be found. Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5912eaf-5c10-4b94-968d-7333a94d6c8c could not be found. Oct 01 20:49:31.920550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:31.923528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a16a9273-3004-4633-8a38-b04a54a8bb4e tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Returning 404 to user: Instance d5912eaf-5c10-4b94-968d-7333a94d6c8c could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:31.927197 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a16a9273-3004-4633-8a38-b04a54a8bb4e tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/d5912eaf-5c10-4b94-968d-7333a94d6c8c/action" status: 404 len: 111 microversion: 2.1 time: 0.681933 Oct 01 20:49:31.940178 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 141/273] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:49:31 2022] POST /compute/v2.1/servers/d5912eaf-5c10-4b94-968d-7333a94d6c8c/action => generated 111 bytes in 696 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:32.120092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-488935732", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:32.171426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:32.172338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:32.187192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:32.190423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:32.192206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:32.194785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:32.196784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:32.198364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:32.211972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:49:32.390281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:32.410792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:32.413286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:32.420561 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-41d45eb7-4210-45af-9bae-b50939c56cba tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.254530 Oct 01 20:49:32.421156 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 142/274] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:32 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:32.737929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:49:32.739001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:49:32.739724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:49:32.740315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:49:32.741023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:49:32.751653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:32.752267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:32.752797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:32.753686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:32.754238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:32.754868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:32.783104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Getting quotas for project f7d124b2b3db49328d393be7be2e82d6. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:32.790437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Getting quotas for user 0980a1e24cdc491aa1a0202afc4fcd64 and project f7d124b2b3db49328d393be7be2e82d6. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:32.807220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:49:32.812198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:49:32.848042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:32.848862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:32.860104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:32.860937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:32.861386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:32.862101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:32.865871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:32.866401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:32.881583 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ce400f9b-bb06-4fda-9729-172d69b13fc5 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766925 Oct 01 20:49:32.885123 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 133/275] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:49:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:49:32.896442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-65d3c73a-17c7-42ed-b435-5576e4db0ee7 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:32.897455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-65d3c73a-17c7-42ed-b435-5576e4db0ee7 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:33.059213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-65d3c73a-17c7-42ed-b435-5576e4db0ee7 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:33.071462 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-65d3c73a-17c7-42ed-b435-5576e4db0ee7 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1221 microversion: 2.1 time: 0.179002 Oct 01 20:49:33.074842 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 134/276] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:32 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1221 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:33.245782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:33.264408 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-35fd0874-cc84-41f9-825b-9bc730e26b08 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1320 microversion: 2.1 time: 0.418022 Oct 01 20:49:33.267194 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 143/277] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:32 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1320 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:33.454426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:33.455302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:33.465422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:33.469533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:33.472378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:33.474226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:33.475970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:33.478322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:33.663082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:33.683837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:33.688088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:33.723797 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-50ff5134-1777-4f8e-9d9c-20a8165f96c4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.272464 Oct 01 20:49:33.725210 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 135/278] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:33 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:33.855462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b4973aa2-0f0a-4d6a-948b-c79a8d3782af req-93d515ac-5aa1-4327-8e50-9e7148b072f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec0fd3d-0841-45e0-903b-48ba9ed1566a", "tag": "18e73bbf-e675-4c38-9134-a0ab0aa19812"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:33.873504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b4973aa2-0f0a-4d6a-948b-c79a8d3782af req-93d515ac-5aa1-4327-8e50-9e7148b072f4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:33.874293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b4973aa2-0f0a-4d6a-948b-c79a8d3782af req-93d515ac-5aa1-4327-8e50-9e7148b072f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:33.875823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b4973aa2-0f0a-4d6a-948b-c79a8d3782af req-93d515ac-5aa1-4327-8e50-9e7148b072f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:33.923059 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b4973aa2-0f0a-4d6a-948b-c79a8d3782af req-93d515ac-5aa1-4327-8e50-9e7148b072f4 service nova] Creating event network-changed:18e73bbf-e675-4c38-9134-a0ab0aa19812 for instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a on nch1-master-1 Oct 01 20:49:33.947125 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b4973aa2-0f0a-4d6a-948b-c79a8d3782af req-93d515ac-5aa1-4327-8e50-9e7148b072f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098464 Oct 01 20:49:33.948843 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 144/279] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:49:34.097795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:34.099418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:34.116373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:34.119375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:34.122462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:34.123489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:34.127014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:34.127764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:34.253548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:34.265995 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75627d62-b614-4c57-8b3c-69057a76e717 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1217 microversion: 2.1 time: 0.173020 Oct 01 20:49:34.268241 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 136/280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:34 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:34.296544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:34.297852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:34.316968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=7 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:34.323729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:34.326709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:34.328019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:34.328922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:34.331169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:34.331778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:34.706274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:34.727898 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6b9d9ba3-4f36-472b-ba58-982c16063abd tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1320 microversion: 2.1 time: 0.435669 Oct 01 20:49:34.729005 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 145/281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:34 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:34.767180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:34.768515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:34.788150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:34.788696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:34.798449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:34.799342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:34.799838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:34.800279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:34.987326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:35.002563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:35.004240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:35.017099 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49d09410-5cba-404a-9674-3eb5d658a48e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.259355 Oct 01 20:49:35.017866 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 137/282] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:34 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:35.289626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:35.291193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:35.303067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:35.304862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:35.305577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:35.307076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:35.311113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:35.311778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:35.464987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:35.481354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:35.484407 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f6420055-3052-4308-a725-7c29c4a298ee tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1279 microversion: 2.1 time: 0.199067 Oct 01 20:49:35.485302 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 146/283] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:35 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:35.758808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:35.760159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:35.776665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:35.777543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:35.777941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:35.792433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:35.792943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:35.793386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:35.993093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:36.004815 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8512766e-d1d9-46a1-9f58-cddd809495d7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1320 microversion: 2.1 time: 0.250087 Oct 01 20:49:36.005799 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 138/284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:35 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:36.048330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:36.048330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:36.058359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:36.064035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:36.066122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:36.068440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:36.069236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:36.070203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:36.256859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:36.270789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:36.274230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:36.282361 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45c20de2-afcd-4186-9515-d34c2739ba11 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.239457 Oct 01 20:49:36.322037 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 139/285] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:36 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:36.480363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c7fb51b0-cf66-4162-a055-ad14d6d1a9e9 tempest-InstanceUsageAuditLogTestJSON-1987713637 tempest-InstanceUsageAuditLogTestJSON-1987713637-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:36.510018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:36.510699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:36.523366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:36.523930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:36.524399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:36.525166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:36.525639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:36.526076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:36.528503 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c7fb51b0-cf66-4162-a055-ad14d6d1a9e9 tempest-InstanceUsageAuditLogTestJSON-1987713637 tempest-InstanceUsageAuditLogTestJSON-1987713637-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-01 20:49:35" status: 200 len: 318 microversion: 2.1 time: 0.578791 Oct 01 20:49:36.529474 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 147/286] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 20:49:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-01%2020%3A49%3A35 => generated 318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:36.544694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cfc912f1-3f76-4466-9165-9f785963da8f tempest-InstanceUsageAuditLogTestJSON-1987713637 tempest-InstanceUsageAuditLogTestJSON-1987713637-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:36.614813 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cfc912f1-3f76-4466-9165-9f785963da8f tempest-InstanceUsageAuditLogTestJSON-1987713637 tempest-InstanceUsageAuditLogTestJSON-1987713637-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.073509 Oct 01 20:49:36.617928 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 148/287] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Oct 1 20:49:36 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:49:36.716070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:36.735160 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fac41857-1eae-4037-94a7-bd0a19c63766 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1279 microversion: 2.1 time: 0.229342 Oct 01 20:49:36.740224 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 140/288] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:36 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1279 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:49:37.038999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:37.048524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:37.059589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:37.060283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:37.061255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:37.062351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:37.063104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:37.063724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:37.623379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:37.633421 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5c839337-5c61-42fc-ba59-36b3b6a51a29 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1320 microversion: 2.1 time: 0.608164 Oct 01 20:49:37.637064 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 149/289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:37 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1320 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:37.643209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:37.644265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:37.656538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:37.658228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:37.659464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:37.660507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:37.661276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:37.662035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:37.779309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Calling method '.version_select at 0x7f4173e67af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:37.784411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:37.791310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:37.792190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:37.830808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:37.831549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:37.832091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:37.851187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:37.851187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:37.851187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:37.855043 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35d0a6fb-bc65-429b-9f7a-7ace0b5817c0 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.567492 Oct 01 20:49:37.866520 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 141/290] 10.222.0.17 () {60 vars in 1208 bytes} [Sat Oct 1 20:49:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:49:37.930879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1323903467", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:38.000836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:49:38.076539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:38.086675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:38.088588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:38.095376 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bb83a2be-94a7-49b6-8ced-2d20c4a1dd50 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.456996 Oct 01 20:49:38.111237 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 150/291] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:37 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:38.123908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:38.124834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:38.134027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:38.135083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:38.135938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:38.138046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:38.138826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:38.139503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:38.255602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:38.268772 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-81498a21-6421-47a7-a9ab-821e567d1d59 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1279 microversion: 2.1 time: 0.156003 Oct 01 20:49:38.270759 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 151/292] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:38 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:38.283255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e939e222-b67a-4b24-aa4e-a070b037fb07 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-696627326"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:38.283255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-e939e222-b67a-4b24-aa4e-a070b037fb07 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Generated uuid 4024e639-0e26-48a6-a246-a4b94c36e77e for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:38.312129 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e939e222-b67a-4b24-aa4e-a070b037fb07 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.040064 Oct 01 20:49:38.314479 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 152/293] 10.222.0.17 () {62 vars in 1205 bytes} [Sat Oct 1 20:49:38 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:38.336122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bf869d70-a211-4093-9888-0e689213f63b tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1844488224"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:38.526984 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bf869d70-a211-4093-9888-0e689213f63b tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.202596 Oct 01 20:49:38.528304 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 153/294] 10.222.0.17 () {62 vars in 1213 bytes} [Sat Oct 1 20:49:38 2022] PUT /compute/v2.1/os-aggregates/10 => generated 300 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:38.539303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ca1e7848-2e9f-4510-bf71-6e5ecb2d9cc8 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:38.558328 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ca1e7848-2e9f-4510-bf71-6e5ecb2d9cc8 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.022452 Oct 01 20:49:38.560080 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 154/295] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Oct 1 20:49:38 2022] GET /compute/v2.1/os-aggregates/10 => generated 300 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:38.595836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d9722a2f-6a54-4471-bd28-14b2b7029387 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:38.651058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9722a2f-6a54-4471-bd28-14b2b7029387 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:38.653234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9722a2f-6a54-4471-bd28-14b2b7029387 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:38.654772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9722a2f-6a54-4471-bd28-14b2b7029387 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:38.893252 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d9722a2f-6a54-4471-bd28-14b2b7029387 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 315 microversion: 2.41 time: 0.314469 Oct 01 20:49:38.894465 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 155/296] 10.222.0.17 () {62 vars in 1235 bytes} [Sat Oct 1 20:49:38 2022] POST /compute/v2.1/os-aggregates/10/action => generated 315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:38.910005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:38.913657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:38.935078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:38.935768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:38.936340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:38.938353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:38.939985 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:38.942346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:38.953820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:49:38.954615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:49:38.955317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:49:38.955598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:49:38.956287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:49:38.983670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:38.987292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:38.988137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:38.989543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:38.991120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:38.995726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:39.075651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:49:39.090928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for user e5bfbc1e512a445ca7527f3d79e40d16 and project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:49:39.124076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:49:39.126999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:49:39.226033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9f0b5aca-e2e9-42f0-b62d-071d49868d39 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368317 Oct 01 20:49:39.226995 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 142/297] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:49:39.248551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e317f971-3325-4a55-b337-fb6d0ec3011a tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:39.255161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:39.264448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e317f971-3325-4a55-b337-fb6d0ec3011a tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:39.265367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e317f971-3325-4a55-b337-fb6d0ec3011a tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:39.266021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e317f971-3325-4a55-b337-fb6d0ec3011a tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:39.481599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e317f971-3325-4a55-b337-fb6d0ec3011a tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 300 microversion: 2.41 time: 0.238080 Oct 01 20:49:39.482226 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 143/298] 10.222.0.17 () {62 vars in 1235 bytes} [Sat Oct 1 20:49:39 2022] POST /compute/v2.1/os-aggregates/10/action => generated 300 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:49:39.493250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:39.494539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:39.512085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:39.512831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:39.513453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:39.514350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:39.516787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:39.518712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:39.534400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:39.684925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:39.697554 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-add217c2-2116-4f51-850b-e50f6d3c2501 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1320 microversion: 2.1 time: 0.801739 Oct 01 20:49:39.698507 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 156/299] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:38 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1320 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:39.708939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-26771ec7-2846-4a15-ae6e-151fe1a56d18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:39.709571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-26771ec7-2846-4a15-ae6e-151fe1a56d18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:39.740075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:39.750888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:39.765000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:39.780915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1937d524-846c-45c5-92f2-2b3e4fb98ddc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.294944 Oct 01 20:49:39.781821 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 144/300] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:39 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:39.802176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:39.803212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:39.816837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:39.817376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:39.817865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:39.818653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:39.819146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:39.819608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:39.885135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-26771ec7-2846-4a15-ae6e-151fe1a56d18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:39.913495 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-26771ec7-2846-4a15-ae6e-151fe1a56d18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1213 microversion: 2.1 time: 0.211890 Oct 01 20:49:39.914848 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 157/301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:39 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1213 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:39.933647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b6338ae1-67c8-4086-a2ff-0a008de3a9d4 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:39.982289 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b6338ae1-67c8-4086-a2ff-0a008de3a9d4 tempest-AggregatesAdminTestV241-858599935 tempest-AggregatesAdminTestV241-858599935-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.41 time: 0.063415 Oct 01 20:49:39.983486 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 158/302] 10.222.0.17 () {60 vars in 1196 bytes} [Sat Oct 1 20:49:39 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:40.315357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:40.330394 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f5e9050-92c1-4b97-bc05-bef32742ec03 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1321 microversion: 2.1 time: 0.547236 Oct 01 20:49:40.334142 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 145/303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:39 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:40.725193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:40.726139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:40.734639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:40.735608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:40.736212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:40.737100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:40.737720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:40.741518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:40.746259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-740eb1a7-b8ed-4319-b722-3b90d003437e tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Action: 'create', calling method: .version_select at 0x7f4173fd1d30>, body: {"pool": null} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:41.377577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:41.388444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e4247497-e463-4fc7-bde3-7b87deb2bff7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1320 microversion: 2.1 time: 0.667564 Oct 01 20:49:41.389240 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 146/304] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:40 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1320 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:49:41.399345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b00efe1e-9a6c-4abb-8d08-67699663896e req-f66a6636-e07e-423b-b34e-038f1aae9c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9435197a-1a11-4d4f-a15f-8886238b2755", "tag": "e6918f48-873e-4725-a36d-69e38bb52dc9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:41.420728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b00efe1e-9a6c-4abb-8d08-67699663896e req-f66a6636-e07e-423b-b34e-038f1aae9c5f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:41.421569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b00efe1e-9a6c-4abb-8d08-67699663896e req-f66a6636-e07e-423b-b34e-038f1aae9c5f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:41.422231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b00efe1e-9a6c-4abb-8d08-67699663896e req-f66a6636-e07e-423b-b34e-038f1aae9c5f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:41.435087 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b00efe1e-9a6c-4abb-8d08-67699663896e req-f66a6636-e07e-423b-b34e-038f1aae9c5f service nova] Creating event network-changed:e6918f48-873e-4725-a36d-69e38bb52dc9 for instance 9435197a-1a11-4d4f-a15f-8886238b2755 on nch1-master-1 Oct 01 20:49:41.441020 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b00efe1e-9a6c-4abb-8d08-67699663896e req-f66a6636-e07e-423b-b34e-038f1aae9c5f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045164 Oct 01 20:49:41.442596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 147/305] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:41.449892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:41.452625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:41.459723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:41.460556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:41.461215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:41.462706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:41.463450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:41.464104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:41.666119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:41.676217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:41.685175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:41.693623 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26f3bdf8-7b98-405a-acf0-83d76dbf1c5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.249565 Oct 01 20:49:41.694223 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 148/306] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:41 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:41.720170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:41.720799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:41.727129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:41.727632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:41.728105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:41.729045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:41.729669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:41.730273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:41.881792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:41.910032 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa3a949c-22e9-4bda-b3ea-e5ad6a73cc18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1271 microversion: 2.1 time: 0.201777 Oct 01 20:49:41.911507 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 149/307] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:41 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:41.923898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:41.924939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:41.932934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:41.933509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:41.934015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:41.936376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:41.937736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:41.938564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:42.680730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:42.695024 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-33413858-f219-4aa9-a474-00b0c363cecc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1321 microversion: 2.1 time: 0.781730 Oct 01 20:49:42.696572 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 150/308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:41 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1321 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:42.702760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:42.704086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:42.712313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:42.713539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:42.714038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:42.715194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:42.715860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:42.716293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:43.101025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:43.113194 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-27759bfa-761a-4317-af01-4c5d912071e1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1320 microversion: 2.1 time: 0.415151 Oct 01 20:49:43.122826 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 151/309] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:42 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1320 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:43.135882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:43.137784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:43.149068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:43.150411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:43.151523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:43.152616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:43.154317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:43.155079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:43.339769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:43.351294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:43.354992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:43.365588 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1167c4bd-fb5b-4e2d-8cf7-35d1444fc07f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.241105 Oct 01 20:49:43.366472 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 152/310] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:43 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:43.380811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6ca7efd1-a3be-4724-867c-26e299c4fa9a req-ed427f1d-f2ae-4372-b0c7-6616d3da31cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec0fd3d-0841-45e0-903b-48ba9ed1566a", "name": "network-vif-plugged", "status": "completed", "tag": "18e73bbf-e675-4c38-9134-a0ab0aa19812"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:43.389034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:43.396098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6ca7efd1-a3be-4724-867c-26e299c4fa9a req-ed427f1d-f2ae-4372-b0c7-6616d3da31cd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:43.397162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6ca7efd1-a3be-4724-867c-26e299c4fa9a req-ed427f1d-f2ae-4372-b0c7-6616d3da31cd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:43.397822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6ca7efd1-a3be-4724-867c-26e299c4fa9a req-ed427f1d-f2ae-4372-b0c7-6616d3da31cd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:43.413428 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6ca7efd1-a3be-4724-867c-26e299c4fa9a req-ed427f1d-f2ae-4372-b0c7-6616d3da31cd service nova] Creating event network-vif-plugged:18e73bbf-e675-4c38-9134-a0ab0aa19812 for instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a on nch1-master-1 Oct 01 20:49:43.420072 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6ca7efd1-a3be-4724-867c-26e299c4fa9a req-ed427f1d-f2ae-4372-b0c7-6616d3da31cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043092 Oct 01 20:49:43.421453 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 153/311] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:43.429846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:43.430817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:43.439509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:43.440362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:43.441004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:43.442667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:43.443617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:43.444275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:43.571436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:43.585764 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df3dd4f0-0b86-41e1-aaa6-e3feeab6f9b1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1271 microversion: 2.1 time: 0.162401 Oct 01 20:49:43.586535 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 154/312] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:43 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:43.719036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:43.719712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:43.737182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:43.737983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:43.739394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:43.751955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:43.752598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:43.754040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:44.390264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:44.400036 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3040ee6c-ba89-46a6-8302-da299c49e07c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1321 microversion: 2.1 time: 0.686042 Oct 01 20:49:44.417157 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 155/313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:43 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1321 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:49:44.423757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:44.424755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:44.445160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:44.446293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:44.447067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:44.452502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:44.453426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:44.454148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:45.127841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:45.145303 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80f862d9-6102-4f47-88da-8bd6e36c4fa1 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1320 microversion: 2.1 time: 0.726465 Oct 01 20:49:45.161326 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 156/314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:44 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1320 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:45.507457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35fcb7dd-6459-4927-ae8b-d32f075854e8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:45.512103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35fcb7dd-6459-4927-ae8b-d32f075854e8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:45.512824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35fcb7dd-6459-4927-ae8b-d32f075854e8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:45.513421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35fcb7dd-6459-4927-ae8b-d32f075854e8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:45.514381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35fcb7dd-6459-4927-ae8b-d32f075854e8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:45.515038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35fcb7dd-6459-4927-ae8b-d32f075854e8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:45.515626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35fcb7dd-6459-4927-ae8b-d32f075854e8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:45.544530 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35fcb7dd-6459-4927-ae8b-d32f075854e8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.397202 Oct 01 20:49:45.545521 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 157/315] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Oct 1 20:49:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:45.550384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:45.551767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:45.559175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:45.560100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:45.560892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:45.561850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:45.562545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:45.563213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:45.612397 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-740eb1a7-b8ed-4319-b722-3b90d003437e tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.356618 Oct 01 20:49:45.619524 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 159/316] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:49:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:45.627742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:45.629694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:45.652662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:45.653313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:45.654022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:45.654911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:45.656197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:45.656869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:45.732078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:45.741106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:45.742742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:45.748541 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d01dc58c-7dd2-417c-9208-c68816745792 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.201819 Oct 01 20:49:45.749739 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 158/317] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:45 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:45.755084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:45.756396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:45.770111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:45.770703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:45.771329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:45.772158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:45.772632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:45.773068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:46.034180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:46.044238 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-90373061-e6a4-4fea-89b8-966b309b390d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1313 microversion: 2.1 time: 0.423115 Oct 01 20:49:46.045329 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 160/318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:45 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:46.057102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c7e9ab6-4849-4091-9bfb-f5ef1bdb4057 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-438290412"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:46.062311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-6c7e9ab6-4849-4091-9bfb-f5ef1bdb4057 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Generated uuid a22b3f52-efce-49fa-aa13-5307f7e50c53 for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:46.092397 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6c7e9ab6-4849-4091-9bfb-f5ef1bdb4057 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043893 Oct 01 20:49:46.093053 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 161/319] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:46.103574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-96e44977-f17e-4221-afee-a069dca48962 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Calling method '.version_select at 0x7f4178046d30>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:46.160225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:46.170829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-afbffaf8-07ef-4783-a3b5-2d94fe8a5545 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1321 microversion: 2.1 time: 0.419770 Oct 01 20:49:46.171637 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 159/320] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:45 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:46.176342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1cc78e20-87df-4859-adab-28f237e282c8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:46.194069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cc78e20-87df-4859-adab-28f237e282c8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:46.194652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cc78e20-87df-4859-adab-28f237e282c8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:46.195107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cc78e20-87df-4859-adab-28f237e282c8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:46.354613 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1cc78e20-87df-4859-adab-28f237e282c8 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.181629 Oct 01 20:49:46.355220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 160/321] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 20:49:46 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:46.368227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:46.370226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:46.386998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:46.388373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:46.391652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:46.392741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:46.393233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:46.394041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:46.465256 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-96e44977-f17e-4221-afee-a069dca48962 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/d96479e7-c42f-4904-aa32-b80d7ce4b2e5" status: 200 len: 142 microversion: 2.1 time: 0.370512 Oct 01 20:49:46.465846 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 162/322] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 20:49:46 2022] GET /compute/v2.1/os-floating-ips/d96479e7-c42f-4904-aa32-b80d7ce4b2e5 => generated 142 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:46.478430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2ec59b95-3c46-4956-ae44-b312816b9f74 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:46.507445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ec59b95-3c46-4956-ae44-b312816b9f74 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:46.507956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ec59b95-3c46-4956-ae44-b312816b9f74 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:46.508406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ec59b95-3c46-4956-ae44-b312816b9f74 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:46.560565 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-2ec59b95-3c46-4956-ae44-b312816b9f74 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] HTTP exception thrown: Aggregate 11 already has host nch1-master-1. Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2ec59b95-3c46-4956-ae44-b312816b9f74 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Request method failure captured: Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 39 Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfoMZ8ynv03TX59fS1O2vyF9JkrM8YzUo-CEdhiCg84P-EqhCvCV1htmdhl3bZ71Fi3Pjr2urdd9sLdcy0hhixxiLyNBpELhnSQpS8Ds1BfA0TErCrWEyfl8npoM8qGxq7srgCnLrl_P15rc9RDT86pJ3CdRVzHCg7jTetwl0gnn1U Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:46.582262 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4803d0561d104d7c8298e6782b8cb18d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}] Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35503a37685d4e11a514195dfaf29f38 Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: {"add_host": {"host": "nch1-master-1"}} Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:46.583826 ncdv-master-1 devstack@n-api.service[140437]: exception: Aggregate 11 already has host nch1-master-1. Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '11', 'body': {'add_host': {'host': 'nch1-master-1'}}} Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result.read() Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:49:46.584610 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch1-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi session.flush() Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 01 20:49:46.585681 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 01 20:49:46.586837 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:49:46.588875 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result.read() Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch1-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 1, 20, 49, 46, 538533), 'updated_at': None, 'host': 'nch1-master-1', 'aggregate_id': 11}] Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:46.590142 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host nch1-master-1. Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:46.591346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host nch1-master-1. Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:46.592805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:46.594236 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host nch1-master-1. Oct 01 20:49:46.594236 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:46.594236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2ec59b95-3c46-4956-ae44-b312816b9f74 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Returning 409 to user: Aggregate 11 already has host nch1-master-1. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:46.594236 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2ec59b95-3c46-4956-ae44-b312816b9f74 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.112822 Oct 01 20:49:46.594236 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 163/323] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 20:49:46 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 01 20:49:46.594236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-765e639c-c620-43e4-b9de-8854b9fe7070 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Calling method '.version_select at 0x7f4173dc78b0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:46.832320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:46.849327 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb8a8e70-d1e7-4b82-83a6-0a3747234133 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1470 microversion: 2.1 time: 0.489450 Oct 01 20:49:46.851587 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 161/324] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:46 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:46.860526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77776777-6df0-4372-b5e0-378586cb761c tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:46.880008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77776777-6df0-4372-b5e0-378586cb761c tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:46.880680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77776777-6df0-4372-b5e0-378586cb761c tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:46.881134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77776777-6df0-4372-b5e0-378586cb761c tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:47.063414 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77776777-6df0-4372-b5e0-378586cb761c tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.210550 Oct 01 20:49:47.064174 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 162/325] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 20:49:46 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:47.083664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:47.084572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:47.102435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:47.105583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:47.106041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:47.106816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:47.107282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:47.107714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:47.150389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:47.176042 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-765e639c-c620-43e4-b9de-8854b9fe7070 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.587228 Oct 01 20:49:47.177270 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 164/326] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 20:49:46 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:47.191218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3131dfbe-dba8-4309-9b22-30657bf9dda1 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:47.194188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3131dfbe-dba8-4309-9b22-30657bf9dda1 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:47.211713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3131dfbe-dba8-4309-9b22-30657bf9dda1 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:47.213678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3131dfbe-dba8-4309-9b22-30657bf9dda1 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:47.214403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3131dfbe-dba8-4309-9b22-30657bf9dda1 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:47.216825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3131dfbe-dba8-4309-9b22-30657bf9dda1 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:47.217536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3131dfbe-dba8-4309-9b22-30657bf9dda1 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:47.218196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3131dfbe-dba8-4309-9b22-30657bf9dda1 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:47.320697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:47.337543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:47.344574 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3131dfbe-dba8-4309-9b22-30657bf9dda1 tempest-DeleteServersAdminTestJSON-40789866 tempest-DeleteServersAdminTestJSON-40789866-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a/action" status: 202 len: 0 microversion: 2.1 time: 0.157312 Oct 01 20:49:47.346484 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 165/327] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:49:47 2022] POST /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:49:47.352427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:47.355042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:47.356529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:47.364403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:47.365251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:47.365363 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7dd0094f-85eb-4ab4-a6fc-f8245ae5fb2c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.292254 Oct 01 20:49:47.365878 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 163/328] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:47 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:47.366403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:47.367368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:47.368618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:47.369274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:47.388429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-42da04bd-bd01-4163-ac08-6e806a5480fe tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:47.450385 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-42da04bd-bd01-4163-ac08-6e806a5480fe tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.076669 Oct 01 20:49:47.456915 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 164/329] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:49:47 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:47.471057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2035bb14-e235-4a85-a564-4236a163d603 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Calling method '.version_select at 0x7f4173e67940>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:48.063452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:48.082688 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d29c826a-39c4-4b4d-ad45-96e649dac084 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1313 microversion: 2.1 time: 0.723941 Oct 01 20:49:48.105266 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 166/330] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:47 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1313 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:48.110910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:48.116715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:48.130677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:48.131189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:48.134440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:48.138463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:48.139200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:48.142888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:48.532525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:48.544731 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e2e621ec-578c-4b53-9985-d976f1e82ccf tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1321 microversion: 2.1 time: 0.438192 Oct 01 20:49:48.550175 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 167/331] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:48 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:48.555149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:48.555799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:48.578839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:48.579570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:48.580569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:48.581442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:48.582066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:48.582673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:48.655595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:48.663015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:48.663015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:48.663508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lazy-loading 'fault' on Instance uuid 4ec0fd3d-0841-45e0-903b-48ba9ed1566a {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:49:49.110158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=15 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:49.280364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:49.290543 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4eb83bc8-7290-4883-870c-c32d634d8890 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1453 microversion: 2.1 time: 0.738252 Oct 01 20:49:49.291450 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 168/332] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:48 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1453 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:49.296491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ede3cd0d-58e7-478f-9274-b01bac44ebe3 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2071123347"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:49.300285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-ede3cd0d-58e7-478f-9274-b01bac44ebe3 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Generated uuid aa0eb5c4-9aa6-4619-909d-75a515471997 for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:49.326219 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ede3cd0d-58e7-478f-9274-b01bac44ebe3 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033575 Oct 01 20:49:49.327365 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 169/333] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:49.332194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b2a2360a-6bc7-43f9-a2dd-d2df2cb3b4f0 req-1e092bb0-0062-49b8-9632-0daf372d32ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718605d6-75e8-4b45-8db7-cd48626c0ce3", "tag": "0293e38a-8ed1-4661-add8-6b614f7f55b2"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:49.344175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b2a2360a-6bc7-43f9-a2dd-d2df2cb3b4f0 req-1e092bb0-0062-49b8-9632-0daf372d32ad service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:49.345057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b2a2360a-6bc7-43f9-a2dd-d2df2cb3b4f0 req-1e092bb0-0062-49b8-9632-0daf372d32ad service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:49.345701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b2a2360a-6bc7-43f9-a2dd-d2df2cb3b4f0 req-1e092bb0-0062-49b8-9632-0daf372d32ad service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:49.357672 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b2a2360a-6bc7-43f9-a2dd-d2df2cb3b4f0 req-1e092bb0-0062-49b8-9632-0daf372d32ad service nova] Creating event network-changed:0293e38a-8ed1-4661-add8-6b614f7f55b2 for instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 on nch2-master-1 Oct 01 20:49:49.363302 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b2a2360a-6bc7-43f9-a2dd-d2df2cb3b4f0 req-1e092bb0-0062-49b8-9632-0daf372d32ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034779 Oct 01 20:49:49.363893 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 170/334] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:49.369520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:49.370213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:49.376151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:49.376637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:49.377075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:49.377770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:49.378805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:49.379236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:49.476670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:49.479457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2035bb14-e235-4a85-a564-4236a163d603 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/d96479e7-c42f-4904-aa32-b80d7ce4b2e5" status: 202 len: 0 microversion: 2.1 time: 2.020654 Oct 01 20:49:49.480302 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 165/335] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:49:47 2022] DELETE /compute/v2.1/os-floating-ips/d96479e7-c42f-4904-aa32-b80d7ce4b2e5 => generated 0 bytes in 2023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:49:49.488553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:49.490088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:49.490410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4813a5c7-a483-47ae-abac-85faa9eb0f60 req-2e9ce93d-8b9f-441a-9167-fe987eae22f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9435197a-1a11-4d4f-a15f-8886238b2755", "name": "network-vif-plugged", "status": "completed", "tag": "e6918f48-873e-4725-a36d-69e38bb52dc9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:49.495923 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-be2faa20-26b3-4b1b-bfad-dcf69029721b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1558 microversion: 2.91 time: 0.130870 Oct 01 20:49:49.496520 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 171/336] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:49 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1558 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:49.501339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4813a5c7-a483-47ae-abac-85faa9eb0f60 req-2e9ce93d-8b9f-441a-9167-fe987eae22f6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:49.501832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4813a5c7-a483-47ae-abac-85faa9eb0f60 req-2e9ce93d-8b9f-441a-9167-fe987eae22f6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:49.502316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4813a5c7-a483-47ae-abac-85faa9eb0f60 req-2e9ce93d-8b9f-441a-9167-fe987eae22f6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:49.513624 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4813a5c7-a483-47ae-abac-85faa9eb0f60 req-2e9ce93d-8b9f-441a-9167-fe987eae22f6 service nova] Creating event network-vif-plugged:e6918f48-873e-4725-a36d-69e38bb52dc9 for instance 9435197a-1a11-4d4f-a15f-8886238b2755 on nch1-master-1 Oct 01 20:49:49.518878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:49.519071 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4813a5c7-a483-47ae-abac-85faa9eb0f60 req-2e9ce93d-8b9f-441a-9167-fe987eae22f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033168 Oct 01 20:49:49.519823 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 166/337] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:49.520998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:49.525310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:49.525891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:49.532098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:49.532263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:49.532588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:49.532855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:49.533314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:49.533403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:49.533760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:49.534012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:49.534214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:49.534670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:49.535047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:49.535561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:49.564193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:49:49.676703 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-544410cd-5864-4cf4-b9aa-4f0cf69cd412 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 204 len: 0 microversion: 2.1 time: 0.155231 Oct 01 20:49:49.678007 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 167/338] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:49:49 2022] DELETE /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:49:49.749595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:49.757419 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-52dec75a-a0c7-46bc-90b1-caa0eeffcaf1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1313 microversion: 2.1 time: 0.249331 Oct 01 20:49:49.757992 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 172/339] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:49 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:49.767926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eabc8bc9-0638-4173-9a9a-b9f6fc7a140d tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Action: 'create', calling method: .version_select at 0x7f4173dc7ee0>, body: {"pool": null} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:49.889796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=54,nova_cell0:UPDATE=7 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:49.987315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9b8a402a-47bb-4e4c-a5d6-d12fb552d77a tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:49.991531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9b8a402a-47bb-4e4c-a5d6-d12fb552d77a tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'fac54082682041db8cb3cf87fdea889f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb176cab2a4f9d9c6e33d62dd91ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9b8a402a-47bb-4e4c-a5d6-d12fb552d77a tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Request method failure captured: Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 39 Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfndby8S-A9rSFn6gjihO38MmcPcK-Ykh1l4ZJvUuIMXa1liRmP88DHEf7T29CPsNBMpBwfQj7-Uv26r11RTGuXfrwNBhKRpDpljF9kwimEcHz9xKwGSJWMgzTiC-H-O-r2gsm3UVUD-lhocq2vHSd04xnjfkJtqNrmxjGYQbx8b8E Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:49.993437 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4cb176cab2a4f9d9c6e33d62dd91ddc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}] Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: fac54082682041db8cb3cf87fdea889f Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: {"add_host": {"host": "nch1-master-1"}} Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:49.994694 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '12', 'body': {'add_host': {'host': 'nch1-master-1'}}} Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:49.995434 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 01 20:49:49.996523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:49.999312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9b8a402a-47bb-4e4c-a5d6-d12fb552d77a tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:50.000265 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9b8a402a-47bb-4e4c-a5d6-d12fb552d77a tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.320786 Oct 01 20:49:50.000928 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 168/340] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 20:49:49 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 322 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:50.011674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:50.012424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:50.028234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:50.028831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:50.029286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:50.030032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:50.030524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:50.030947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:50.304504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:50.315431 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87182b62-3d97-4edc-aaf0-3336ab511013 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1321 microversion: 2.1 time: 0.308775 Oct 01 20:49:50.331069 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 169/341] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:50 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:50.337753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:50.344197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:50.372679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:50.373631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:50.374252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:50.375896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:50.376542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:50.377131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:50.423354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:50.424406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:50.424682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:50.425239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lazy-loading 'fault' on Instance uuid 4ec0fd3d-0841-45e0-903b-48ba9ed1566a {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:49:50.900209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:50.923442 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d2403dd7-b5ae-4db5-8581-36438bf7731d tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1459 microversion: 2.1 time: 0.585936 Oct 01 20:49:50.924788 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 170/342] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:50 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1459 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:50.932258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d67179ba-f59a-4595-bece-3f3af1757ef3 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:50.975166 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d67179ba-f59a-4595-bece-3f3af1757ef3 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.049037 Oct 01 20:49:50.976159 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 171/343] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:49:50 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:50.984177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:50.987167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:50.995678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:50.996664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:50.997341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:50.998656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:51.000479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:51.000942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:51.190025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:51.209821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:51.211303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:51.220562 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-360b6e74-0b93-4c66-8b5b-5564e8a63598 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.242992 Oct 01 20:49:51.235796 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 172/344] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:50 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:51.247874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:51.248923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:51.263221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:51.263922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:51.264525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:51.265415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:51.266688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:51.267455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:51.884274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:51.893207 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-11ec3241-c9d5-4657-bf10-0b38b144388e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1313 microversion: 2.1 time: 0.656071 Oct 01 20:49:51.898617 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 173/345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:51 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:51.925839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2df96ffb-20b9-4a63-8f31-665537942a65 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-330653191"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:51.960001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.aggregate [None req-2df96ffb-20b9-4a63-8f31-665537942a65 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Generated uuid 5870eba4-1593-4179-9d59-44f0abfc69c0 for aggregate {{(pid=140438) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:52.036834 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2df96ffb-20b9-4a63-8f31-665537942a65 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.134360 Oct 01 20:49:52.038928 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 174/346] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:52.053473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:52.054362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:52.073299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:52.074082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:52.074717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:52.075591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:52.076207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:52.076794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:52.521558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:52.534272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ef12e64-7b43-48f1-8da7-26e531489ffc tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1469 microversion: 2.1 time: 0.489257 Oct 01 20:49:52.535967 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 175/347] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:52 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1469 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:52.549943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:52.550928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:52.572533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:52.574848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:52.576972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:52.578433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:52.579433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:52.580070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:52.640776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:52.641491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:52.643344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:52.644021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lazy-loading 'fault' on Instance uuid 4ec0fd3d-0841-45e0-903b-48ba9ed1566a {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:49:52.785903 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eabc8bc9-0638-4173-9a9a-b9f6fc7a140d tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.025249 Oct 01 20:49:52.786916 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 173/348] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:49:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:52.804785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1494730741"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:52.845584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:52.846309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:52.848244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:52.885526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:52.887107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:52.887681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:52.911289 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1494730741 could not be found. Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Request method failure captured: Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 58 Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfoMZ8ynv03TX59fS1O2vyF9JkrM8YzUo-CEdhiCg84P-EqhCvCV1htmdhl3bZ71Fi3Pjr2urdd9sLdcy0hhixxiLyNBpELhnSQpS8Ds1BfA0TErCrWEyfl8npoM8qGxq7srgCnLrl_P15rc9RDT86pJ3CdRVzHCg7jTetwl0gnn1U Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:52.913557 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4803d0561d104d7c8298e6782b8cb18d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}] Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35503a37685d4e11a514195dfaf29f38 Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: {"add_host": {"host": "tempest-nonexist_host-1494730741"}} Oct 01 20:49:52.915666 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: exception: Compute host tempest-nonexist_host-1494730741 could not be found. Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1494730741'}}} Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1494730741' is not mapped to any cell Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:52.916474 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 01 20:49:52.917900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1494730741 could not be found. Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1494730741 could not be found. Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:52.919402 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:52.921006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:52.921006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:52.921006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:52.921006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:52.921006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:52.921006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1494730741 could not be found. Oct 01 20:49:52.921006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:52.924143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1494730741 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:52.925351 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e3b2589a-87b2-468c-b101-f8b5f6a0098a tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.135592 Oct 01 20:49:52.926543 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 174/349] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 20:49:52 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:52.935181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:52.944012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:52.969528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:52.973454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:52.977162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:52.988438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef35c15f9d541ac90239c3713f9f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93dcf30e02b41178c6cde6e50a41e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:52.993990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:52.994865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:52.996079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:53.000430 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-800a07e5-fa17-49c1-ae46-ca61e0a75e9c tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 200 len: 1459 microversion: 2.1 time: 0.461941 Oct 01 20:49:53.002616 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 176/350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:52 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 1459 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:53.026773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:53.027684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:53.034822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:53.035586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:53.036249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:53.037223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:53.037870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:53.038485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:53.233161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:53.249777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lazy-loading 'flavor' on Instance uuid 9435197a-1a11-4d4f-a15f-8886238b2755 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:49:53.256282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:53.259569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:53.284949 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2cdce727-0d57-4c3b-a8b1-d5a851dc32ac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.355110 Oct 01 20:49:53.286816 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 175/351] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:52 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:53.293841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-06b13725-a44f-4f57-b9ea-140f12268ed4 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Calling method '.version_select at 0x7f4173dc7670>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:53.525340 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3798984d-1224-4913-8fd2-c3155241a0ed tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755/action" status: 202 len: 0 microversion: 2.1 time: 0.520380 Oct 01 20:49:53.526827 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 177/352] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:49:53 2022] POST /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:49:53.542898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:53.544291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:53.557679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:53.558191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:53.558701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:53.559433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:53.564838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:53.565321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:54.527048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:54.535721 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-53eafe7f-0a34-4e11-aed2-fc1076400a1e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1313 microversion: 2.1 time: 1.007486 Oct 01 20:49:54.551254 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 178/353] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:53 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1313 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:54.557704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-43a89273-3435-49b2-b556-378841e6026d tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:54.599874 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-43a89273-3435-49b2-b556-378841e6026d tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.046681 Oct 01 20:49:54.604779 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 179/354] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:49:54 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:54.619808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b71a3adb-d4f2-4d56-bc7e-2a4fb611b78b req-aa456885-ad62-4c2d-8725-0190bce0f819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec0fd3d-0841-45e0-903b-48ba9ed1566a", "name": "network-vif-deleted", "tag": "18e73bbf-e675-4c38-9134-a0ab0aa19812"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:54.646133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b71a3adb-d4f2-4d56-bc7e-2a4fb611b78b req-aa456885-ad62-4c2d-8725-0190bce0f819 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:54.649715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b71a3adb-d4f2-4d56-bc7e-2a4fb611b78b req-aa456885-ad62-4c2d-8725-0190bce0f819 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:54.650390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b71a3adb-d4f2-4d56-bc7e-2a4fb611b78b req-aa456885-ad62-4c2d-8725-0190bce0f819 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:54.681164 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b71a3adb-d4f2-4d56-bc7e-2a4fb611b78b req-aa456885-ad62-4c2d-8725-0190bce0f819 service nova] Creating event network-vif-deleted:18e73bbf-e675-4c38-9134-a0ab0aa19812 for instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a on nch1-master-1 Oct 01 20:49:54.693944 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b71a3adb-d4f2-4d56-bc7e-2a4fb611b78b req-aa456885-ad62-4c2d-8725-0190bce0f819 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085529 Oct 01 20:49:54.696626 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 180/355] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:54.716051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b29fba99-920c-4aad-8c3a-8e6c59d33ef3 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:54.720099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b29fba99-920c-4aad-8c3a-8e6c59d33ef3 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:54.743510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29fba99-920c-4aad-8c3a-8e6c59d33ef3 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:54.745037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29fba99-920c-4aad-8c3a-8e6c59d33ef3 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:54.748484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29fba99-920c-4aad-8c3a-8e6c59d33ef3 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:54.749534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29fba99-920c-4aad-8c3a-8e6c59d33ef3 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:54.750749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29fba99-920c-4aad-8c3a-8e6c59d33ef3 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:54.752641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29fba99-920c-4aad-8c3a-8e6c59d33ef3 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:55.421820 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-06b13725-a44f-4f57-b9ea-140f12268ed4 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/22544659-7690-47dc-9c00-ef46667d0e3a" status: 202 len: 0 microversion: 2.1 time: 2.133746 Oct 01 20:49:55.425884 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 176/356] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:49:53 2022] DELETE /compute/v2.1/os-floating-ips/22544659-7690-47dc-9c00-ef46667d0e3a => generated 0 bytes in 2138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:49:55.432837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:55.433456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:55.448643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:55.449161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:55.451284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:55.452057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:55.454245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:55.456852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:55.489928 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] HTTP exception thrown: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Request method failure captured: Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a HTTP/1.1 Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKe51e_P6YvkkzbxVUeqFO4x7I7BSGu7qxvuNRbOs9Wrpa9VT8add7Sn8wzeX71lLEij1Z_WbVqb4tDM54OH1sxX6DdlC39LwzGXWlwM16RzjinnOHCAs5L9VZaDJjWBUYtzWsRPDFBbclf_DuIkFG4Hex8jFQr21Uo8XbqiXgD9qTk Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:55.495243 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e93dcf30e02b41178c6cde6e50a41e17", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}] Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 7ef35c15f9d541ac90239c3713f9f5e6 Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.496554 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '4ec0fd3d-0841-45e0-903b-48ba9ed1566a'} Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:55.497206 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.498342 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.499919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Returning 404 to user: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:55.501246 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1460343f-fd51-4c1e-848a-80cdfc17b355 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 404 len: 111 microversion: 2.1 time: 0.074328 Oct 01 20:49:55.504477 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 177/357] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:55 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:55.515317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:55.516043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:55.523402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:55.524767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=11 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:55.525768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:55.526321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:55.527790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:55.528364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:55.529250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:55.627609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:55.633003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:55.646070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:55.647998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:55.655757 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d9dc77e6-43eb-46e8-a587-6a02bd095a31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.149828 Oct 01 20:49:55.667791 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 178/358] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:55 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:55.685420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-019973ba-2e84-4efb-92e0-433727c9b473 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-019973ba-2e84-4efb-92e0-433727c9b473 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Request method failure captured: Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 283 Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfoMZ8ynv03TX59fS1O2vyF9JkrM8YzUo-CEdhiCg84P-EqhCvCV1htmdhl3bZ71Fi3Pjr2urdd9sLdcy0hhixxiLyNBpELhnSQpS8Ds1BfA0TErCrWEyfl8npoM8qGxq7srgCnLrl_P15rc9RDT86pJ3CdRVzHCg7jTetwl0gnn1U Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:55.690319 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4803d0561d104d7c8298e6782b8cb18d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}] Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35503a37685d4e11a514195dfaf29f38 Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:55.691853 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:49:55.692413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:55.693006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.693902 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.697045 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:49:55.697045 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:49:55.697045 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 20:49:55.697045 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.699861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-019973ba-2e84-4efb-92e0-433727c9b473 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:55.701229 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-019973ba-2e84-4efb-92e0-433727c9b473 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.031952 Oct 01 20:49:55.708141 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 179/359] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Oct 1 20:49:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:49:55.714466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3214e02f-4ec7-40e8-9d84-6af529919824 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Calling method '.version_select at 0x7f4173df9a60>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:55.843080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG neutronclient.v2_0.client [None req-3214e02f-4ec7-40e8-9d84-6af529919824 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 22544659-7690-47dc-9c00-ef46667d0e3a could not be found", "detail": ""}} {{(pid=140437) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 20:49:55.843764 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-3214e02f-4ec7-40e8-9d84-6af529919824 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] HTTP exception thrown: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a Oct 01 20:49:55.855524 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b29fba99-920c-4aad-8c3a-8e6c59d33ef3 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1611 microversion: 2.1 time: 1.154383 Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3214e02f-4ec7-40e8-9d84-6af529919824 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Request method failure captured: Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-floating-ips/22544659-7690-47dc-9c00-ef46667d0e3a HTTP/1.1 Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfkbLDpLQLB_P3jiCp33xxQAS_2UqyI6OcKZwYyC0GbUiQsOh14qlzD_j2X1Gp0WNhoIBK9OUeSn7PfCWIgzpAGic1BW-90pX9K2m8a1sD-7QtaLK1wNOWRaBw26EDZ8Tymz6HTI070rvJXNHlFLVByaM34EYzKslBWd12b1Y16uDo Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 70acee88008f4d83af21de726cafe09a Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FloatingIPsTestJSON-2057651148 Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:55.857444 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_70acee88008f4d83af21de726cafe09a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70acee88008f4d83af21de726cafe09a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/70acee88008f4d83af21de726cafe09a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70acee88008f4d83af21de726cafe09a"}]}] Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FloatingIPsTestJSON-2057651148 Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 70acee88008f4d83af21de726cafe09a Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2057651148 Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FloatingIPsTestJSON-2057651148-project Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: e34abaa1d265489fa35c25a3eae6f052 Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FloatingIPsTestJSON-2057651148-project Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: exception: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '22544659-7690-47dc-9c00-ef46667d0e3a'} Oct 01 20:49:55.858668 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 20:49:55.859416 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 22544659-7690-47dc-9c00-ef46667d0e3a could not be found Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1abd812-8b2c-46b7-beb9-2656f45a2449'] Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a. Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.860427 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:55.861541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:55.866642 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a Oct 01 20:49:55.866642 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.868342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3214e02f-4ec7-40e8-9d84-6af529919824 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Returning 404 to user: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:55.869424 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3214e02f-4ec7-40e8-9d84-6af529919824 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/22544659-7690-47dc-9c00-ef46667d0e3a" status: 404 len: 111 microversion: 2.1 time: 0.159312 Oct 01 20:49:55.872184 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 181/360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:54 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1611 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:55.874945 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 180/361] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 20:49:55 2022] GET /compute/v2.1/os-floating-ips/22544659-7690-47dc-9c00-ef46667d0e3a => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:55.885321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:55.885762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:55.893828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:55.894677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:55.895519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:55.896467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:55.897130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:55.897782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:55.901277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:55.907934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:55.919873 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] HTTP exception thrown: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Request method failure captured: Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a HTTP/1.1 Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKe51e_P6YvkkzbxVUeqFO4x7I7BSGu7qxvuNRbOs9Wrpa9VT8add7Sn8wzeX71lLEij1Z_WbVqb4tDM54OH1sxX6DdlC39LwzGXWlwM16RzjinnOHCAs5L9VZaDJjWBUYtzWsRPDFBbclf_DuIkFG4Hex8jFQr21Uo8XbqiXgD9qTk Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:55.923376 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e93dcf30e02b41178c6cde6e50a41e17", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}] Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7ef35c15f9d541ac90239c3713f9f5e6 Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.924638 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '4ec0fd3d-0841-45e0-903b-48ba9ed1566a'} Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:55.925284 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:55.926339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.936522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Returning 404 to user: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:55.939335 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9f47745c-be4e-4f18-8466-c5ea635cc199 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 404 len: 111 microversion: 2.1 time: 0.066054 Oct 01 20:49:55.940554 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 182/362] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:49:55 2022] DELETE /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:55.949188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:55.950351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92aca895-eaca-4925-b4be-9aabe37b84fa tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:55.952697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:55.953255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92aca895-eaca-4925-b4be-9aabe37b84fa tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Request method failure captured: Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 27 Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfoMZ8ynv03TX59fS1O2vyF9JkrM8YzUo-CEdhiCg84P-EqhCvCV1htmdhl3bZ71Fi3Pjr2urdd9sLdcy0hhixxiLyNBpELhnSQpS8Ds1BfA0TErCrWEyfl8npoM8qGxq7srgCnLrl_P15rc9RDT86pJ3CdRVzHCg7jTetwl0gnn1U Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:55.957563 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4803d0561d104d7c8298e6782b8cb18d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}] Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 35503a37685d4e11a514195dfaf29f38 Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: {"aggregate": {"name": ""}} Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:55.958831 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '' Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:55.959566 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 01 20:49:55.961796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:55.962911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:55.962911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:55.966143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92aca895-eaca-4925-b4be-9aabe37b84fa tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:55.966269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:55.967502 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92aca895-eaca-4925-b4be-9aabe37b84fa tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.024987 Oct 01 20:49:55.968297 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 183/363] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:55 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:49:55.980393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd691a3d-f331-4bac-a5ed-42f63418c589 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Calling method '.version_select at 0x7f4173e02f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:56.080068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-bd691a3d-f331-4bac-a5ed-42f63418c589 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 22544659-7690-47dc-9c00-ef46667d0e3a could not be found", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 20:49:56.081699 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-bd691a3d-f331-4bac-a5ed-42f63418c589 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] HTTP exception thrown: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd691a3d-f331-4bac-a5ed-42f63418c589 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Request method failure captured: Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-floating-ips/22544659-7690-47dc-9c00-ef46667d0e3a HTTP/1.1 Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfkbLDpLQLB_P3jiCp33xxQAS_2UqyI6OcKZwYyC0GbUiQsOh14qlzD_j2X1Gp0WNhoIBK9OUeSn7PfCWIgzpAGic1BW-90pX9K2m8a1sD-7QtaLK1wNOWRaBw26EDZ8Tymz6HTI070rvJXNHlFLVByaM34EYzKslBWd12b1Y16uDo Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 70acee88008f4d83af21de726cafe09a Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FloatingIPsTestJSON-2057651148 Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:56.089709 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_70acee88008f4d83af21de726cafe09a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70acee88008f4d83af21de726cafe09a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/70acee88008f4d83af21de726cafe09a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70acee88008f4d83af21de726cafe09a"}]}] Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FloatingIPsTestJSON-2057651148 Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 70acee88008f4d83af21de726cafe09a Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2057651148 Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FloatingIPsTestJSON-2057651148-project Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e34abaa1d265489fa35c25a3eae6f052 Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FloatingIPsTestJSON-2057651148-project Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: exception: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '22544659-7690-47dc-9c00-ef46667d0e3a'} Oct 01 20:49:56.091757 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 20:49:56.092476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 22544659-7690-47dc-9c00-ef46667d0e3a could not be found Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89502685-23ff-44df-99bd-bceaf7031214'] Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a. Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.093461 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:56.094540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:56.097350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a Oct 01 20:49:56.097350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.099044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd691a3d-f331-4bac-a5ed-42f63418c589 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] Returning 404 to user: Floating IP not found for ID 22544659-7690-47dc-9c00-ef46667d0e3a {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.100146 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd691a3d-f331-4bac-a5ed-42f63418c589 tempest-FloatingIPsTestJSON-2057651148 tempest-FloatingIPsTestJSON-2057651148-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/22544659-7690-47dc-9c00-ef46667d0e3a" status: 404 len: 111 microversion: 2.1 time: 0.123651 Oct 01 20:49:56.101042 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 184/364] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:49:55 2022] DELETE /compute/v2.1/os-floating-ips/22544659-7690-47dc-9c00-ef46667d0e3a => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:56.150876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:56.153350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:56.182288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.184660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.187841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.188744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.189330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.190004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.401938 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] HTTP exception thrown: Cannot 'migrate' instance 9435197a-1a11-4d4f-a15f-8886238b2755 while it is in vm_state suspended Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Request method failure captured: Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755/action HTTP/1.1 Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 15 Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfKe2mFYMVlpxNJZoTyLYq6s4RFv3sb3LT2qZ85DzTvHLy-78pOBinSlPApha3cTWyoSLp6WqLSoy9aguUCJWsfx8DFAknKjqL0stA-DPE8i7h6Ukx_Ziax2DFaekxBX3Nqz5TsucHUg-cSufuapoyFjrYK8NPZVHhWQRyqPf-BNEY Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:56.404299 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_219a096e44d4400c9513ada7e5acf85b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}] Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: c964ff61874f4e8f8713261701c34991 Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: {"migrate": {}} Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:56.405686 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'migrate' instance 9435197a-1a11-4d4f-a15f-8886238b2755 while it is in vm_state suspended Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '9435197a-1a11-4d4f-a15f-8886238b2755', 'body': {'migrate': {}}} Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9435197a-1a11-4d4f-a15f-8886238b2755 in vm_state suspended. Cannot resize while the instance is in this state. Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.406427 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 9435197a-1a11-4d4f-a15f-8886238b2755 while it is in vm_state suspended Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.407517 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.408555 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:56.408555 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:56.408555 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 9435197a-1a11-4d4f-a15f-8886238b2755 while it is in vm_state suspended Oct 01 20:49:56.408555 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.408555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Returning 409 to user: Cannot 'migrate' instance 9435197a-1a11-4d4f-a15f-8886238b2755 while it is in vm_state suspended {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.408555 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b34e0c1e-7380-4c5e-9927-0a3688bfce3d tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755/action" status: 409 len: 148 microversion: 2.1 time: 0.299295 Oct 01 20:49:56.418963 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 185/365] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:49:56 2022] POST /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755/action => generated 148 bytes in 313 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:56.432287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:56.432906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: 4ec0fd3d-0841-45e0-903b-48ba9ed1566a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:56.440820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.441838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.442457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.443793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.444426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.445202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.462122 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] HTTP exception thrown: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Request method failure captured: Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a HTTP/1.1 Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKe51e_P6YvkkzbxVUeqFO4x7I7BSGu7qxvuNRbOs9Wrpa9VT8add7Sn8wzeX71lLEij1Z_WbVqb4tDM54OH1sxX6DdlC39LwzGXWlwM16RzjinnOHCAs5L9VZaDJjWBUYtzWsRPDFBbclf_DuIkFG4Hex8jFQr21Uo8XbqiXgD9qTk Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:56.464753 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e93dcf30e02b41178c6cde6e50a41e17", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}] Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7ef35c15f9d541ac90239c3713f9f5e6 Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:56.465995 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '4ec0fd3d-0841-45e0-903b-48ba9ed1566a'} Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.467172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. Oct 01 20:49:56.468245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.469243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Returning 404 to user: Instance 4ec0fd3d-0841-45e0-903b-48ba9ed1566a could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.469243 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d042a434-b9ca-4fc2-b7bb-7c010c726fd7 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a" status: 404 len: 111 microversion: 2.1 time: 0.046132 Oct 01 20:49:56.469243 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 186/366] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:56 2022] GET /compute/v2.1/servers/4ec0fd3d-0841-45e0-903b-48ba9ed1566a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:56.479682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15da6af6-0c80-4106-8b16-2e751fdc3e74 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-175238343"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:56.483228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15da6af6-0c80-4106-8b16-2e751fdc3e74 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'fac54082682041db8cb3cf87fdea889f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb176cab2a4f9d9c6e33d62dd91ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15da6af6-0c80-4106-8b16-2e751fdc3e74 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Request method failure captured: Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 59 Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfndby8S-A9rSFn6gjihO38MmcPcK-Ykh1l4ZJvUuIMXa1liRmP88DHEf7T29CPsNBMpBwfQj7-Uv26r11RTGuXfrwNBhKRpDpljF9kwimEcHz9xKwGSJWMgzTiC-H-O-r2gsm3UVUD-lhocq2vHSd04xnjfkJtqNrmxjGYQbx8b8E Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:56.484814 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4cb176cab2a4f9d9c6e33d62dd91ddc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}] Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: fac54082682041db8cb3cf87fdea889f Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: {"aggregate": {"name": "tempest-test_aggregate-175238343"}} Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:56.486017 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-175238343'}}} Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:56.487258 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:56.488562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 01 20:49:56.489661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.489661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15da6af6-0c80-4106-8b16-2e751fdc3e74 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.489661 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15da6af6-0c80-4106-8b16-2e751fdc3e74 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018075 Oct 01 20:49:56.492758 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 187/367] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:56 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:56.497433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-382253cb-ae74-4613-9b18-a3bb4d2c2b21 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-382253cb-ae74-4613-9b18-a3bb4d2c2b21 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Request method failure captured: Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db/action HTTP/1.1 Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 39 Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfKe2mFYMVlpxNJZoTyLYq6s4RFv3sb3LT2qZ85DzTvHLy-78pOBinSlPApha3cTWyoSLp6WqLSoy9aguUCJWsfx8DFAknKjqL0stA-DPE8i7h6Ukx_Ziax2DFaekxBX3Nqz5TsucHUg-cSufuapoyFjrYK8NPZVHhWQRyqPf-BNEY Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:56.501593 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_219a096e44d4400c9513ada7e5acf85b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}] Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: c964ff61874f4e8f8713261701c34991 Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: {"os-resetState": {"state": "invalid"}} Oct 01 20:49:56.502930 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bff70c8-a206-4b32-8db9-aba1975bf1db', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'invalid' Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.503728 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:49:56.505210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 01 20:49:56.507639 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.507639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-382253cb-ae74-4613-9b18-a3bb4d2c2b21 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.509162 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-382253cb-ae74-4613-9b18-a3bb4d2c2b21 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db/action" status: 400 len: 144 microversion: 2.1 time: 0.013947 Oct 01 20:49:56.517620 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 188/368] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:49:56 2022] POST /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db/action => generated 144 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:49:56.524535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:56.525535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:56.535277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:56.540563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.541190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.541933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.542935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.543903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.544540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.549213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:56.549364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:56.568921 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] HTTP exception thrown: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Request method failure captured: Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a HTTP/1.1 Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKe51e_P6YvkkzbxVUeqFO4x7I7BSGu7qxvuNRbOs9Wrpa9VT8add7Sn8wzeX71lLEij1Z_WbVqb4tDM54OH1sxX6DdlC39LwzGXWlwM16RzjinnOHCAs5L9VZaDJjWBUYtzWsRPDFBbclf_DuIkFG4Hex8jFQr21Uo8XbqiXgD9qTk Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:56.570876 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e93dcf30e02b41178c6cde6e50a41e17", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}] Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7ef35c15f9d541ac90239c3713f9f5e6 Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.572044 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f695f0f4-e9de-43e3-9d93-46705a83fa0a'} Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.572703 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.573740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.574921 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9315deba-5c4f-4ae9-b300-caed5b351822 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1313 microversion: 2.1 time: 0.693490 Oct 01 20:49:56.576345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Returning 404 to user: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.577427 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3247b343-510f-4a4f-a56c-e2f003389d16 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 404 len: 111 microversion: 2.1 time: 0.057661 Oct 01 20:49:56.578335 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 189/369] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:49:56 2022] DELETE /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:56.583164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1b5ad62-4748-4180-8d75-e7c73bfe03b2 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1773114782"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:56.587578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.aggregate [None req-a1b5ad62-4748-4180-8d75-e7c73bfe03b2 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Generated uuid 18634d38-8bf2-4d6a-b1d1-8756de55ab97 for aggregate {{(pid=140438) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:56.589390 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 181/370] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:55 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:56.611470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5df55669-fb80-4467-9224-9cd20738abf4 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:56.624248 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1b5ad62-4748-4180-8d75-e7c73bfe03b2 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.042407 Oct 01 20:49:56.633160 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 190/371] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5df55669-fb80-4467-9224-9cd20738abf4 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Request method failure captured: Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db/action HTTP/1.1 Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 31 Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfKe2mFYMVlpxNJZoTyLYq6s4RFv3sb3LT2qZ85DzTvHLy-78pOBinSlPApha3cTWyoSLp6WqLSoy9aguUCJWsfx8DFAknKjqL0stA-DPE8i7h6Ukx_Ziax2DFaekxBX3Nqz5TsucHUg-cSufuapoyFjrYK8NPZVHhWQRyqPf-BNEY Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:56.635347 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_219a096e44d4400c9513ada7e5acf85b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}] Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: c964ff61874f4e8f8713261701c34991 Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: {"os-resetState": {"state": 1}} Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:56.636566 ncdv-master-1 devstack@n-api.service[140437]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '5bff70c8-a206-4b32-8db9-aba1975bf1db', 'body': {'os-resetState': {'state': 1}}} Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 1 Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.637273 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 01 20:49:56.638510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.640050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5df55669-fb80-4467-9224-9cd20738abf4 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.641683 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5df55669-fb80-4467-9224-9cd20738abf4 tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db/action" status: 400 len: 120 microversion: 2.1 time: 0.051188 Oct 01 20:49:56.649109 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 182/372] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:49:56 2022] POST /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db/action => generated 120 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:49:56.661752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1bf0e816-e970-48a1-ac78-22abd71392bc tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1773114782"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:56.661985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:56.662682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] [instance: f695f0f4-e9de-43e3-9d93-46705a83fa0a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:56.675737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-1bf0e816-e970-48a1-ac78-22abd71392bc tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Generated uuid 0183a5c8-adcf-448f-8dc7-366e6dca7277 for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:56.682475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.683249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.683850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.684766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.685382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.685957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.711797 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] HTTP exception thrown: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Request method failure captured: Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a HTTP/1.1 Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKe51e_P6YvkkzbxVUeqFO4x7I7BSGu7qxvuNRbOs9Wrpa9VT8add7Sn8wzeX71lLEij1Z_WbVqb4tDM54OH1sxX6DdlC39LwzGXWlwM16RzjinnOHCAs5L9VZaDJjWBUYtzWsRPDFBbclf_DuIkFG4Hex8jFQr21Uo8XbqiXgD9qTk Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:49:56.720456 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e93dcf30e02b41178c6cde6e50a41e17", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e93dcf30e02b41178c6cde6e50a41e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e93dcf30e02b41178c6cde6e50a41e17"}]}] Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e93dcf30e02b41178c6cde6e50a41e17 Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-607459471 Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7ef35c15f9d541ac90239c3713f9f5e6 Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersAdminTestJSON-607459471-project Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.721814 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f695f0f4-e9de-43e3-9d93-46705a83fa0a'} Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.722538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. Oct 01 20:49:56.723749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.725593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] Returning 404 to user: Instance f695f0f4-e9de-43e3-9d93-46705a83fa0a could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.726660 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5f17d3b7-6aae-44f9-a88a-10e287a8f510 tempest-DeleteServersAdminTestJSON-607459471 tempest-DeleteServersAdminTestJSON-607459471-project] 10.222.0.17 "GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a" status: 404 len: 111 microversion: 2.1 time: 0.091465 Oct 01 20:49:56.727921 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 191/373] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:56 2022] GET /compute/v2.1/servers/f695f0f4-e9de-43e3-9d93-46705a83fa0a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:56.736264 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-1bf0e816-e970-48a1-ac78-22abd71392bc tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1773114782 already exists. Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1bf0e816-e970-48a1-ac78-22abd71392bc tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Request method failure captured: Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 60 Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfoMZ8ynv03TX59fS1O2vyF9JkrM8YzUo-CEdhiCg84P-EqhCvCV1htmdhl3bZ71Fi3Pjr2urdd9sLdcy0hhixxiLyNBpELhnSQpS8Ds1BfA0TErCrWEyfl8npoM8qGxq7srgCnLrl_P15rc9RDT86pJ3CdRVzHCg7jTetwl0gnn1U Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:49:56.743911 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4803d0561d104d7c8298e6782b8cb18d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}] Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35503a37685d4e11a514195dfaf29f38 Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: {"aggregate": {"name": "tempest-test_aggregate-1773114782"}} Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:56.745426 ncdv-master-1 devstack@n-api.service[140437]: exception: Aggregate tempest-test_aggregate-1773114782 already exists. Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1773114782'}}} Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 01 20:49:56.746343 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1773114782 already exists. Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:56.747481 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1773114782 already exists. Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1773114782 already exists. Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1bf0e816-e970-48a1-ac78-22abd71392bc tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1773114782 already exists. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.748548 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1bf0e816-e970-48a1-ac78-22abd71392bc tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.094302 Oct 01 20:49:56.749406 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 183/374] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:56 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:56.754201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-947f46ad-558e-45ad-a562-25e14c3cc43b tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:56.757681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-947f46ad-558e-45ad-a562-25e14c3cc43b tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Failed to fetch instance by id 999 {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 01 20:49:56.758201 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-947f46ad-558e-45ad-a562-25e14c3cc43b tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-947f46ad-558e-45ad-a562-25e14c3cc43b tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Request method failure captured: Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 37 Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfKe2mFYMVlpxNJZoTyLYq6s4RFv3sb3LT2qZ85DzTvHLy-78pOBinSlPApha3cTWyoSLp6WqLSoy9aguUCJWsfx8DFAknKjqL0stA-DPE8i7h6Ukx_Ziax2DFaekxBX3Nqz5TsucHUg-cSufuapoyFjrYK8NPZVHhWQRyqPf-BNEY Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:56.760046 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_219a096e44d4400c9513ada7e5acf85b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/219a096e44d4400c9513ada7e5acf85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/219a096e44d4400c9513ada7e5acf85b"}]}] Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 219a096e44d4400c9513ada7e5acf85b Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1551131491 Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: c964ff61874f4e8f8713261701c34991 Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1551131491-project-admin Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: {"os-resetState": {"state": "error"}} Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:56.761335 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 999 could not be found. Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:49:56.762103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-947f46ad-558e-45ad-a562-25e14c3cc43b tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:56.763487 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-947f46ad-558e-45ad-a562-25e14c3cc43b tempest-ServersAdminNegativeTestJSON-1551131491 tempest-ServersAdminNegativeTestJSON-1551131491-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.032351 Oct 01 20:49:56.764550 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 192/375] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Oct 1 20:49:56 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:56.766755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:56.767389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:56.790202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2ff8a108-84bd-4e6d-90a5-57a5233d463b tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:56.801786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.802342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.810090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.810940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.811434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.811873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.859421 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2ff8a108-84bd-4e6d-90a5-57a5233d463b tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.096417 Oct 01 20:49:56.860007 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 193/376] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:49:56 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:56.870590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:56.874178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:56.890229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.902524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.904056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.905614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:56.906534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:56.908510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:56.976257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:49:57.040354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:57.061553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:57.064606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:57.093270 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cdf9f7a3-b91d-49a8-baad-8edefa4130a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.346115 Oct 01 20:49:57.098831 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 184/377] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:56 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:57.106093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-13bfd018-25dc-44e9-8754-22506285ad6d tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1668284556"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:57.111839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-13bfd018-25dc-44e9-8754-22506285ad6d tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Generated uuid 208403c8-a226-45bd-97ff-e1dbc954f1d8 for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:49:57.165942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:49:57.230051 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-13bfd018-25dc-44e9-8754-22506285ad6d tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.126058 Oct 01 20:49:57.231749 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 185/378] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:57.262433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4cc04142-f902-4b87-a012-ce161b499e71 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:57.267475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4cc04142-f902-4b87-a012-ce161b499e71 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'fac54082682041db8cb3cf87fdea889f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb176cab2a4f9d9c6e33d62dd91ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4cc04142-f902-4b87-a012-ce161b499e71 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Request method failure captured: Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfndby8S-A9rSFn6gjihO38MmcPcK-Ykh1l4ZJvUuIMXa1liRmP88DHEf7T29CPsNBMpBwfQj7-Uv26r11RTGuXfrwNBhKRpDpljF9kwimEcHz9xKwGSJWMgzTiC-H-O-r2gsm3UVUD-lhocq2vHSd04xnjfkJtqNrmxjGYQbx8b8E Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:49:57.280853 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4cb176cab2a4f9d9c6e33d62dd91ddc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}] Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: fac54082682041db8cb3cf87fdea889f Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 01 20:49:57.282213 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '15'} Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:57.282961 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 01 20:49:57.284172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:49:57.288431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4cc04142-f902-4b87-a012-ce161b499e71 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:57.291319 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4cc04142-f902-4b87-a012-ce161b499e71 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.039356 Oct 01 20:49:57.292875 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 186/379] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:49:57 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:49:57.296358 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6be86b48-7302-4fe0-8505-b4e3df27fe50 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 204 len: 0 microversion: 2.1 time: 0.428031 Oct 01 20:49:57.301750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 194/380] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:49:56 2022] DELETE /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:49:57.310305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c250a086-a335-4f09-a7e5-e886afff1214 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:57.320879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:57.325711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:57.353294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:57.353803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:57.354251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:57.364281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:57.364901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:57.379798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:57.410621 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c250a086-a335-4f09-a7e5-e886afff1214 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.110273 Oct 01 20:49:57.411668 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 187/381] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:49:57 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:49:57.846443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1688101376", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "e94323fd-d911-423e-a839-fc9242e1930f"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:57.937193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] validate_networks() for [('e94323fd-d911-423e-a839-fc9242e1930f', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:49:58.472771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:58.485770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-291d58ab-55b9-4742-8d27-d24d56ee9603 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1466 microversion: 2.1 time: 1.179156 Oct 01 20:49:58.487560 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 195/382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:57 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1466 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:58.507839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-63036cfd-2e9a-4165-8832-f89e160d69a4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:58.525398 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-63036cfd-2e9a-4165-8832-f89e160d69a4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-63036cfd-2e9a-4165-8832-f89e160d69a4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Request method failure captured: Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfoMZ8ynv03TX59fS1O2vyF9JkrM8YzUo-CEdhiCg84P-EqhCvCV1htmdhl3bZ71Fi3Pjr2urdd9sLdcy0hhixxiLyNBpELhnSQpS8Ds1BfA0TErCrWEyfl8npoM8qGxq7srgCnLrl_P15rc9RDT86pJ3CdRVzHCg7jTetwl0gnn1U Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:49:58.527498 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4803d0561d104d7c8298e6782b8cb18d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}] Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 35503a37685d4e11a514195dfaf29f38 Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: exception: Aggregate -1 could not be found. Oct 01 20:49:58.528711 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '-1'} Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 01 20:49:58.529407 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:58.530433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:49:58.531592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:49:58.531592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:49:58.531592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:49:58.531592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:49:58.531592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 01 20:49:58.531592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:49:58.533344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-63036cfd-2e9a-4165-8832-f89e160d69a4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:49:58.535027 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-63036cfd-2e9a-4165-8832-f89e160d69a4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.046241 Oct 01 20:49:58.539104 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 196/383] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:49:58 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:49:58.549357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:58.550224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:58.564462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:58.565426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:58.566793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:58.567674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:58.568624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:58.569308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:59.361079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:59.385771 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a70668ad-755a-4c61-bf62-fccf87856377 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1313 microversion: 2.1 time: 0.844212 Oct 01 20:49:59.388644 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 197/384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:49:58 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1313 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:49:59.402468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:49:59.403464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:49:59.415915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:59.416409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:59.416865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:59.417549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:59.418005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:59.418428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:59.814098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:59.833763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:59.835640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:49:59.842012 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-131b82df-4fc9-4031-90ff-a89e847e899c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.450187 Oct 01 20:49:59.851763 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 198/385] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:49:59 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:49:59.862961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-49294f2c-be88-482e-bc82-8974b6a896d9 req-256423e9-570e-4468-b47f-0a2bc9fcddfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718605d6-75e8-4b45-8db7-cd48626c0ce3", "name": "network-vif-plugged", "status": "completed", "tag": "0293e38a-8ed1-4661-add8-6b614f7f55b2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:59.904620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-49294f2c-be88-482e-bc82-8974b6a896d9 req-256423e9-570e-4468-b47f-0a2bc9fcddfd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:49:59.905481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-49294f2c-be88-482e-bc82-8974b6a896d9 req-256423e9-570e-4468-b47f-0a2bc9fcddfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:49:59.906330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-49294f2c-be88-482e-bc82-8974b6a896d9 req-256423e9-570e-4468-b47f-0a2bc9fcddfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:49:59.949675 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-49294f2c-be88-482e-bc82-8974b6a896d9 req-256423e9-570e-4468-b47f-0a2bc9fcddfd service nova] Creating event network-vif-plugged:0293e38a-8ed1-4661-add8-6b614f7f55b2 for instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 on nch2-master-1 Oct 01 20:49:59.964826 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-49294f2c-be88-482e-bc82-8974b6a896d9 req-256423e9-570e-4468-b47f-0a2bc9fcddfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111019 Oct 01 20:49:59.966895 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 199/386] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:49:59.972190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-826803c6-0913-4fe9-8206-cc27e4a2d9e9 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-54072925"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:49:59.976160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.aggregate [None req-826803c6-0913-4fe9-8206-cc27e4a2d9e9 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Generated uuid 8e55efcb-85b8-4fd7-b8b5-2c9342b0c5a3 for aggregate {{(pid=140438) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:50:00.015192 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-826803c6-0913-4fe9-8206-cc27e4a2d9e9 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045515 Oct 01 20:50:00.026733 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 200/387] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:49:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:00.033481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:00.034625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:00.048414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:00.049190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:00.049861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:00.051893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:00.055873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:00.056547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:00.113424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:50:00.253284 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-571b99f7-9913-4de6-9e0d-1dfb6da03b83 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 204 len: 0 microversion: 2.1 time: 0.224694 Oct 01 20:50:00.254205 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 201/388] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:50:00 2022] DELETE /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:50:00.267163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:00.267939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:00.288417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:00.288940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:00.289394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:00.290177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:00.293077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:00.293077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:00.589420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:50:00.590078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:50:00.590328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:50:00.591295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:50:00.591793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:50:00.611414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:00.616560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:00.617236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:00.619652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:00.621350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:00.623115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:00.662994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:50:00.672175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for user aa72870453cd4b958725801b842c7a28 and project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:50:00.692528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:50:00.706051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:50:00.805057 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8fe759bd-858e-4dfe-b155-9b979d896d9c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.391991 Oct 01 20:50:00.806417 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 188/389] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:49:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3394 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 20:50:00.811937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e789d7a-fcc2-40f6-bdfd-3a3e52a3866c tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:00.814467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0e789d7a-fcc2-40f6-bdfd-3a3e52a3866c tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'fac54082682041db8cb3cf87fdea889f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb176cab2a4f9d9c6e33d62dd91ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e789d7a-fcc2-40f6-bdfd-3a3e52a3866c tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Request method failure captured: Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfndby8S-A9rSFn6gjihO38MmcPcK-Ykh1l4ZJvUuIMXa1liRmP88DHEf7T29CPsNBMpBwfQj7-Uv26r11RTGuXfrwNBhKRpDpljF9kwimEcHz9xKwGSJWMgzTiC-H-O-r2gsm3UVUD-lhocq2vHSd04xnjfkJtqNrmxjGYQbx8b8E Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:50:00.816828 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4cb176cab2a4f9d9c6e33d62dd91ddc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}] Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: fac54082682041db8cb3cf87fdea889f Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 01 20:50:00.818063 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '16'} Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:50:00.818929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 01 20:50:00.819951 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:00.823274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e789d7a-fcc2-40f6-bdfd-3a3e52a3866c tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:00.824382 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0e789d7a-fcc2-40f6-bdfd-3a3e52a3866c tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] 10.222.0.17 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.016548 Oct 01 20:50:00.826321 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 189/390] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:50:00 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:50:00.831710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:00.832626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:00.841190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:00.842382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:00.843740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:00.844918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:00.846009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:00.846743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:00.959828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:00.970542 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6bbd461e-60b2-47d7-bf65-2f9a3d76cc4c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1466 microversion: 2.1 time: 0.714917 Oct 01 20:50:00.975917 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 202/391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:00 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1466 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:00.986161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-282418961", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "657278611", "adminPass": "***", "networks": [{"uuid": "717cf1be-00b6-4edb-85b1-17a561c83f04"}], "security_groups": [{"name": "tempest-securitygroup--573574117"}], "key_name": "tempest-keypair-1903102010", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:01.346778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] validate_networks() for [('717cf1be-00b6-4edb-85b1-17a561c83f04', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:50:01.423725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:01.440121 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1ef52ada-3b2b-46c4-83d0-7ccc8878d9d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1313 microversion: 2.1 time: 0.606747 Oct 01 20:50:01.442340 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 190/392] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:00 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:01.459878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c88405a8-cc5f-4629-9d22-d428c5d99569 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:01.460592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c88405a8-cc5f-4629-9d22-d428c5d99569 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:01.840828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c88405a8-cc5f-4629-9d22-d428c5d99569 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:01.852719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c88405a8-cc5f-4629-9d22-d428c5d99569 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:01.857084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c88405a8-cc5f-4629-9d22-d428c5d99569 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:01.858617 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c88405a8-cc5f-4629-9d22-d428c5d99569 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1262 microversion: 2.25 time: 0.414971 Oct 01 20:50:01.876568 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 191/393] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:01 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1262 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:01.889305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8682407f-e8c2-4241-a26d-0a13a45fa6f4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:01.933018 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8682407f-e8c2-4241-a26d-0a13a45fa6f4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.054684 Oct 01 20:50:01.934200 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 192/394] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:50:01 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:50:01.946598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:01.947466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:01.977030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:01.978605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:01.979795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:01.982961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:01.983703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:01.986213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:02.388720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:02.414061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:02.416654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:02.438273 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c6468850-9c15-4b3e-82ae-da6e76185317 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.494890 Oct 01 20:50:02.458581 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 193/395] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:01 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:02.482204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a154fd92-d4bc-4784-8874-bb9e799d71b0 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:02.503512 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-a154fd92-d4bc-4784-8874-bb9e799d71b0 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a154fd92-d4bc-4784-8874-bb9e799d71b0 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Request method failure captured: Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfoMZ8ynv03TX59fS1O2vyF9JkrM8YzUo-CEdhiCg84P-EqhCvCV1htmdhl3bZ71Fi3Pjr2urdd9sLdcy0hhixxiLyNBpELhnSQpS8Ds1BfA0TErCrWEyfl8npoM8qGxq7srgCnLrl_P15rc9RDT86pJ3CdRVzHCg7jTetwl0gnn1U Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:50:02.508330 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4803d0561d104d7c8298e6782b8cb18d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}] Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 35503a37685d4e11a514195dfaf29f38 Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: exception: Aggregate -1 could not be found. Oct 01 20:50:02.510813 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '-1'} Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:02.511633 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 01 20:50:02.513900 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:02.517558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a154fd92-d4bc-4784-8874-bb9e799d71b0 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:02.518687 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a154fd92-d4bc-4784-8874-bb9e799d71b0 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.048956 Oct 01 20:50:02.519553 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 194/396] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:50:02 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:50:02.533329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:02.534250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:02.544365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:02.545202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:02.545861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:02.546970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:02.547980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:02.549202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:02.601995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:02.604286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:02.605012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:02.605714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lazy-loading 'fault' on Instance uuid 9435197a-1a11-4d4f-a15f-8886238b2755 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:50:02.792846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:02.802235 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4ff2177c-4721-4c29-9624-d710b611eb72 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 200 len: 1311 microversion: 2.1 time: 0.273499 Oct 01 20:50:02.813995 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 195/397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:02 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 1311 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:03.101526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9da0e69f-45b9-47f7-bb44-f9a39bb960c5 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:03.103661 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-9da0e69f-45b9-47f7-bb44-f9a39bb960c5 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9da0e69f-45b9-47f7-bb44-f9a39bb960c5 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320-project-admin] Request method failure captured: Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKf6OzACnZC8CziXZ1kTNwNWqRWkH9hCsDSl7nNl-eY3moiXINR01pVSH9ScSDgMPHeaOeLT-Yo0K9qXYkqc7fw_5rHltqcgpuVgwvQuzbg9BPUCYXjTf9JtUlYFOw2f7vxGjCG0kDNkY6EIUQC4Od4agly44DrxFED3TJIkBV-rQtY Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: cb7f6c9003734fcaac1124e7879370d7 Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-724428320 Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:50:03.113281 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cb7f6c9003734fcaac1124e7879370d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb7f6c9003734fcaac1124e7879370d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cb7f6c9003734fcaac1124e7879370d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb7f6c9003734fcaac1124e7879370d7"}]}] Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-724428320 Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: cb7f6c9003734fcaac1124e7879370d7 Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-724428320 Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-724428320-project-admin Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 3dd3804e3e0a43ffa8fda4161c7b77c7 Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-724428320-project-admin Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:50:03.114645 ncdv-master-1 devstack@n-api.service[140437]: exception: Invalid timestamp for date invalid_time Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'invalid_time'} Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:03.115294 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 01 20:50:03.116423 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:03.122384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9da0e69f-45b9-47f7-bb44-f9a39bb960c5 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:03.124806 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9da0e69f-45b9-47f7-bb44-f9a39bb960c5 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320 tempest-InstanceUsageAuditLogNegativeTestJSON-724428320-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.309691 Oct 01 20:50:03.125935 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 196/398] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Oct 1 20:50:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:03.131750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-46b1dadf-c789-45c0-83ba-9af355ce454a req-04c02711-67ed-42e8-ad03-188d407d66ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9435197a-1a11-4d4f-a15f-8886238b2755", "name": "network-vif-deleted", "tag": "e6918f48-873e-4725-a36d-69e38bb52dc9"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:03.144622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-46b1dadf-c789-45c0-83ba-9af355ce454a req-04c02711-67ed-42e8-ad03-188d407d66ef service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:03.145381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-46b1dadf-c789-45c0-83ba-9af355ce454a req-04c02711-67ed-42e8-ad03-188d407d66ef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:03.146066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-46b1dadf-c789-45c0-83ba-9af355ce454a req-04c02711-67ed-42e8-ad03-188d407d66ef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:03.163448 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-46b1dadf-c789-45c0-83ba-9af355ce454a req-04c02711-67ed-42e8-ad03-188d407d66ef service nova] Creating event network-vif-deleted:e6918f48-873e-4725-a36d-69e38bb52dc9 for instance 9435197a-1a11-4d4f-a15f-8886238b2755 on nch1-master-1 Oct 01 20:50:03.172829 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-46b1dadf-c789-45c0-83ba-9af355ce454a req-04c02711-67ed-42e8-ad03-188d407d66ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044185 Oct 01 20:50:03.174423 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 197/399] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:03.184560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:03.187604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:03.200282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:03.218018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:03.218914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:03.222607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:03.223330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:03.224010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:04.150916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:50:04.151417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:50:04.151816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:50:04.152231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:50:04.152647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:50:04.163362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:04.164069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:04.165270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:04.166367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:04.168125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:04.168784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:04.188512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Getting quotas for project 6741e5e1d01343dbb0889a1de15d6302. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:50:04.195510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Getting quotas for user f40f50783d9f417a8f84fab11b0d10d0 and project 6741e5e1d01343dbb0889a1de15d6302. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:50:04.213109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:50:04.215692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:50:04.271670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.283069 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b7111c3a-95d3-479d-abc4-0952f6bc0225 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1463 microversion: 2.1 time: 1.105098 Oct 01 20:50:04.285263 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 198/400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:03 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1463 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:04.301056 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c1cea63-3ee7-4fbe-ac65-82c489590442 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.323921 Oct 01 20:50:04.309944 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 203/401] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 3333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:50:04.318278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e71daa0a-d676-4a18-bfa4-b75a30944b85 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:04.320476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e71daa0a-d676-4a18-bfa4-b75a30944b85 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'fac54082682041db8cb3cf87fdea889f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb176cab2a4f9d9c6e33d62dd91ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.321905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:04.324568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e71daa0a-d676-4a18-bfa4-b75a30944b85 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Request method failure captured: Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfndby8S-A9rSFn6gjihO38MmcPcK-Ykh1l4ZJvUuIMXa1liRmP88DHEf7T29CPsNBMpBwfQj7-Uv26r11RTGuXfrwNBhKRpDpljF9kwimEcHz9xKwGSJWMgzTiC-H-O-r2gsm3UVUD-lhocq2vHSd04xnjfkJtqNrmxjGYQbx8b8E Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:50:04.327017 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4cb176cab2a4f9d9c6e33d62dd91ddc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}] Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: fac54082682041db8cb3cf87fdea889f Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 01 20:50:04.328487 ncdv-master-1 devstack@n-api.service[140437]: action_args: {} Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:50:04.329314 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 01 20:50:04.330628 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.333302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e71daa0a-d676-4a18-bfa4-b75a30944b85 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:04.334224 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e71daa0a-d676-4a18-bfa4-b75a30944b85 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.026630 Oct 01 20:50:04.337808 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 199/402] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:50:04 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:50:04.347038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:04.348554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:04.351483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:04.352556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:04.354115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:04.355814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:04.488004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-47fb4aa1-efe9-4205-a063-000e48a00dd8 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:04.490190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-47fb4aa1-efe9-4205-a063-000e48a00dd8 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5df768a2d0f64f08953559660694beef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1f2ee4738b4b74bbcb7c685d12feb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-47fb4aa1-efe9-4205-a063-000e48a00dd8 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] Request method failure captured: Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKf4vgSoX2EKRkWMnMLpeKkRzh1RluPKVLFYNw3UpmlPfcxgR_h44bdpBPRVU5qY01B3eGzdlaV4RR5s3Nd3BUGFpgWuYplVfqr2Og69peH1nN3dDuEEpTUUtFjyhvXhDMrkbiDW9S3NCuSjzoChgahZO0Ea30oErGYcM-CJEekca6E Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 7f1f2ee4738b4b74bbcb7c685d12feb4 Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:50:04.494055 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f1f2ee4738b4b74bbcb7c685d12feb4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f1f2ee4738b4b74bbcb7c685d12feb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f1f2ee4738b4b74bbcb7c685d12feb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f1f2ee4738b4b74bbcb7c685d12feb4"}]}] Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 7f1f2ee4738b4b74bbcb7c685d12feb4 Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 5df768a2d0f64f08953559660694beef Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project Oct 01 20:50:04.495401 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: action_args: {} Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:50:04.495990 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 01 20:50:04.497114 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.499857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-47fb4aa1-efe9-4205-a063-000e48a00dd8 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:04.503744 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-47fb4aa1-efe9-4205-a063-000e48a00dd8 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.164534 Oct 01 20:50:04.504449 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 200/403] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Oct 1 20:50:04 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:50:04.523803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:04.524599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:04.536126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:04.536753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:04.537758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:04.538983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:04.540369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:04.541214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:04.627107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.638203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.639796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.641290 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68a170bb-d896-4387-9a5e-bcf8b613a20b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1320 microversion: 2.25 time: 0.329812 Oct 01 20:50:04.642199 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 204/404] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:04 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:04.670855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:04.671840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 9435197a-1a11-4d4f-a15f-8886238b2755] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:04.682187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:04.683066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:04.683947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:04.685609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:04.686517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:04.687177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:04.714478 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] HTTP exception thrown: Instance 9435197a-1a11-4d4f-a15f-8886238b2755 could not be found. Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Request method failure captured: Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 HTTP/1.1 Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfICyMBszm6S6yrD__6amgXsakMNq7RpZo9cQhrEgXKcK2vSPwyCW4n8vO6UHF8TN0dy7lsd3By-BhRmkv0ivzgpz42Fsq_jHoBe8n1vc1kwDP4mjJQrJHM8aHcOqjSwZwVfFGmFg6icHKex6DNkAhYH4RJrDIQ-sGXIY4h1hhzv1E Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: f7d124b2b3db49328d393be7be2e82d6 Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-465991356 Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:50:04.716826 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7d124b2b3db49328d393be7be2e82d6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7d124b2b3db49328d393be7be2e82d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7d124b2b3db49328d393be7be2e82d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7d124b2b3db49328d393be7be2e82d6"}]}] Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersAdminNegativeTestJSON-465991356 Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: f7d124b2b3db49328d393be7be2e82d6 Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-465991356 Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersAdminNegativeTestJSON-465991356-project Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0980a1e24cdc491aa1a0202afc4fcd64 Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersAdminNegativeTestJSON-465991356-project Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 9435197a-1a11-4d4f-a15f-8886238b2755 could not be found. Oct 01 20:50:04.718198 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '9435197a-1a11-4d4f-a15f-8886238b2755'} Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9435197a-1a11-4d4f-a15f-8886238b2755 could not be found. Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:04.718947 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9435197a-1a11-4d4f-a15f-8886238b2755 could not be found. Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9435197a-1a11-4d4f-a15f-8886238b2755 could not be found. Oct 01 20:50:04.720002 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:04.722728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Returning 404 to user: Instance 9435197a-1a11-4d4f-a15f-8886238b2755 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:04.723823 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-af0e77eb-2f46-4d80-ab17-daea0e58d4f6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755" status: 404 len: 111 microversion: 2.1 time: 0.067910 Oct 01 20:50:04.724919 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 205/405] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:04 2022] GET /compute/v2.1/servers/9435197a-1a11-4d4f-a15f-8886238b2755 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:50:04.730232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea3ebffe-1ba5-4ebd-ae94-61fb47113ebd tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:04.731188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea3ebffe-1ba5-4ebd-ae94-61fb47113ebd tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:04.789029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.804382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.806377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.828573 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c32f6bce-cc4a-490d-8803-92f06c3940cb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.321332 Oct 01 20:50:04.830305 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 201/406] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:04 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:04.906832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea3ebffe-1ba5-4ebd-ae94-61fb47113ebd tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:04.916238 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea3ebffe-1ba5-4ebd-ae94-61fb47113ebd tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1262 microversion: 2.1 time: 0.189993 Oct 01 20:50:04.921065 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 206/407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:04 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1262 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:04.931226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efb0abe3-8bf7-429f-bc3f-5ccba6951f92 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-954006272"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:04.968933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.aggregate [None req-efb0abe3-8bf7-429f-bc3f-5ccba6951f92 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Generated uuid 659c9e42-0bc0-4500-9ef4-93d9f4124adf for aggregate {{(pid=140438) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:50:05.050669 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-efb0abe3-8bf7-429f-bc3f-5ccba6951f92 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.128220 Oct 01 20:50:05.056771 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 207/408] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:50:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:05.081741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8663c798-aa38-4b42-9601-8bf321086487 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:05.087380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8663c798-aa38-4b42-9601-8bf321086487 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5df768a2d0f64f08953559660694beef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1f2ee4738b4b74bbcb7c685d12feb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8663c798-aa38-4b42-9601-8bf321086487 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] Request method failure captured: Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-01%2020:50:04 HTTP/1.1 Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKf4vgSoX2EKRkWMnMLpeKkRzh1RluPKVLFYNw3UpmlPfcxgR_h44bdpBPRVU5qY01B3eGzdlaV4RR5s3Nd3BUGFpgWuYplVfqr2Og69peH1nN3dDuEEpTUUtFjyhvXhDMrkbiDW9S3NCuSjzoChgahZO0Ea30oErGYcM-CJEekca6E Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7f1f2ee4738b4b74bbcb7c685d12feb4 Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:50:05.104767 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f1f2ee4738b4b74bbcb7c685d12feb4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f1f2ee4738b4b74bbcb7c685d12feb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f1f2ee4738b4b74bbcb7c685d12feb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f1f2ee4738b4b74bbcb7c685d12feb4"}]}] Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7f1f2ee4738b4b74bbcb7c685d12feb4 Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 5df768a2d0f64f08953559660694beef Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project Oct 01 20:50:05.106223 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2022-10-01 20:50:04'} Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:50:05.106932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 01 20:50:05.108250 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:05.110387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8663c798-aa38-4b42-9601-8bf321086487 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:05.115567 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8663c798-aa38-4b42-9601-8bf321086487 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540 tempest-InstanceUsageAuditLogNegativeTestJSON-551913540-project] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-01 20:50:04" status: 403 len: 128 microversion: 2.1 time: 0.056129 Oct 01 20:50:05.119491 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 208/409] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 20:50:05 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-01%2020%3A50%3A04 => generated 128 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:50:05.160693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-06d62bb2-cb37-4a42-b0f1-a9b93b7595bf tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:05.161418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-06d62bb2-cb37-4a42-b0f1-a9b93b7595bf tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:05.166866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:05.167288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:05.177475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d62bb2-cb37-4a42-b0f1-a9b93b7595bf tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:05.178021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d62bb2-cb37-4a42-b0f1-a9b93b7595bf tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:05.178513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d62bb2-cb37-4a42-b0f1-a9b93b7595bf tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:05.197751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d62bb2-cb37-4a42-b0f1-a9b93b7595bf tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:05.198262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d62bb2-cb37-4a42-b0f1-a9b93b7595bf tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:05.207517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:05.208054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:05.208531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:05.209283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:05.209776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:05.210215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:05.210854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d62bb2-cb37-4a42-b0f1-a9b93b7595bf tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:05.369907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:50:05.668934 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-78a61a3e-2996-4c90-b06d-8a541e53e8a3 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 204 len: 0 microversion: 2.1 time: 0.544617 Oct 01 20:50:05.670204 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 209/410] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:50:05 2022] DELETE /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:50:05.684333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f64779f-2e70-4020-a134-db6afce479b4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:05.731852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f64779f-2e70-4020-a134-db6afce479b4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:05.732251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f64779f-2e70-4020-a134-db6afce479b4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:05.738621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f64779f-2e70-4020-a134-db6afce479b4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:06.205272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f64779f-2e70-4020-a134-db6afce479b4 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.533420 Oct 01 20:50:06.212937 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 210/411] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 20:50:05 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:06.217611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:06.223350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:06.252128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:06.252700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:06.256902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:06.257847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:06.259143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:06.260918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:06.612817 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-06d62bb2-cb37-4a42-b0f1-a9b93b7595bf tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1614 microversion: 2.1 time: 1.781125 Oct 01 20:50:06.613406 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 202/412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:04 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1614 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:06.635871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:06.643872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:06.659982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:06.667466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:06.668294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:06.673244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:06.674150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:06.674901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:07.795218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:07.813242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:07.817413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:07.821635 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29c75805-5646-4c00-a337-139fb46c005a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1362 microversion: 2.25 time: 1.611809 Oct 01 20:50:07.822807 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 211/413] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:06 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1362 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:07.834446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:07.843004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:07.865857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:07.866366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:07.872148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:07.874426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:07.877354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:07.877883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:07.929034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:08.251049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:08.280539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:08.283660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:08.304023 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71699a4e-b28a-48e3-98f3-c912e5b3e779 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.474928 Oct 01 20:50:08.314625 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 212/414] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:07 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:08.325809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:08.327387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:08.337137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:08.358268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:08.360697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:08.361443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:08.362348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:08.368343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:08.368819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:08.372368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:08.382770 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cbda8465-116c-440a-adec-fc79c92b21cd tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1476 microversion: 2.1 time: 1.765766 Oct 01 20:50:08.383861 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 203/415] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:06 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1476 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:08.412436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1fd241ad-790d-41c6-9242-7722f985fa11 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:08.433849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1fd241ad-790d-41c6-9242-7722f985fa11 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'fac54082682041db8cb3cf87fdea889f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb176cab2a4f9d9c6e33d62dd91ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1fd241ad-790d-41c6-9242-7722f985fa11 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Request method failure captured: Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 42 Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfndby8S-A9rSFn6gjihO38MmcPcK-Ykh1l4ZJvUuIMXa1liRmP88DHEf7T29CPsNBMpBwfQj7-Uv26r11RTGuXfrwNBhKRpDpljF9kwimEcHz9xKwGSJWMgzTiC-H-O-r2gsm3UVUD-lhocq2vHSd04xnjfkJtqNrmxjGYQbx8b8E Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:50:08.443184 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4cb176cab2a4f9d9c6e33d62dd91ddc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4cb176cab2a4f9d9c6e33d62dd91ddc"}]}] Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: d4cb176cab2a4f9d9c6e33d62dd91ddc Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210 Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: fac54082682041db8cb3cf87fdea889f Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580351210-project Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: {"remove_host": {"host": "nch1-master-1"}} Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:50:08.444804 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch1-master-1'}}} Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:50:08.446312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 01 20:50:08.449172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:08.454183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1fd241ad-790d-41c6-9242-7722f985fa11 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:08.456278 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1fd241ad-790d-41c6-9242-7722f985fa11 tempest-AggregatesAdminNegativeTestJSON-1580351210 tempest-AggregatesAdminNegativeTestJSON-1580351210-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.063661 Oct 01 20:50:08.463173 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 204/416] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 20:50:08 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:50:08.484887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:08.496105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:08.526850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:08.530011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:08.532683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:08.534909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:08.537988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:08.541496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:09.205867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b12f27914a4544cf82521abd3e7db9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efda885854e4211bc1145a488270fbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:09.206483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] flavor_id is None. Assuming migration. {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 01 20:50:09.206951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 20:50:09.212220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:09.224871 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5ca9e8df-4a15-4471-a3f4-c3d7c11fd3eb tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1320 microversion: 2.1 time: 0.916120 Oct 01 20:50:09.229892 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 213/417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:08 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1320 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:09.243801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-62647573-9f61-47d5-93ce-3b2611d4906e req-d5eeb29c-fe43-41f2-9af4-b41b4ff1f68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14cd883-3b04-49e9-9e08-002afa2fae2f", "name": "network-vif-deleted", "tag": "e9b6f564-0714-46c8-bd67-3d043e15b73c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:09.271982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-62647573-9f61-47d5-93ce-3b2611d4906e req-d5eeb29c-fe43-41f2-9af4-b41b4ff1f68f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:09.272762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-62647573-9f61-47d5-93ce-3b2611d4906e req-d5eeb29c-fe43-41f2-9af4-b41b4ff1f68f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:09.273364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-62647573-9f61-47d5-93ce-3b2611d4906e req-d5eeb29c-fe43-41f2-9af4-b41b4ff1f68f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:09.300339 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-62647573-9f61-47d5-93ce-3b2611d4906e req-d5eeb29c-fe43-41f2-9af4-b41b4ff1f68f service nova] Creating event network-vif-deleted:e9b6f564-0714-46c8-bd67-3d043e15b73c for instance e14cd883-3b04-49e9-9e08-002afa2fae2f on nch1-master-1 Oct 01 20:50:09.320908 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-62647573-9f61-47d5-93ce-3b2611d4906e req-d5eeb29c-fe43-41f2-9af4-b41b4ff1f68f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089347 Oct 01 20:50:09.322188 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 214/418] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:09.330447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6277b9d1-6052-406f-af41-08cd521b1160 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:09.354996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6277b9d1-6052-406f-af41-08cd521b1160 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:09.355742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6277b9d1-6052-406f-af41-08cd521b1160 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:09.356385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6277b9d1-6052-406f-af41-08cd521b1160 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:09.611854 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6277b9d1-6052-406f-af41-08cd521b1160 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.288199 Oct 01 20:50:09.613866 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 215/419] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 20:50:09 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:09.625309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:09.630953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:09.648328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:09.655297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:09.655710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:09.656461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:09.656936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:09.657371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:09.863075 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c39b9c29-1320-4bf6-ba1f-dd0d6f208b34 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3/action" status: 202 len: 0 microversion: 2.1 time: 1.397778 Oct 01 20:50:09.873039 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 205/420] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:50:08 2022] POST /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3/action => generated 0 bytes in 1409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:09.887858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:09.895895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:09.928221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:09.939390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:09.943929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:09.944977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:09.946799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:09.948615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:10.652496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:10.970428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:10.982810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:10.991041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:11.034843 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3fa88d57-4151-4645-8e8f-ccdea646f75f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 1.158606 Oct 01 20:50:11.037199 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 206/421] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:09 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:11.085009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:11.092101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:11.124150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:11.141881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:11.144129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:11.145105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:11.148532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:11.155342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:11.451540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:11.462627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:11.477189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:11.482265 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e6498358-504c-48be-9629-5df6922a9627 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1362 microversion: 2.25 time: 1.865178 Oct 01 20:50:11.483142 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 216/422] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:09 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1362 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:11.498551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5539279b-6b67-444c-aa83-678b80328f28 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:11.525606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980a1e24cdc491aa1a0202afc4fcd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d124b2b3db49328d393be7be2e82d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:11.536753 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f028cbf1-a8e4-427f-8ee2-357310e32aa6 tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 200 len: 1306 microversion: 2.1 time: 0.497942 Oct 01 20:50:11.546803 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 207/423] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:11 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 1306 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:11.563004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:11.564368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:11.564584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5539279b-6b67-444c-aa83-678b80328f28 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.078077 Oct 01 20:50:11.569521 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 217/424] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:50:11 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:50:11.583611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:11.588038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:11.599169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:11.599748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:11.600337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:11.605458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:11.606263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:11.606948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:11.618799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:11.619792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:11.622210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:11.624178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:11.626379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:11.627265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:11.846319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:12.567456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:12.581882 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1d180fb5-6256-4b96-8cc0-68fdc043c238 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1472 microversion: 2.1 time: 1.033425 Oct 01 20:50:12.589280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:12.595794 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 208/425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:11 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1472 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:12.603862 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a56b43c-2bf6-4e2d-9c6d-dfa332a355f8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1387 microversion: 2.1 time: 1.031317 Oct 01 20:50:12.609655 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 218/426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:11 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1387 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:12.623598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-9afe6295-c813-4b4f-8ba7-0f930c3ee74b req-8ec9c09d-fa38-4f5c-b58a-1ecc1b63440f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bff70c8-a206-4b32-8db9-aba1975bf1db", "name": "network-vif-deleted", "tag": "2cc51466-d60f-4b61-9c90-acdd94cf1546"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:12.629019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0dd44ee2-857b-411c-b395-fe9b6c936c99 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-265503242"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:12.641854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.aggregate [None req-0dd44ee2-857b-411c-b395-fe9b6c936c99 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Generated uuid 08c90f3f-dd5c-4a63-8572-ea2031394901 for aggregate {{(pid=140438) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 20:50:12.662237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9afe6295-c813-4b4f-8ba7-0f930c3ee74b req-8ec9c09d-fa38-4f5c-b58a-1ecc1b63440f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:12.664194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9afe6295-c813-4b4f-8ba7-0f930c3ee74b req-8ec9c09d-fa38-4f5c-b58a-1ecc1b63440f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:12.664992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9afe6295-c813-4b4f-8ba7-0f930c3ee74b req-8ec9c09d-fa38-4f5c-b58a-1ecc1b63440f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:12.706586 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0dd44ee2-857b-411c-b395-fe9b6c936c99 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085738 Oct 01 20:50:12.707807 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 219/427] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 20:50:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:12.711177 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-9afe6295-c813-4b4f-8ba7-0f930c3ee74b req-8ec9c09d-fa38-4f5c-b58a-1ecc1b63440f service nova] Creating event network-vif-deleted:2cc51466-d60f-4b61-9c90-acdd94cf1546 for instance 5bff70c8-a206-4b32-8db9-aba1975bf1db on nch2-master-1 Oct 01 20:50:12.719641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:12.720945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:12.730049 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-9afe6295-c813-4b4f-8ba7-0f930c3ee74b req-8ec9c09d-fa38-4f5c-b58a-1ecc1b63440f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127151 Oct 01 20:50:12.731190 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 209/428] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:12.743784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:12.744239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:12.745155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:12.747001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:12.747651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:12.748549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:12.750154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:12.751401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:12.769348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:12.769857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:12.770299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:12.781138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:12.781646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:12.787682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:12.900402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:13.755034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:13.763343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:13.771710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:13.773170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:13.778210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:13.783102 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-98203d84-d978-4f30-92ef-71ed7281d568 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1362 microversion: 2.25 time: 1.047344 Oct 01 20:50:13.795667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:13.796171 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 210/429] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:12 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1362 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:13.808733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:13.809639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] [instance: 5bff70c8-a206-4b32-8db9-aba1975bf1db] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:13.819452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:13.822326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-396e34f7-58ca-4d6c-bc8d-f87be6a39077 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 1.112873 Oct 01 20:50:13.825249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:13.825738 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 220/430] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:12 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:13.826644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:13.829229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:13.834932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:13.835720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:13.847549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:13.885513 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] HTTP exception thrown: Instance 5bff70c8-a206-4b32-8db9-aba1975bf1db could not be found. Oct 01 20:50:13.888488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:13.889019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Request method failure captured: Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db HTTP/1.1 Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfICyMBszm6S6yrD__6amgXsakMNq7RpZo9cQhrEgXKcK2vSPwyCW4n8vO6UHF8TN0dy7lsd3By-BhRmkv0ivzgpz42Fsq_jHoBe8n1vc1kwDP4mjJQrJHM8aHcOqjSwZwVfFGmFg6icHKex6DNkAhYH4RJrDIQ-sGXIY4h1hhzv1E Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: f7d124b2b3db49328d393be7be2e82d6 Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-465991356 Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:50:13.893207 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7d124b2b3db49328d393be7be2e82d6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7d124b2b3db49328d393be7be2e82d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7d124b2b3db49328d393be7be2e82d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7d124b2b3db49328d393be7be2e82d6"}]}] Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersAdminNegativeTestJSON-465991356 Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: f7d124b2b3db49328d393be7be2e82d6 Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-465991356 Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersAdminNegativeTestJSON-465991356-project Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 0980a1e24cdc491aa1a0202afc4fcd64 Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersAdminNegativeTestJSON-465991356-project Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 5bff70c8-a206-4b32-8db9-aba1975bf1db could not be found. Oct 01 20:50:13.894762 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '5bff70c8-a206-4b32-8db9-aba1975bf1db'} Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bff70c8-a206-4b32-8db9-aba1975bf1db could not be found. Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:13.895541 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bff70c8-a206-4b32-8db9-aba1975bf1db could not be found. Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bff70c8-a206-4b32-8db9-aba1975bf1db could not be found. Oct 01 20:50:13.897493 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:13.899373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] Returning 404 to user: Instance 5bff70c8-a206-4b32-8db9-aba1975bf1db could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:13.899573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:13.904204 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6cbd7c9c-a5ed-4282-8a6d-4e2fce23b14c tempest-ServersAdminNegativeTestJSON-465991356 tempest-ServersAdminNegativeTestJSON-465991356-project] 10.222.0.17 "GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db" status: 404 len: 111 microversion: 2.1 time: 0.105923 Oct 01 20:50:13.905371 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 211/431] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:13 2022] GET /compute/v2.1/servers/5bff70c8-a206-4b32-8db9-aba1975bf1db => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:50:13.917252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:13.918140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:13.927446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:13.928613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:13.929262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:13.931941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:13.932866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:13.934119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:13.953111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:13.957780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:13.958084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:14.018293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.compute.aggregates [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 01 20:50:14.022742 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Request method failure captured: Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 42 Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfoMZ8ynv03TX59fS1O2vyF9JkrM8YzUo-CEdhiCg84P-EqhCvCV1htmdhl3bZ71Fi3Pjr2urdd9sLdcy0hhixxiLyNBpELhnSQpS8Ds1BfA0TErCrWEyfl8npoM8qGxq7srgCnLrl_P15rc9RDT86pJ3CdRVzHCg7jTetwl0gnn1U Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:50:14.036574 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4803d0561d104d7c8298e6782b8cb18d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4803d0561d104d7c8298e6782b8cb18d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4803d0561d104d7c8298e6782b8cb18d"}]}] Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 4803d0561d104d7c8298e6782b8cb18d Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851 Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 35503a37685d4e11a514195dfaf29f38 Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: {"remove_host": {"host": "nonexist_host"}} Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:50:14.038106 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 01 20:50:14.039867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 01 20:50:14.041782 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:14.043455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:14.044904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:14.044904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:14.044904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:50:14.044904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:50:14.044904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 01 20:50:14.044904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:14.049756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:14.057618 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ccdfcc5b-3974-4cc3-a13a-853cb1318da6 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.230648 Oct 01 20:50:14.059940 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 221/432] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 20:50:13 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:50:14.076144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:14.078307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:14.095037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:14.099147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:14.099628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:14.100405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:14.102643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:14.106211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:14.469274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:14.485097 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-79cda826-258e-4701-acc8-20e4e6f37360 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1472 microversion: 2.1 time: 0.577975 Oct 01 20:50:14.502528 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 212/433] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:13 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1472 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:14.502528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-73619121-2222-44d2-bd36-0ca853746e72 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:14.554426 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-73619121-2222-44d2-bd36-0ca853746e72 tempest-AggregatesAdminNegativeTestJSON-2083667851 tempest-AggregatesAdminNegativeTestJSON-2083667851-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.061666 Oct 01 20:50:14.558715 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 213/434] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:50:14 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:50:14.774261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:14.783856 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-22474cdf-1af8-468a-a80c-e7b3498eb954 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1387 microversion: 2.1 time: 0.722080 Oct 01 20:50:14.804335 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 222/435] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:14 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1387 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:14.830171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:14.830849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:14.854444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:14.861702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-da02f72f-53b4-4799-be76-d1185136fc00 req-85019d57-6bbb-40f4-b48d-5e90465ae53f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a6997f-d4d8-405f-9d73-c2ff5d089bde", "tag": "c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:14.863798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:14.863798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:14.864438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:14.864864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:14.865305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:15.137391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:15.166694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-da02f72f-53b4-4799-be76-d1185136fc00 req-85019d57-6bbb-40f4-b48d-5e90465ae53f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:15.171938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-da02f72f-53b4-4799-be76-d1185136fc00 req-85019d57-6bbb-40f4-b48d-5e90465ae53f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:15.172680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-da02f72f-53b4-4799-be76-d1185136fc00 req-85019d57-6bbb-40f4-b48d-5e90465ae53f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:15.205634 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-da02f72f-53b4-4799-be76-d1185136fc00 req-85019d57-6bbb-40f4-b48d-5e90465ae53f service nova] Creating event network-changed:c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba for instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde on nch1-master-1 Oct 01 20:50:15.221384 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-da02f72f-53b4-4799-be76-d1185136fc00 req-85019d57-6bbb-40f4-b48d-5e90465ae53f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389869 Oct 01 20:50:15.222904 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 223/436] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:15.230076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:15.231307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:15.242163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:15.245226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:15.246106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:15.248117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:15.251380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:15.253880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:15.504593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:15.519894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:15.525634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:15.533493 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d6a0436e-b161-4845-be7b-52a8305a3dc2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.309037 Oct 01 20:50:15.539734 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 224/437] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:15 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:15.551863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:15.552766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:15.571419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:15.572364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:15.573643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:15.575390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:15.580622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:15.581448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:16.125462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:16.136908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:16.139077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:16.141886 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8a023ad0-c7e8-400c-8635-625a882fc0fc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1362 microversion: 2.25 time: 1.329705 Oct 01 20:50:16.161119 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 214/438] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:14 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1362 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:16.168609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:16.169974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:16.181131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:16.181948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:16.182652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:16.183638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:16.184265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:16.184983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:17.015453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:17.030044 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a5a48892-b14a-4655-a366-c1f35fb53ce8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1472 microversion: 2.1 time: 1.483959 Oct 01 20:50:17.042571 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 225/439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:15 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1472 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:17.042571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:17.043025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:17.057794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:17.058661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:17.061304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:17.062314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:17.064729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:17.065393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:17.285981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:17.303721 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7fce607b-d3f0-494a-bd8b-0ef3da6f14d7 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1387 microversion: 2.1 time: 1.138840 Oct 01 20:50:17.327691 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 215/440] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:16 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1387 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:17.342463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:17.352542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:17.363711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:17.367348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:17.368924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:17.371047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:17.371916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:17.374834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:17.523067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:17.537526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:17.548961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:17.557612 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1410ebe1-5ca7-45b9-a58f-ffca6e1372d6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.525028 Oct 01 20:50:17.558852 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 226/441] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:17 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:17.578793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2637d670-4bf7-41ef-ac03-8a8db6504769 req-8ffbda2b-d091-4c4b-b5c6-893f46cb4a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee", "tag": "b4dbc00f-0984-4ed5-8983-d9db1f2ce13d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:17.598548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2637d670-4bf7-41ef-ac03-8a8db6504769 req-8ffbda2b-d091-4c4b-b5c6-893f46cb4a38 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:17.599801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2637d670-4bf7-41ef-ac03-8a8db6504769 req-8ffbda2b-d091-4c4b-b5c6-893f46cb4a38 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:17.600405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2637d670-4bf7-41ef-ac03-8a8db6504769 req-8ffbda2b-d091-4c4b-b5c6-893f46cb4a38 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:17.637868 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2637d670-4bf7-41ef-ac03-8a8db6504769 req-8ffbda2b-d091-4c4b-b5c6-893f46cb4a38 service nova] Creating event network-changed:b4dbc00f-0984-4ed5-8983-d9db1f2ce13d for instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee on nch1-master-1 Oct 01 20:50:17.669441 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2637d670-4bf7-41ef-ac03-8a8db6504769 req-8ffbda2b-d091-4c4b-b5c6-893f46cb4a38 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107841 Oct 01 20:50:17.703053 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 227/442] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:18.026842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:18.040330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:18.049454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:18.051360 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-27871484-65ba-4f6c-b56e-78390e543872 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1362 microversion: 2.25 time: 0.718619 Oct 01 20:50:18.059229 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 216/443] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:17 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1362 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:18.061876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:18.063554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:18.072796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:18.076766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:18.077605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:18.079489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:18.085582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:18.086856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:18.339266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:18.340616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:18.356238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:18.356738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:18.357175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:18.357885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:18.358350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:18.358811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:18.736154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:18.745256 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0032d220-35b6-4559-a9f4-b771fb220483 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1472 microversion: 2.1 time: 0.692234 Oct 01 20:50:18.756057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 228/444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:18 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1472 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:18.762165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:18.763680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:18.780345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:18.781194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:18.781850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:18.783092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:18.783757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:18.784507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:18.998632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:19.014511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:19.017802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:19.040978 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88b8457a-114b-49c2-9c76-2499b7f4899e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1535 microversion: 2.91 time: 0.279925 Oct 01 20:50:19.043115 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 229/445] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:18 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1535 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:19.093255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:19.096289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:19.128747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:19.129356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:19.129897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:19.131843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:19.132475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:19.133159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:19.585736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:19.614236 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d4e8c1b9-9dde-430d-88bb-f35eec203df1 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1387 microversion: 2.1 time: 1.277563 Oct 01 20:50:19.615722 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 217/446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:18 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1387 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:19.757117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:19.768773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:19.780006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:19.781369 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3dfb6ccb-be92-4ae9-9e1d-7ebdb78853a4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1362 microversion: 2.25 time: 0.697002 Oct 01 20:50:19.794516 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 230/447] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:19 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1362 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:19.798912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:19.800124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:19.810247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:19.811092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:19.812506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:19.814809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:19.816302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:19.819042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:19.922375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-48e6f900-f625-43d6-a336-75d3486a21cf tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:19.940658 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-48e6f900-f625-43d6-a336-75d3486a21cf tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.268957 Oct 01 20:50:19.944059 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 218/448] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:19.957810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-57259cc0-6be6-44b2-a34b-9e5217f9b9df tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.004509 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-57259cc0-6be6-44b2-a34b-9e5217f9b9df tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 3079 microversion: 2.1 time: 0.049097 Oct 01 20:50:20.005048 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 219/449] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 20:50:19 2022] GET /compute/v2.1/flavors => generated 3079 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:20.020769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ee42d5a4-18ef-4e7a-9256-574b86cdba68 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.031566 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ee42d5a4-18ef-4e7a-9256-574b86cdba68 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013284 Oct 01 20:50:20.040175 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 220/450] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:50:20.056617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5ed256e1-cffd-47c2-9ddd-5fc4289c01ae tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.076695 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5ed256e1-cffd-47c2-9ddd-5fc4289c01ae tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026022 Oct 01 20:50:20.084780 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 221/451] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:20.090859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.091726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:20.097648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90,nova_api:DELETE=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:20.100301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:20.101274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:20.102132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:20.104611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:20.105521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:20.106182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:20.222191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:20.232006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:20.240548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:20.258825 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cd14ea94-e94b-42ba-82db-3710b45efea0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1535 microversion: 2.91 time: 0.172674 Oct 01 20:50:20.260380 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 222/452] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1535 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:20.270322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-254c815a-fbad-4195-94c3-b0b23826630c tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.344656 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-254c815a-fbad-4195-94c3-b0b23826630c tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.082564 Oct 01 20:50:20.346177 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 223/453] 10.222.0.17 () {58 vars in 1165 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:20.364798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5145f75f-7aa5-40a0-aa77-8e571e3d4709 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.374037 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5145f75f-7aa5-40a0-aa77-8e571e3d4709 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013298 Oct 01 20:50:20.382637 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 224/454] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:50:20.388284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8a9606c9-7330-4902-9b00-c5912bfbe816 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.424406 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8a9606c9-7330-4902-9b00-c5912bfbe816 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.040176 Oct 01 20:50:20.448620 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 225/455] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:20.454526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0992f3b2-e574-41d0-8f2e-f701dc0de117 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.478909 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0992f3b2-e574-41d0-8f2e-f701dc0de117 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.028097 Oct 01 20:50:20.479772 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 226/456] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:20.507279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-56938587-f838-43d9-9833-075b591f9ae4 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.520783 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-56938587-f838-43d9-9833-075b591f9ae4 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025062 Oct 01 20:50:20.523709 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 227/457] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:20.542403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d34cc431-fcfe-4629-99c5-cb0487ea4fc1 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.598034 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d34cc431-fcfe-4629-99c5-cb0487ea4fc1 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2912 microversion: 2.1 time: 0.063688 Oct 01 20:50:20.599480 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 228/458] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2912 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:20.602778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:20.617390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-85b1858c-39ca-43e6-a743-50768d7ae44a tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.618450 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07785004-3475-42f6-ae47-5202c5720769 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 0.834340 Oct 01 20:50:20.632323 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 231/459] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:19 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:20.637363 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-85b1858c-39ca-43e6-a743-50768d7ae44a tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024439 Oct 01 20:50:20.638527 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 229/460] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:50:20.652007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-040437a8-e400-4ed9-b658-acff640f8833 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.656093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.658889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:20.674791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:20.678897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:20.679741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:20.680747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:20.681923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:20.683714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:20.692004 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-040437a8-e400-4ed9-b658-acff640f8833 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.044749 Oct 01 20:50:20.692875 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 230/461] 10.222.0.17 () {58 vars in 1144 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:20.707512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-66a95688-b226-413b-91c6-e87e53f1ba68 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.716424 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-66a95688-b226-413b-91c6-e87e53f1ba68 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012948 Oct 01 20:50:20.717615 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 231/462] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:20.732143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-14d66514-28a8-4192-9e90-1c62d1964aa0 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.755895 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-14d66514-28a8-4192-9e90-1c62d1964aa0 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.026560 Oct 01 20:50:20.758032 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 232/463] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:20.771761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3296b874-9c15-43b7-8a85-57769c2e493b tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.793298 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3296b874-9c15-43b7-8a85-57769c2e493b tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.025835 Oct 01 20:50:20.805528 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 233/464] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:50:20.823065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:20.823690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:20.832886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:20.833387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:20.841823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:20.842623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:20.843267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:20.843862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:21.914502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:21.923890 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e83bfaa-424f-40ac-a599-89da5c142df2 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1387 microversion: 2.1 time: 1.281809 Oct 01 20:50:21.948432 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 232/465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1387 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:21.955804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c239998-2ac1-4cb2-b225-d1de6d96f110 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:21.957962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:21.967060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:21.967947 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3c239998-2ac1-4cb2-b225-d1de6d96f110 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017126 Oct 01 20:50:21.968519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:21.969576 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 233/466] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:21.974646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:21.975504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:21.983013 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8ce2a127-85e8-4aef-b5af-7dff1d9e1148 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1362 microversion: 2.25 time: 1.175090 Oct 01 20:50:21.983254 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 234/467] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:20 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1362 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:21.996536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:21.997146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:21.997603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:21.998405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:21.998896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:21.999405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.004956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:22.005590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:22.012451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.013055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.013490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.014211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.014716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.015335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.195380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:22.213426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:22.216992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:22.228763 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b297953-dbe0-4db8-a2cb-5ebb477f3df9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1478 microversion: 2.91 time: 0.257880 Oct 01 20:50:22.230167 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 234/468] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:21 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1478 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:22.426568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bc903b7-e968-457f-9d8d-fd61bc769263 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:22.428414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bc903b7-e968-457f-9d8d-fd61bc769263 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.429246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bc903b7-e968-457f-9d8d-fd61bc769263 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.429984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bc903b7-e968-457f-9d8d-fd61bc769263 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.430793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bc903b7-e968-457f-9d8d-fd61bc769263 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.431326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bc903b7-e968-457f-9d8d-fd61bc769263 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.431971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bc903b7-e968-457f-9d8d-fd61bc769263 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.442853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:22.463611 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6bc903b7-e968-457f-9d8d-fd61bc769263 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.230521 Oct 01 20:50:22.464438 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 235/469] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Oct 1 20:50:22 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:50:22.477415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e5e7ea65-2219-4873-a8d3-51ae50dad0c7 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:22.481071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:22.494957 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a4b35069-e03f-42b4-a2d6-dc771f70cba7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 0.503553 Oct 01 20:50:22.496051 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 235/470] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:21 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:22.511422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch2-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:22.520194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:22.532599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e5e7ea65-2219-4873-a8d3-51ae50dad0c7 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1541 microversion: 2.1 time: 0.066740 Oct 01 20:50:22.533980 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 236/471] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:22 2022] GET /compute/v2.1/flavors?marker=452 => generated 1541 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:22.540248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a92f95ed-08a5-4355-8694-0644e24c0811 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:22.540501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.542590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.542889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.544727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a92f95ed-08a5-4355-8694-0644e24c0811 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.545377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.545817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a92f95ed-08a5-4355-8694-0644e24c0811 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.546390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.546698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a92f95ed-08a5-4355-8694-0644e24c0811 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.547521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.548010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a92f95ed-08a5-4355-8694-0644e24c0811 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.548668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a92f95ed-08a5-4355-8694-0644e24c0811 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.549356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a92f95ed-08a5-4355-8694-0644e24c0811 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.588709 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a92f95ed-08a5-4355-8694-0644e24c0811 tempest-AZAdminV2TestJSON-304998379 tempest-AZAdminV2TestJSON-304998379-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.053172 Oct 01 20:50:22.590357 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 237/472] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Oct 1 20:50:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:22.603640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23b6826d-2a7b-4ea7-938e-f59aefb9aa60 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:22.634776 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23b6826d-2a7b-4ea7-938e-f59aefb9aa60 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.042667 Oct 01 20:50:22.636203 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 238/473] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:22 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:22.655084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba6a3276-8604-43e0-b09c-de403bed3087 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:22.669044 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba6a3276-8604-43e0-b09c-de403bed3087 tempest-FlavorsV2TestJSON-1236910398 tempest-FlavorsV2TestJSON-1236910398-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017165 Oct 01 20:50:22.670674 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 239/474] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:22.712585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch2-master-1". {{(pid=140437) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 20:50:22.876540 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-560e6a5e-08ed-4b97-9d54-0200a25ff4d8 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21/action" status: 202 len: 0 microversion: 2.91 time: 0.378754 Oct 01 20:50:22.877472 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 236/475] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:50:22 2022] POST /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:50:22.887067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:22.887818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:22.906217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.910157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.910813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.919845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.924779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.926122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.954789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:22.955411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:22.963616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.967346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.968934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:22.970468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:22.972203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:22.973881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:23.140997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:23.156313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:23.157778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:23.172062 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9facfc1-c291-477e-926b-27ed0dd70e44 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1486 microversion: 2.91 time: 0.290431 Oct 01 20:50:23.177210 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 240/476] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:22 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1486 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:23.191619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:23.192652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:23.204696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:23.205432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:23.206145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:23.207215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:23.208129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:23.209067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:23.541624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:23.555905 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2a39dc10-cead-4ab7-bde2-c38be03f9f2d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1387 microversion: 2.1 time: 0.606309 Oct 01 20:50:23.567152 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 237/477] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:22 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1387 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:23.573672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:23.573672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:23.580351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:23.587430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:23.588249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:23.588948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:23.589955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:23.590907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:23.591561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:23.595348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:23.599089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:23.603781 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9f1ae0c5-ca8c-4564-b304-231e92846731 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1362 microversion: 2.25 time: 0.424625 Oct 01 20:50:23.605730 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 241/478] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:23 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:23.824080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc2ca29e-3a67-4218-b82d-0326ac43fb63 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] Calling method '.version_select at 0x7f4173c74790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:23.949156 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc2ca29e-3a67-4218-b82d-0326ac43fb63 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.342257 Oct 01 20:50:23.950885 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 242/479] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 20:50:23 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:50:23.956133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a557c16f-77fa-4967-a085-a326ca12645a req-ad2e543a-14fe-4155-a7cd-c3c7ddd51c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a6997f-d4d8-405f-9d73-c2ff5d089bde", "name": "network-vif-plugged", "status": "completed", "tag": "c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:23.979412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a557c16f-77fa-4967-a085-a326ca12645a req-ad2e543a-14fe-4155-a7cd-c3c7ddd51c0e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:23.981053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a557c16f-77fa-4967-a085-a326ca12645a req-ad2e543a-14fe-4155-a7cd-c3c7ddd51c0e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:23.984081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a557c16f-77fa-4967-a085-a326ca12645a req-ad2e543a-14fe-4155-a7cd-c3c7ddd51c0e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:24.221105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:24.232615 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-29a2a169-6d3b-42f5-a37c-80ab293647f2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 0.667372 Oct 01 20:50:24.233226 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 238/480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:23 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:24.245905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3836b2f1-ec53-4ec2-8089-3f919682e3a3 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] Action: 'create', calling method: .version_select at 0x7f4173bf0f70>, body: {"pool": "non_exist_pool"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:24.298389 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a557c16f-77fa-4967-a085-a326ca12645a req-ad2e543a-14fe-4155-a7cd-c3c7ddd51c0e service nova] Creating event network-vif-plugged:c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba for instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde on nch1-master-1 Oct 01 20:50:24.306206 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a557c16f-77fa-4967-a085-a326ca12645a req-ad2e543a-14fe-4155-a7cd-c3c7ddd51c0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.353608 Oct 01 20:50:24.308366 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 243/481] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:24.317185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:24.318751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:24.332556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:24.333516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:24.334203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:24.336556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:24.337395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:24.338031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:24.350827 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-3836b2f1-ec53-4ec2-8089-3f919682e3a3 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] HTTP exception thrown: Floating IP pool not found. Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3836b2f1-ec53-4ec2-8089-3f919682e3a3 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] Request method failure captured: Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 26 Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKgPegvcJ9BgAR9NXpG6210VPmk-G_n3hd5LHqtAwYFVTvKkkw6c9V6B9bLGsIsua4l4Or64ie-FvwrXOOgjX1CSGvUqZ4RKMJUw6xTwliGuQI67BzM4vR0Vaw_PEvtyj-VpH8WQcMxnEA7Dqu6iBoWK74YtBNVgk9CKZhABPuEUUYc Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 3b1e74abd17d4102b622bf3ec2d4f715 Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1329902408 Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:50:24.352422 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3b1e74abd17d4102b622bf3ec2d4f715", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3b1e74abd17d4102b622bf3ec2d4f715"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3b1e74abd17d4102b622bf3ec2d4f715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3b1e74abd17d4102b622bf3ec2d4f715"}]}] Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1329902408 Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 3b1e74abd17d4102b622bf3ec2d4f715 Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1329902408 Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FloatingIPsNegativeTestJSON-1329902408-project Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 0e76f88bb60c4f4eb2657a929098f991 Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1329902408-project Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: {"pool": "non_exist_pool"} Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: exception: Floating IP pool not found. Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 01 20:50:24.353784 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:24.354740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.356494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3836b2f1-ec53-4ec2-8089-3f919682e3a3 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] Returning 404 to user: Floating IP pool not found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:24.364683 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3836b2f1-ec53-4ec2-8089-3f919682e3a3 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.125221 Oct 01 20:50:24.370654 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 239/482] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:50:24 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:50:24.388090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3b6edc0d-dbba-4b23-87a7-eb2e84fed3f8 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] Calling method '.version_select at 0x7f4173cd8b80>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:24.707578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:24.708562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG neutronclient.v2_0.client [None req-3b6edc0d-dbba-4b23-87a7-eb2e84fed3f8 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 37dde079-3806-4035-8d4e-a17e9cbfdbf3 could not be found", "detail": ""}} {{(pid=140437) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 20:50:24.709254 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-3b6edc0d-dbba-4b23-87a7-eb2e84fed3f8 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] HTTP exception thrown: Floating IP not found for ID 37dde079-3806-4035-8d4e-a17e9cbfdbf3 Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3b6edc0d-dbba-4b23-87a7-eb2e84fed3f8 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] Request method failure captured: Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/os-floating-ips/37dde079-3806-4035-8d4e-a17e9cbfdbf3 HTTP/1.1 Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKgPegvcJ9BgAR9NXpG6210VPmk-G_n3hd5LHqtAwYFVTvKkkw6c9V6B9bLGsIsua4l4Or64ie-FvwrXOOgjX1CSGvUqZ4RKMJUw6xTwliGuQI67BzM4vR0Vaw_PEvtyj-VpH8WQcMxnEA7Dqu6iBoWK74YtBNVgk9CKZhABPuEUUYc Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 3b1e74abd17d4102b622bf3ec2d4f715 Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1329902408 Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:50:24.715008 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3b1e74abd17d4102b622bf3ec2d4f715", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3b1e74abd17d4102b622bf3ec2d4f715"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3b1e74abd17d4102b622bf3ec2d4f715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3b1e74abd17d4102b622bf3ec2d4f715"}]}] Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1329902408 Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 3b1e74abd17d4102b622bf3ec2d4f715 Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1329902408 Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FloatingIPsNegativeTestJSON-1329902408-project Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 0e76f88bb60c4f4eb2657a929098f991 Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1329902408-project Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: exception: Floating IP not found for ID 37dde079-3806-4035-8d4e-a17e9cbfdbf3 Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '37dde079-3806-4035-8d4e-a17e9cbfdbf3'} Oct 01 20:50:24.716325 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 20:50:24.717164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 37dde079-3806-4035-8d4e-a17e9cbfdbf3 could not be found Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98203aeb-e9bc-4820-a3de-671b11634995'] Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 37dde079-3806-4035-8d4e-a17e9cbfdbf3. Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:24.718297 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 37dde079-3806-4035-8d4e-a17e9cbfdbf3 Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:50:24.719461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:50:24.723280 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 37dde079-3806-4035-8d4e-a17e9cbfdbf3 Oct 01 20:50:24.723280 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:24.723708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:24.724874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3b6edc0d-dbba-4b23-87a7-eb2e84fed3f8 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] Returning 404 to user: Floating IP not found for ID 37dde079-3806-4035-8d4e-a17e9cbfdbf3 {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:24.725941 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3b6edc0d-dbba-4b23-87a7-eb2e84fed3f8 tempest-FloatingIPsNegativeTestJSON-1329902408 tempest-FloatingIPsNegativeTestJSON-1329902408-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/37dde079-3806-4035-8d4e-a17e9cbfdbf3" status: 404 len: 111 microversion: 2.1 time: 0.354055 Oct 01 20:50:24.728366 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 240/483] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:50:24 2022] DELETE /compute/v2.1/os-floating-ips/37dde079-3806-4035-8d4e-a17e9cbfdbf3 => generated 111 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:50:24.737892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:24.738235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:24.743018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:24.745683 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-78d6b411-01aa-40a5-8469-143f6ae9dd1c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1486 microversion: 2.91 time: 0.435628 Oct 01 20:50:24.760669 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 244/484] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:24 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1486 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:24.774980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:24.775647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:24.781014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:24.781967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:24.784910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:24.787390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:24.788149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:24.789355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:24.791959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:24.794817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:24.795399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:24.795787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:24.796280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:24.796756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:25.653074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:25.683309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:25.692780 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6faa6997-fa97-46c5-934e-3610e392390d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1387 microversion: 2.1 time: 0.958478 Oct 01 20:50:25.698741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:25.706756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:25.707561 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 241/485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:24 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1387 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:25.713186 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3c907fbb-c834-494c-97a5-6af529459900 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1362 microversion: 2.25 time: 0.951097 Oct 01 20:50:25.718432 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 245/486] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:24 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1362 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:25.719124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:25.730681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:25.745875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:25.746528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:25.747538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:25.748272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:25.748737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:25.749160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:25.777818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:25.778438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:25.787220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:25.789279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:25.790475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:25.791688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:25.792566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:25.794595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:25.899484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:25.923782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:25.938198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:25.951051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85c8e93e-e8e7-4c06-a484-9257e3a6af84 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.177933 Oct 01 20:50:25.954467 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 246/487] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:25 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:50:25.987842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:26.002094 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-97a69ef2-af62-4ea7-b0f5-0f741083d609 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 0.293429 Oct 01 20:50:26.006026 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 242/488] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:25 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:26.280631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5cf30317-e4c6-4dc0-a96f-d5cac07f4efc tempest-FlavorsV2NegativeTest-1715970218 tempest-FlavorsV2NegativeTest-1715970218-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:26.289414 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5cf30317-e4c6-4dc0-a96f-d5cac07f4efc tempest-FlavorsV2NegativeTest-1715970218 tempest-FlavorsV2NegativeTest-1715970218-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.244719 Oct 01 20:50:26.290534 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 247/489] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:50:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:50:26.737303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:26.738804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:26.746937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:26.748184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:26.753247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:26.764567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:26.767967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:26.768514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:26.771408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:26.774617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:26.775077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:26.781437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:26.782241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:26.784691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:26.787358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:26.789095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:26.795075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:27.882909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:27.900992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:27.902471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:27.923572 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-240aea01-b4ab-4210-826e-460116ae0442 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1559 microversion: 2.25 time: 1.180717 Oct 01 20:50:27.925014 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 248/490] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:26 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1559 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:50:27.937088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:27.938162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:27.956789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:27.965585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:27.970446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:27.971294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:27.972379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:27.973306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:27.973986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:27.981214 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8308eaca-44ec-4393-bf51-f00c70773f5e tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1387 microversion: 2.1 time: 1.243011 Oct 01 20:50:27.982966 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 243/491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:26 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1387 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:28.020113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:28.020740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:28.066907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:28.067416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:28.067864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:28.068584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:28.073260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:28.075545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:28.158917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:28.250718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:28.272260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:28.279970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:28.312043 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4eed7e5c-66af-4474-9fa9-ed720b3c36cc tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.384573 Oct 01 20:50:28.313413 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 249/492] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:27 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:28.327968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e74ac23b-9cb6-41d1-adfc-aea7cf3dd7cb req-b6bbd4d0-b69d-442d-922d-3c3c489f49af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee", "name": "network-vif-plugged", "status": "completed", "tag": "b4dbc00f-0984-4ed5-8983-d9db1f2ce13d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:28.356410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e74ac23b-9cb6-41d1-adfc-aea7cf3dd7cb req-b6bbd4d0-b69d-442d-922d-3c3c489f49af service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:28.356958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e74ac23b-9cb6-41d1-adfc-aea7cf3dd7cb req-b6bbd4d0-b69d-442d-922d-3c3c489f49af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:28.361714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e74ac23b-9cb6-41d1-adfc-aea7cf3dd7cb req-b6bbd4d0-b69d-442d-922d-3c3c489f49af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:28.406254 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e74ac23b-9cb6-41d1-adfc-aea7cf3dd7cb req-b6bbd4d0-b69d-442d-922d-3c3c489f49af service nova] Creating event network-vif-plugged:b4dbc00f-0984-4ed5-8983-d9db1f2ce13d for instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee on nch1-master-1 Oct 01 20:50:28.418283 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e74ac23b-9cb6-41d1-adfc-aea7cf3dd7cb req-b6bbd4d0-b69d-442d-922d-3c3c489f49af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100929 Oct 01 20:50:28.418987 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 250/493] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:28.437375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83fb8d6b-a537-4f66-aa92-0cd5c878de0a tempest-FlavorsV2NegativeTest-1715970218 tempest-FlavorsV2NegativeTest-1715970218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-149363368", "imageRef": "be7e312c-231e-40a1-9834-87d3bf4f6fc9", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:28.550099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-83fb8d6b-a537-4f66-aa92-0cd5c878de0a tempest-FlavorsV2NegativeTest-1715970218 tempest-FlavorsV2NegativeTest-1715970218-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:50:29.329936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:29.345447 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d5f9303b-303e-4b94-8af9-c85700100b3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 1.344908 Oct 01 20:50:29.351937 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 244/494] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:27 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:29.649240 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-83fb8d6b-a537-4f66-aa92-0cd5c878de0a tempest-FlavorsV2NegativeTest-1715970218 tempest-FlavorsV2NegativeTest-1715970218-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83fb8d6b-a537-4f66-aa92-0cd5c878de0a tempest-FlavorsV2NegativeTest-1715970218 tempest-FlavorsV2NegativeTest-1715970218-project] Request method failure captured: Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 142 Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKgR9LLQDdwvpHwY-IMds27zknbsEeCaoPP6_FIrWtkVqhzhhJPC3Xf4e5atmc1jzG9WjzNXmccNEvMx92C3NnfdoKNOBlg1nfY39VPvSuCyqygOtehFt_UEFPbxIQRScsf4pXGf81zclN4WcJPGd7EgrdynSfIY0nRGQ4KG0fmtxAg Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b775e6b549b54415b76066373ff165b4 Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FlavorsV2NegativeTest-1715970218 Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:50:29.651773 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b775e6b549b54415b76066373ff165b4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b775e6b549b54415b76066373ff165b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b775e6b549b54415b76066373ff165b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b775e6b549b54415b76066373ff165b4"}]}] Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FlavorsV2NegativeTest-1715970218 Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b775e6b549b54415b76066373ff165b4 Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1715970218 Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FlavorsV2NegativeTest-1715970218-project Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 485f457f31154f9aad86634ae69d14bb Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FlavorsV2NegativeTest-1715970218-project Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-149363368", "imageRef": "be7e312c-231e-40a1-9834-87d3bf4f6fc9", "flavorRef": "452"}} Oct 01 20:50:29.653252 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: exception: Flavor's memory is too small for requested image. Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-149363368', 'imageRef': 'be7e312c-231e-40a1-9834-87d3bf4f6fc9', 'flavorRef': '452'}}} Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:29.654120 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:29.655660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:29.657134 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:29.657134 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:29.657134 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:50:29.657134 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:50:29.657134 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 01 20:50:29.657134 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:50:29.657134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83fb8d6b-a537-4f66-aa92-0cd5c878de0a tempest-FlavorsV2NegativeTest-1715970218 tempest-FlavorsV2NegativeTest-1715970218-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:29.657659 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-83fb8d6b-a537-4f66-aa92-0cd5c878de0a tempest-FlavorsV2NegativeTest-1715970218 tempest-FlavorsV2NegativeTest-1715970218-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.232583 Oct 01 20:50:29.658276 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 251/495] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:28 2022] POST /compute/v2.1/servers => generated 93 bytes in 1239 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:29.670819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:29.671854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:29.716215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:29.721444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:29.722052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:29.723006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:29.724195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:29.724756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:30.105221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:30.115774 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c0ce32b-0a61-4f90-93d1-be66cea7afb6 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1387 microversion: 2.1 time: 0.450083 Oct 01 20:50:30.117176 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 252/496] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:29 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1387 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:30.122701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:30.123633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:30.138375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:30.139921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:30.140638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:30.141783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:30.143068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:30.144321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:30.270527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:30.272293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:30.275959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:30.284527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:30.285024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:30.286372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:30.289420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:30.290901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:30.292704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:30.299824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:30.300836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:30.309361 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-67fbb577-3902-4a4f-893e-a03b2c95558b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.190687 Oct 01 20:50:30.330864 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 253/497] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:30 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:30.381780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:30.382956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:30.401447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:30.405707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:30.408546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:30.409999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:30.416245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:30.417181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:30.741800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid 57a6997f-d4d8-405f-9d73-c2ff5d089bde {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:50:30.818768 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-50850356-847f-4214-932b-584a8fb0f275 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 2052 microversion: 2.25 time: 1.460620 Oct 01 20:50:30.821880 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 245/498] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:29 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 2052 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:30.846092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:30.859417 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fee5ad5-fe36-4a84-8ece-aa2e8fb9a464 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 0.481925 Oct 01 20:50:30.860020 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 254/499] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:30 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:30.879479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:30.880893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:30.900763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:30.901551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:30.902217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:30.903263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:30.903958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:30.904587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.218481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6abb42bf-c04a-4b11-b421-5848794a7e31 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-398526937", "id": 1153122840, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:31.243101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid 57a6997f-d4d8-405f-9d73-c2ff5d089bde {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:50:31.267773 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6abb42bf-c04a-4b11-b421-5848794a7e31 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.440266 Oct 01 20:50:31.268980 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 246/500] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:30 2022] POST /compute/v2.1/flavors => generated 429 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:31.275035 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b04b14ca-78db-48be-a9a1-f9a28a6160fe tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 2052 microversion: 2.25 time: 0.406298 Oct 01 20:50:31.283423 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 255/501] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:30 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 2052 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:31.285584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:31.286380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:31.289118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-053ebc62-856b-4a29-b89d-f7194ba3d190 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:31.295290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.296970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.298636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.302324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.304364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.304969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.361599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-053ebc62-856b-4a29-b89d-f7194ba3d190 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1153122840" status: 202 len: 0 microversion: 2.1 time: 0.076118 Oct 01 20:50:31.362465 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 256/502] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:50:31 2022] DELETE /compute/v2.1/flavors/1153122840 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:31.377352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c68b4c2-5f01-43c5-8ffa-0d5e6b497014 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:31.388340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c68b4c2-5f01-43c5-8ffa-0d5e6b497014 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.395100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c68b4c2-5f01-43c5-8ffa-0d5e6b497014 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.395725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c68b4c2-5f01-43c5-8ffa-0d5e6b497014 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.396672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c68b4c2-5f01-43c5-8ffa-0d5e6b497014 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.397306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c68b4c2-5f01-43c5-8ffa-0d5e6b497014 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.398481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c68b4c2-5f01-43c5-8ffa-0d5e6b497014 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.437883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=9 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:31.516545 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4c68b4c2-5f01-43c5-8ffa-0d5e6b497014 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.149669 Oct 01 20:50:31.517908 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 257/503] 10.222.0.17 () {60 vars in 1217 bytes} [Sat Oct 1 20:50:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:50:31.525196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:31.526169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:31.535720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.536558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.537260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.538346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.539133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.540078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.687127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:31.700996 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6b5486a2-5837-411d-9ab7-5732c80bdce5 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1587 microversion: 2.1 time: 0.430703 Oct 01 20:50:31.704777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:31.714055 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 247/504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:31 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1587 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:31.724193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:31.728234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:31.729247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fd09993b-cb7a-4ff1-a23c-86c09c04dda7 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:31.743936 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-83baf2e1-3560-4d14-a31b-980129d4de6a tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.224036 Oct 01 20:50:31.745936 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 258/505] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:31 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:31.758855 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fd09993b-cb7a-4ff1-a23c-86c09c04dda7 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.041095 Oct 01 20:50:31.759529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:31.761270 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 248/506] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:31 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:31.767262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-701be83d-845f-4663-9a2d-cc0870ebe7b8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:31.768109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-701be83d-845f-4663-9a2d-cc0870ebe7b8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:31.777428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-701be83d-845f-4663-9a2d-cc0870ebe7b8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.778305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-701be83d-845f-4663-9a2d-cc0870ebe7b8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.781473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-701be83d-845f-4663-9a2d-cc0870ebe7b8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.782904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-701be83d-845f-4663-9a2d-cc0870ebe7b8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.784063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-701be83d-845f-4663-9a2d-cc0870ebe7b8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.785576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-701be83d-845f-4663-9a2d-cc0870ebe7b8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.794648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:31.809606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.810480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.811218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.812747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:31.813436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:31.814224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:31.952484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'flavor' on Instance uuid 57a6997f-d4d8-405f-9d73-c2ff5d089bde {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:50:31.962856 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-701be83d-845f-4663-9a2d-cc0870ebe7b8 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198529 Oct 01 20:50:31.963988 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 249/507] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 20:50:31 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:31.969352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b669141d-91ea-4245-ab80-9776fbbc8111 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1861793901", "id": 701023426, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:31.993989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Going to try to live migrate instance to nch2-master-1 {{(pid=140438) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 20:50:32.008265 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b669141d-91ea-4245-ab80-9776fbbc8111 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.040120 Oct 01 20:50:32.020598 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 250/508] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:31 2022] POST /compute/v2.1/flavors => generated 414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:32.030421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:32.035581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:32.051295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:32.051792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:32.052235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:32.057411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:32.058393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:32.067058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:32.211464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:32.754091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:32.765669 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dbc9f11c-a2f5-48d7-ad8a-3580c503e3df tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 0.743853 Oct 01 20:50:32.766360 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 251/509] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:32 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:32.785488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fd2a8772-cc8f-409f-ac67-448cc00513c5 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:32.874196 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fd2a8772-cc8f-409f-ac67-448cc00513c5 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.106747 Oct 01 20:50:32.893887 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 252/510] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:32 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:32.909025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:32.909717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:32.926674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:32.938111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:32.938606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:32.939360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:32.939823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:32.940257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:33.504073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:33.521784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:33.528495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:33.557181 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cb3007f2-21dc-45e8-826d-4588d9f3a9a4 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.661069 Oct 01 20:50:33.559149 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 253/511] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:32 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:33.571372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bc72abf5-e228-471b-9c9e-d78e4e135af6 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:33.686234 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bc72abf5-e228-471b-9c9e-d78e4e135af6 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/701023426" status: 202 len: 0 microversion: 2.1 time: 0.123532 Oct 01 20:50:33.693886 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 254/512] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 20:50:33 2022] DELETE /compute/v2.1/flavors/701023426 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:33.719704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-39fe9a95-2f10-4a6a-9b49-431f3d600628 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:33.803256 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-39fe9a95-2f10-4a6a-9b49-431f3d600628 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.103433 Oct 01 20:50:33.822658 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 255/513] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:33 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:33.834068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:33.836125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:33.847260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:33.848350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:33.849092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:33.849981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:33.852582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:33.853458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:35.097724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:35.112121 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f014594b-1664-406b-953a-a8a6659fbcf7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 1.287488 Oct 01 20:50:35.163363 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 256/514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:33 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:35.189422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0a869077-c679-48bb-b164-bfc09a889aea tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-59543893", "id": 673513055, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:35.253674 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0a869077-c679-48bb-b164-bfc09a889aea tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.086465 Oct 01 20:50:35.266121 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 257/515] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:35 2022] POST /compute/v2.1/flavors => generated 424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:35.281790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:35.283061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:35.303078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:35.307562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:35.308230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:35.324796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:35.325316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:35.325923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:35.475692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:35.495490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:35.497487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:35.517957 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d1f5ed3b-48d0-49ff-9c96-68483aee1758 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.248143 Oct 01 20:50:35.521645 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 258/516] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:35 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:35.540990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-92de0f25-12ea-4e02-bce7-4a7faf53e705 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:35.577705 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-92de0f25-12ea-4e02-bce7-4a7faf53e705 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/673513055" status: 202 len: 0 microversion: 2.1 time: 0.052581 Oct 01 20:50:35.584290 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 259/517] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 20:50:35 2022] DELETE /compute/v2.1/flavors/673513055 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:35.609935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1591c8da-db73-4f76-92fe-1e72a9d22c7c tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:35.637620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:35.699048 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1591c8da-db73-4f76-92fe-1e72a9d22c7c tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.112689 Oct 01 20:50:35.707835 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 260/518] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:35 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:35.732596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c219817b-f7c3-4a3e-b0e7-cb7201518ef5 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-325009286", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:35.792597 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c219817b-f7c3-4a3e-b0e7-cb7201518ef5 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.072772 Oct 01 20:50:35.797418 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 261/519] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:35 2022] POST /compute/v2.1/flavors => generated 506 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:35.824702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ac0f735-2288-4d07-97a5-948953205392 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:35.873851 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3ac0f735-2288-4d07-97a5-948953205392 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/f943fef4-86e7-4177-8b97-265a454146e0" status: 202 len: 0 microversion: 2.1 time: 0.068649 Oct 01 20:50:35.879959 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 262/520] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:50:35 2022] DELETE /compute/v2.1/flavors/f943fef4-86e7-4177-8b97-265a454146e0 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:35.888234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-113ebea9-1090-4d65-a1a5-c02d6509a364 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:35.927357 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-113ebea9-1090-4d65-a1a5-c02d6509a364 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.045494 Oct 01 20:50:35.928068 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 263/521] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:35 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:35.960743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d0b9bd75-56bc-46de-9a6e-3d935f083361 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-925471706", "id": "edeccf21-8456-47b8-8a80-a9791d23c50f", "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:36.032888 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d0b9bd75-56bc-46de-9a6e-3d935f083361 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.081243 Oct 01 20:50:36.036982 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 264/522] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:35 2022] POST /compute/v2.1/flavors => generated 506 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:36.051150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-de8aeff4-123a-4fd5-baa5-694b3b1195bf tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:36.104043 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-de8aeff4-123a-4fd5-baa5-694b3b1195bf tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/edeccf21-8456-47b8-8a80-a9791d23c50f" status: 202 len: 0 microversion: 2.1 time: 0.056988 Oct 01 20:50:36.105619 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 265/523] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:50:36 2022] DELETE /compute/v2.1/flavors/edeccf21-8456-47b8-8a80-a9791d23c50f => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:36.131595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-648c135b-2482-4dbc-a53b-4f02566607f1 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:36.225545 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-648c135b-2482-4dbc-a53b-4f02566607f1 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.108016 Oct 01 20:50:36.230795 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 266/524] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:36 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:36.249800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:36.258373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:36.279084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:36.280355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:36.280962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:36.284072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:36.289235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:36.303916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:36.652739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:36.665501 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d8d6942a-e692-40fa-b2db-d35182153d90 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde/action" status: 202 len: 0 microversion: 2.25 time: 4.918153 Oct 01 20:50:36.666333 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 259/525] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:50:31 2022] POST /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde/action => generated 0 bytes in 4920 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:50:36.671878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39fed098-c8df-449a-898a-90b5b588042c tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1634317472", "id": 718405214, "os-flavor-access:is_public": "True"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:36.673119 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c5b97d74-9188-4279-ac9f-b9fa51354215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 0.439258 Oct 01 20:50:36.674587 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 267/526] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:36 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:36.683422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:36.688214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:36.706468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:36.708435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:36.709080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:36.711500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:36.712103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:36.714178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:36.765181 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-39fed098-c8df-449a-898a-90b5b588042c tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.093168 Oct 01 20:50:36.774890 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 260/527] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:36 2022] POST /compute/v2.1/flavors => generated 411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:36.780067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:36.798446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:36.846084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:36.846621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:36.847073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:36.847819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:36.848321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:36.874943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:36.904036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:36.932581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:36.934631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:36.979812 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c6241945-5465-4f40-93d9-6848577bbfa0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.302969 Oct 01 20:50:36.999925 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 268/528] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:36 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:37.034775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c8a2fdd5-65f6-4ceb-83bc-dcf2c6959169 req-8b6b101a-32f9-42ff-8035-026b5afbbd63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee", "tag": "b4dbc00f-0984-4ed5-8983-d9db1f2ce13d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:37.101723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8a2fdd5-65f6-4ceb-83bc-dcf2c6959169 req-8b6b101a-32f9-42ff-8035-026b5afbbd63 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:37.109941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8a2fdd5-65f6-4ceb-83bc-dcf2c6959169 req-8b6b101a-32f9-42ff-8035-026b5afbbd63 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:37.110658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8a2fdd5-65f6-4ceb-83bc-dcf2c6959169 req-8b6b101a-32f9-42ff-8035-026b5afbbd63 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:37.174416 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c8a2fdd5-65f6-4ceb-83bc-dcf2c6959169 req-8b6b101a-32f9-42ff-8035-026b5afbbd63 service nova] Creating event network-changed:b4dbc00f-0984-4ed5-8983-d9db1f2ce13d for instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee on nch1-master-1 Oct 01 20:50:37.186304 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c8a2fdd5-65f6-4ceb-83bc-dcf2c6959169 req-8b6b101a-32f9-42ff-8035-026b5afbbd63 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179080 Oct 01 20:50:37.187545 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 269/529] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:37.247355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:37.251433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:37.267886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:37.268450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:37.273424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:37.274582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:37.275493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:37.276554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:37.886755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:37.900881 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7db53496-6566-4ea1-801b-bce083c3bf42 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1587 microversion: 2.1 time: 1.123979 Oct 01 20:50:37.903138 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 261/530] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:36 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1587 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:37.919950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c3b89461-f620-4b01-af84-d9d0c824923a tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:37.945823 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c3b89461-f620-4b01-af84-d9d0c824923a tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/718405214" status: 200 len: 411 microversion: 2.1 time: 0.041201 Oct 01 20:50:37.965693 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 262/531] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 20:50:37 2022] GET /compute/v2.1/flavors/718405214 => generated 411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:37.994909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:37.998200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:38.024372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:38.047075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:38.047599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:38.049467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:38.050104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:38.051210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:38.759102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:38.776710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:38.781290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:38.785106 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-31745275-d927-413b-be80-99cfbc2481d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 1.583241 Oct 01 20:50:38.791499 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 270/532] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:37 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:39.245068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:39.260287 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc3f631a-9935-4329-a767-b7913cf511da tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 1.291510 Oct 01 20:50:39.280560 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 263/533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:37 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:39.301153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:39.301816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:39.312878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3dafa4b5-7c92-4f02-a8e2-fc8d6ed26e37 tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:39.331996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:39.332500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:39.332946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:39.333671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:39.334125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:39.341163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:39.408775 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3dafa4b5-7c92-4f02-a8e2-fc8d6ed26e37 tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.615604 Oct 01 20:50:39.410007 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 271/534] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:38 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:39.440122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6ff02d18-b855-4d08-952b-8622b76150b3 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:39.483463 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6ff02d18-b855-4d08-952b-8622b76150b3 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/718405214" status: 202 len: 0 microversion: 2.1 time: 0.047732 Oct 01 20:50:39.484726 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 272/535] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 20:50:39 2022] DELETE /compute/v2.1/flavors/718405214 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:39.492811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-602cd949-529b-45d0-9e52-c837c822f968 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:39.528805 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-602cd949-529b-45d0-9e52-c837c822f968 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.039634 Oct 01 20:50:39.535806 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 273/536] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:39 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:39.572166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eb51a67e-059a-42e9-b618-f84889dd2703 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1176461445", "id": 1814723138, "os-flavor-access:is_public": "False"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:39.618240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:39.636599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:39.644973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:39.649635 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eb51a67e-059a-42e9-b618-f84889dd2703 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.089386 Oct 01 20:50:39.653777 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 274/537] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:39 2022] POST /compute/v2.1/flavors => generated 430 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:39.667953 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f03bc16d-e0f0-492c-9684-085d723c67d9 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.385954 Oct 01 20:50:39.676829 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 264/538] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:39 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:39.677501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7069ba33-0d8a-4209-9010-79d4ab6bab44 tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "1814723138"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:39.702643 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-7069ba33-0d8a-4209-9010-79d4ab6bab44 tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] HTTP exception thrown: Flavor 1814723138 could not be found. Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7069ba33-0d8a-4209-9010-79d4ab6bab44 tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] Request method failure captured: Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 107 Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKgUcU0On42x7WKhbdlycqY03Pzw9JtK3b4APMZZ23vF_xVjXUQY_gH4tyApxlgyA7Qg-VbB9-5DroBp5L2vslle12wDVG40s16PdxkyQMTKOlPklh3mTniTDaJdiRi7O8yNssti29DcFW0k6b-SJn387pnMa5eR1Ful-QGYxh5eRbw Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: de2a660566d947f9a2a2977cf3a32d80 Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FlavorsAdminTestJSON-648690929 Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:50:39.705718 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_de2a660566d947f9a2a2977cf3a32d80", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de2a660566d947f9a2a2977cf3a32d80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/de2a660566d947f9a2a2977cf3a32d80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de2a660566d947f9a2a2977cf3a32d80"}]}] Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FlavorsAdminTestJSON-648690929 Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: de2a660566d947f9a2a2977cf3a32d80 Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-648690929 Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FlavorsAdminTestJSON-648690929-project Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: b99f9f102b064fd68a8222a23948c813 Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FlavorsAdminTestJSON-648690929-project Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: {"server": {"name": "test", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "1814723138"}} Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:50:39.707101 ncdv-master-1 devstack@n-api.service[140437]: exception: Flavor 1814723138 could not be found. Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '1814723138'}}} Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1814723138 could not be found. Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:39.707929 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1814723138 could not be found. Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:50:39.709132 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:50:39.711364 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:50:39.711364 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:50:39.711364 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:50:39.711364 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1814723138 could not be found. Oct 01 20:50:39.711364 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:50:39.713141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7069ba33-0d8a-4209-9010-79d4ab6bab44 tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] Returning 400 to user: Flavor 1814723138 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:50:39.714623 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7069ba33-0d8a-4209-9010-79d4ab6bab44 tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.051994 Oct 01 20:50:39.715913 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 275/539] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:39 2022] POST /compute/v2.1/servers => generated 81 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:50:39.724840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7eac658e-455a-4959-a903-77b671146ac2 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:39.747129 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7eac658e-455a-4959-a903-77b671146ac2 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1814723138" status: 202 len: 0 microversion: 2.1 time: 0.026838 Oct 01 20:50:39.748621 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 265/540] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:50:39 2022] DELETE /compute/v2.1/flavors/1814723138 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 20:50:39.757905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-11948e03-fe2c-48dd-a144-8df89cd17f2f tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:39.818600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:39.821188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:39.828560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:39.829365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:39.831418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:39.834666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:39.835358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:39.835959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:40.080027 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-11948e03-fe2c-48dd-a144-8df89cd17f2f tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.327019 Oct 01 20:50:40.081601 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 276/541] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:39 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:40.119693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-409f559f-9a42-4bef-8867-e9502b367b15 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1974678676", "id": 1196333876, "os-flavor-access:is_public": "False"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:40.157749 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-409f559f-9a42-4bef-8867-e9502b367b15 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.046306 Oct 01 20:50:40.158355 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 277/542] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:40 2022] POST /compute/v2.1/flavors => generated 415 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:40.174123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-71ef4cd0-893e-4db7-a19a-f298d6bbb99d tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1929929450", "id": 1103507155, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:40.215701 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-71ef4cd0-893e-4db7-a19a-f298d6bbb99d tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.048879 Oct 01 20:50:40.228606 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 278/543] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:40 2022] POST /compute/v2.1/flavors => generated 414 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:40.231815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-222a324b-5b2a-4bb0-b067-a565b44d33b2 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:40.277501 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-222a324b-5b2a-4bb0-b067-a565b44d33b2 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.049652 Oct 01 20:50:40.281341 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 279/544] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Oct 1 20:50:40 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:40.292920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:40.296197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:40.312753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:40.313407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:40.313972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:40.314915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:40.315491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:40.316304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:40.536292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:40.562991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:40.576400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:40.577808 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9790c957-e521-42e8-af8f-01955f73f70b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 0.764922 Oct 01 20:50:40.595067 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 266/545] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:39 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:40.627674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1011e86c-d77d-4b66-a85c-3b5e5a800e54 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:40.681365 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1011e86c-d77d-4b66-a85c-3b5e5a800e54 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.084675 Oct 01 20:50:40.707006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 267/546] 10.222.0.17 () {58 vars in 1177 bytes} [Sat Oct 1 20:50:40 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:40.722433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac2571de-49c4-443b-ad7e-da346164874b tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:40.754873 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac2571de-49c4-443b-ad7e-da346164874b tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.045601 Oct 01 20:50:40.756373 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 268/547] 10.222.0.17 () {58 vars in 1171 bytes} [Sat Oct 1 20:50:40 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:40.773105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:40.783227 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c2fb9559-65e7-42dc-ab5e-09901eae3714 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 0.500489 Oct 01 20:50:40.786162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:40.787011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:40.787370 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 280/548] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:40 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:40.807521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-568ac79f-f2bf-4e82-b3e4-8009d7487ea2 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:40.812373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:40.812894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:40.813339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:40.814063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:40.814537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:40.814976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:40.826385 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-568ac79f-f2bf-4e82-b3e4-8009d7487ea2 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.037023 Oct 01 20:50:40.827369 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 281/549] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Oct 1 20:50:40 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:40.843029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bbc54673-e40c-4d39-ab13-49bd931e8392 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:40.885661 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bbc54673-e40c-4d39-ab13-49bd931e8392 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6222 microversion: 2.1 time: 0.046289 Oct 01 20:50:40.892674 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 282/550] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Oct 1 20:50:40 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6222 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:40.926775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e711b959-537e-4f94-8dd4-d9611b1a2be8 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:40.989736 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e711b959-537e-4f94-8dd4-d9611b1a2be8 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6222 microversion: 2.1 time: 0.066707 Oct 01 20:50:40.994677 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 283/551] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Oct 1 20:50:40 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6222 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:41.017240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2234cb2c-6b8c-493e-be85-f512adb392d2 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.063321 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2234cb2c-6b8c-493e-be85-f512adb392d2 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6222 microversion: 2.1 time: 0.049769 Oct 01 20:50:41.064886 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 284/552] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Oct 1 20:50:41 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6222 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:41.086569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7acf92db-583f-48b0-85ce-123ee8c01297 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.159087 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7acf92db-583f-48b0-85ce-123ee8c01297 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6222 microversion: 2.1 time: 0.071090 Oct 01 20:50:41.172203 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 285/553] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Oct 1 20:50:41 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:41.188161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe90d4f5-52ae-4acd-8a17-816c333915d7 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.242944 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe90d4f5-52ae-4acd-8a17-816c333915d7 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1103507155" status: 202 len: 0 microversion: 2.1 time: 0.065133 Oct 01 20:50:41.244266 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 286/554] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:50:41 2022] DELETE /compute/v2.1/flavors/1103507155 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:41.258893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-62486d76-cd5f-4619-b737-541f130a7ff5 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.314895 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-62486d76-cd5f-4619-b737-541f130a7ff5 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.060088 Oct 01 20:50:41.314895 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 287/555] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:41 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:41.341618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5dc61134-dd77-499c-920a-3e78db906d82 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.386860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:41.406062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:41.412329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:41.417867 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5dc61134-dd77-499c-920a-3e78db906d82 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1196333876" status: 202 len: 0 microversion: 2.1 time: 0.085403 Oct 01 20:50:41.417867 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 288/556] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:50:41 2022] DELETE /compute/v2.1/flavors/1196333876 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:41.429565 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fba6fcd5-74e6-479a-a18e-dee5a19709c7 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.667306 Oct 01 20:50:41.432017 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 269/557] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:40 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:41.434860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-47def55e-7d62-4822-86aa-7a6fe77ba82a tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.481425 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-47def55e-7d62-4822-86aa-7a6fe77ba82a tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.053506 Oct 01 20:50:41.492414 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 289/558] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:41 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:41.512335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a65a1b70-acd8-42df-b66d-b9bb57df617d tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-173466617", "id": 780104423, "os-flavor-access:is_public": "False"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:41.525800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:41.586282 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a65a1b70-acd8-42df-b66d-b9bb57df617d tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.078368 Oct 01 20:50:41.590321 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 270/559] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:41 2022] POST /compute/v2.1/flavors => generated 411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:41.602839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b94503dd-b648-4a09-afdf-1b1d56219102 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.612244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.613052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:41.640392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:41.640822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:41.642530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:41.646386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:41.647058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:41.649034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:41.672881 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b94503dd-b648-4a09-afdf-1b1d56219102 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.075104 Oct 01 20:50:41.673882 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 290/560] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:41 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:41.696055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-96fa4eab-f7fc-471d-b6fe-8d463374f474 tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.764971 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-96fa4eab-f7fc-471d-b6fe-8d463374f474 tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.067419 Oct 01 20:50:41.765635 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 291/561] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:41 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:41.791338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e66ad9bc-6c91-481f-be04-70e394d96963 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.798674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=15 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:41.852360 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e66ad9bc-6c91-481f-be04-70e394d96963 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/780104423" status: 202 len: 0 microversion: 2.1 time: 0.070885 Oct 01 20:50:41.853629 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 292/562] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 20:50:41 2022] DELETE /compute/v2.1/flavors/780104423 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:41.863216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:41.864058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:41.882712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:41.885715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:41.886391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:41.887669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:41.890783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:41.892116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:42.826327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:42.843000 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-50b7e063-5def-403b-854d-ed3568701e03 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1477 microversion: 2.1 time: 0.987677 Oct 01 20:50:42.845077 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 293/563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:41 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1477 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:42.856036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d438de9a-f41c-4565-bfdb-cbf03b0bfcda tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:42.893973 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d438de9a-f41c-4565-bfdb-cbf03b0bfcda tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.047234 Oct 01 20:50:42.895421 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 294/564] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:42 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:42.909318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:42.911931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:42.931793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:42.934923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:42.935638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:42.936996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:42.940393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:42.941455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:43.044067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:43.057706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:43.062049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:43.068001 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea1d1d6a-ab13-4f1d-a0bb-78e16b932043 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 1.458596 Oct 01 20:50:43.070368 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 271/565] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:41 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:50:43.083152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-53bf6024-f5d5-4b0b-907c-ebd9577cac62 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-651951773", "id": 1771494106, "os-flavor-access:is_public": "True"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:43.135640 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-53bf6024-f5d5-4b0b-907c-ebd9577cac62 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.055884 Oct 01 20:50:43.143987 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 272/566] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:43 2022] POST /compute/v2.1/flavors => generated 413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:43.151248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1507f26-cf1e-4033-9716-2b8975326d6c tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:43.153715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:43.169913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:43.173616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:43.192987 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b2df5cb6-a9d9-4290-b1be-9ad74b0d2ade tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.291743 Oct 01 20:50:43.193668 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 295/567] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:42 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:43.199195 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1507f26-cf1e-4033-9716-2b8975326d6c tempest-FlavorsAdminTestJSON-648690929 tempest-FlavorsAdminTestJSON-648690929-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.053598 Oct 01 20:50:43.210901 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 273/568] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:43 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:43.221979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a8e7ba9d-894b-45f8-85c0-4c827f6bd6c0 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:43.276286 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a8e7ba9d-894b-45f8-85c0-4c827f6bd6c0 tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1771494106" status: 202 len: 0 microversion: 2.1 time: 0.056951 Oct 01 20:50:43.277864 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 296/569] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:50:43 2022] DELETE /compute/v2.1/flavors/1771494106 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:50:43.287245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-900eb69c-dc38-4554-a3fe-52f15fbc190a tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:43.315232 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-900eb69c-dc38-4554-a3fe-52f15fbc190a tempest-FlavorsAdminTestJSON-1489855161 tempest-FlavorsAdminTestJSON-1489855161-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.032471 Oct 01 20:50:43.341216 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 274/570] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:50:43 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:43.871921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:43.872686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:43.889488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:43.890013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:43.898280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:43.900607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:43.903347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:43.904022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:44.096997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:44.097606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:44.110020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:44.110849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:44.113257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:44.114542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:44.117069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:44.118176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:44.886905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:44.899318 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c61b316d-1df0-413d-8c41-594bb8fb5b99 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1476 microversion: 2.1 time: 1.033038 Oct 01 20:50:44.901647 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 297/571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:43 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1476 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:44.911360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:44.915457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:44.925838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:44.928753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:44.930126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:44.935762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:44.936255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:44.936698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:45.215847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:45.231546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:45.233154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:45.238391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:45.239968 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2a8b747-9704-43ca-b2c3-975cab35e4f0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 1.147074 Oct 01 20:50:45.243879 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 275/572] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:44 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:45.245927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:45.247639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:45.253553 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-52503860-ae3e-4922-a7dc-9ad7ef7b3b31 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.350147 Oct 01 20:50:45.255253 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 298/573] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:44 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:45.292992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3238d6ff-08b8-467f-a8b7-7d49d91a0bcf req-d823cc10-6730-46d5-891e-8079c77efc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a6997f-d4d8-405f-9d73-c2ff5d089bde", "name": "network-vif-unplugged", "status": "completed", "tag": "c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:45.316126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3238d6ff-08b8-467f-a8b7-7d49d91a0bcf req-d823cc10-6730-46d5-891e-8079c77efc62 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:45.317676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3238d6ff-08b8-467f-a8b7-7d49d91a0bcf req-d823cc10-6730-46d5-891e-8079c77efc62 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:45.318441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3238d6ff-08b8-467f-a8b7-7d49d91a0bcf req-d823cc10-6730-46d5-891e-8079c77efc62 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:45.333476 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3238d6ff-08b8-467f-a8b7-7d49d91a0bcf req-d823cc10-6730-46d5-891e-8079c77efc62 service nova] Creating event network-vif-unplugged:c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba for instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde on nch1-master-1 Oct 01 20:50:45.343444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3238d6ff-08b8-467f-a8b7-7d49d91a0bcf req-d823cc10-6730-46d5-891e-8079c77efc62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062611 Oct 01 20:50:45.344725 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 276/574] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:45.925440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:45.926064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:45.932765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:45.933296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:45.933736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:45.934452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:45.935245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:45.935882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:46.271391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:46.272524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:46.306474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:46.307508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:46.308186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:46.309572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:46.310298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:46.311271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:47.648122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:47.651531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:47.666702 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a203621d-9515-4d1b-b045-2f4f2601fb88 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1476 microversion: 2.1 time: 1.746300 Oct 01 20:50:47.675015 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 299/575] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:45 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1476 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:47.680589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:47.687305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:47.709026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:47.709981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:47.710682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:47.711639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:47.712314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:47.715437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:47.941224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:47.951002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:47.956549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:47.968426 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-57f35503-270f-4c00-ad42-f9439f325862 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1531 microversion: 2.91 time: 0.292058 Oct 01 20:50:47.975304 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 300/576] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:47 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1531 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:47.987567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-2487334a-818a-439c-a3bb-cabf8835ea8c req-3b243549-53ea-47cc-b7e0-a2467f132740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718605d6-75e8-4b45-8db7-cd48626c0ce3", "name": "network-vif-unplugged", "status": "completed", "tag": "0293e38a-8ed1-4661-add8-6b614f7f55b2"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:48.000379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:48.006190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2487334a-818a-439c-a3bb-cabf8835ea8c req-3b243549-53ea-47cc-b7e0-a2467f132740 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:48.014442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:48.015149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2487334a-818a-439c-a3bb-cabf8835ea8c req-3b243549-53ea-47cc-b7e0-a2467f132740 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:48.015677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2487334a-818a-439c-a3bb-cabf8835ea8c req-3b243549-53ea-47cc-b7e0-a2467f132740 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:48.016068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:48.018014 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-db2508c0-28a0-43b6-bee2-22de4faa6e37 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 1.751443 Oct 01 20:50:48.019287 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 277/577] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:46 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:48.027622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:48.028482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:48.041856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:48.042753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:48.043683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:48.045095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:48.046080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:48.046940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:48.058583 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-2487334a-818a-439c-a3bb-cabf8835ea8c req-3b243549-53ea-47cc-b7e0-a2467f132740 service nova] Creating event network-vif-unplugged:0293e38a-8ed1-4661-add8-6b614f7f55b2 for instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 on nch1-master-1 Oct 01 20:50:48.077389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-2487334a-818a-439c-a3bb-cabf8835ea8c req-3b243549-53ea-47cc-b7e0-a2467f132740 service nova] Instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:50:48.100650 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-2487334a-818a-439c-a3bb-cabf8835ea8c req-3b243549-53ea-47cc-b7e0-a2467f132740 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116733 Oct 01 20:50:48.104900 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 301/578] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:50:48.294363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lazy-loading 'services' on Instance uuid 88ff8817-cf9a-4f27-a93e-7c1e847eda21 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:50:48.331915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76b71c31-9650-403c-90d1-4a1a6e25d923 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1936 microversion: 2.91 time: 0.310691 Oct 01 20:50:48.332976 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 278/579] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:48 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1936 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:48.363518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:48.364151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:48.390402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:48.391873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:48.394818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:48.396025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:48.398462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:48.400237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:48.468618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lazy-loading 'flavor' on Instance uuid 88ff8817-cf9a-4f27-a93e-7c1e847eda21 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:50:48.703641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:48.704317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:48.718046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:48.718575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:48.719014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:48.722445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:48.723170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:48.725253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:48.953025 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7e35c692-14de-405e-b9a7-fdb372500c90 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "POST /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21/action" status: 202 len: 0 microversion: 2.91 time: 0.594159 Oct 01 20:50:48.954416 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 302/580] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:50:48 2022] POST /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 01 20:50:48.992664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:48.994741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:49.043839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:49.048671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:49.052176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:49.058849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:49.063831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:49.064690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:49.302091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:49.317028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:49.319322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:49.328035 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fa53fc5b-a06b-4047-9cfa-91ce677b8e64 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.367641 Oct 01 20:50:49.329302 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 303/581] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:48 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:49.334928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:49.335862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:49.352220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:49.355086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:49.355829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:49.356741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:49.358729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:49.360432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:49.515136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:49.536178 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94cc8253-5d6f-4c52-b222-a75a6fd1acf3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1476 microversion: 2.1 time: 0.837456 Oct 01 20:50:49.538414 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 279/582] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:48 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1476 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:49.986755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:50.001252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:50.009254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:50.014509 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-03e2de5a-571a-4736-9cd3-bdc519e78316 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 0.683125 Oct 01 20:50:50.015304 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 304/583] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:49 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:50.153179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-014a0cf8-3b5a-4dea-b2e7-077fadcbbf45 req-137441b1-d6fb-4e59-ab96-d688efad60b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a6997f-d4d8-405f-9d73-c2ff5d089bde", "tag": "c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:50.176861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-014a0cf8-3b5a-4dea-b2e7-077fadcbbf45 req-137441b1-d6fb-4e59-ab96-d688efad60b1 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:50.177924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-014a0cf8-3b5a-4dea-b2e7-077fadcbbf45 req-137441b1-d6fb-4e59-ab96-d688efad60b1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:50.179258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-014a0cf8-3b5a-4dea-b2e7-077fadcbbf45 req-137441b1-d6fb-4e59-ab96-d688efad60b1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:50.217949 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-014a0cf8-3b5a-4dea-b2e7-077fadcbbf45 req-137441b1-d6fb-4e59-ab96-d688efad60b1 service nova] Creating event network-changed:c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba for instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde on nch1-master-1 Oct 01 20:50:50.234799 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-014a0cf8-3b5a-4dea-b2e7-077fadcbbf45 req-137441b1-d6fb-4e59-ab96-d688efad60b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085932 Oct 01 20:50:50.235426 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 280/584] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:50.359897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:50.360750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:50.372265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:50.372773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:50.373213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:50.373925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:50.374381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:50.374837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:50.572188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:50.573953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:50.574426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:50.586055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:50.587545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:50.590754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:50.592754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:50.595098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:50.596067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:50.598344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:50.599096 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-77712470-8e84-4191-983d-9a3422a7455c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.243382 Oct 01 20:50:50.608096 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 305/585] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:50 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:50.612833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:51.044747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:51.044747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:51.051814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:51.052523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:51.053301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:51.054173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:51.055143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:51.055583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:51.764928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:51.779250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:51.783464 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cdbcc0bf-1329-45fb-a89b-4c3086374e3f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1476 microversion: 2.1 time: 1.217652 Oct 01 20:50:51.783992 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 281/586] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:50 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1476 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:51.791761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:51.794030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:51.796223 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-707d22d5-8f21-4bed-a4dc-033bb9d47ba1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 0.758493 Oct 01 20:50:51.797259 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 306/587] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:51 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:50:51.808978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:51.809870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:51.831680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:51.833454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:51.834112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:51.835330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:51.836222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:51.836830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:51.837415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:52.222995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:52.234155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:52.248137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:52.261066 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-28372310-6045-4a2c-9559-580c5af106a6 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.475936 Oct 01 20:50:52.294877 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 282/588] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:51 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:52.334252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-35aed044-c931-47c5-a64d-9f7603b04918 req-f4a4ba37-282f-4b66-9622-ba85186bb242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718605d6-75e8-4b45-8db7-cd48626c0ce3", "tag": "0293e38a-8ed1-4661-add8-6b614f7f55b2"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:52.354831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-35aed044-c931-47c5-a64d-9f7603b04918 req-f4a4ba37-282f-4b66-9622-ba85186bb242 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:52.355333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-35aed044-c931-47c5-a64d-9f7603b04918 req-f4a4ba37-282f-4b66-9622-ba85186bb242 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:52.355766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-35aed044-c931-47c5-a64d-9f7603b04918 req-f4a4ba37-282f-4b66-9622-ba85186bb242 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:52.388060 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-35aed044-c931-47c5-a64d-9f7603b04918 req-f4a4ba37-282f-4b66-9622-ba85186bb242 service nova] Creating event network-changed:0293e38a-8ed1-4661-add8-6b614f7f55b2 for instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 on nch1-master-1 Oct 01 20:50:52.406138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-35aed044-c931-47c5-a64d-9f7603b04918 req-f4a4ba37-282f-4b66-9622-ba85186bb242 service nova] Instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:50:52.435785 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-35aed044-c931-47c5-a64d-9f7603b04918 req-f4a4ba37-282f-4b66-9622-ba85186bb242 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103765 Oct 01 20:50:52.436941 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 307/589] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:50:52.821502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:52.822216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:52.830784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:52.831510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:52.851477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:52.851982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:52.852421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:52.853142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:52.855868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:52.860150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:52.861341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:52.862285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:52.863001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:52.864001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:52.867941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:52.873482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:53.800532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:53.809651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:53.829052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:53.830315 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dc9cb75f-36ba-4068-a155-2c96b01b8b74 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 1.003817 Oct 01 20:50:53.833237 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 308/590] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:52 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:54.105917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:54.127298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ecc747d3-e0fe-4c2c-9677-1d662f805215 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1476 microversion: 2.1 time: 1.307467 Oct 01 20:50:54.128575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1c8eb76a-f980-41db-9c18-d1d045dbeeb9 tempest-FlavorMetadataValidation-233851289 tempest-FlavorMetadataValidation-233851289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1758632069", "id": 1205640863, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:54.133329 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 283/591] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:52 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1476 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:54.154432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:54.157202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:54.175948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:54.178789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:54.181287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:54.197143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:54.197950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:54.199963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:54.200145 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1c8eb76a-f980-41db-9c18-d1d045dbeeb9 tempest-FlavorMetadataValidation-233851289 tempest-FlavorMetadataValidation-233851289-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.361196 Oct 01 20:50:54.200734 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 309/592] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:50:53 2022] POST /compute/v2.1/flavors => generated 471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:50:54.238530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1bb8bdbb-30d1-41bd-8948-74a122ec7cfb tempest-FlavorMetadataValidation-233851289 tempest-FlavorMetadataValidation-233851289-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:54.502308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:54.517498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:54.529025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:54.547384 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-862a6e47-f12f-4d97-80bf-9f30316f592e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.412323 Oct 01 20:50:54.548586 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 284/593] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:54 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:54.667130 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1bb8bdbb-30d1-41bd-8948-74a122ec7cfb tempest-FlavorMetadataValidation-233851289 tempest-FlavorMetadataValidation-233851289-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1205640863/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.451302 Oct 01 20:50:54.668083 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 310/594] 10.222.0.17 () {62 vars in 1265 bytes} [Sat Oct 1 20:50:54 2022] POST /compute/v2.1/flavors/1205640863/os-extra_specs => generated 62 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:54.679010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fae2a511-6892-4fa3-a7a7-9bf5059174ce tempest-FlavorMetadataValidation-233851289 tempest-FlavorMetadataValidation-233851289-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:54.712069 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fae2a511-6892-4fa3-a7a7-9bf5059174ce tempest-FlavorMetadataValidation-233851289 tempest-FlavorMetadataValidation-233851289-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1205640863" status: 202 len: 0 microversion: 2.86 time: 0.037868 Oct 01 20:50:54.713573 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 285/595] 10.222.0.17 () {60 vars in 1202 bytes} [Sat Oct 1 20:50:54 2022] DELETE /compute/v2.1/flavors/1205640863 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:50:54.726206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8cb6c0b4-6605-4cef-8063-b366e6e1f78f tempest-FlavorMetadataValidation-233851289 tempest-FlavorMetadataValidation-233851289-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:54.788662 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8cb6c0b4-6605-4cef-8063-b366e6e1f78f tempest-FlavorMetadataValidation-233851289 tempest-FlavorMetadataValidation-233851289-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6682 microversion: 2.86 time: 0.070520 Oct 01 20:50:54.794673 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 311/596] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Oct 1 20:50:54 2022] GET /compute/v2.1/flavors/detail => generated 6682 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:54.862617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:54.863490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:54.880009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:54.880507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:54.883379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:54.884533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:54.886035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:54.888078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:55.161302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:55.163164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:55.172063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:55.172740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:55.173337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:55.174239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:55.178830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:55.179468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:55.989911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:56.015678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:56.024170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:56.066427 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f27c76e-8a0e-4f8e-897e-f218164beda7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 1.209485 Oct 01 20:50:56.082691 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 286/597] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:54 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:56.094862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:56.095756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:56.104355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:56.105360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:56.106184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:56.107610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:56.108341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:56.109013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:56.137041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:50:56.332170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:56.333671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:56.343573 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-02b50d44-acf2-429b-98f7-3981ded3713f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1474 microversion: 2.1 time: 1.187805 Oct 01 20:50:56.348613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:56.353923 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 312/598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:55 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1474 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:50:56.357809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:56.370983 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eabf44ea-1742-440c-91e7-88cbacbe215b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.286766 Oct 01 20:50:56.372136 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 287/599] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:56 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:57.099196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:57.099850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:57.110281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:57.110809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:57.131968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:57.132928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:57.133491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:57.133970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:57.377123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:57.377727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:57.390048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:57.391531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:57.393129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:57.394454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:57.395987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:57.398253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:58.512032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:58.512704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:58.544975 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06dd8785-baeb-4c79-87a3-c433ed8828d1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1471 microversion: 2.1 time: 1.169193 Oct 01 20:50:58.546741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:58.548305 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 288/600] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:57 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1471 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:50:58.562762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:58.564790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:58.566429 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-84651516-d487-4171-8606-e1b696d6ac06 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 1.470940 Oct 01 20:50:58.566793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:58.567054 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 313/601] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:57 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:58.597636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:58.603483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:58.604519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:58.610332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:58.616220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:58.616930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:58.881260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:58.906574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:58.913820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:50:58.928235 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-52cc43cc-ff9f-4434-81d6-59e8ab377076 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.378281 Oct 01 20:50:58.929930 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 289/602] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:50:58 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:50:58.941580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24678750-1f29-4894-ab4e-917232dfc41e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:58.952852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24678750-1f29-4894-ab4e-917232dfc41e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:58.977804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24678750-1f29-4894-ab4e-917232dfc41e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:58.978682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24678750-1f29-4894-ab4e-917232dfc41e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:58.979355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24678750-1f29-4894-ab4e-917232dfc41e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:58.981915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24678750-1f29-4894-ab4e-917232dfc41e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:58.982754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24678750-1f29-4894-ab4e-917232dfc41e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:58.985003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24678750-1f29-4894-ab4e-917232dfc41e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:59.096557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-74410324", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "770e6dc0-cb45-4514-84ad-d006592eb04d"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:50:59.192726 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24678750-1f29-4894-ab4e-917232dfc41e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3/action" status: 204 len: 0 microversion: 2.1 time: 0.261288 Oct 01 20:50:59.193921 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 290/603] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:50:58 2022] POST /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3/action => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:50:59.229994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:50:59.230856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:50:59.245327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:59.245834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:59.246925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:59.249454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:50:59.250160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:50:59.254172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:50:59.294529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] validate_networks() for [('770e6dc0-cb45-4514-84ad-d006592eb04d', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:51:00.975597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:00.996019 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c2c91c5a-f845-4640-8d7a-c45d19f0889c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1471 microversion: 2.1 time: 1.793035 Oct 01 20:51:01.000783 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 291/604] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:50:59 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1471 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:01.016125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:01.017384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:01.044441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:01.049617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:01.054405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:01.055317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:01.056904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:01.059460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:01.339327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:51:01.340293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:51:01.341582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:51:01.341741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:51:01.342331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:51:01.368063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:01.381522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:01.387720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:01.388607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:01.389090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:01.394717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:01.468399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Getting quotas for project bbd3b538b14a4f77a6a50e9fbe849427. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:51:01.474769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Getting quotas for user 50d13e9e2afc44fd91caf096922460ed and project bbd3b538b14a4f77a6a50e9fbe849427. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:51:01.499669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:51:01.507133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:51:01.672589 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-160c8572-d475-4101-9ac5-58445a0a0929 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.096379 Oct 01 20:51:01.674919 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 314/605] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:50:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:51:01.692243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:01.694940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:01.713220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:01.715595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:01.718975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:01.721210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:01.722963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:01.724036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:01.781609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:01.804847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:01.816293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:01.822858 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc38f505-428e-4456-b9ed-2530e200457e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1569 microversion: 2.25 time: 0.816974 Oct 01 20:51:01.827333 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 292/606] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:01 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1569 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:01.847488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-894414c6-3639-4535-a219-8144c6279ed2 req-be457668-ca06-445b-a742-1fdada185bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718605d6-75e8-4b45-8db7-cd48626c0ce3", "name": "network-vif-plugged", "status": "completed", "tag": "0293e38a-8ed1-4661-add8-6b614f7f55b2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:01.913760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-894414c6-3639-4535-a219-8144c6279ed2 req-be457668-ca06-445b-a742-1fdada185bd8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:01.919768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-894414c6-3639-4535-a219-8144c6279ed2 req-be457668-ca06-445b-a742-1fdada185bd8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:01.921521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-894414c6-3639-4535-a219-8144c6279ed2 req-be457668-ca06-445b-a742-1fdada185bd8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:01.942372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:01.964067 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-894414c6-3639-4535-a219-8144c6279ed2 req-be457668-ca06-445b-a742-1fdada185bd8 service nova] Creating event network-vif-plugged:0293e38a-8ed1-4661-add8-6b614f7f55b2 for instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 on nch1-master-1 Oct 01 20:51:01.979025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:01.982219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:01.982474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-894414c6-3639-4535-a219-8144c6279ed2 req-be457668-ca06-445b-a742-1fdada185bd8 service nova] Instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:51:02.003927 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-025fad64-5e0c-4dd1-b1f3-be18ccebc9a1 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.323065 Oct 01 20:51:02.008487 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 315/607] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:01 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:02.026589 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-894414c6-3639-4535-a219-8144c6279ed2 req-be457668-ca06-445b-a742-1fdada185bd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196868 Oct 01 20:51:02.030664 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 293/608] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:02.049226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:02.050002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:02.062249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:02.062790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:02.063236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:02.063952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:02.070684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:02.072447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:02.077115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-69dbf542-b54b-47bb-b18f-e07d9b24b82a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:02.077877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-69dbf542-b54b-47bb-b18f-e07d9b24b82a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:02.472243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-69dbf542-b54b-47bb-b18f-e07d9b24b82a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:02.488328 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-69dbf542-b54b-47bb-b18f-e07d9b24b82a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1230 microversion: 2.1 time: 0.460992 Oct 01 20:51:02.492597 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 316/609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:02 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1230 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:02.859877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:02.861192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:02.868323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=6,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:02.880444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:02.882753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:02.884124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:02.886278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:02.887030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:02.888203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:03.712682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:03.733105 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6c7ca03d-a80f-49cb-8145-24d41649ccda tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1471 microversion: 2.1 time: 1.700212 Oct 01 20:51:03.735177 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 294/610] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:02 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1471 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:03.749362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:03.750445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:03.761244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:03.762093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:03.762907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:03.764006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:03.764714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:03.765370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.056928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:04.079697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:04.083644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:04.092099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:04.100974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:04.102434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:04.106704 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec0c9995-79cc-4c2f-b689-61890d81272c tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.365659 Oct 01 20:51:04.108509 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 295/611] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:03 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:04.135064 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e122875c-27d7-47dc-b9a0-63d2dcf18d2c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1559 microversion: 2.25 time: 1.281165 Oct 01 20:51:04.135670 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 317/612] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:02 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1559 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:04.158378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:04.159126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:04.195237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.196550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.198692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.201583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.202287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.204808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.401661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:04.412206 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-897c931c-b57b-4528-8d3c-35c5d9ded2ff tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1288 microversion: 2.1 time: 0.275404 Oct 01 20:51:04.420208 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 318/613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:04 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1288 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:04.429372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-51041f6a-64d0-47fb-ab14-e0516c89f2e2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '.version_select at 0x7f4173dd5d30>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:04.486260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51041f6a-64d0-47fb-ab14-e0516c89f2e2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.487865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51041f6a-64d0-47fb-ab14-e0516c89f2e2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.488798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51041f6a-64d0-47fb-ab14-e0516c89f2e2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.537031 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-51041f6a-64d0-47fb-ab14-e0516c89f2e2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1104 microversion: 2.25 time: 0.115647 Oct 01 20:51:04.566154 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 319/614] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Oct 1 20:51:04 2022] GET /compute/v2.1/os-migrations => generated 1104 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:04.577055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:04.579405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:04.605540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.606276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.608657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.610921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.611567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.614593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.637534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:04.720312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Calling method '.version_select at 0x7f4173ec7f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:04.724293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.724856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.726801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.755362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.756720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.757395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.775438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.776302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.776916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.794802 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-04d1a5c8-3ea0-46c6-b883-67f6adab2146 tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.684412 Oct 01 20:51:04.796347 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 296/615] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Oct 1 20:51:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:51:04.802066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:04.803614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:04.841739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.844115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.851293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:04.852860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:04.856863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:04.860736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:05.345403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid 57a6997f-d4d8-405f-9d73-c2ff5d089bde {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:51:05.361126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:05.375112 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99b09fbe-072e-4273-9b87-aeb636b9aa2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1471 microversion: 2.1 time: 0.577422 Oct 01 20:51:05.382262 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 297/616] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:04 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1471 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:05.399153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38e3bb5b-68b3-4051-8c4a-8c2a0679535b tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Calling method '.version_select at 0x7f41782eb310>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:05.400980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38e3bb5b-68b3-4051-8c4a-8c2a0679535b tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:05.401475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38e3bb5b-68b3-4051-8c4a-8c2a0679535b tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:05.401916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38e3bb5b-68b3-4051-8c4a-8c2a0679535b tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:05.419269 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-52be5675-9bfd-45f8-a98b-7998cb89e84b tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 2052 microversion: 2.25 time: 0.851407 Oct 01 20:51:05.422006 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 320/617] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:04 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 2052 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:05.429541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:05.441207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:05.462744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38e3bb5b-68b3-4051-8c4a-8c2a0679535b tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:05.462898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38e3bb5b-68b3-4051-8c4a-8c2a0679535b tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:05.463324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38e3bb5b-68b3-4051-8c4a-8c2a0679535b tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:05.467883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:05.468381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:05.469018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:05.471640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:05.474697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:05.474697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:05.494726 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38e3bb5b-68b3-4051-8c4a-8c2a0679535b tempest-HypervisorAdminV228Test-239774424 tempest-HypervisorAdminV228Test-239774424-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.109068 Oct 01 20:51:05.495357 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 298/618] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Oct 1 20:51:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:51:05.500196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:05.516510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:05.527455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:05.531594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:05.535515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:05.538647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:05.539322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:05.539925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:05.857567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:05.871695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:05.873403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:05.885991 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e51422a7-ad91-424c-be50-bd0e40b12eeb tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.462611 Oct 01 20:51:05.887183 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 321/619] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:05 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:05.892883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-483022175", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "e94323fd-d911-423e-a839-fc9242e1930f"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:06.024027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] validate_networks() for [('e94323fd-d911-423e-a839-fc9242e1930f', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:51:06.541191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:06.549758 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d22a32c7-f35e-412e-b320-b4aec148ce2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1330 microversion: 2.1 time: 1.053173 Oct 01 20:51:06.556049 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 299/620] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:05 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1330 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:06.563536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:06.571455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:06.585145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:06.585891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:06.586520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:06.587618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:06.588234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:06.588816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:07.355726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:07.368225 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2502d64d-892a-4ab8-81d2-3626c894faa5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1463 microversion: 2.1 time: 0.810990 Oct 01 20:51:07.371507 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 300/621] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:06 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1463 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:07.386836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:07.387503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:07.399408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:07.399919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:07.400373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:07.401094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:07.401560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:07.401990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:07.559404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:51:07.559871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:51:07.560504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:51:07.561272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:51:07.561847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:51:07.564477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:07.586052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:07.586597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:07.587017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:07.587162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:07.587759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:07.588221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:07.588484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:07.588653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:07.602862 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21e48838-ba53-4587-8f70-283c56f24d6f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.228593 Oct 01 20:51:07.603744 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 301/622] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:07 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:07.623044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:51:07.629398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8a050c0a-73d1-44c0-8c23-d7f6f906497c req-0d180744-c770-4432-a6db-879174fd6676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ad1478-bbd3-461f-ade4-dac84f2b76c5", "tag": "d3a654b9-62ac-48b8-9349-843d9100fa18"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:07.629742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for user aa72870453cd4b958725801b842c7a28 and project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:51:07.640756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8a050c0a-73d1-44c0-8c23-d7f6f906497c req-0d180744-c770-4432-a6db-879174fd6676 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:07.641251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8a050c0a-73d1-44c0-8c23-d7f6f906497c req-0d180744-c770-4432-a6db-879174fd6676 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:07.641687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8a050c0a-73d1-44c0-8c23-d7f6f906497c req-0d180744-c770-4432-a6db-879174fd6676 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:07.645885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:51:07.648673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:51:07.662928 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8a050c0a-73d1-44c0-8c23-d7f6f906497c req-0d180744-c770-4432-a6db-879174fd6676 service nova] Creating event network-changed:d3a654b9-62ac-48b8-9349-843d9100fa18 for instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 on nch2-master-1 Oct 01 20:51:07.669532 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8a050c0a-73d1-44c0-8c23-d7f6f906497c req-0d180744-c770-4432-a6db-879174fd6676 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048666 Oct 01 20:51:07.670790 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 302/623] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:07.678737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7ff5ef7-0410-4392-bf9a-30160e10af7a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:07.680094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f7ff5ef7-0410-4392-bf9a-30160e10af7a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:07.696304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7ff5ef7-0410-4392-bf9a-30160e10af7a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:07.699557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7ff5ef7-0410-4392-bf9a-30160e10af7a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:07.700186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7ff5ef7-0410-4392-bf9a-30160e10af7a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:07.701978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7ff5ef7-0410-4392-bf9a-30160e10af7a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:07.704754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7ff5ef7-0410-4392-bf9a-30160e10af7a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:07.705404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7ff5ef7-0410-4392-bf9a-30160e10af7a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:07.723896 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-65eb595e-6c89-4f66-95f9-7834d6266db3 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.835223 Oct 01 20:51:07.742753 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 322/624] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 20:51:07.749289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:07.750969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:07.759546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:07.760343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:07.760996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:07.761895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:07.762703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:07.763284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:08.193341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:08.217191 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9ac545a8-5965-46f5-97b6-9e4565d3da78 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1330 microversion: 2.1 time: 0.472851 Oct 01 20:51:08.218997 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 323/625] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:07 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1330 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:08.225806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7ddf2ca0-5c21-409f-b823-8d849322f1d8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:08.226678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7ddf2ca0-5c21-409f-b823-8d849322f1d8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:08.227122 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7ff5ef7-0410-4392-bf9a-30160e10af7a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1614 microversion: 2.1 time: 0.542699 Oct 01 20:51:08.227775 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 303/626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:07 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1614 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:08.259105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0c2dc929-c3d9-44b3-be9c-16555cfb6b77 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '.version_select at 0x7f4173bee430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:08.262848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c2dc929-c3d9-44b3-be9c-16555cfb6b77 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:08.263355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c2dc929-c3d9-44b3-be9c-16555cfb6b77 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:08.269291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c2dc929-c3d9-44b3-be9c-16555cfb6b77 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:08.293494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:08.329297 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0c2dc929-c3d9-44b3-be9c-16555cfb6b77 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.076573 Oct 01 20:51:08.330011 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 304/627] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:51:08 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:51:08.465335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7ddf2ca0-5c21-409f-b823-8d849322f1d8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:08.485527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7ddf2ca0-5c21-409f-b823-8d849322f1d8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:08.485527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7ddf2ca0-5c21-409f-b823-8d849322f1d8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:08.488492 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7ddf2ca0-5c21-409f-b823-8d849322f1d8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1261 microversion: 2.25 time: 0.268050 Oct 01 20:51:08.507277 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 324/628] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:08 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1261 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:08.541117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-798966834", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:08.633810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:51:08.634834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:08.635989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:08.647692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:08.648298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:08.648797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:08.657022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:08.657522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:08.658012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:08.820684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:08.834364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:08.836825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:08.844280 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-de5d1f39-1f76-40f8-ab5a-51c456c12b20 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.214947 Oct 01 20:51:08.859904 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 325/629] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:08 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:51:09.243844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:09.245165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:09.266134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:09.266970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:09.267597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:09.268522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:09.269195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:09.269843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:09.697316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:51:09.697820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:51:09.698117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:51:09.698821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:51:09.699412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:51:09.730481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:09.731008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:09.731443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:09.732366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:09.733156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:09.734028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:09.779604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:51:09.798654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for user e5bfbc1e512a445ca7527f3d79e40d16 and project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:51:09.836586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:51:09.842344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:51:09.975289 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-737fb4b2-e00d-457d-afd5-5d5c9cee2604 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.438727 Oct 01 20:51:09.994192 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 305/630] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:51:10.008984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:10.009618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:10.020022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:10.020726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:10.021946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:10.023577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:10.024197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:10.024817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:10.155108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:10.181730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:10.203793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:10.216205 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1bcc1c33-9df9-4363-8d9f-3ecfa5591cdf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1319 microversion: 2.25 time: 0.220721 Oct 01 20:51:10.225683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 306/631] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:09 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:10.235486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:10.236800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:10.303786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:10.312788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:10.314062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:10.327250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:10.329576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:10.334526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:10.347808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:10.357760 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9a5e063a-b7d7-4516-91f7-a2998b611761 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1330 microversion: 2.1 time: 1.119880 Oct 01 20:51:10.370731 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 326/632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:09 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1330 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:51:10.378299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-15819c50-d5db-478e-9760-32dd66d733d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:10.384894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-15819c50-d5db-478e-9760-32dd66d733d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:10.656093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-15819c50-d5db-478e-9760-32dd66d733d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:10.666891 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-15819c50-d5db-478e-9760-32dd66d733d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1212 microversion: 2.1 time: 0.295047 Oct 01 20:51:10.667480 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 327/633] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:10 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1212 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:11.148761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:11.174786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:11.179691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:11.193212 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b7a4993-a5d5-42dd-8efa-ba131df5811b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.966054 Oct 01 20:51:11.198231 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 307/634] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:10 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:11.247429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:11.248291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:11.265005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:11.266249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:11.269538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:11.270601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:11.271696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:11.282078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:11.335084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:11.335592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:11.351595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:11.352093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:11.361143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:11.376259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:11.377184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:11.382247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:11.480193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:51:11.616629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:11.636409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:11.638937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:11.646312 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1000685b-bc60-495d-b70d-4ca13d959349 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1319 microversion: 2.25 time: 0.402669 Oct 01 20:51:11.648002 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 328/635] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:11 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:11.653348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:11.654761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:11.662045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:11.662823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:11.663632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:11.665914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:11.666891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:11.667838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:11.678300 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a802e64b-f5bc-49b6-a32c-18c7920e1db9 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 204 len: 0 microversion: 2.1 time: 0.347865 Oct 01 20:51:11.679834 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 308/636] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:51:11 2022] DELETE /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 20:51:11.689292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:11.693829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:11.721384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:11.722118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:11.723592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:11.725341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:11.726260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:11.727720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:12.352115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:12.366413 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-53d18bfb-846f-470d-94fe-d31f0ec29d47 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1712 microversion: 2.1 time: 0.681810 Oct 01 20:51:12.367296 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 309/637] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:11 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1712 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:12.375879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:12.382514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:12.397086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:12.398168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:12.398921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:12.400046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:12.401650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:12.405857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:12.450959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:12.464130 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c8fc00df-2773-4d51-a4f8-2d9472e91555 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1330 microversion: 2.1 time: 0.814808 Oct 01 20:51:12.464736 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 329/638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:11 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1330 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:12.472706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:12.475650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:12.497933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:12.498370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:12.498890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:12.499561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:12.500022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:12.500454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:12.623358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:12.639875 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba1385e3-d240-479f-82d2-08b254e9d720 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1272 microversion: 2.1 time: 0.267671 Oct 01 20:51:12.643680 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 310/639] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:12 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1272 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:12.685906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:12.687671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:12.696159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:12.697694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:12.698381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:12.699373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:12.700758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:12.701625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:12.847664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:12.861217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:12.862792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:12.885425 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7d363bd6-9a50-4d04-a99c-e11168ce696e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.409181 Oct 01 20:51:12.886726 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 330/640] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:12 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:13.389017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:13.392015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:13.392691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:13.404818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:13.405335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:13.405851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:13.406272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:13.406411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:13.407043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:13.407426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d0e71fbc-d3c5-41fb-80d9-adaa689e7434 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1361 microversion: 2.25 time: 0.734116 Oct 01 20:51:13.407545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:13.407929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:13.408068 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 311/641] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:12 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1361 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:13.493816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:13.494459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:13.497830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:13.508719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:13.509230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:13.509678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:13.511129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:13.512674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:13.514472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:13.980053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:13.997274 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3e6fdde8-2bee-44d2-98da-7c9f350b9330 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1712 microversion: 2.1 time: 0.609333 Oct 01 20:51:13.998546 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 331/642] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:13 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1712 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:51:14.003356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-1b314fc7-dc92-440b-921b-a61037736575 req-c895d893-950a-4479-b9cd-a9ab266ecf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ad1478-bbd3-461f-ade4-dac84f2b76c5", "name": "network-vif-plugged", "status": "completed", "tag": "d3a654b9-62ac-48b8-9349-843d9100fa18"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:14.024433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b314fc7-dc92-440b-921b-a61037736575 req-c895d893-950a-4479-b9cd-a9ab266ecf94 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:14.028232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b314fc7-dc92-440b-921b-a61037736575 req-c895d893-950a-4479-b9cd-a9ab266ecf94 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:14.028798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b314fc7-dc92-440b-921b-a61037736575 req-c895d893-950a-4479-b9cd-a9ab266ecf94 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:14.058416 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-1b314fc7-dc92-440b-921b-a61037736575 req-c895d893-950a-4479-b9cd-a9ab266ecf94 service nova] Creating event network-vif-plugged:d3a654b9-62ac-48b8-9349-843d9100fa18 for instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 on nch2-master-1 Oct 01 20:51:14.073965 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-1b314fc7-dc92-440b-921b-a61037736575 req-c895d893-950a-4479-b9cd-a9ab266ecf94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073988 Oct 01 20:51:14.077848 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 332/643] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:14.117589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:14.118466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:14.135098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:14.137234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:14.137848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:14.140111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:14.140743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:14.142694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:14.488275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:14.509258 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8dcea39c-0147-4b29-9cc3-7dad68e686fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1270 microversion: 2.1 time: 0.429796 Oct 01 20:51:14.510589 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 333/644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:14 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1270 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:14.534385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:14.535323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:14.553524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:14.554749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:14.555379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:14.556266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:14.556880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:14.557461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:14.583921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:14.601722 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75e538ae-af3c-457f-bf6a-b019e241310c tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1330 microversion: 2.1 time: 1.113787 Oct 01 20:51:14.605776 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 312/645] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:13 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1330 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:14.628016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:14.629727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:14.653342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:14.656598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:14.659986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:14.662305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:14.663075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:14.664672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:14.813452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:14.834665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:14.848975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:14.868910 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-efe92182-ecb7-4e2d-8a01-9e42a5d68c9d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1558 microversion: 2.91 time: 0.339353 Oct 01 20:51:14.870627 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 334/646] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:14 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1558 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:15.029228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:15.031383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:15.049520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:15.050165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:15.050635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:15.051380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:15.051885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:15.056716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:16.247102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:16.259465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:16.274484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:16.275695 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7af4b7cf-b859-4fc4-8f88-210b5aa2a96e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1361 microversion: 2.25 time: 1.668593 Oct 01 20:51:16.276268 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 313/647] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:14 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1361 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:16.303745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:16.318060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:16.333125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:16.333659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:16.334101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:16.350051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:16.352054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:16.352527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:16.696941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:16.710455 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b19d47c4-c0da-43cc-bedd-1c8eafbb8558 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1270 microversion: 2.1 time: 0.433053 Oct 01 20:51:16.711626 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 314/648] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:16 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1270 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:16.721519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:16.722091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:16.734330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:16.734877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:16.735417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:16.736616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:16.737113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:16.737545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:16.740626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:16.757015 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-05cb0815-1cf3-422f-817f-85b6be4032c0 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1712 microversion: 2.1 time: 1.733953 Oct 01 20:51:16.767710 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 335/649] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:15 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1712 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:16.768898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:16.769606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:16.794421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:16.794936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:16.795379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:16.796085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:16.796694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:16.799015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:17.408548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:17.427139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:17.431260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:17.445139 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f2447120-3c4f-46c8-b20f-6431b280db83 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.683464 Oct 01 20:51:17.451145 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 336/650] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:16 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:17.456944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-842c685e-64ed-461a-b362-0a9e297cf0af req-82bf38e4-922e-4db1-b0a4-4119ca950e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee", "name": "network-vif-unplugged", "status": "completed", "tag": "b4dbc00f-0984-4ed5-8983-d9db1f2ce13d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:17.507631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-842c685e-64ed-461a-b362-0a9e297cf0af req-82bf38e4-922e-4db1-b0a4-4119ca950e08 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:17.508548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-842c685e-64ed-461a-b362-0a9e297cf0af req-82bf38e4-922e-4db1-b0a4-4119ca950e08 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:17.508992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-842c685e-64ed-461a-b362-0a9e297cf0af req-82bf38e4-922e-4db1-b0a4-4119ca950e08 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:17.537070 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-842c685e-64ed-461a-b362-0a9e297cf0af req-82bf38e4-922e-4db1-b0a4-4119ca950e08 service nova] Creating event network-vif-unplugged:b4dbc00f-0984-4ed5-8983-d9db1f2ce13d for instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee on nch1-master-1 Oct 01 20:51:17.546726 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-842c685e-64ed-461a-b362-0a9e297cf0af req-82bf38e4-922e-4db1-b0a4-4119ca950e08 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093870 Oct 01 20:51:17.552562 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 337/651] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:17.562569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:17.584126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:17.591649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:17.592389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:17.593012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:17.593951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:17.594802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:17.595396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:17.621492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:18.189093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:18.204105 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c338efb4-9a46-4dc8-b320-5ae552637cac tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1533 microversion: 2.1 time: 1.491191 Oct 01 20:51:18.219037 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 315/652] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:16 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1533 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:18.233575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:18.234204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:18.274384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:18.282380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:18.282989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:18.283705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:18.284181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:18.290637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:18.782080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:18.807248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:18.808769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:18.809410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:18.810955 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5d22fac8-5147-407b-b84a-4555bafafe13 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1361 microversion: 2.25 time: 1.256822 Oct 01 20:51:18.829268 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 338/653] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:17 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1361 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:18.829517 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7bf8ed23-ae35-477b-b9e7-714c3efe5248 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1270 microversion: 2.1 time: 0.604193 Oct 01 20:51:18.830130 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 316/654] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:18 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1270 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:18.832271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:18.833831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:18.837576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6985d12-6b47-4617-be3e-7b54449e3ea2 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Action: 'create', calling method: .version_select at 0x7f4173b06550>, body: {"pool": "bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249"} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:18.863086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:18.863888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:18.866206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:18.870366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:18.872025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:18.872465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:19.461175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:19.476262 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6c653209-23b1-4b9f-83c5-7889616d6e8f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1645 microversion: 2.1 time: 0.654277 Oct 01 20:51:19.491605 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 339/655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:18 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1645 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:19.498802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:19.514185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:19.535803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:19.540744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:19.543885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:19.546543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:19.549509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:19.551049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:19.759233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:19.828463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:20.612738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:20.622724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:20.636125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:20.639414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:20.659481 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4dd55250-e096-4e10-a953-79eebb195201 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 1.164490 Oct 01 20:51:20.663612 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 340/656] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:19 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:20.678254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:20.681710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:20.686265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=18 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:20.700520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:20.701043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:20.701494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:20.702222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:20.712220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:20.713199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:22.310286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:22.330859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:22.332445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:22.333671 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ae836837-39e9-422a-a7e9-163723830ab6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1361 microversion: 2.25 time: 1.668731 Oct 01 20:51:22.354295 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 341/657] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:20 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1361 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:22.365182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:22.390660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:22.402698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:22.407979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:22.409723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:22.411875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:22.414277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:22.415605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:23.368003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:23.384671 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-97f08642-e200-433d-8f59-3b230d7fb1a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1312 microversion: 2.1 time: 1.023941 Oct 01 20:51:23.387885 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 342/658] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:22 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1312 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:23.394753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:23.400739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:23.423116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:23.423917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:23.424594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:23.425547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:23.431535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:23.432289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:23.518656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:23.522784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:23.523356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:23.523932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lazy-loading 'fault' on Instance uuid ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:51:23.779680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40f50783d9f417a8f84fab11b0d10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6741e5e1d01343dbb0889a1de15d6302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:23.797183 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-35604958-9b13-4134-a693-a5d7c9a8519f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 200 len: 1352 microversion: 2.1 time: 0.406164 Oct 01 20:51:23.797784 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 343/659] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:23 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 1352 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:23.813228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-5d505742-2ac7-4989-9db6-abb4cbde263d req-a6ba3fb1-a362-4b00-bb84-a35ed6a71440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b1c8b2-7399-45f1-8791-a1f7f3368ab1", "tag": "07d17637-612c-4ad6-8395-05ff1f3aafa8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:23.863044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5d505742-2ac7-4989-9db6-abb4cbde263d req-a6ba3fb1-a362-4b00-bb84-a35ed6a71440 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:23.865917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5d505742-2ac7-4989-9db6-abb4cbde263d req-a6ba3fb1-a362-4b00-bb84-a35ed6a71440 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:23.869016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5d505742-2ac7-4989-9db6-abb4cbde263d req-a6ba3fb1-a362-4b00-bb84-a35ed6a71440 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:23.935673 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-5d505742-2ac7-4989-9db6-abb4cbde263d req-a6ba3fb1-a362-4b00-bb84-a35ed6a71440 service nova] Creating event network-changed:07d17637-612c-4ad6-8395-05ff1f3aafa8 for instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 on nch1-master-1 Oct 01 20:51:23.952926 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-5d505742-2ac7-4989-9db6-abb4cbde263d req-a6ba3fb1-a362-4b00-bb84-a35ed6a71440 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153892 Oct 01 20:51:23.965203 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 344/660] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:23.998550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:24.009786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:24.036840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:24.037541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:24.038151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:24.047411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:24.048468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:24.049961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:24.380567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:24.397778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:24.415139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:24.430126 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ae6ed7e4-95f8-4f58-a48c-c93a90f085a0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.463314 Oct 01 20:51:24.433953 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 345/661] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:23 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:24.448502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:24.449220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:24.460689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:24.461218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:24.461650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:24.462835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:24.463151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:24.463618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:25.319111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:25.353072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:25.356710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:25.358605 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fdcb38ce-bf76-4d2d-aaef-425536d1f2e8 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1361 microversion: 2.25 time: 0.923598 Oct 01 20:51:25.359716 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 346/662] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:24 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1361 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:25.365637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:25.366559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:25.373660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:25.374554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:25.375188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:25.376436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:25.377089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:25.377702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:26.972446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:26.987205 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3d85c8cf-a87e-4ee9-b7c6-d3ccc991f320 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1312 microversion: 2.1 time: 1.625794 Oct 01 20:51:26.987828 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 347/663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:25 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1312 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:27.015916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:27.018352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:27.045196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:27.051353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:27.055152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:27.057380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:27.068591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:27.069308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:27.126867 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] HTTP exception thrown: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Request method failure captured: Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee HTTP/1.1 Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKeum-AidbDo5sQnUpjc0tV7kTxwiEjZOqmP6PBkkadTmDpHhZH6_fCt5f-YqxRpZBDUKU8nB5CSyR_qf2GBASO0tg3HDWyKUg8ydURQeMaW99Td2Sqs24kdTIutWPt2Pq0cvMo4-aEBxBnMrVPEnRVmtPLNXoVq9uhnriHCnCbZdo4 Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:51:27.131534 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6741e5e1d01343dbb0889a1de15d6302", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}] Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f40f50783d9f417a8f84fab11b0d10d0 Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:27.133238 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee'} Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:51:27.134172 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:27.135777 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:27.138242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Returning 404 to user: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:51:27.139519 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ffa283a1-cfa3-46d8-9d7c-50d0e2466d13 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 404 len: 111 microversion: 2.1 time: 0.146378 Oct 01 20:51:27.142031 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 348/664] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:26 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:51:27.155546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:27.156461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:27.172165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:27.173068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:27.176678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:27.177829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:27.178798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:27.179601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:27.555996 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6985d12-6b47-4617-be3e-7b54449e3ea2 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.722783 Oct 01 20:51:27.557516 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 317/665] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:51:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:27.562704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:27.563316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:27.588671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:27.589180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:27.589624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:27.590347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:27.590835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:27.591266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:28.133267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:28.151556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:28.154452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:28.168079 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b69176c6-0758-4f24-a0fe-d1734f3b3bcf tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 1.024739 Oct 01 20:51:28.174292 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 349/666] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:27 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:28.182420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-dd79353a-6e43-46b5-97e6-a7188166b78f req-24d4076b-e38e-4503-898d-12d6cc04c02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee", "name": "network-vif-deleted", "tag": "b4dbc00f-0984-4ed5-8983-d9db1f2ce13d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:28.211015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:28.219372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-dd79353a-6e43-46b5-97e6-a7188166b78f req-24d4076b-e38e-4503-898d-12d6cc04c02c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:28.224083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-dd79353a-6e43-46b5-97e6-a7188166b78f req-24d4076b-e38e-4503-898d-12d6cc04c02c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:28.227161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-dd79353a-6e43-46b5-97e6-a7188166b78f req-24d4076b-e38e-4503-898d-12d6cc04c02c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:28.256528 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-dd79353a-6e43-46b5-97e6-a7188166b78f req-24d4076b-e38e-4503-898d-12d6cc04c02c service nova] Creating event network-vif-deleted:b4dbc00f-0984-4ed5-8983-d9db1f2ce13d for instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee on nch1-master-1 Oct 01 20:51:28.275628 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-dd79353a-6e43-46b5-97e6-a7188166b78f req-24d4076b-e38e-4503-898d-12d6cc04c02c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099541 Oct 01 20:51:28.287590 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 350/667] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:28.299623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:28.300572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:28.316170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:28.318564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:28.320330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:28.324397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:28.325247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:28.325959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:28.374430 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] HTTP exception thrown: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Request method failure captured: Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f HTTP/1.1 Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKeum-AidbDo5sQnUpjc0tV7kTxwiEjZOqmP6PBkkadTmDpHhZH6_fCt5f-YqxRpZBDUKU8nB5CSyR_qf2GBASO0tg3HDWyKUg8ydURQeMaW99Td2Sqs24kdTIutWPt2Pq0cvMo4-aEBxBnMrVPEnRVmtPLNXoVq9uhnriHCnCbZdo4 Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:51:28.385098 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6741e5e1d01343dbb0889a1de15d6302", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}] Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f40f50783d9f417a8f84fab11b0d10d0 Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:28.386680 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e14cd883-3b04-49e9-9e08-002afa2fae2f'} Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:51:28.387641 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:28.389016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:51:28.390873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Returning 404 to user: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:51:28.391884 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-17461f53-80b0-44ef-b00a-b910b681d647 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 404 len: 111 microversion: 2.1 time: 0.102016 Oct 01 20:51:28.395651 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 351/668] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:51:28 2022] DELETE /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:51:28.404798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Action: 'action', calling method: .version_select at 0x7f4179492ee0>, body: {"addFloatingIp": {"address": "172.35.1.50"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:28.414869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:28.430768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:28.433617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:28.435022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:28.436040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:28.440354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:28.441430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:28.670044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:51:28.671541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquired lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:51:29.683617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:29.700019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:29.702303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:29.706717 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ded2d69a-a342-43e4-a35c-a6533eb9152d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1361 microversion: 2.25 time: 2.148163 Oct 01 20:51:29.708989 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 318/669] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:27 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1361 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:29.729072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:29.729932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:29.751374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:29.759351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:29.762563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:29.763573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:29.767184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:29.778986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:30.835453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:30.843765 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-750b4b9f-5a2a-492a-93db-aa1f908ef472 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1312 microversion: 2.1 time: 1.133462 Oct 01 20:51:30.858072 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 319/670] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:29 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1312 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:30.899025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:30.899765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:30.913618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:30.914192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:30.934770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:30.935707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:30.936245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:30.936724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:30.972426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] HTTP exception thrown: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Request method failure captured: Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f HTTP/1.1 Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKeum-AidbDo5sQnUpjc0tV7kTxwiEjZOqmP6PBkkadTmDpHhZH6_fCt5f-YqxRpZBDUKU8nB5CSyR_qf2GBASO0tg3HDWyKUg8ydURQeMaW99Td2Sqs24kdTIutWPt2Pq0cvMo4-aEBxBnMrVPEnRVmtPLNXoVq9uhnriHCnCbZdo4 Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:51:30.980583 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6741e5e1d01343dbb0889a1de15d6302", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}] Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f40f50783d9f417a8f84fab11b0d10d0 Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:30.982155 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e14cd883-3b04-49e9-9e08-002afa2fae2f'} Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:51:30.983089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:30.984500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:30.985619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Returning 404 to user: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:51:30.985619 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa654982-1c5c-47e8-b9ef-0a3b6273573f tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 404 len: 111 microversion: 2.1 time: 0.121524 Oct 01 20:51:30.996215 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 320/671] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:30 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:51:31.001443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:31.002070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:31.033506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:31.047994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:31.048631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:31.049565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:31.050180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:31.050817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:31.455664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:31.478010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:31.479948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:31.501104 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-362b1c6a-ea23-49e7-a4f5-0d3d490cbe6b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.498108 Oct 01 20:51:31.503108 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 321/672] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:30 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:31.508040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3928aa0e-c882-4bf8-9e8a-6a1c1124a9f7 req-e87c4f2b-a5bc-46a2-b244-ca91f7c787de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2c58aa-4921-414b-95d6-d976a10c336b", "tag": "91d3a9b8-4d83-45ba-9fcf-e81641ef7683"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:31.541897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3928aa0e-c882-4bf8-9e8a-6a1c1124a9f7 req-e87c4f2b-a5bc-46a2-b244-ca91f7c787de service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:31.549019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3928aa0e-c882-4bf8-9e8a-6a1c1124a9f7 req-e87c4f2b-a5bc-46a2-b244-ca91f7c787de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:31.554158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3928aa0e-c882-4bf8-9e8a-6a1c1124a9f7 req-e87c4f2b-a5bc-46a2-b244-ca91f7c787de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:31.562520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:31.587242 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3928aa0e-c882-4bf8-9e8a-6a1c1124a9f7 req-e87c4f2b-a5bc-46a2-b244-ca91f7c787de service nova] Creating event network-changed:91d3a9b8-4d83-45ba-9fcf-e81641ef7683 for instance bd2c58aa-4921-414b-95d6-d976a10c336b on nch1-master-1 Oct 01 20:51:31.596504 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3928aa0e-c882-4bf8-9e8a-6a1c1124a9f7 req-e87c4f2b-a5bc-46a2-b244-ca91f7c787de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091251 Oct 01 20:51:31.597147 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 322/673] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:31.614963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:31.615682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:31.636222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:31.636766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:31.639067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:31.639864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:31.640349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:31.640794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:32.737212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:32.759122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:32.768335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:32.769783 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3640c614-dbb6-4e1b-974d-1a8780173177 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1361 microversion: 2.25 time: 1.167978 Oct 01 20:51:32.795027 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 323/674] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:31 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1361 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:32.812179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0dd09ebf-4bf5-4cc8-9b89-1959493fe18d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '.version_select at 0x7f4173af5430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:32.897342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0dd09ebf-4bf5-4cc8-9b89-1959493fe18d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903102010" status: 202 len: 0 microversion: 2.1 time: 0.100936 Oct 01 20:51:32.899269 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 324/675] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 20:51:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903102010 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:51:32.916157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:32.918762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:32.940937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:32.941448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:32.942289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:32.943538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:32.945898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:32.946922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:34.169650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:34.204556 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-17e7ee1a-011c-48ff-9f03-ae6b1e167959 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1312 microversion: 2.1 time: 1.278613 Oct 01 20:51:34.205719 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 325/676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:32 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1312 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:34.228085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:34.232591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:34.245743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:34.250905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:34.251606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:34.253164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:34.255278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:34.259238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:34.931155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:34.941568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:34.948427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:34.966855 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f25be837-dc5f-44b8-8100-cae869d59555 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.759424 Oct 01 20:51:34.968170 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 326/677] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:34 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:34.972959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-89dee755-1025-4ea6-9dd8-4314ff2f2275 req-7abce9d5-ca85-4c1d-b638-6f8239a1524f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1c8b2-7399-45f1-8791-a1f7f3368ab1", "name": "network-vif-plugged", "status": "completed", "tag": "07d17637-612c-4ad6-8395-05ff1f3aafa8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:34.996925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-89dee755-1025-4ea6-9dd8-4314ff2f2275 req-7abce9d5-ca85-4c1d-b638-6f8239a1524f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:34.998179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-89dee755-1025-4ea6-9dd8-4314ff2f2275 req-7abce9d5-ca85-4c1d-b638-6f8239a1524f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:34.998924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-89dee755-1025-4ea6-9dd8-4314ff2f2275 req-7abce9d5-ca85-4c1d-b638-6f8239a1524f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:35.044513 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-89dee755-1025-4ea6-9dd8-4314ff2f2275 req-7abce9d5-ca85-4c1d-b638-6f8239a1524f service nova] Creating event network-vif-plugged:07d17637-612c-4ad6-8395-05ff1f3aafa8 for instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 on nch1-master-1 Oct 01 20:51:35.064852 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-89dee755-1025-4ea6-9dd8-4314ff2f2275 req-7abce9d5-ca85-4c1d-b638-6f8239a1524f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094276 Oct 01 20:51:35.069756 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 327/678] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:35.089809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:35.101325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:35.128873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:35.130703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:35.131470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:35.132323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:35.134716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:35.135374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:35.803848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Building network info cache for instance {{(pid=140437) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 20:51:35.897481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:35.912410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:35.923931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:35.925226 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-610e5535-5ce5-46de-ae89-0d24f065a5db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1361 microversion: 2.25 time: 0.853811 Oct 01 20:51:35.937352 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 328/679] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:35 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1361 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:35.947342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:35.948065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:35.967759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:35.968265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:35.968707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:35.971922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:35.972460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:35.979995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:36.696826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:36.705647 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9756ad44-72aa-4062-a709-ee9870b3da2e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1312 microversion: 2.1 time: 0.767133 Oct 01 20:51:36.713147 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 329/680] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:35 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1312 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:36.741485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-dc75824e-84ab-4dcf-a3d9-40c20a4213f6 req-d8566aef-adec-4083-b752-a2533069446e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ad1478-bbd3-461f-ade4-dac84f2b76c5", "tag": "d3a654b9-62ac-48b8-9349-843d9100fa18"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:36.788393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dc75824e-84ab-4dcf-a3d9-40c20a4213f6 req-d8566aef-adec-4083-b752-a2533069446e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:36.788925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dc75824e-84ab-4dcf-a3d9-40c20a4213f6 req-d8566aef-adec-4083-b752-a2533069446e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:36.789385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dc75824e-84ab-4dcf-a3d9-40c20a4213f6 req-d8566aef-adec-4083-b752-a2533069446e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:36.835962 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-dc75824e-84ab-4dcf-a3d9-40c20a4213f6 req-d8566aef-adec-4083-b752-a2533069446e service nova] Creating event network-changed:d3a654b9-62ac-48b8-9349-843d9100fa18 for instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 on nch2-master-1 Oct 01 20:51:36.860858 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-dc75824e-84ab-4dcf-a3d9-40c20a4213f6 req-d8566aef-adec-4083-b752-a2533069446e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144814 Oct 01 20:51:36.880770 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 330/681] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:36.907389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:36.910464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:36.946290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:36.947283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:36.948733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:36.965387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:36.969481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:36.975076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:37.204137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:37.224866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:37.229392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:37.237844 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e49a4a79-0f84-47cc-acfd-d4d2b328ea26 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.355510 Oct 01 20:51:37.243587 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 331/682] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:36 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:37.252347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:37.261474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:37.282772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:37.283276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:37.283742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:37.284452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:37.284920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:37.285348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:37.905710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:37.929186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:37.936379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:37.951188 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38381f33-c5b6-4410-aa3e-92e6240ae305 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1558 microversion: 2.25 time: 0.701716 Oct 01 20:51:37.952220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 332/683] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:37 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1558 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:37.966037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-419ba919-7cbf-46f3-88b0-ab14516f351d tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:37.987742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Updating instance_info_cache with network_info: [{"id": "d3a654b9-62ac-48b8-9349-843d9100fa18", "address": "fa:16:3e:a6:4f:6f", "network": {"id": "770e6dc0-cb45-4514-84ad-d006592eb04d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-477251176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bbd3b538b14a4f77a6a50e9fbe849427", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd3a654b9-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140437) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 20:51:38.007525 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-419ba919-7cbf-46f3-88b0-ab14516f351d tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1440176315" status: 202 len: 0 microversion: 2.1 time: 0.053869 Oct 01 20:51:38.014079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Releasing lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:51:38.015167 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-619bde31-b5ba-4a0c-91b0-7345b535688b tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action" status: 202 len: 0 microversion: 2.1 time: 9.619885 Oct 01 20:51:38.016490 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 352/684] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:51:28 2022] POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action => generated 0 bytes in 9623 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 01 20:51:38.022630 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 333/685] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:51:37 2022] DELETE /compute/v2.1/flavors/1440176315 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:51:38.025175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:38.027963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:38.032520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:38.033363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:38.041460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:38.042119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:38.042726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:38.043923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:38.044502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:38.045171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:38.056434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:38.057307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:38.057970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:38.058989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:38.059672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:38.060317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:38.710362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:51:38.761687 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-13b67f72-5250-4fbf-bf0e-304bf80a09f2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 2050 microversion: 2.25 time: 0.737430 Oct 01 20:51:38.772780 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 334/686] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:38 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 2050 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:38.803752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20664da1-862c-4d96-b499-036314ffc47a tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:38.822281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:38.832116 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8349c9bf-9890-4fd3-9cde-2ac977e3e1d0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1312 microversion: 2.1 time: 0.814018 Oct 01 20:51:38.835746 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 353/687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:38 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1312 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:38.858177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e96e4e36-6535-478c-bdf1-79df05263468 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Action: 'create', calling method: .version_select at 0x7f4173b93310>, body: {"pool": "bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:38.898827 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20664da1-862c-4d96-b499-036314ffc47a tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.124722 Oct 01 20:51:38.899977 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 335/688] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:51:38 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:38.904973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:38.916028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:38.935218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:38.936785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:38.938556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:38.939680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:38.941695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:38.943406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:39.227480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:39.240468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:39.241910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:39.261853 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-79ddc269-aab8-4d1e-9759-3006e2f0699b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.359308 Oct 01 20:51:39.265397 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 336/689] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:38 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:39.273449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:39.277429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:39.294936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:39.300083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:39.300770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:39.302372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:39.303050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:39.304127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:39.652779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:51:39.705458 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76481bf5-4a59-4361-bc87-622ea890dcde tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 2050 microversion: 2.25 time: 0.433401 Oct 01 20:51:39.709718 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 337/690] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:39 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 2050 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:39.726253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-301b0716-0a10-40a1-ad41-0fd1ca5c799e tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:39.786532 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-301b0716-0a10-40a1-ad41-0fd1ca5c799e tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/657278611" status: 202 len: 0 microversion: 2.1 time: 0.071928 Oct 01 20:51:39.789582 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 338/691] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 20:51:39 2022] DELETE /compute/v2.1/flavors/657278611 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:51:39.804737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-61d3cc39-2102-4919-93fd-6ba6eb177e0f tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:39.819606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61d3cc39-2102-4919-93fd-6ba6eb177e0f tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:39.820118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61d3cc39-2102-4919-93fd-6ba6eb177e0f tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:39.822712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61d3cc39-2102-4919-93fd-6ba6eb177e0f tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:39.823610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61d3cc39-2102-4919-93fd-6ba6eb177e0f tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:39.826794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61d3cc39-2102-4919-93fd-6ba6eb177e0f tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:39.827812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61d3cc39-2102-4919-93fd-6ba6eb177e0f tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:39.902735 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-61d3cc39-2102-4919-93fd-6ba6eb177e0f tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.109623 Oct 01 20:51:39.905835 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 339/692] 10.222.0.17 () {60 vars in 1217 bytes} [Sat Oct 1 20:51:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:51:39.916070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf3d0048-b92d-4322-82ef-62d345d77842 tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:39.961314 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf3d0048-b92d-4322-82ef-62d345d77842 tempest-ServersWithSpecificFlavorTestJSON-805551005 tempest-ServersWithSpecificFlavorTestJSON-805551005-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053928 Oct 01 20:51:39.967525 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 340/693] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:51:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:39.972774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:39.985782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:40.007044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:40.009448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:40.012443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:40.013746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:40.016924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:40.021013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:40.763140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:40.784201 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab27c549-484c-4013-8f9f-1bb87dd402bd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1312 microversion: 2.1 time: 0.814939 Oct 01 20:51:40.785210 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 341/694] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:39 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1312 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:40.790702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b667fdf7-99a4-4efd-913a-a11099e29d66 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:40.791611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b667fdf7-99a4-4efd-913a-a11099e29d66 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:40.798030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b667fdf7-99a4-4efd-913a-a11099e29d66 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:40.798866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b667fdf7-99a4-4efd-913a-a11099e29d66 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:40.799549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b667fdf7-99a4-4efd-913a-a11099e29d66 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:40.801825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b667fdf7-99a4-4efd-913a-a11099e29d66 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:40.802615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b667fdf7-99a4-4efd-913a-a11099e29d66 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:40.803330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b667fdf7-99a4-4efd-913a-a11099e29d66 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:41.028264 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b667fdf7-99a4-4efd-913a-a11099e29d66 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1/action" status: 202 len: 0 microversion: 2.25 time: 0.241456 Oct 01 20:51:41.048467 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 342/695] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:51:40 2022] POST /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:51:41.086023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:41.106282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:41.143333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:41.144140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:41.144844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:41.146281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:41.146973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:41.147620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:41.168046 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] HTTP exception thrown: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Request method failure captured: Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee HTTP/1.1 Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKeum-AidbDo5sQnUpjc0tV7kTxwiEjZOqmP6PBkkadTmDpHhZH6_fCt5f-YqxRpZBDUKU8nB5CSyR_qf2GBASO0tg3HDWyKUg8ydURQeMaW99Td2Sqs24kdTIutWPt2Pq0cvMo4-aEBxBnMrVPEnRVmtPLNXoVq9uhnriHCnCbZdo4 Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:51:41.170434 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6741e5e1d01343dbb0889a1de15d6302", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}] Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f40f50783d9f417a8f84fab11b0d10d0 Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:41.181536 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee'} Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:51:41.182425 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:41.184013 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:41.188139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Returning 404 to user: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:51:41.190016 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26a338e9-c617-4b2f-9b47-3b5ac422bc48 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 404 len: 111 microversion: 2.1 time: 0.121272 Oct 01 20:51:41.191450 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 343/696] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:51:41 2022] DELETE /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:51:41.198867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-20afcf4c-b23e-4476-b6c4-50e7ae0c4d72 req-bf4b1c55-41b8-4baf-8cce-5e7b2dcf73f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2c58aa-4921-414b-95d6-d976a10c336b", "name": "network-vif-plugged", "status": "completed", "tag": "91d3a9b8-4d83-45ba-9fcf-e81641ef7683"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:41.244030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-20afcf4c-b23e-4476-b6c4-50e7ae0c4d72 req-bf4b1c55-41b8-4baf-8cce-5e7b2dcf73f0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:41.244725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-20afcf4c-b23e-4476-b6c4-50e7ae0c4d72 req-bf4b1c55-41b8-4baf-8cce-5e7b2dcf73f0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:41.245515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-20afcf4c-b23e-4476-b6c4-50e7ae0c4d72 req-bf4b1c55-41b8-4baf-8cce-5e7b2dcf73f0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:41.286807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-20afcf4c-b23e-4476-b6c4-50e7ae0c4d72 req-bf4b1c55-41b8-4baf-8cce-5e7b2dcf73f0 service nova] Creating event network-vif-plugged:91d3a9b8-4d83-45ba-9fcf-e81641ef7683 for instance bd2c58aa-4921-414b-95d6-d976a10c336b on nch1-master-1 Oct 01 20:51:41.305516 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-20afcf4c-b23e-4476-b6c4-50e7ae0c4d72 req-bf4b1c55-41b8-4baf-8cce-5e7b2dcf73f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111945 Oct 01 20:51:41.306143 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 344/697] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:41.330617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:41.331493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:41.373938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:41.378628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:41.382774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:41.383566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:41.390072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:41.390839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:41.736920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:41.748458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:41.754978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:41.767099 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ab2de6b-0e7b-4cfe-98ad-c8b75895dcb2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.459582 Oct 01 20:51:41.770004 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 345/698] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:41 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:41.784398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:41.785042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:41.805232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:41.805232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:41.805616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:41.806645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:41.807268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:41.807874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:41.868339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:42.318834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:51:42.353951 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f8a4b68-0795-48d5-8efc-7a8bb1d3e553 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 2035 microversion: 2.25 time: 0.582730 Oct 01 20:51:42.359324 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 346/699] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:41 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 2035 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:42.370451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:42.371239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:42.380913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:42.383053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:42.385853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:42.387310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:42.389038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:42.390155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:42.429307 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] HTTP exception thrown: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Request method failure captured: Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee HTTP/1.1 Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKeum-AidbDo5sQnUpjc0tV7kTxwiEjZOqmP6PBkkadTmDpHhZH6_fCt5f-YqxRpZBDUKU8nB5CSyR_qf2GBASO0tg3HDWyKUg8ydURQeMaW99Td2Sqs24kdTIutWPt2Pq0cvMo4-aEBxBnMrVPEnRVmtPLNXoVq9uhnriHCnCbZdo4 Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:51:42.432883 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6741e5e1d01343dbb0889a1de15d6302", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}] Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f40f50783d9f417a8f84fab11b0d10d0 Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:42.434227 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee'} Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:51:42.435018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. Oct 01 20:51:42.436280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:42.437337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Returning 404 to user: Instance ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:51:42.437337 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-671df038-100d-4766-9017-3efcf0d77a97 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee" status: 404 len: 111 microversion: 2.1 time: 0.073951 Oct 01 20:51:42.440664 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 347/700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:42 2022] GET /compute/v2.1/servers/ac8a4aca-2a30-4dde-aeeb-dfdd3609c0ee => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:51:42.483716 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e96e4e36-6535-478c-bdf1-79df05263468 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.643610 Oct 01 20:51:42.492515 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 354/701] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:51:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:42.497218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:42.497842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:42.514454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:42.515253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:42.515866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:42.516753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:42.518956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:42.520538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:42.931740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:42.940052 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5f690662-f2a6-4b2e-9096-7b9b9a240b18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1312 microversion: 2.1 time: 0.446380 Oct 01 20:51:42.944901 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 355/702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:42 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1312 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:42.988048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:43.000443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:43.037781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:43.039868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:43.040341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:43.041555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:43.042157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:43.042637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:43.049501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-151670709", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "e7712b88-b266-47cd-9f95-cfb0ee26fa9f"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:43.243586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'flavor' on Instance uuid e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:51:43.266119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] validate_networks() for [('e7712b88-b266-47cd-9f95-cfb0ee26fa9f', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:51:43.365526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Going to try to live migrate instance to nch2-master-1 {{(pid=140437) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 20:51:44.293835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:51:44.294377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:51:44.294821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:51:44.296554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:51:44.296995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:51:44.307240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=7 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:44.327595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:44.328303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:44.328911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:44.329819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:44.330458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:44.331066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:44.396113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for project 237c6bad691343e7a7e64304f55e01e9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:51:44.411626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for user a749a74841e840e2b8de67fb9562bf51 and project 237c6bad691343e7a7e64304f55e01e9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:51:44.444311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:51:44.448177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:51:44.554173 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c23c046c-5c8e-48f8-96b0-9074a0a66eda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.109025 Oct 01 20:51:44.554932 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 348/703] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:51:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:51:44.569272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:44.571302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:44.602192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:44.602834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:44.603504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:44.604432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:44.606601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:44.607552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:44.656630 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] HTTP exception thrown: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Request method failure captured: Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f HTTP/1.1 Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKeum-AidbDo5sQnUpjc0tV7kTxwiEjZOqmP6PBkkadTmDpHhZH6_fCt5f-YqxRpZBDUKU8nB5CSyR_qf2GBASO0tg3HDWyKUg8ydURQeMaW99Td2Sqs24kdTIutWPt2Pq0cvMo4-aEBxBnMrVPEnRVmtPLNXoVq9uhnriHCnCbZdo4 Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:51:44.662377 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6741e5e1d01343dbb0889a1de15d6302", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}] Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f40f50783d9f417a8f84fab11b0d10d0 Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:44.663736 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e14cd883-3b04-49e9-9e08-002afa2fae2f'} Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:51:44.664442 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:44.666335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:44.669338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Returning 404 to user: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:51:44.671362 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1787d868-b6f2-4b5e-9902-0c33b48e419d tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 404 len: 111 microversion: 2.1 time: 0.113911 Oct 01 20:51:44.679221 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 349/704] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:51:44 2022] DELETE /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:51:44.689723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Action: 'action', calling method: .version_select at 0x7f4179490ee0>, body: {"addFloatingIp": {"address": "172.35.1.218"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:44.696156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:44.711932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:44.712437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:44.717192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:44.718051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:44.722080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:44.723559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:45.032464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:51:45.033138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquired lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:51:46.117896 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2a00afd0-8873-4a7e-acf1-24fb0902f9bf tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1/action" status: 202 len: 0 microversion: 2.25 time: 3.152262 Oct 01 20:51:46.118861 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 356/705] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:51:42 2022] POST /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1/action => generated 0 bytes in 3173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:51:46.127984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:46.128605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:46.168000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:46.168658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:46.169122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:46.169879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:46.170347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:46.170815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:46.759325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:46.768255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:46.795222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:46.798401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:46.825048 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-82b0d4d8-204c-4036-8200-bc4fbb18e7a8 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1553 microversion: 2.91 time: 0.702021 Oct 01 20:51:46.826844 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 357/706] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:46 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1553 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:46.833437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:46.834305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:46.846166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:46.847032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:46.852312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:46.853526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:46.854224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:46.854900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:46.943610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.1.218 (d7eca391-cf8d-44b3-ba30-20b890e0e9fb) with port d3a654b9-62ac-48b8-9349-843d9100fa18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249.", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 20:51:46.944182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Releasing lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:51:46.944779 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] HTTP exception thrown: Cannot associate floating IP 172.35.1.218 (d7eca391-cf8d-44b3-ba30-20b890e0e9fb) with port d3a654b9-62ac-48b8-9349-843d9100fa18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249. Oct 01 20:51:46.944779 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-42866d24-123d-45bf-a738-8235c1d230d6'] Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Request method failure captured: Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action HTTP/1.1 Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 46 Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKgx4OD85fe47rWLoeI50CXe0E8Ci10hA1GZWNckDmfWGlzAzxASj8-7tsWH2kqM7YhHYjlnJx2DOu-LHTudVdGoXikQfW3Z4SGaiYKcMqc7Llt4OkJfgIy4qDsVPg4kFt56wSzgdM5Uie90n2ZD37RhLLYbBeFaYDBcd5P231-5NJQ Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:51:46.947035 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bbd3b538b14a4f77a6a50e9fbe849427", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}] Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 50d13e9e2afc44fd91caf096922460ed Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: {"addFloatingIp": {"address": "172.35.1.218"}} Oct 01 20:51:46.948760 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot associate floating IP 172.35.1.218 (d7eca391-cf8d-44b3-ba30-20b890e0e9fb) with port d3a654b9-62ac-48b8-9349-843d9100fa18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249. Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-42866d24-123d-45bf-a738-8235c1d230d6'] Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '87ad1478-bbd3-461f-ade4-dac84f2b76c5', 'body': {'addFloatingIp': {'address': '172.35.1.218'}}} Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:51:46.949569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 20:51:46.951116 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.1.218 (d7eca391-cf8d-44b3-ba30-20b890e0e9fb) with port d3a654b9-62ac-48b8-9349-843d9100fa18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249. Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42866d24-123d-45bf-a738-8235c1d230d6'] Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.1.218 (d7eca391-cf8d-44b3-ba30-20b890e0e9fb) with port d3a654b9-62ac-48b8-9349-843d9100fa18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249. Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42866d24-123d-45bf-a738-8235c1d230d6'] Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:46.952582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.1.218 (d7eca391-cf8d-44b3-ba30-20b890e0e9fb) with port d3a654b9-62ac-48b8-9349-843d9100fa18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249. Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42866d24-123d-45bf-a738-8235c1d230d6'] Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:46.953857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.1.218 (d7eca391-cf8d-44b3-ba30-20b890e0e9fb) with port d3a654b9-62ac-48b8-9349-843d9100fa18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249. Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42866d24-123d-45bf-a738-8235c1d230d6'] Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Returning 400 to user: Cannot associate floating IP 172.35.1.218 (d7eca391-cf8d-44b3-ba30-20b890e0e9fb) with port d3a654b9-62ac-48b8-9349-843d9100fa18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249. Oct 01 20:51:46.955293 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-42866d24-123d-45bf-a738-8235c1d230d6'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:51:46.956225 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bb9d744e-e10d-4230-955d-53233c16dbb8 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action" status: 400 len: 381 microversion: 2.1 time: 2.268123 Oct 01 20:51:46.956225 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 350/707] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:51:44 2022] POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action => generated 381 bytes in 2273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:51:46.958901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:46.958998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:46.981198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:46.987102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:46.987554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:46.988395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:46.988915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:46.989330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:47.133427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:47.146772 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05000ee7-97fa-4f09-8150-53592c0b7ee3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1262 microversion: 2.1 time: 0.192342 Oct 01 20:51:47.147166 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 351/708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:46 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1262 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:47.153314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:47.154089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] [instance: e14cd883-3b04-49e9-9e08-002afa2fae2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:47.173503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:47.174085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:47.174890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:47.175811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:47.176439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:47.176918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:47.189214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:47.195744 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] HTTP exception thrown: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Request method failure captured: Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f HTTP/1.1 Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKeum-AidbDo5sQnUpjc0tV7kTxwiEjZOqmP6PBkkadTmDpHhZH6_fCt5f-YqxRpZBDUKU8nB5CSyR_qf2GBASO0tg3HDWyKUg8ydURQeMaW99Td2Sqs24kdTIutWPt2Pq0cvMo4-aEBxBnMrVPEnRVmtPLNXoVq9uhnriHCnCbZdo4 Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:51:47.197277 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6741e5e1d01343dbb0889a1de15d6302", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6741e5e1d01343dbb0889a1de15d6302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6741e5e1d01343dbb0889a1de15d6302"}]}] Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6741e5e1d01343dbb0889a1de15d6302 Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224 Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f40f50783d9f417a8f84fab11b0d10d0 Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-230364224-project Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:47.198969 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e14cd883-3b04-49e9-9e08-002afa2fae2f'} Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:51:47.199889 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. Oct 01 20:51:47.201367 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:51:47.203358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] Returning 404 to user: Instance e14cd883-3b04-49e9-9e08-002afa2fae2f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:51:47.203358 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e9185aa6-2d04-4879-8510-c7e40b9f8718 tempest-ServersWithSpecificFlavorTestJSON-230364224 tempest-ServersWithSpecificFlavorTestJSON-230364224-project] 10.222.0.17 "GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f" status: 404 len: 111 microversion: 2.1 time: 0.050356 Oct 01 20:51:47.203358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 352/709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:47 2022] GET /compute/v2.1/servers/e14cd883-3b04-49e9-9e08-002afa2fae2f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:51:47.203776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:47.204375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:47.211146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:47.212242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:47.212242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:47.212795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:47.213262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:47.213699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:47.230884 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-34e3dbe7-4432-4f93-b9a7-8014faeecfde tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1462 microversion: 2.1 time: 0.400775 Oct 01 20:51:47.233564 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 358/710] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:46 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1462 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:47.430831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1488774603", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:47.526817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:51:47.795933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:47.809082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:47.811358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:47.823397 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a69ce2e7-6c37-4262-8084-08a929a1ab8a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1568 microversion: 2.25 time: 0.622399 Oct 01 20:51:47.845274 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 353/711] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:47 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1568 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:47.852597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb8a4852-96af-4774-8576-af035fd90e76 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '.version_select at 0x7f4173ab4f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:48.298080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:51:48.299391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:51:48.300050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:51:48.300523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:51:48.301932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:51:48.314854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:48.315729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:48.317212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:48.318072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:48.318828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:48.319428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:48.346767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Getting quotas for project 963f525498ef4ebdb9db327df62bd68a. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:51:48.357584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Getting quotas for user 04add76a65d74165b65189a5fd1f47ed and project 963f525498ef4ebdb9db327df62bd68a. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:51:48.393745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:51:48.398984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:51:48.503374 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dee11509-079c-433b-ad9b-08bd388d657a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264324 Oct 01 20:51:48.506896 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 359/712] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:51:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:51:48.514790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:48.519704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:48.547030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:48.547547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:48.549086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:48.550074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:48.551489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:48.552075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:48.706086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:48.717980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Old instance type m1.heat2, new instance type m1.heat {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 20:51:48.730356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:51:48.731079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:51:48.731741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:51:48.732636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:51:48.733430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:51:49.007086 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2ac9571a-1da0-43b5-b391-9cdcc646e312 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b/action" status: 202 len: 0 microversion: 2.1 time: 0.500446 Oct 01 20:51:49.008210 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 360/713] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:51:48 2022] POST /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:51:49.014782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:49.015886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:49.028530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:49.029176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:49.029722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:49.030828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:49.031571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:49.032155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:49.557562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:49.575279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:49.577172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:49.595424 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eb81e6c6-019d-476d-9891-d0e0188e4c19 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1535 microversion: 2.91 time: 0.585512 Oct 01 20:51:49.597810 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 361/714] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:49 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1535 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:49.611926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:49.613922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:49.632067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:49.632954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:49.633579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:49.643645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:49.645930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:49.646764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:50.027818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:50.050427 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5bbbe1c0-1099-479e-9109-102acbc689dd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1268 microversion: 2.1 time: 0.450637 Oct 01 20:51:50.053028 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 362/715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:49 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1268 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:50.083890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:50.089132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:50.109079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:50.109505 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:50.109957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:50.110747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:50.111823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:50.113820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:50.279363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:50.290249 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5664d64b-b7e2-4b4d-a4de-8367daa92751 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1271 microversion: 2.1 time: 0.233826 Oct 01 20:51:50.291164 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 363/716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:50 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:50.296415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:50.298295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:50.314177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:50.314917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:50.316941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:50.317887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:50.318424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:50.318890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:50.925450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:50.941053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:50.946790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:50.950775 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c31f460b-a0cc-4620-ba64-624b35018d67 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1568 microversion: 2.25 time: 0.658218 Oct 01 20:51:50.954660 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 364/717] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:50 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1568 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:50.963738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:50.965183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:50.995993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:51.002960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:51.006337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:51.007757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:51.011932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:51.015809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:51.505904 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bb8a4852-96af-4774-8576-af035fd90e76 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/d7eca391-cf8d-44b3-ba30-20b890e0e9fb" status: 202 len: 0 microversion: 2.1 time: 3.658481 Oct 01 20:51:51.506818 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 354/718] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:51:47 2022] DELETE /compute/v2.1/os-floating-ips/d7eca391-cf8d-44b3-ba30-20b890e0e9fb => generated 0 bytes in 3660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:51:51.511321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e91fac4b-2f62-4721-b5d2-7dddc341d429 req-1b33a2dc-348a-4d9b-95ae-2845cf28cace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1c8b2-7399-45f1-8791-a1f7f3368ab1", "name": "network-vif-unplugged", "status": "completed", "tag": "07d17637-612c-4ad6-8395-05ff1f3aafa8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:51.539546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e91fac4b-2f62-4721-b5d2-7dddc341d429 req-1b33a2dc-348a-4d9b-95ae-2845cf28cace service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:51.540685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e91fac4b-2f62-4721-b5d2-7dddc341d429 req-1b33a2dc-348a-4d9b-95ae-2845cf28cace service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:51.541289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e91fac4b-2f62-4721-b5d2-7dddc341d429 req-1b33a2dc-348a-4d9b-95ae-2845cf28cace service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:51.555695 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e91fac4b-2f62-4721-b5d2-7dddc341d429 req-1b33a2dc-348a-4d9b-95ae-2845cf28cace service nova] Creating event network-vif-unplugged:07d17637-612c-4ad6-8395-05ff1f3aafa8 for instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 on nch1-master-1 Oct 01 20:51:51.561182 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e91fac4b-2f62-4721-b5d2-7dddc341d429 req-1b33a2dc-348a-4d9b-95ae-2845cf28cace service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053150 Oct 01 20:51:51.561824 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 355/719] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:51.567730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:51.568727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:51.575418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:51.575917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:51.576354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:51.577088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:51.577556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:51.577976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:51.723812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:51.733831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:51.735865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:51.743686 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ce7a0859-2f84-4883-af65-26f9e23b1e4e tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1478 microversion: 2.91 time: 0.180227 Oct 01 20:51:51.744263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:51.744943 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 356/720] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:51 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1478 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:51.750998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:51.751904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:51.758996 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c306e362-878a-4b9e-a889-63d682878a43 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1471 microversion: 2.1 time: 0.802064 Oct 01 20:51:51.760188 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 365/721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:50 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1471 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:51.760665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:51.761383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:51.761982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:51.762954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:51.763548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:51.764109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:51.805320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:51.806059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:51.813893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:51.814476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:51.815022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:51.816064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:51.817086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:51.818582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:52.387207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:52.402422 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c99937d-0571-4998-bc35-bb1a35e92913 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1310 microversion: 2.1 time: 0.651836 Oct 01 20:51:52.403340 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 357/722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:51 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1310 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:52.414405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Action: 'action', calling method: .version_select at 0x7f4179490f70>, body: {"removeFloatingIp": {"address": "172.35.1.50"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:52.624720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:52.644033 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-83793be3-4d1e-4026-a629-dbfba85e9293 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1319 microversion: 2.1 time: 0.847057 Oct 01 20:51:52.645567 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 366/723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:51 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1319 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:52.663247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:52.666028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:52.672444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:52.673171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:52.673800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:52.674738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:52.676106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:52.676750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:52.748177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch1-master-1". {{(pid=140437) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 20:51:52.815177 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fc04bde5-eeb6-4a5f-a983-4732adbfb3b1 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21/action" status: 202 len: 0 microversion: 2.91 time: 0.168062 Oct 01 20:51:52.816143 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 367/724] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:51:52 2022] POST /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:51:52.823365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:52.824441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:52.831639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:52.833137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:52.833953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:52.834973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:52.835640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:52.836321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:53.340358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:53.346508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:53.347020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:53.347986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:53.348718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:53.349178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:53.349610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:53.667706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:53.677940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:53.679776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:53.681309 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b2ce76e6-d788-4b5c-bcdd-ddd83408622d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1568 microversion: 2.25 time: 0.863506 Oct 01 20:51:53.694705 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 368/725] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:52 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1568 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:53.706074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:53.706837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:53.713092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:53.713739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:53.714153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:53.715000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:53.715528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:53.716125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:54.255052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:51:54.255466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquired lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:51:54.265738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:54.274029 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f7791bc5-c422-4fb7-8682-5b1f63130154 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1471 microversion: 2.1 time: 0.577900 Oct 01 20:51:54.274736 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 369/726] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:53 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1471 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:54.279281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:54.279956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:54.286533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:54.287073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:54.287582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:54.288371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:54.288914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:54.289406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:54.359617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:54.417896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:54.427762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:54.429189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:54.429564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:54.436443 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-812c6ef8-0ca6-4dca-a252-58cf8ec5edac tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.160608 Oct 01 20:51:54.437040 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 370/727] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:54 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:54.442098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d1c3610d-8dc9-439e-963b-22bdeee66815 req-5b2f318a-a268-40da-a6fa-9ba5702dbb3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c88671-ff54-4647-96ce-a5fabf200cc6", "tag": "fa02211a-74c3-4a29-abe0-4a0d42899f3e"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:54.452892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d1c3610d-8dc9-439e-963b-22bdeee66815 req-5b2f318a-a268-40da-a6fa-9ba5702dbb3f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:54.453789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d1c3610d-8dc9-439e-963b-22bdeee66815 req-5b2f318a-a268-40da-a6fa-9ba5702dbb3f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:54.454549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d1c3610d-8dc9-439e-963b-22bdeee66815 req-5b2f318a-a268-40da-a6fa-9ba5702dbb3f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:54.474682 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d1c3610d-8dc9-439e-963b-22bdeee66815 req-5b2f318a-a268-40da-a6fa-9ba5702dbb3f service nova] Creating event network-changed:fa02211a-74c3-4a29-abe0-4a0d42899f3e for instance 45c88671-ff54-4647-96ce-a5fabf200cc6 on nch2-master-1 Oct 01 20:51:54.480468 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d1c3610d-8dc9-439e-963b-22bdeee66815 req-5b2f318a-a268-40da-a6fa-9ba5702dbb3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042242 Oct 01 20:51:54.481369 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 371/728] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:54.490249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:54.490959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:54.497550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:54.498069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:54.498527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:54.499235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:54.499695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:54.500134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:55.092086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:55.113849 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ed08a475-f756-4519-b96b-b01785fa3ade tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1310 microversion: 2.1 time: 0.627541 Oct 01 20:51:55.114559 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 372/729] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:54 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1310 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:55.119437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f3463f42-bcbe-471c-89f8-694856af7ffb req-554a2f7f-de2e-4e43-bcf9-486a4fa1983c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b1c8b2-7399-45f1-8791-a1f7f3368ab1", "tag": "07d17637-612c-4ad6-8395-05ff1f3aafa8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:55.139985 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f3463f42-bcbe-471c-89f8-694856af7ffb req-554a2f7f-de2e-4e43-bcf9-486a4fa1983c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:55.140477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f3463f42-bcbe-471c-89f8-694856af7ffb req-554a2f7f-de2e-4e43-bcf9-486a4fa1983c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:55.140914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f3463f42-bcbe-471c-89f8-694856af7ffb req-554a2f7f-de2e-4e43-bcf9-486a4fa1983c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:55.145216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:55.165511 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f3463f42-bcbe-471c-89f8-694856af7ffb req-554a2f7f-de2e-4e43-bcf9-486a4fa1983c service nova] Creating event network-changed:07d17637-612c-4ad6-8395-05ff1f3aafa8 for instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 on nch1-master-1 Oct 01 20:51:55.171007 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f3463f42-bcbe-471c-89f8-694856af7ffb req-554a2f7f-de2e-4e43-bcf9-486a4fa1983c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054986 Oct 01 20:51:55.182874 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 373/730] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:55.189047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:55.190010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:55.210469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:55.211004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:55.211447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:55.212174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:55.212637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:55.213066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:56.700521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:56.717344 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe20810f-ad21-4c96-86a0-b1c39db66339 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1319 microversion: 2.1 time: 1.532866 Oct 01 20:51:56.724441 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 374/731] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:55 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1319 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:56.724441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:56.724441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:56.739111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:56.739958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:56.743510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:56.744899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:56.746187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:56.746958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:57.637369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:57.654020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:57.656555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:57.664245 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4509f467-96b9-4f6e-bb2a-604185a73882 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1568 microversion: 2.25 time: 0.943628 Oct 01 20:51:57.665898 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 375/732] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:56 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1568 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:57.689746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:57.690686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:57.715174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:57.715761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:57.717678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:57.720354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:57.720854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:57.721302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:57.841264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Building network info cache for instance {{(pid=140438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 20:51:58.332332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:58.386787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:58.522310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:58.531302 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-56aa3c9a-46e5-4964-8d98-fc141d15aa22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1476 microversion: 2.1 time: 0.864074 Oct 01 20:51:58.536917 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 376/733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:57 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1476 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:58.541915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:58.555165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:58.557303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:51:58.574900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:58.575695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:58.576356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:58.578796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:58.578796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:58.578796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:58.767061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:58.782204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:58.783721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:58.807287 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9dd7931a-dbd6-4386-b856-c90a851ed3c2 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.268908 Oct 01 20:51:58.808429 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 377/734] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:58 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:51:58.813192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:58.816712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:58.833111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:58.833611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:58.847275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:58.848326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:58.848810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:58.849237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:59.148850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:51:59.157442 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-65b061e1-8f0b-4020-bd5d-fb5fa6f3a9c5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1310 microversion: 2.1 time: 0.347762 Oct 01 20:51:59.177672 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 378/735] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:58 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1310 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:51:59.182939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-be66e1a0-47d2-46fe-8ea0-e882d3080b80 req-6be674aa-8da9-4296-8e09-d9990ef9183e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28ddcd83-e345-4846-9f2e-2808c079168f", "tag": "f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:51:59.195856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-be66e1a0-47d2-46fe-8ea0-e882d3080b80 req-6be674aa-8da9-4296-8e09-d9990ef9183e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:59.197109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-be66e1a0-47d2-46fe-8ea0-e882d3080b80 req-6be674aa-8da9-4296-8e09-d9990ef9183e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:59.198251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-be66e1a0-47d2-46fe-8ea0-e882d3080b80 req-6be674aa-8da9-4296-8e09-d9990ef9183e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:59.235660 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-be66e1a0-47d2-46fe-8ea0-e882d3080b80 req-6be674aa-8da9-4296-8e09-d9990ef9183e service nova] Creating event network-changed:f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9 for instance 28ddcd83-e345-4846-9f2e-2808c079168f on nch2-master-1 Oct 01 20:51:59.245999 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-be66e1a0-47d2-46fe-8ea0-e882d3080b80 req-6be674aa-8da9-4296-8e09-d9990ef9183e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066868 Oct 01 20:51:59.250439 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 379/736] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:51:59.264412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:59.282338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:59.307160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:59.310313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:59.311363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:59.312647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:59.313339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:59.314206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:59.419962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Updating instance_info_cache with network_info: [{"id": "d3a654b9-62ac-48b8-9349-843d9100fa18", "address": "fa:16:3e:a6:4f:6f", "network": {"id": "770e6dc0-cb45-4514-84ad-d006592eb04d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-477251176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bbd3b538b14a4f77a6a50e9fbe849427", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd3a654b9-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 20:51:59.449364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Releasing lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:51:59.450697 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-43bd5b02-af9e-468f-96da-a90a11656b22 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action" status: 202 len: 0 microversion: 2.1 time: 7.046099 Oct 01 20:51:59.451464 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 358/737] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:51:52 2022] POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action => generated 0 bytes in 7047 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 01 20:51:59.459717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:51:59.461324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:51:59.475009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:59.477950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:59.479213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:51:59.482138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:51:59.482885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:51:59.485999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:00.215400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:00.234307 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-37b8f9e8-2db9-49b1-bbfd-d034977e1773 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1319 microversion: 2.1 time: 0.979913 Oct 01 20:52:00.237965 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 380/738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:51:59 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1319 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:00.249793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b6089c9-3d9d-4018-a205-f8c2d4c59f9f tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '.version_select at 0x7f4173dd50d0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:01.072468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:01.084098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:01.094933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:01.099991 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-43e27f48-2d6e-44f8-b132-2081df3acdfa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1568 microversion: 2.25 time: 1.647076 Oct 01 20:52:01.106845 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 359/739] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:51:59 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1568 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:01.111950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:01.117480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:01.129820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:01.136329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:01.136959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:01.137763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:01.138242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:01.138723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:02.044677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:02.055584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa500e29-6270-4cfa-9059-ef50801926d5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1476 microversion: 2.1 time: 0.947359 Oct 01 20:52:02.056185 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 360/740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:01 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1476 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:02.062484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:02.063510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:02.075054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:02.077775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:02.078445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:02.099391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:02.100322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:02.103868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:02.293421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:02.311774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:02.313526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:02.319537 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc2ae89c-75cc-4558-bd3e-cafb043bc6ee tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.261451 Oct 01 20:52:02.323057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 361/741] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:02 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:02.327974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:02.335030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:02.350775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:02.351671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:02.352331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:02.354235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:02.355072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:02.355735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:02.732293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:02.741453 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1181bed-1634-4579-9181-fd57958863d0 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1310 microversion: 2.1 time: 0.417068 Oct 01 20:52:02.742289 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 362/742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:02 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1310 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:02.746971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:02.747571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:02.753941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:02.754666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:02.755272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:02.756145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:02.756798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:02.757382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:03.188552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:03.216434 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-afc89046-c26c-4738-a16b-4c29bb654c27 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1319 microversion: 2.1 time: 0.460399 Oct 01 20:52:03.218001 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 363/743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:02 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:03.247111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6b7aa68f-82e3-4004-afb6-6f39b73a6230 req-3d4a7521-617e-4bd2-b8ab-98e172efaa29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ad1478-bbd3-461f-ade4-dac84f2b76c5", "tag": "d3a654b9-62ac-48b8-9349-843d9100fa18"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:03.284693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6b7aa68f-82e3-4004-afb6-6f39b73a6230 req-3d4a7521-617e-4bd2-b8ab-98e172efaa29 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:03.285241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6b7aa68f-82e3-4004-afb6-6f39b73a6230 req-3d4a7521-617e-4bd2-b8ab-98e172efaa29 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:03.285690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6b7aa68f-82e3-4004-afb6-6f39b73a6230 req-3d4a7521-617e-4bd2-b8ab-98e172efaa29 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:03.340596 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6b7aa68f-82e3-4004-afb6-6f39b73a6230 req-3d4a7521-617e-4bd2-b8ab-98e172efaa29 service nova] Creating event network-changed:d3a654b9-62ac-48b8-9349-843d9100fa18 for instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 on nch2-master-1 Oct 01 20:52:03.358314 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6b7aa68f-82e3-4004-afb6-6f39b73a6230 req-3d4a7521-617e-4bd2-b8ab-98e172efaa29 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135696 Oct 01 20:52:03.360097 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 364/744] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:03.410644 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b6089c9-3d9d-4018-a205-f8c2d4c59f9f tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/7853f9d0-e79c-4036-b6ac-9e0c46a5064c" status: 202 len: 0 microversion: 2.1 time: 3.170685 Oct 01 20:52:03.412198 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 381/745] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:52:00 2022] DELETE /compute/v2.1/os-floating-ips/7853f9d0-e79c-4036-b6ac-9e0c46a5064c => generated 0 bytes in 3173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:03.415564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:03.417879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:03.418872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:03.428348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:03.435153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:03.438111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:03.439055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:03.442976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:03.444875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:03.449036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:03.449631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:03.453699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:03.454223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:03.456442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:03.458986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:03.460274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:04.056840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:04.067195 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6844f63c-f9d1-477e-b8ad-5f164adc2518 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1476 microversion: 2.1 time: 0.653636 Oct 01 20:52:04.067802 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 382/746] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:03 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1476 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:04.086199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:04.087185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:04.104016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:04.104981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:04.107056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:04.109471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:04.112184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:04.114101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:04.191361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:04.219433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:04.222722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:04.224256 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-03cce728-b786-422a-96b2-4197f637e7d6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1543 microversion: 2.25 time: 0.862567 Oct 01 20:52:04.225537 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 365/747] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:03 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1543 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:04.231019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45d95df8-77b9-4383-ad37-5ddd598fc086 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45d95df8-77b9-4383-ad37-5ddd598fc086 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Request method failure captured: Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action HTTP/1.1 Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 34 Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKgx4OD85fe47rWLoeI50CXe0E8Ci10hA1GZWNckDmfWGlzAzxASj8-7tsWH2kqM7YhHYjlnJx2DOu-LHTudVdGoXikQfW3Z4SGaiYKcMqc7Llt4OkJfgIy4qDsVPg4kFt56wSzgdM5Uie90n2ZD37RhLLYbBeFaYDBcd5P231-5NJQ Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:52:04.235492 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bbd3b538b14a4f77a6a50e9fbe849427", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}] Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 50d13e9e2afc44fd91caf096922460ed Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: {"addFloatingIp": {"address": ""}} Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:52:04.237061 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '87ad1478-bbd3-461f-ade4-dac84f2b76c5', 'body': {'addFloatingIp': {'address': ''}}} Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '' Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:04.237977 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:52:04.239567 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:52:04.241266 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 01 20:52:04.241266 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:04.241266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45d95df8-77b9-4383-ad37-5ddd598fc086 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:04.241266 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45d95df8-77b9-4383-ad37-5ddd598fc086 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action" status: 400 len: 142 microversion: 2.1 time: 0.010206 Oct 01 20:52:04.241266 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 366/748] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:52:04 2022] POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action => generated 142 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:52:04.248368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:04.249244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:04.260711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:04.261499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:04.262343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:04.263633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:04.264437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:04.265037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:04.959153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:04.975386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:04.983223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:04.994394 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-479d757e-0b27-43b0-9aa6-18915a513b56 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.914643 Oct 01 20:52:05.011438 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 383/749] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:04 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:05.035293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:05.036324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:05.053948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:05.057392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:05.058439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:05.059779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:05.060803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:05.062887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:05.614976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:05.649026 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ced36175-24e0-4438-8937-978e67454321 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1310 microversion: 2.1 time: 1.406379 Oct 01 20:52:05.650260 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 367/750] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:04 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1310 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:05.655951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:05.658623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:05.671916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:05.672682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:05.673305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:05.683410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:05.686760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:05.691837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:05.702014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:05.712308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:05.722747 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a53a5680-761d-4702-8ad0-471cf3c24ffb tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1319 microversion: 2.1 time: 0.712684 Oct 01 20:52:05.740381 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 384/751] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:05 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1319 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:05.759061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3cee1d7b-e5c1-4b53-938e-ac3cd2e948bd tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '.version_select at 0x7f417386c280>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:05.766359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cee1d7b-e5c1-4b53-938e-ac3cd2e948bd tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:05.767739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cee1d7b-e5c1-4b53-938e-ac3cd2e948bd tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:05.768210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cee1d7b-e5c1-4b53-938e-ac3cd2e948bd tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:05.797858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:52:05.798388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquired lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:52:05.798561 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3cee1d7b-e5c1-4b53-938e-ac3cd2e948bd tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1701 microversion: 2.25 time: 0.054471 Oct 01 20:52:05.813139 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 385/752] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Oct 1 20:52:05 2022] GET /compute/v2.1/os-migrations => generated 1701 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:05.854989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bc865cd6-ea6e-426c-bd8d-403c021ae6fe tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Action: 'create', calling method: .version_select at 0x7f41738493a0>, body: {"keypair": {"name": "tempest-keypair-1367473008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBim43SNcfSWirgJ2aVOXtXQg2UfmG3veGHCmjkcGWTaZ0IyEJXTpAf/VnLCYzyaxvshksgww5nnjSNnScY8CBur0NCKhRVz75RKEFFQvdzqhSYH9uWw//R/GB1Obc32WA=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:05.914001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-bc865cd6-ea6e-426c-bd8d-403c021ae6fe tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Getting quotas for project bb36a4c325b54c8a964113ba5e52f47b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:05.943353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-bc865cd6-ea6e-426c-bd8d-403c021ae6fe tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Getting quotas for user 2aa4f468a15546eb9f72cb2b632e67bb and project bb36a4c325b54c8a964113ba5e52f47b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:06.070549 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bc865cd6-ea6e-426c-bd8d-403c021ae6fe tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.255928 Oct 01 20:52:06.081440 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 386/753] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Oct 1 20:52:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 267 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 01 20:52:06.087464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-1f168ee2-2e9d-47ed-b268-1166d4c00b1c req-9e312419-d03e-4a1f-8f6b-a4fe630611eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ddcd83-e345-4846-9f2e-2808c079168f", "name": "network-vif-plugged", "status": "completed", "tag": "f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:06.102876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Releasing lock "refresh_cache-87ad1478-bbd3-461f-ade4-dac84f2b76c5" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:52:06.103927 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] HTTP exception thrown: floating IP not found Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Request method failure captured: Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action HTTP/1.1 Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 41 Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKgx4OD85fe47rWLoeI50CXe0E8Ci10hA1GZWNckDmfWGlzAzxASj8-7tsWH2kqM7YhHYjlnJx2DOu-LHTudVdGoXikQfW3Z4SGaiYKcMqc7Llt4OkJfgIy4qDsVPg4kFt56wSzgdM5Uie90n2ZD37RhLLYbBeFaYDBcd5P231-5NJQ Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:52:06.105973 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bbd3b538b14a4f77a6a50e9fbe849427", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}] Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 50d13e9e2afc44fd91caf096922460ed Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:52:06.107902 ncdv-master-1 devstack@n-api.service[140438]: exception: floating IP not found Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '87ad1478-bbd3-461f-ade4-dac84f2b76c5', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:06.109104 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 01 20:52:06.110656 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:06.115798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Returning 404 to user: floating IP not found {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:06.117569 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-729b9edd-5f24-4c72-a0a1-2d27e2dd84d7 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action" status: 404 len: 67 microversion: 2.1 time: 0.466088 Oct 01 20:52:06.118355 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 368/754] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:52:05 2022] POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action => generated 67 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:52:06.133079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:06.133465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1f168ee2-2e9d-47ed-b268-1166d4c00b1c req-9e312419-d03e-4a1f-8f6b-a4fe630611eb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:06.134161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1f168ee2-2e9d-47ed-b268-1166d4c00b1c req-9e312419-d03e-4a1f-8f6b-a4fe630611eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:06.135808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1f168ee2-2e9d-47ed-b268-1166d4c00b1c req-9e312419-d03e-4a1f-8f6b-a4fe630611eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:06.138253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:06.156950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:06.161166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:06.161934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:06.163586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:06.164726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:06.168312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:06.171247 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-1f168ee2-2e9d-47ed-b268-1166d4c00b1c req-9e312419-d03e-4a1f-8f6b-a4fe630611eb service nova] Creating event network-vif-plugged:f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9 for instance 28ddcd83-e345-4846-9f2e-2808c079168f on nch2-master-1 Oct 01 20:52:06.198230 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-1f168ee2-2e9d-47ed-b268-1166d4c00b1c req-9e312419-d03e-4a1f-8f6b-a4fe630611eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115178 Oct 01 20:52:06.203704 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 387/755] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:06.218245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:06.221685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:06.239611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:06.241307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:06.242562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:06.246015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:06.264732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:06.268577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:06.838010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:52:06.888682 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-89175307-3cd7-4bf4-ad05-dbad16ffea6d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 2035 microversion: 2.25 time: 0.680042 Oct 01 20:52:06.897426 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 388/756] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:06 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 2035 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:06.911609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:06.913998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:06.945650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:06.948162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:06.948636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:06.955411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:06.957093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:06.958174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:07.144671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:07.154369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:07.163284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:07.171362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:07.177168 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9f32341b-2d16-4bc7-a525-9c6dce35ca43 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.278555 Oct 01 20:52:07.178002 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 389/757] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:06 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:07.202873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a296ced9-8b8d-43b8-9598-83a70d6255c0 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Action: 'action', calling method: .version_select at 0x7f4179492f70>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:07.212721 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4a6ac6e-16d5-4c44-8dce-831840ba40f7 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1476 microversion: 2.1 time: 1.086513 Oct 01 20:52:07.219294 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 369/758] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:06 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1476 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:07.254452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:07.255118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:07.278993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:07.282911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:07.283401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:07.290236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:07.290771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:07.291221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:07.350410 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-a296ced9-8b8d-43b8-9598-83a70d6255c0 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a296ced9-8b8d-43b8-9598-83a70d6255c0 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Request method failure captured: Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action HTTP/1.1 Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 44 Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKgx4OD85fe47rWLoeI50CXe0E8Ci10hA1GZWNckDmfWGlzAzxASj8-7tsWH2kqM7YhHYjlnJx2DOu-LHTudVdGoXikQfW3Z4SGaiYKcMqc7Llt4OkJfgIy4qDsVPg4kFt56wSzgdM5Uie90n2ZD37RhLLYbBeFaYDBcd5P231-5NJQ Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:52:07.353733 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bbd3b538b14a4f77a6a50e9fbe849427", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}] Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 50d13e9e2afc44fd91caf096922460ed Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:52:07.355529 ncdv-master-1 devstack@n-api.service[140437]: exception: Floating IP not found for address 0.0.0.0. Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '87ad1478-bbd3-461f-ade4-dac84f2b76c5', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:07.356527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 01 20:52:07.357954 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:07.361344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a296ced9-8b8d-43b8-9598-83a70d6255c0 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:07.364621 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a296ced9-8b8d-43b8-9598-83a70d6255c0 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action" status: 404 len: 88 microversion: 2.1 time: 0.185428 Oct 01 20:52:07.381970 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 390/759] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:52:07 2022] POST /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5/action => generated 88 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:52:07.400734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:07.402111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:07.422402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:07.423175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:07.423707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:07.426542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:07.428863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:07.430237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:07.632671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:07.656434 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-52a44ea8-ad33-4079-96dc-dc59548ff2cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1310 microversion: 2.1 time: 0.418453 Oct 01 20:52:07.674479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 370/760] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:07 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1310 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:07.682788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f8ee3c7-748c-4a11-8c81-dd0cd870d050 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Action: 'create', calling method: .version_select at 0x7f41739c1550>, body: {"keypair": {"name": "tempest-keypair-104867800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaDWJBcq9ZQi/ZlM9UjoyjQVESoHR23XtSUbnJBgIYncHHGVyoszohLjx9hpxg8eJ1vhKXmu+p2V8lTn1IWauqqD0HdjS9kqnOZ7Gpg60YN4c238hBWfpkGORTiOI7RPw=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:07.707491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8f8ee3c7-748c-4a11-8c81-dd0cd870d050 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:07.714884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8f8ee3c7-748c-4a11-8c81-dd0cd870d050 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for user aa72870453cd4b958725801b842c7a28 and project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:07.766376 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8f8ee3c7-748c-4a11-8c81-dd0cd870d050 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.090211 Oct 01 20:52:07.768051 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 371/761] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Oct 1 20:52:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 01 20:52:07.778706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:07.779226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:07.806240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:07.807148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:07.807603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:07.809510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:07.810537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:07.812148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:07.812678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:07.821487 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f6003e49-8399-432a-ae50-edca49133dd0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1319 microversion: 2.1 time: 0.438151 Oct 01 20:52:07.841260 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 391/762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:07 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1319 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:07.889433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:52:08.025405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35cfc9ba-9d9d-4ccf-a472-ef6f573f6b2d tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "DELETE /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 204 len: 0 microversion: 2.1 time: 0.254471 Oct 01 20:52:08.031385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 372/763] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:52:07 2022] DELETE /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:52:08.036662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:08.037304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:08.051160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:08.051988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:08.052609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:08.053851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:08.054558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:08.055172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:08.218076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:08.218926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:08.225557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:08.226051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:08.226511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:08.227225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:08.227691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:08.228121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:08.465530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:08.480377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:08.493422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:08.499394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:08.508428 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-44d44825-210d-43dd-b8d1-fef361b6a4f5 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.294653 Oct 01 20:52:08.519728 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-58613e2a-4753-492e-9c6c-9a0aab623d2a tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1539 microversion: 2.1 time: 0.486652 Oct 01 20:52:08.520377 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 392/764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:08 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1539 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:52:08.524994 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 373/765] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:08 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:52:08.540248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-50d4f7ba-e37d-4ea9-8982-9fb1a2a35cd8 req-6bf9fbc5-d52d-4289-b99a-72e785705d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c88671-ff54-4647-96ce-a5fabf200cc6", "name": "network-vif-plugged", "status": "completed", "tag": "fa02211a-74c3-4a29-abe0-4a0d42899f3e"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:08.550844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:08.554613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:08.555277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-50d4f7ba-e37d-4ea9-8982-9fb1a2a35cd8 req-6bf9fbc5-d52d-4289-b99a-72e785705d62 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:08.556014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-50d4f7ba-e37d-4ea9-8982-9fb1a2a35cd8 req-6bf9fbc5-d52d-4289-b99a-72e785705d62 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:08.556681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-50d4f7ba-e37d-4ea9-8982-9fb1a2a35cd8 req-6bf9fbc5-d52d-4289-b99a-72e785705d62 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:08.569808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:08.570512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:08.571138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:08.572450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:08.574115 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-50d4f7ba-e37d-4ea9-8982-9fb1a2a35cd8 req-6bf9fbc5-d52d-4289-b99a-72e785705d62 service nova] Creating event network-vif-plugged:fa02211a-74c3-4a29-abe0-4a0d42899f3e for instance 45c88671-ff54-4647-96ce-a5fabf200cc6 on nch2-master-1 Oct 01 20:52:08.575447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:08.576233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:08.579737 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-50d4f7ba-e37d-4ea9-8982-9fb1a2a35cd8 req-6bf9fbc5-d52d-4289-b99a-72e785705d62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058207 Oct 01 20:52:08.581198 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 393/766] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:08.681832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:08.682561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:08.689631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:08.691871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:08.692510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:08.698725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:08.699475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:08.700075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:08.997006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:08.998596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:09.011448 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0af77f45-ae3a-40b9-9d47-ac6728ce0559 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1493 microversion: 2.1 time: 0.332916 Oct 01 20:52:09.012193 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 394/767] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:08 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1493 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:09.022452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:09.024455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:09.038426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c2cc48a3-4792-4750-b071-6693857c2624 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1476 microversion: 2.1 time: 0.512257 Oct 01 20:52:09.039112 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 374/768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:08 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1476 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:09.057733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:09.058670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:09.059319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:09.060239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:09.060858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:09.061444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:09.267450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cfc335e5-9ff5-4547-b7e4-88b5bf521583 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:09.270060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cfc335e5-9ff5-4547-b7e4-88b5bf521583 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:09.282127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfc335e5-9ff5-4547-b7e4-88b5bf521583 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:09.284818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfc335e5-9ff5-4547-b7e4-88b5bf521583 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:09.285597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfc335e5-9ff5-4547-b7e4-88b5bf521583 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:09.286961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfc335e5-9ff5-4547-b7e4-88b5bf521583 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:09.291142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfc335e5-9ff5-4547-b7e4-88b5bf521583 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:09.295757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfc335e5-9ff5-4547-b7e4-88b5bf521583 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:09.511831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:09.520726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:09.531634 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2cd24edb-fb35-4313-9192-b16d5f20f5e5 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1319 microversion: 2.1 time: 0.518278 Oct 01 20:52:09.541245 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 395/769] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:09 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:09.546666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-929191829", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "12d7103d-edfb-4a23-910a-cdf237f7b03d"}, {"port": "6f2ebed3-0185-425f-97ad-a2760826ab42", "tag": "port-1"}, {"port": "763cb4a6-c74b-499d-b2d2-9e97df7f57dd", "tag": "port-2"}, {"uuid": "9f9b7a39-3d7f-4272-adc7-c6413bb5887c", "tag": "net-1"}, {"uuid": "9f9b7a39-3d7f-4272-adc7-c6413bb5887c"}, {"uuid": "473e1d8a-e841-4210-84d4-edb57f3978ba", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "473e1d8a-e841-4210-84d4-edb57f3978ba", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ea35f176-da9d-49b3-9ff6-4dce9e05b3c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e3be1f38-f8d0-4c82-a901-0c7a1abac289", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d4764752-297f-4f5f-bd4a-009489d9151b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--264585045"}], "key_name": "tempest-keypair-1367473008", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:09.764725 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cfc335e5-9ff5-4547-b7e4-88b5bf521583 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1644 microversion: 2.1 time: 0.721975 Oct 01 20:52:09.782592 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 375/770] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:09 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1644 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:09.789952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:09.791202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:09.798619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:09.800480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:09.802037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:09.802037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:09.802346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:09.803047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:09.816527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] validate_networks() for [('12d7103d-edfb-4a23-910a-cdf237f7b03d', None, None, None, None, None), (None, None, '6f2ebed3-0185-425f-97ad-a2760826ab42', None, None, None), (None, None, '763cb4a6-c74b-499d-b2d2-9e97df7f57dd', None, None, None), ('9f9b7a39-3d7f-4272-adc7-c6413bb5887c', None, None, None, None, None), ('9f9b7a39-3d7f-4272-adc7-c6413bb5887c', None, None, None, None, None), ('473e1d8a-e841-4210-84d4-edb57f3978ba', '10.2.2.100', None, None, None, None), ('473e1d8a-e841-4210-84d4-edb57f3978ba', '10.2.2.200', None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:52:09.999127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:10.011064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:10.024316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:10.055057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2c3669d-b54d-4597-a989-fa9f17fc9cca tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1544 microversion: 2.91 time: 0.270244 Oct 01 20:52:10.074335 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 376/771] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:09 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1544 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:10.080796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:10.081643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:10.089372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:10.089983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:10.090590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:10.091417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:10.091986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:10.092573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:10.986527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d13e9e2afc44fd91caf096922460ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3b538b14a4f77a6a50e9fbe849427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:10.995037 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1cb5991b-8d99-416c-be54-fb747f6d5012 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 200 len: 1539 microversion: 2.1 time: 0.919252 Oct 01 20:52:10.995695 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 377/772] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:10 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 1539 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:11.000018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-451eb056-6be7-4398-8eb0-b8f4d12df5ce tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:11.000689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-451eb056-6be7-4398-8eb0-b8f4d12df5ce tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:11.006660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-451eb056-6be7-4398-8eb0-b8f4d12df5ce tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:11.007240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-451eb056-6be7-4398-8eb0-b8f4d12df5ce tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:11.007745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-451eb056-6be7-4398-8eb0-b8f4d12df5ce tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:11.008700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-451eb056-6be7-4398-8eb0-b8f4d12df5ce tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:11.009237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-451eb056-6be7-4398-8eb0-b8f4d12df5ce tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:11.009759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-451eb056-6be7-4398-8eb0-b8f4d12df5ce tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:11.598094 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-451eb056-6be7-4398-8eb0-b8f4d12df5ce tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1644 microversion: 2.1 time: 0.601262 Oct 01 20:52:11.599720 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 378/773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:10 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1644 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:11.605418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:11.606041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:11.613191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:11.613694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:11.614139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:11.615131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:11.615795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:11.616310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:11.886355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:11.896760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-22302e1d-e08d-4cab-a333-25a9b41e53f0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1476 microversion: 2.1 time: 0.295730 Oct 01 20:52:11.897336 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 379/774] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:11 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1476 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:11.902386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-370899747", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "e94323fd-d911-423e-a839-fc9242e1930f"}], "security_groups": [{"name": "tempest-securitygroup--1099198688"}], "key_name": "tempest-keypair-104867800", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:12.115061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] validate_networks() for [('e94323fd-d911-423e-a839-fc9242e1930f', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:52:12.827139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:52:12.827898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:52:12.828275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:52:12.829044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:52:12.829796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:52:12.832732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:12.844798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:12.845808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:12.845808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:12.846480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:12.847289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:12.847816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:12.868558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:12.874440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for user aa72870453cd4b958725801b842c7a28 and project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:12.888340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:52:12.890644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:52:12.948696 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3df20dd5-0c4c-4a2e-b778-c9e5872eab85 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.048048 Oct 01 20:52:12.948696 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 380/775] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:52:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 20:52:12.953012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:12.953905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:12.960374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:12.961105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:12.961718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:12.962648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:12.963144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:12.963581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.218115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:13.231457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cbb86e49-18bb-4fcc-ae75-e915bba0547a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1469 microversion: 2.1 time: 0.282495 Oct 01 20:52:13.248149 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 381/776] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:12 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:13.257414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:13.258187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:13.265428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.266669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.267860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.269462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.270095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.270989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.411664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:13.425391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:13.427385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:13.435823 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6ac89c47-c4d6-4472-b9f2-dc2b461472f0 tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1531 microversion: 2.91 time: 0.186725 Oct 01 20:52:13.437852 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 382/777] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:13 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1531 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:13.444916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c56935e3-1480-4313-9820-aae84a224f99 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:13.450811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56935e3-1480-4313-9820-aae84a224f99 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.452633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56935e3-1480-4313-9820-aae84a224f99 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.453697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56935e3-1480-4313-9820-aae84a224f99 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.455048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56935e3-1480-4313-9820-aae84a224f99 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.455727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56935e3-1480-4313-9820-aae84a224f99 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.457630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56935e3-1480-4313-9820-aae84a224f99 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.498512 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c56935e3-1480-4313-9820-aae84a224f99 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059157 Oct 01 20:52:13.507367 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 383/778] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Oct 1 20:52:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:13.514076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-83627391-af55-461e-a993-7635c1443a57 req-c8a26d7b-679a-4287-afad-87cf81ef8894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ad1478-bbd3-461f-ade4-dac84f2b76c5", "name": "network-vif-deleted", "tag": "d3a654b9-62ac-48b8-9349-843d9100fa18"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:13.526230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-83627391-af55-461e-a993-7635c1443a57 req-c8a26d7b-679a-4287-afad-87cf81ef8894 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.527107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-83627391-af55-461e-a993-7635c1443a57 req-c8a26d7b-679a-4287-afad-87cf81ef8894 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.527955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-83627391-af55-461e-a993-7635c1443a57 req-c8a26d7b-679a-4287-afad-87cf81ef8894 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.549531 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-83627391-af55-461e-a993-7635c1443a57 req-c8a26d7b-679a-4287-afad-87cf81ef8894 service nova] Creating event network-vif-deleted:d3a654b9-62ac-48b8-9349-843d9100fa18 for instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 on nch2-master-1 Oct 01 20:52:13.556599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-83627391-af55-461e-a993-7635c1443a57 req-c8a26d7b-679a-4287-afad-87cf81ef8894 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047076 Oct 01 20:52:13.557970 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 384/779] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:13.569758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:13.571835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] [instance: 87ad1478-bbd3-461f-ade4-dac84f2b76c5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:13.581570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.583007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.583663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.584595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.585437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.586081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.604562 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] HTTP exception thrown: Instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 could not be found. Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Request method failure captured: Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 HTTP/1.1 Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKgx4OD85fe47rWLoeI50CXe0E8Ci10hA1GZWNckDmfWGlzAzxASj8-7tsWH2kqM7YhHYjlnJx2DOu-LHTudVdGoXikQfW3Z4SGaiYKcMqc7Llt4OkJfgIy4qDsVPg4kFt56wSzgdM5Uie90n2ZD37RhLLYbBeFaYDBcd5P231-5NJQ Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:52:13.606695 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bbd3b538b14a4f77a6a50e9fbe849427", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bbd3b538b14a4f77a6a50e9fbe849427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd3b538b14a4f77a6a50e9fbe849427"}]}] Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bbd3b538b14a4f77a6a50e9fbe849427 Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671 Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 50d13e9e2afc44fd91caf096922460ed Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:52:13.608488 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 could not be found. Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '87ad1478-bbd3-461f-ade4-dac84f2b76c5'} Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 could not be found. Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:13.609390 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 could not be found. Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 could not be found. Oct 01 20:52:13.611057 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:13.613566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] Returning 404 to user: Instance 87ad1478-bbd3-461f-ade4-dac84f2b76c5 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:13.613566 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80a3b62d-49b6-4a3f-90e6-03caa1027a06 tempest-FloatingIPsAssociationNegativeTestJSON-496466671 tempest-FloatingIPsAssociationNegativeTestJSON-496466671-project] 10.222.0.17 "GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5" status: 404 len: 111 microversion: 2.1 time: 0.051156 Oct 01 20:52:13.614179 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 385/780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:13 2022] GET /compute/v2.1/servers/87ad1478-bbd3-461f-ade4-dac84f2b76c5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:52:13.619608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:13.620648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:13.634607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.635089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.635609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.636592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.637374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.637848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.878477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:13.887483 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f009f72a-3d2f-447d-9536-5ce1ab9f34dc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1476 microversion: 2.1 time: 0.272053 Oct 01 20:52:13.889695 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 386/781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:13 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1476 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:13.903740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:13.904359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:13.913757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.914262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.914730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.915445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:13.918017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:13.918465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:13.929173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:14.030548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:14.051319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:14.052808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:14.053963 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a629009-3ce9-4913-8c32-2910086870f5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1336 microversion: 2.25 time: 0.160535 Oct 01 20:52:14.066922 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 387/782] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:13 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1336 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:14.301503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:52:14.303567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:52:14.304719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:52:14.306384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:52:14.307295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:52:14.327742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:14.328399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:14.328915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:14.329723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:14.330299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:14.330824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:14.331617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-138522604", "block_migration": true, "disk_over_commit": false}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:14.336206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:14.343059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:14.343727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:14.344359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:14.345661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:14.353319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Getting quotas for project bb36a4c325b54c8a964113ba5e52f47b. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:14.357762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:14.358589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:14.360446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Getting quotas for user 2aa4f468a15546eb9f72cb2b632e67bb and project bb36a4c325b54c8a964113ba5e52f47b. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:14.415340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lazy-loading 'flavor' on Instance uuid 45c88671-ff54-4647-96ce-a5fabf200cc6 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:52:14.453048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Going to try to live migrate instance to tempest-host-138522604 {{(pid=140438) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 20:52:14.469014 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] HTTP exception thrown: Compute host tempest-host-138522604 could not be found. Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Request method failure captured: Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6/action HTTP/1.1 Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 106 Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKhhkT30UDYhgY37FhRiZF2E7fpPT2e0MiuY4GP_34vlECo0rlpYj3Cn1mEFiTKMUaOCIkqlD_RWBDUiaOb802kzYuqddfwgp6qZ-QwrwsXQ_rGmcXfr-z25YZReiKB3Qtj6yk27BInmZKDwW1hElFSPKravCVqd2rj1_6H37Q1svaM Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 1ab469e2d1a04a368860f8a96492940f Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveMigrationNegativeTest-2120192844 Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:52:14.476000 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ab469e2d1a04a368860f8a96492940f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab469e2d1a04a368860f8a96492940f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ab469e2d1a04a368860f8a96492940f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab469e2d1a04a368860f8a96492940f"}]}] Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveMigrationNegativeTest-2120192844 Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 1ab469e2d1a04a368860f8a96492940f Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2120192844 Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveMigrationNegativeTest-2120192844-project-admin Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: dfd53627e013481fb9fb43b94d43db47 Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveMigrationNegativeTest-2120192844-project-admin Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: {"os-migrateLive": {"host": "tempest-host-138522604", "block_migration": true, "disk_over_commit": false}} Oct 01 20:52:14.477452 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: exception: Compute host tempest-host-138522604 could not be found. Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '45c88671-ff54-4647-96ce-a5fabf200cc6', 'body': {'os-migrateLive': {'host': 'tempest-host-138522604', 'block_migration': True, 'disk_over_commit': False}}} Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 20:52:14.478245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-138522604 could not be found. Oct 01 20:52:14.479457 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-138522604 could not be found. Oct 01 20:52:14.480663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-138522604 could not be found. Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Returning 400 to user: Compute host tempest-host-138522604 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:14.484317 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff5931a2-4e0c-4871-bc5a-531ddf4cc57a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6/action" status: 400 len: 99 microversion: 2.1 time: 0.419185 Oct 01 20:52:14.501173 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 388/783] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Oct 1 20:52:14 2022] POST /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6/action => generated 99 bytes in 444 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:52:14.517143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:14.517775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:14.538393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:14.539215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:14.540763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:14.542021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:14.543657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:14.548388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:14.672941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] Lazy-loading 'services' on Instance uuid 88ff8817-cf9a-4f27-a93e-7c1e847eda21 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:52:14.686526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:52:14.689392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ea35f176-da9d-49b3-9ff6-4dce9e05b3c8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e3be1f38-f8d0-4c82-a901-0c7a1abac289',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4764752-297f-4f5f-bd4a-009489d9151b',volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:52:14.704640 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f5788120-453b-42d2-ac35-b53b0ec2cc42 tempest-UnshelveToHostMultiNodesTest-1552301830 tempest-UnshelveToHostMultiNodesTest-1552301830-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1936 microversion: 2.91 time: 0.199769 Oct 01 20:52:14.705950 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 389/784] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:14 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1936 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:14.712661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:14.715690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:14.726633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:14.727290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:14.727816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:14.728625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:14.729323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:14.729854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:14.782022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lazy-loading 'flavor' on Instance uuid 28ddcd83-e345-4846-9f2e-2808c079168f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:52:14.788887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Going to try to live migrate instance to nch1-master-1 {{(pid=140438) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 20:52:15.279185 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1b85b5b4-d9fe-4fb1-ac73-5f732e43a16e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.736058 Oct 01 20:52:15.280426 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 396/785] 10.222.0.17 () {62 vars in 1189 bytes} [Sat Oct 1 20:52:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 5738 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 20:52:15.287749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:15.290318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:15.301639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:15.302977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:15.303617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:15.304517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:15.305146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:15.305737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:15.504910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:15.513232 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b8f47c14-c1c1-4134-a6fb-bcf27846f415 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1469 microversion: 2.1 time: 0.231446 Oct 01 20:52:15.513867 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 397/786] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:15 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:15.691052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-452ced83-242b-4ef9-ae35-bce1dee36b52 tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1880600768", "ram": 512, "vcpus": 1, "disk": 10, "id": 1940372646, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:15.714873 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-452ced83-242b-4ef9-ae35-bce1dee36b52 tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.199666 Oct 01 20:52:15.716293 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 398/787] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:52:15 2022] POST /compute/v2.1/flavors => generated 416 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:15.721459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:15.722405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:15.733345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:15.734767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:15.735444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:15.736405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:15.738120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:15.738999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:15.773165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:52:15.900311 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0a5d3c0c-518e-41e8-980d-4426c9b4d66b tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 204 len: 0 microversion: 2.91 time: 0.182352 Oct 01 20:52:15.901292 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 399/788] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:52:15 2022] DELETE /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:52:15.907801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:15.908517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:15.915114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:15.915834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:15.916462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:15.917644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:15.918268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:15.918912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:16.083436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:16.092894 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6d637a17-025a-4529-a5c1-2bf4cda7a7a8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1476 microversion: 2.1 time: 0.189441 Oct 01 20:52:16.093935 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 400/789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:15 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1476 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:16.111444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:16.112769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:16.119623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:16.120124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:16.120561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:16.121323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:16.121781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:16.122305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:16.286766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:16.301340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:16.303067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:16.304941 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9a0f6504-a68a-4b7a-9855-7fa0af9d453f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.209136 Oct 01 20:52:16.321441 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 401/790] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:16 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:16.333944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:16.335067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:16.342351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:16.343010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:16.343616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:16.344521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:16.345079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:16.345602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:16.548187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:16.565394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:16.571103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:16.572509 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-758d541f-8528-4790-b6a5-282f86433837 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1519 microversion: 2.42 time: 0.245604 Oct 01 20:52:16.575863 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 402/791] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:16 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:16.583622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-144017402", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:16.698199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:52:17.685113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:52:17.686175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:52:17.686939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:52:17.687595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:52:17.688171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:52:17.708394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:17.710253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:17.710612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:17.711758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:17.715207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:17.715871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:17.826815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Getting quotas for project 963f525498ef4ebdb9db327df62bd68a. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:17.844031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Getting quotas for user 04add76a65d74165b65189a5fd1f47ed and project 963f525498ef4ebdb9db327df62bd68a. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:17.869155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:52:17.872222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:52:17.926276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:17.970563 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6781c43a-4cef-4de7-9efd-63856d453610 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f/action" status: 202 len: 0 microversion: 2.1 time: 3.262658 Oct 01 20:52:17.971574 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bba5c545-c67c-4871-ad84-0472d9ce4940 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393114 Oct 01 20:52:17.972498 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 390/792] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:52:14 2022] POST /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f/action => generated 0 bytes in 3266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:17.978621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0153294d-660a-46b1-a269-b63cd3963e4f tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:17.980443 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 403/793] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:52:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:52:17.989650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:17.991965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:18.020222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.022051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.022918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:18.024020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.033491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.034685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:18.077584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0153294d-660a-46b1-a269-b63cd3963e4f tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1940372646/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078760 Oct 01 20:52:18.078314 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 391/794] 10.222.0.17 () {60 vars in 1224 bytes} [Sat Oct 1 20:52:17 2022] POST /compute/v2.1/flavors/1940372646/os-extra_specs => generated 66 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:18.089063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:18.089685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:18.126087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.126628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.127069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:18.127823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.128280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.128712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:18.208529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:18.220723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:18.223167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b61faa86ae0d4eedb371407380c22bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9de2ad3ad459794059338dd371e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:18.229941 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7e621931-e313-485f-a647-6eeffabf1e8f tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 200 len: 1537 microversion: 2.91 time: 0.247149 Oct 01 20:52:18.234637 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 404/795] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:17 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:18.240797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:18.241654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:18.249198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.250414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.251098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:18.251982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.253177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.253767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:18.781410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:18.791357 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b6f73ba-4ea7-483d-935a-9c18975b5c96 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1475 microversion: 2.1 time: 0.711755 Oct 01 20:52:18.791949 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 392/796] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:18 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1475 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:18.805812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:18.806451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:18.823425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.823935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.824370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:18.831186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.831717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.833568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:18.888298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:18.897850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:18.906288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:18.907684 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7bcb3158-b160-4a23-8fed-50c61763039b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.671782 Oct 01 20:52:18.908288 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 405/797] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:18 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:18.937278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:18.937832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:18.959235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.966170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.966998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:18.967837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:18.976472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:18.977177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:19.198779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:19.214695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:19.219272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:19.222780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92bcb7b8-e8f3-4ad4-8817-cd766ee8b1c5 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1593 microversion: 2.42 time: 0.427794 Oct 01 20:52:19.234669 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 393/798] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:18 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1593 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:19.246669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:19.250909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:19.270248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:19.271055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:19.272980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:19.274468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:19.278320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:19.278878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:19.510525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:19.522882 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-11f4952a-7bc1-43d0-9072-ccfa8f20f070 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1214 microversion: 2.1 time: 0.285363 Oct 01 20:52:19.524614 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 394/799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:19 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1214 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:19.761098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:19.781140 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f7d60ea7-bf75-48dd-b1cf-7d0b466602c6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1503 microversion: 2.1 time: 0.871589 Oct 01 20:52:19.783119 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 406/800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:18 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1503 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:19.789624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:19.790628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] [instance: 88ff8817-cf9a-4f27-a93e-7c1e847eda21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:19.803756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:19.806839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:19.813466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f3d3905c-f4d6-4f65-afbd-f476968bf7dc tempest-FlavorsExtraSpecsTestJSON-78478194 tempest-FlavorsExtraSpecsTestJSON-78478194-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:19.818785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:19.821385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:19.825440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:19.829497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:19.844491 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f3d3905c-f4d6-4f65-afbd-f476968bf7dc tempest-FlavorsExtraSpecsTestJSON-78478194 tempest-FlavorsExtraSpecsTestJSON-78478194-project] 10.222.0.17 "GET /compute/v2.1/flavors/1940372646/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.315162 Oct 01 20:52:19.845354 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 395/801] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Oct 1 20:52:19 2022] GET /compute/v2.1/flavors/1940372646/os-extra_specs => generated 66 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:19.859007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:19.863963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:19.871769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:19.872851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:19.873922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:19.875462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:19.876403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:19.877147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:19.881109 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] HTTP exception thrown: Instance 88ff8817-cf9a-4f27-a93e-7c1e847eda21 could not be found. Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Request method failure captured: Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 HTTP/1.1 Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKfIxJJqf8VZa0F57MYVPBKzGDF-zd4YSsFV7AKUJn7l8WR-mm7QVUosqkquGtdu9PyWWyJOZKekJPG74srGeD7BZXnOoVZ_kpRsMxcZtr3_l8IikRt3W5lpiNs2ZGcKDAOU0JCgWb65oQ_kjmSaWQubz4dZdkDE4AtAL3AwpcM100c Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Openstack-Nova-Api-Version: 2.91 Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: b2b9de2ad3ad459794059338dd371e0b Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-721485362 Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:52:19.898796 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b2b9de2ad3ad459794059338dd371e0b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b2b9de2ad3ad459794059338dd371e0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b2b9de2ad3ad459794059338dd371e0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b2b9de2ad3ad459794059338dd371e0b"}]}] Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-721485362 Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: b2b9de2ad3ad459794059338dd371e0b Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-721485362 Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-UnshelveToHostMultiNodesTest-721485362-project Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: b61faa86ae0d4eedb371407380c22bfe Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-721485362-project Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 88ff8817-cf9a-4f27-a93e-7c1e847eda21 could not be found. Oct 01 20:52:19.900656 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '88ff8817-cf9a-4f27-a93e-7c1e847eda21'} Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ff8817-cf9a-4f27-a93e-7c1e847eda21 could not be found. Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:19.901390 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ff8817-cf9a-4f27-a93e-7c1e847eda21 could not be found. Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ff8817-cf9a-4f27-a93e-7c1e847eda21 could not be found. Oct 01 20:52:19.903244 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:19.906108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] Returning 404 to user: Instance 88ff8817-cf9a-4f27-a93e-7c1e847eda21 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:19.906108 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eaf8c387-1374-49eb-8307-c5cbd72d2a5d tempest-UnshelveToHostMultiNodesTest-721485362 tempest-UnshelveToHostMultiNodesTest-721485362-project] 10.222.0.17 "GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21" status: 404 len: 111 microversion: 2.91 time: 0.116201 Oct 01 20:52:19.906108 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 407/802] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:19 2022] GET /compute/v2.1/servers/88ff8817-cf9a-4f27-a93e-7c1e847eda21 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:52:19.927945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e56973e4-9e20-408d-8cc6-3a7231228027 tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:19.995624 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e56973e4-9e20-408d-8cc6-3a7231228027 tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1940372646/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.090528 Oct 01 20:52:19.998712 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 408/803] 10.222.0.17 () {60 vars in 1224 bytes} [Sat Oct 1 20:52:19 2022] POST /compute/v2.1/flavors/1940372646/os-extra_specs => generated 66 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:20.009664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:20.013809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:20.024825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:20.027161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:20.028776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:20.030062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:20.032150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:20.034034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:20.634156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:20.650930 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bad507a8-9667-4873-8260-3890d7faba29 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1475 microversion: 2.1 time: 0.801150 Oct 01 20:52:20.654528 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 396/804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:19 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1475 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:20.664985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c5d18467-83f2-47f5-a40e-3b68eb0d63ac tempest-FlavorsExtraSpecsTestJSON-78478194 tempest-FlavorsExtraSpecsTestJSON-78478194-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:20.697992 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c5d18467-83f2-47f5-a40e-3b68eb0d63ac tempest-FlavorsExtraSpecsTestJSON-78478194 tempest-FlavorsExtraSpecsTestJSON-78478194-project] 10.222.0.17 "GET /compute/v2.1/flavors/1940372646/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.039623 Oct 01 20:52:20.698821 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 397/805] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 20:52:20 2022] GET /compute/v2.1/flavors/1940372646/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:20.713345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:20.715613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:20.729959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:20.731734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:20.732244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:20.734167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:20.734691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:20.735125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:20.755661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:20.772017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:20.774441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:20.775985 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e4f9236-c28d-4b46-8c43-f6c1d6fd7f0d tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.776121 Oct 01 20:52:20.779354 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 409/806] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:19 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:20.975418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5318c357-63c6-4c2c-83d5-a93255e67d8d tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Action: 'create', calling method: .version_select at 0x7f4173834ee0>, body: {"keypair": {"name": "tempest-keypair-1507767220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwqWWWOqNQQGeHIBFziHDRAxlpYY4Za/+zrpa3FQnja6TKTUFy1awTNJ6Jrs6nmvLBw5HoyA6BQSnnnUQJ4AwUdszgagpt92uvsi/Hz5LomPCY3zgistX2NEDqAzT8zcQ=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:21.001007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-5318c357-63c6-4c2c-83d5-a93255e67d8d tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:21.007468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-5318c357-63c6-4c2c-83d5-a93255e67d8d tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for user bba86a7a9dab49d191e553647250f279 and project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:21.057845 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5318c357-63c6-4c2c-83d5-a93255e67d8d tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.266471 Oct 01 20:52:21.067971 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 410/807] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:52:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:21.075514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:21.076150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:21.096406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:21.097158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:21.097638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:21.102763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:21.103675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:21.104268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:21.507352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:21.528060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:21.529981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:21.531199 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1affe85c-1348-455c-8f61-b62b22fe8447 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1593 microversion: 2.42 time: 0.828775 Oct 01 20:52:21.532125 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 398/808] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:20 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1593 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:21.546096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26c9e834-599f-4ab8-99fc-d51e9a8e3afa tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:21.594471 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26c9e834-599f-4ab8-99fc-d51e9a8e3afa tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1940372646/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.061133 Oct 01 20:52:21.595728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 399/809] 10.222.0.17 () {60 vars in 1224 bytes} [Sat Oct 1 20:52:21 2022] POST /compute/v2.1/flavors/1940372646/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:21.609454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e65ff829-5308-4794-a84e-8428059574aa req-cc3fb1b1-bcad-40e9-baf4-53db87aac5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee54a04f-6360-4f81-a7ba-68d65e8d8d36", "tag": "6c19a1ab-152a-407c-bec3-017d592a748b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:21.626895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e65ff829-5308-4794-a84e-8428059574aa req-cc3fb1b1-bcad-40e9-baf4-53db87aac5b5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:21.627681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e65ff829-5308-4794-a84e-8428059574aa req-cc3fb1b1-bcad-40e9-baf4-53db87aac5b5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:21.628303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e65ff829-5308-4794-a84e-8428059574aa req-cc3fb1b1-bcad-40e9-baf4-53db87aac5b5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:21.649070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e65ff829-5308-4794-a84e-8428059574aa req-cc3fb1b1-bcad-40e9-baf4-53db87aac5b5 service nova] Creating event network-changed:6c19a1ab-152a-407c-bec3-017d592a748b for instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 on nch1-master-1 Oct 01 20:52:21.655250 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e65ff829-5308-4794-a84e-8428059574aa req-cc3fb1b1-bcad-40e9-baf4-53db87aac5b5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057468 Oct 01 20:52:21.656248 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 400/810] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:21.662122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:21.663617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:21.671510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:21.672244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:21.672688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:21.673590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:21.674080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:21.674846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:22.094784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:22.106161 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-88f0ddda-8941-48d0-a9bd-3bb682919ba0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1318 microversion: 2.1 time: 1.041454 Oct 01 20:52:22.107562 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 411/811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:21 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1318 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:22.113960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4090f548-be0d-482d-8fe6-c283131d783d tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Calling method '.version_select at 0x7f41737c84c0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:22.124480 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4090f548-be0d-482d-8fe6-c283131d783d tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1507767220" status: 200 len: 497 microversion: 2.1 time: 0.015682 Oct 01 20:52:22.125638 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 412/812] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 20:52:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1507767220 => generated 497 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:22.139544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-81941d5c-cc45-4f65-b125-df56e8d1616f tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:22.152768 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-81941d5c-cc45-4f65-b125-df56e8d1616f tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1940372646/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025513 Oct 01 20:52:22.154267 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 413/813] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Oct 1 20:52:22 2022] GET /compute/v2.1/flavors/1940372646/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:22.160960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:22.162104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:22.174176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:22.175394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:22.176024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:22.176818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:22.177331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:22.177928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:22.225804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:22.236263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45c71d1e-1040-46f0-882a-5d17813c4490 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1503 microversion: 2.1 time: 0.578737 Oct 01 20:52:22.237767 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 401/814] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:21 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1503 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:22.243635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:22.245726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:22.253592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:22.254171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:22.254957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:22.256016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:22.256486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:22.256997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:22.777420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:22.789059 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b28a11d3-7764-412a-b9c7-f6f662a7cfb1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1475 microversion: 2.1 time: 0.632771 Oct 01 20:52:22.800118 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 414/815] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:22 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1475 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:22.816027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-bf1bc3b5-8330-4d00-8edc-a8b9d54df168 req-70c74af5-6f5f-4fa6-9794-ed34f2ad523d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2c58aa-4921-414b-95d6-d976a10c336b", "name": "network-vif-unplugged", "status": "completed", "tag": "91d3a9b8-4d83-45ba-9fcf-e81641ef7683"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:22.829059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bf1bc3b5-8330-4d00-8edc-a8b9d54df168 req-70c74af5-6f5f-4fa6-9794-ed34f2ad523d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:22.830354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bf1bc3b5-8330-4d00-8edc-a8b9d54df168 req-70c74af5-6f5f-4fa6-9794-ed34f2ad523d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:22.832126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bf1bc3b5-8330-4d00-8edc-a8b9d54df168 req-70c74af5-6f5f-4fa6-9794-ed34f2ad523d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:22.847804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:22.862264 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-bf1bc3b5-8330-4d00-8edc-a8b9d54df168 req-70c74af5-6f5f-4fa6-9794-ed34f2ad523d service nova] Creating event network-vif-unplugged:91d3a9b8-4d83-45ba-9fcf-e81641ef7683 for instance bd2c58aa-4921-414b-95d6-d976a10c336b on nch1-master-1 Oct 01 20:52:22.866197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:22.873091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-bf1bc3b5-8330-4d00-8edc-a8b9d54df168 req-70c74af5-6f5f-4fa6-9794-ed34f2ad523d service nova] Instance bd2c58aa-4921-414b-95d6-d976a10c336b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:52:22.873498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:22.879392 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-65abacbe-3a97-4b46-aa9e-ec664032000b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.638369 Oct 01 20:52:22.882124 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 402/816] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:22 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:22.885017 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-bf1bc3b5-8330-4d00-8edc-a8b9d54df168 req-70c74af5-6f5f-4fa6-9794-ed34f2ad523d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083153 Oct 01 20:52:22.886048 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 415/817] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:22.896818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b3377c51-f71b-4028-9a77-cf53461ef969 tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:22.896958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c857e6b-50b0-4a62-9e39-425750b08b45 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Calling method '.version_select at 0x7f41738c21f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:22.922978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:22.948621 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4c857e6b-50b0-4a62-9e39-425750b08b45 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507767220" status: 202 len: 0 microversion: 2.1 time: 0.063490 Oct 01 20:52:22.951668 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 403/818] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 20:52:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507767220 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:22.954399 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b3377c51-f71b-4028-9a77-cf53461ef969 tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1940372646/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.064962 Oct 01 20:52:22.955054 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 416/819] 10.222.0.17 () {60 vars in 1265 bytes} [Sat Oct 1 20:52:22 2022] PUT /compute/v2.1/flavors/1940372646/os-extra_specs/hw:numa_nodes => generated 22 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:22.967095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-765b9a3f-bf3b-4f13-abae-b6a442e585f8 req-5d22974e-f979-40ce-a9f2-7cdaa49a15c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e87f64-79a1-4ba9-872c-ae22c7846863", "tag": "997b440d-6bb5-41f4-9988-30ada9875cc0"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:22.987269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-765b9a3f-bf3b-4f13-abae-b6a442e585f8 req-5d22974e-f979-40ce-a9f2-7cdaa49a15c3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:22.988012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-765b9a3f-bf3b-4f13-abae-b6a442e585f8 req-5d22974e-f979-40ce-a9f2-7cdaa49a15c3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:22.988223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-765b9a3f-bf3b-4f13-abae-b6a442e585f8 req-5d22974e-f979-40ce-a9f2-7cdaa49a15c3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:22.989947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:22.993999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:23.008103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:23.008617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:23.011283 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-765b9a3f-bf3b-4f13-abae-b6a442e585f8 req-5d22974e-f979-40ce-a9f2-7cdaa49a15c3 service nova] Creating event network-changed:997b440d-6bb5-41f4-9988-30ada9875cc0 for instance 47e87f64-79a1-4ba9-872c-ae22c7846863 on nch1-master-1 Oct 01 20:52:23.011568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:23.012561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:23.014224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:23.023139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:23.024579 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-765b9a3f-bf3b-4f13-abae-b6a442e585f8 req-5d22974e-f979-40ce-a9f2-7cdaa49a15c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068296 Oct 01 20:52:23.026028 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 417/820] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:23.034604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e361aebd-9685-4b06-a775-4b819608182c tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Action: 'create', calling method: .version_select at 0x7f41737bd5e0>, body: {"keypair": {"name": "tempest-keypair-490752658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa0M62hDS0A/IlQWDUokmL1q/Uck9UnAVuEwhoeI5jOE76hMOnMv9fPyGxDbTtJTalmLhu2EFOE8FO1dJgWoTWzOKIMPo6jJ+jgAEWeYL5m7NhTSt3N0tbrszynh//1Cg=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:23.072489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e361aebd-9685-4b06-a775-4b819608182c tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:23.083099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e361aebd-9685-4b06-a775-4b819608182c tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for user bba86a7a9dab49d191e553647250f279 and project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:23.134298 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e361aebd-9685-4b06-a775-4b819608182c tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103298 Oct 01 20:52:23.134987 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 418/821] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:52:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:23.140444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f2ae7369-a97a-4ad5-9496-05c408390fad tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.157218 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f2ae7369-a97a-4ad5-9496-05c408390fad tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1940372646/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020617 Oct 01 20:52:23.158303 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 419/822] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Oct 1 20:52:23 2022] GET /compute/v2.1/flavors/1940372646/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:23.163852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.164604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:23.173140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:23.173699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:23.174141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:23.175467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:23.176575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:23.177020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:23.390153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:23.401762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:23.403329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:23.404557 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-83b887af-fae5-4c93-a05e-b6005db6e155 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1660 microversion: 2.42 time: 0.449348 Oct 01 20:52:23.405655 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 404/823] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:22 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1660 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:23.413094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0af210fc-4d57-4794-bc00-f00656a98cf9 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Calling method '.version_select at 0x7f41739c1670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.435574 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0af210fc-4d57-4794-bc00-f00656a98cf9 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-490752658" status: 202 len: 0 microversion: 2.1 time: 0.028660 Oct 01 20:52:23.436164 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 405/824] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 20:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-490752658 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:23.444468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc04a85e-aa50-40fb-92d0-c06006349a0e tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.461051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:DELETE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:23.473155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:23.476357 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc04a85e-aa50-40fb-92d0-c06006349a0e tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1940372646/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.038852 Oct 01 20:52:23.476951 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 406/825] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 20:52:23 2022] DELETE /compute/v2.1/flavors/1940372646/os-extra_specs/hw:numa_nodes => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:52:23.482984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.483886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:23.486938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:23.490533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:23.491260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:23.492307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:23.493562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:23.494243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:23.494933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:23.501827 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cc9ea528-2790-4da3-813d-2a038733da14 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1318 microversion: 2.1 time: 0.341581 Oct 01 20:52:23.504222 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 420/826] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:23 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:23.511612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-65cdfbbc-1905-45fd-998e-c383f1b1c113 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Action: 'create', calling method: .version_select at 0x7f41737c8670>, body: {"keypair": {"name": "tempest-keypair-1538467480", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:23.537317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-65cdfbbc-1905-45fd-998e-c383f1b1c113 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:23.547043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-65cdfbbc-1905-45fd-998e-c383f1b1c113 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for user bba86a7a9dab49d191e553647250f279 and project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:23.572758 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-65cdfbbc-1905-45fd-998e-c383f1b1c113 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.066941 Oct 01 20:52:23.573424 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 421/827] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:52:23 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:23.582361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5ee825ac-eadb-4b73-96bf-21aeabc7219c tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.603532 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5ee825ac-eadb-4b73-96bf-21aeabc7219c tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1940372646/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.027646 Oct 01 20:52:23.606572 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 422/828] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 20:52:23 2022] DELETE /compute/v2.1/flavors/1940372646/os-extra_specs/hw:cpu_policy => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 01 20:52:23.609193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-520d3d79-44f7-4d97-9a20-01f57360e430 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Calling method '.version_select at 0x7f41737bd040>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.628763 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-520d3d79-44f7-4d97-9a20-01f57360e430 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538467480" status: 202 len: 0 microversion: 2.1 time: 0.023051 Oct 01 20:52:23.629416 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 423/829] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 20:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538467480 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:23.638093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-46c31631-4093-45d5-97f4-0c4cc1803d3c tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.646338 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-46c31631-4093-45d5-97f4-0c4cc1803d3c tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1940372646/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015916 Oct 01 20:52:23.647295 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 424/830] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Oct 1 20:52:23 2022] GET /compute/v2.1/flavors/1940372646/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:23.653717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-26705967-d3ce-471d-be01-ef7874bc1245 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Action: 'create', calling method: .version_select at 0x7f41737663a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1680926888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjkUCKrVqGx33k1BrBktRZ6JqRj748NhhHZNd5n4CkTqNwyROxPYEQ+faYIOdDC00TUxBn59grUpyt6uZdwy2e0XocAHMjTW46QJXEVdGLhxpBbhj1cIKlTmTOB79Tsdw=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:23.662479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=85,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:23.672940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-26705967-d3ce-471d-be01-ef7874bc1245 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:23.679236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-26705967-d3ce-471d-be01-ef7874bc1245 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for user bba86a7a9dab49d191e553647250f279 and project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:23.708693 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-26705967-d3ce-471d-be01-ef7874bc1245 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.060206 Oct 01 20:52:23.718549 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 425/831] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:52:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:23.718549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e07926cf-1ffe-4f42-83d7-a6349d0a8a19 tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.743665 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e07926cf-1ffe-4f42-83d7-a6349d0a8a19 tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1940372646" status: 202 len: 0 microversion: 2.1 time: 0.033276 Oct 01 20:52:23.747568 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 426/832] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:52:23 2022] DELETE /compute/v2.1/flavors/1940372646 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:23.750885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d85cebb7-ff3b-417c-908c-845a800e05b5 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Action: 'create', calling method: .version_select at 0x7f417385b280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-966463820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXrzuJK5R2rBGsmcG/KH+ABvH/pryxwiqZidQ2C//180aA83tGNY4mfeUYKmTD3DwHwOd/g2Xs2K+l5+d2M353fZB8U60mXjGnrILWeXyOvAdGJbyvan/+y2H9nfceTUg=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:23.769023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-d85cebb7-ff3b-417c-908c-845a800e05b5 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:23.774300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:23.774873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-d85cebb7-ff3b-417c-908c-845a800e05b5 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for user bba86a7a9dab49d191e553647250f279 and project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:23.806511 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d85cebb7-ff3b-417c-908c-845a800e05b5 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.060113 Oct 01 20:52:23.814690 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 427/833] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:52:23 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:23.819473 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-388e2ec7-f0fd-48af-bb09-95addf034b9a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1503 microversion: 2.1 time: 0.341067 Oct 01 20:52:23.820117 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 407/834] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:23 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:23.826866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-22ae8346-b111-4f27-b661-d407e410291a tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.842282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:23.843880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:23.851877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:23.853064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:23.853669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:23.854592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:23.856457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:23.858642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:23.881052 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-22ae8346-b111-4f27-b661-d407e410291a tempest-FlavorsExtraSpecsTestJSON-217342065 tempest-FlavorsExtraSpecsTestJSON-217342065-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063384 Oct 01 20:52:23.881940 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 428/835] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:52:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:23.900069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6dfbf5ca-30a2-46a0-93e7-dad82a64e4ac tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Action: 'create', calling method: .version_select at 0x7f41737a01f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-856978465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0CS2zBEPl4RwEfc8x9rcQJ/gN5RwGDQqGGPy16sp2M9tcIg3cOVSXfaqTSsMZfyKHdGo54fuMXc8MgDj0FZeaTGOPV2Ew+l6131m0IqGNWV48IhO0rVTAYg26TJdQx4w=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:23.951806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-6dfbf5ca-30a2-46a0-93e7-dad82a64e4ac tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:23.958557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-6dfbf5ca-30a2-46a0-93e7-dad82a64e4ac tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Getting quotas for user bba86a7a9dab49d191e553647250f279 and project 4ae105e248b648f182d75d1eb8db51df. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:24.017182 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6dfbf5ca-30a2-46a0-93e7-dad82a64e4ac tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.131938 Oct 01 20:52:24.018557 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 429/836] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:52:23 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:24.024073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:24.031415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:24.051648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:24.052485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:24.065708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:24.067457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:24.069501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:24.070056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:24.481531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:24.484291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:24.494609 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b98eb55-ac9f-4652-9b2e-61ba1d7dc7aa tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1473 microversion: 2.1 time: 0.655932 Oct 01 20:52:24.496505 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 408/837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:23 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1473 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:24.515632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-de5c1c51-e193-43fd-b924-de8e668fc7c4 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Calling method '.version_select at 0x7f41738c2ca0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:24.525819 ncdv-master-1 devstack@n-api.service[140438]: WARNING oslo_db.sqlalchemy.utils [None req-de5c1c51-e193-43fd-b924-de8e668fc7c4 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 01 20:52:24.533707 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-de5c1c51-e193-43fd-b924-de8e668fc7c4 tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.035484 Oct 01 20:52:24.534624 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 409/838] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:52:24 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:24.541868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:24.543322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:24.552573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:24.553432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:24.554397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:24.555348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:24.556223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:24.556479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:24.556968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:24.560835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:24.575618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:24.581689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:24.584574 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-56bd26a5-f53c-436a-a119-6493666d8b93 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.563864 Oct 01 20:52:24.585453 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 430/839] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:24 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:24.602777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:24.603614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:24.616270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:24.616908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:24.617535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:24.618434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:24.619263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:24.619786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:24.872258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:24.903125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:24.905305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:24.907670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:24.909572 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f8e43df9-3a47-4531-a4e9-47adc92b900b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1694 microversion: 2.42 time: 0.373081 Oct 01 20:52:24.913771 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c13da324-05bf-4de8-ac21-b5ff3ff2a49c tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1318 microversion: 2.1 time: 0.325621 Oct 01 20:52:24.916434 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 431/840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:24 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:24.924169 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 410/841] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:24 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1694 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:24.926745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-64d73e79-e237-4242-bf19-a494606ab3ce tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Calling method '.version_select at 0x7f41737bb8b0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:24.939660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:24.941412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:24.950906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:24.951617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:24.952510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:24.953497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:24.955703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:24.956972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:24.969370 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-64d73e79-e237-4242-bf19-a494606ab3ce tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-856978465" status: 202 len: 0 microversion: 2.1 time: 0.051229 Oct 01 20:52:24.970409 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 432/842] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 20:52:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-856978465 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:24.979838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a77c30d3-0171-4054-96d6-1d999070c16b tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Calling method '.version_select at 0x7f41738aca60>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:25.017422 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a77c30d3-0171-4054-96d6-1d999070c16b tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-966463820" status: 202 len: 0 microversion: 2.1 time: 0.041840 Oct 01 20:52:25.024405 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 433/843] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 20:52:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-966463820 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:25.038722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3f1d1172-1dcd-4e78-9915-a9d668f68e5f tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] Calling method '.version_select at 0x7f417377c820>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:25.065608 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3f1d1172-1dcd-4e78-9915-a9d668f68e5f tempest-KeyPairsV2TestJSON-683676185 tempest-KeyPairsV2TestJSON-683676185-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1680926888" status: 202 len: 0 microversion: 2.1 time: 0.039430 Oct 01 20:52:25.070974 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 434/844] 10.222.0.17 () {58 vars in 1278 bytes} [Sat Oct 1 20:52:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1680926888 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:25.083799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-1b187e2d-3c12-4295-800b-f9fc01cae88d req-e1a15a46-0a7b-44e1-865b-1254d350b634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ddcd83-e345-4846-9f2e-2808c079168f", "name": "network-vif-unplugged", "status": "completed", "tag": "f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:25.107963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b187e2d-3c12-4295-800b-f9fc01cae88d req-e1a15a46-0a7b-44e1-865b-1254d350b634 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:25.110780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b187e2d-3c12-4295-800b-f9fc01cae88d req-e1a15a46-0a7b-44e1-865b-1254d350b634 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:25.112404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b187e2d-3c12-4295-800b-f9fc01cae88d req-e1a15a46-0a7b-44e1-865b-1254d350b634 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:25.140181 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-1b187e2d-3c12-4295-800b-f9fc01cae88d req-e1a15a46-0a7b-44e1-865b-1254d350b634 service nova] Creating event network-vif-unplugged:f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9 for instance 28ddcd83-e345-4846-9f2e-2808c079168f on nch2-master-1 Oct 01 20:52:25.145959 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-1b187e2d-3c12-4295-800b-f9fc01cae88d req-e1a15a46-0a7b-44e1-865b-1254d350b634 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077961 Oct 01 20:52:25.147025 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 435/845] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:25.355459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-531248104", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:25.432936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:52:25.446382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:25.456835 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71c3cb94-6d08-41ee-a780-b11a33164442 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1503 microversion: 2.1 time: 0.524258 Oct 01 20:52:25.457923 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 411/846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:24 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1503 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:25.523892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:25.524657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:25.537178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:25.537699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:25.538148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:25.542969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:25.543520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:25.543967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:26.555886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:26.565780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a732635-5187-4f69-a6d4-e69776151340 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1470 microversion: 2.1 time: 1.047910 Oct 01 20:52:26.571020 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 412/847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:25 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1470 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:26.577025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:26.577646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:26.584985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:26.585701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:26.586315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:26.587250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:26.587866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:26.588620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:26.725084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:52:26.725084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:52:26.725084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:52:26.725084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:52:26.725084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:52:26.740550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:26.741546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:26.742140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:26.747535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:26.748246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:26.748870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:26.799215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Getting quotas for project a1c660e5e0f14f16b4b2b43e89609bb2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:26.809214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Getting quotas for user 3245b8304f604cfc97da73b4dc884bd5 and project a1c660e5e0f14f16b4b2b43e89609bb2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:26.832217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:52:26.844463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:52:26.930847 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-53fd071a-8c82-4b59-bc23-c17c8227c447 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.751424 Oct 01 20:52:26.935051 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 436/848] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:52:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:52:26.944485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:26.945309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:26.953395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:26.954232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:26.955023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:26.956644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:26.957503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:26.958153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:27.149830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:27.162653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:27.166168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:27.168029 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38189760-c39f-43b7-bc38-4a9f72f1aff4 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.595233 Oct 01 20:52:27.185631 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 413/849] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:26 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:27.201844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:27.202513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:27.211251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:27.212209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:27.213079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:27.214285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:27.214990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:27.217333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:27.515529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:27.525252 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d1ecc8ed-e406-4e7a-bc08-c0d2493a7074 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1318 microversion: 2.1 time: 0.588752 Oct 01 20:52:27.525855 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 437/850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:26 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:27.550353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:27.551230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:27.559641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:27.560559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:27.561447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:27.562586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:27.563412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:27.564204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:27.638825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:27.660503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:27.662206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:27.663833 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bceee01d-165c-42db-964a-77bf5a992f20 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1740 microversion: 2.42 time: 0.467416 Oct 01 20:52:27.674917 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 414/851] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:27 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:27.691829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c372f6e-a8ef-4bde-b0c6-5f61712cb73e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:27.692391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c372f6e-a8ef-4bde-b0c6-5f61712cb73e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:27.709448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c372f6e-a8ef-4bde-b0c6-5f61712cb73e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:27.709941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c372f6e-a8ef-4bde-b0c6-5f61712cb73e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:27.712377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c372f6e-a8ef-4bde-b0c6-5f61712cb73e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:27.713305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c372f6e-a8ef-4bde-b0c6-5f61712cb73e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:27.713982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c372f6e-a8ef-4bde-b0c6-5f61712cb73e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:27.715199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c372f6e-a8ef-4bde-b0c6-5f61712cb73e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:27.850464 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c372f6e-a8ef-4bde-b0c6-5f61712cb73e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b/action" status: 204 len: 0 microversion: 2.1 time: 0.173916 Oct 01 20:52:27.855645 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 415/852] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:52:27 2022] POST /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b/action => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:52:27.879659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:27.880368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:27.902138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:27.903343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:27.904316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:27.905446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:27.906476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:27.907651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.189097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:28.215645 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-33734333-b983-4a41-81f2-d9bf60b67d9c tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1217 microversion: 2.1 time: 0.348484 Oct 01 20:52:28.217316 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 416/853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:27 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1217 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:28.234336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-aa7fae65-a3dc-465c-ac95-24eccc0b7f9e req-f88686e2-5918-4b89-a53f-5859e546a2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28ddcd83-e345-4846-9f2e-2808c079168f", "tag": "f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:28.235978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:28.246245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-aa7fae65-a3dc-465c-ac95-24eccc0b7f9e req-f88686e2-5918-4b89-a53f-5859e546a2a9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.247044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-aa7fae65-a3dc-465c-ac95-24eccc0b7f9e req-f88686e2-5918-4b89-a53f-5859e546a2a9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.247722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-aa7fae65-a3dc-465c-ac95-24eccc0b7f9e req-f88686e2-5918-4b89-a53f-5859e546a2a9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.261529 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-aa7fae65-a3dc-465c-ac95-24eccc0b7f9e req-f88686e2-5918-4b89-a53f-5859e546a2a9 service nova] Creating event network-changed:f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9 for instance 28ddcd83-e345-4846-9f2e-2808c079168f on nch2-master-1 Oct 01 20:52:28.262051 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d03069a7-4bc4-4ebf-963d-d0a4524e5e91 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1503 microversion: 2.1 time: 0.716820 Oct 01 20:52:28.262696 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 438/854] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:27 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1503 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:28.268018 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-aa7fae65-a3dc-465c-ac95-24eccc0b7f9e req-f88686e2-5918-4b89-a53f-5859e546a2a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049385 Oct 01 20:52:28.273215 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 417/855] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:28.279366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:28.280398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:28.288518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.289358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.290115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.291081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.291773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.292419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.641842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:28.654178 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bce64296-735b-4b3d-8c87-1c465f242172 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1470 microversion: 2.1 time: 0.377049 Oct 01 20:52:28.656267 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 418/856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:28 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1470 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:28.675093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d4259a48-147b-49e2-b5f8-b16f9a372886 req-56a9bc15-65a0-41f5-aa5b-ae0f68c55854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2c58aa-4921-414b-95d6-d976a10c336b", "name": "network-vif-plugged", "status": "completed", "tag": "91d3a9b8-4d83-45ba-9fcf-e81641ef7683"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:28.687273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d4259a48-147b-49e2-b5f8-b16f9a372886 req-56a9bc15-65a0-41f5-aa5b-ae0f68c55854 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.688712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d4259a48-147b-49e2-b5f8-b16f9a372886 req-56a9bc15-65a0-41f5-aa5b-ae0f68c55854 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.689665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d4259a48-147b-49e2-b5f8-b16f9a372886 req-56a9bc15-65a0-41f5-aa5b-ae0f68c55854 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.693974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-701800094", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": "none"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:28.707618 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d4259a48-147b-49e2-b5f8-b16f9a372886 req-56a9bc15-65a0-41f5-aa5b-ae0f68c55854 service nova] Creating event network-vif-plugged:91d3a9b8-4d83-45ba-9fcf-e81641ef7683 for instance bd2c58aa-4921-414b-95d6-d976a10c336b on nch1-master-1 Oct 01 20:52:28.714462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-d4259a48-147b-49e2-b5f8-b16f9a372886 req-56a9bc15-65a0-41f5-aa5b-ae0f68c55854 service nova] Instance bd2c58aa-4921-414b-95d6-d976a10c336b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:52:28.724129 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d4259a48-147b-49e2-b5f8-b16f9a372886 req-56a9bc15-65a0-41f5-aa5b-ae0f68c55854 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065631 Oct 01 20:52:28.726389 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 419/857] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:28.736171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:28.737585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:28.746079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.747420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.748292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.749208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.750191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.751667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.802332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:52:28.802803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:52:28.803315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:52:28.803731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:52:28.804179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:52:28.817733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=47 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:28.825333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.825880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.826250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.832693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.833403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.834008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.858220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Getting quotas for project ec1c1a8f4f8745388760db1428e4c1b5. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:28.864320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Getting quotas for user b3cecdbd13d74f4397e0f3f34b9d64f0 and project ec1c1a8f4f8745388760db1428e4c1b5. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:28.879004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:52:28.881517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:52:28.933258 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e24f177f-a949-448a-916f-617e6cf3e5cf tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.648362 Oct 01 20:52:28.934880 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 439/858] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 20:52:28.962949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:28.963587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:28.982853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.984187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.984990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:28.986009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:28.987297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:28.987940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:29.352202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.369472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.372450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.374029 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7c8c3ec-aa50-4bd9-91e4-8a915e923d27 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.646176 Oct 01 20:52:29.374626 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 420/859] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:28 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:29.380941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:29.382217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:29.390984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:29.392407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:29.393588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:29.395235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:29.395892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:29.396507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:29.448058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.458757 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-29ec1b37-c57e-4900-a2fd-bbf369570811 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1318 microversion: 2.1 time: 0.522551 Oct 01 20:52:29.460429 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 440/860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:28 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:29.469697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1556d0c3-9d88-448a-87cb-992226d7a25c tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:29.470433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1556d0c3-9d88-448a-87cb-992226d7a25c tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:29.473189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:29.607097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1556d0c3-9d88-448a-87cb-992226d7a25c tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.617501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1556d0c3-9d88-448a-87cb-992226d7a25c tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.619657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1556d0c3-9d88-448a-87cb-992226d7a25c tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.621259 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1556d0c3-9d88-448a-87cb-992226d7a25c tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2" status: 200 len: 1280 microversion: 2.47 time: 0.157168 Oct 01 20:52:29.637347 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 441/861] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:29 2022] GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:29.649705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:29.650652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:29.659378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:29.660113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:29.660786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:29.661747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:29.662541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:29.663597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:29.854224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.895506 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-edfc967c-1bfc-428a-af11-e5bd90dab172 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1271 microversion: 2.1 time: 0.246419 Oct 01 20:52:29.898187 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 442/862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:29 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:29.900575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.910248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:29.912569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.914021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:29.914514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:29.921359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:29.922181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:29.924309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:29.925311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:29.926009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:29.926728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:29.930411 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d8e73758-2cb9-4bb3-809b-16d1db7dc13d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1740 microversion: 2.42 time: 0.554691 Oct 01 20:52:29.931055 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 421/863] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:29 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1740 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:30.228044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-905966a8-5597-4f4b-85db-21e05b4c95d2 tempest-FlavorsV255TestJSON-52140128 tempest-FlavorsV255TestJSON-52140128-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-435360763", "id": 208271781, "os-flavor-access:is_public": "True"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:30.258287 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-905966a8-5597-4f4b-85db-21e05b4c95d2 tempest-FlavorsV255TestJSON-52140128 tempest-FlavorsV255TestJSON-52140128-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.326148 Oct 01 20:52:30.279067 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 422/864] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:52:29 2022] POST /compute/v2.1/flavors => generated 445 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:52:30.284542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:30.285102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:30.308965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:30.309785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:30.310253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:30.310981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:30.311438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:30.311866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:30.809768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:30.818256 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1fb4d992-1504-45d8-8237-6b7d64429739 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1503 microversion: 2.1 time: 0.918791 Oct 01 20:52:30.818861 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 443/865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:29 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1503 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:30.940536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-56566cbc-16bd-4105-b154-ef207d7e00c3 tempest-FlavorsV255TestJSON-389529931 tempest-FlavorsV255TestJSON-389529931-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:30.950569 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-56566cbc-16bd-4105-b154-ef207d7e00c3 tempest-FlavorsV255TestJSON-389529931 tempest-FlavorsV255TestJSON-389529931-project] 10.222.0.17 "GET /compute/v2.1/flavors/208271781" status: 200 len: 445 microversion: 2.55 time: 0.130469 Oct 01 20:52:30.951302 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 444/866] 10.222.0.17 () {60 vars in 1196 bytes} [Sat Oct 1 20:52:30 2022] GET /compute/v2.1/flavors/208271781 => generated 445 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:52:30.956493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:30.967317 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c8b25295-d249-4ca4-b42f-1e1e1aa4bd00 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1462 microversion: 2.1 time: 0.687030 Oct 01 20:52:30.972819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:30.975707 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 423/867] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:30 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1462 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:30.995639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:30.999385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:31.000005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:31.007473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.008419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.009133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.009977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.010255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.010502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.010987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.011463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.011827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.012303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.012753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.014361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.474705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:31.483482 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-25118d24-0608-479c-bfcf-58e1e06a4656 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1318 microversion: 2.1 time: 0.490849 Oct 01 20:52:31.484793 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 424/868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:30 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:31.490336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:31.491378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:31.499696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:31.507820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.508825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.510651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.511236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:31.512152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.512698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:31.513048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.514818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.519577 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3667bd3e-e804-42f1-8020-91d4a9be63fb tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.555032 Oct 01 20:52:31.522711 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 445/869] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:30 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:31.535888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f4030f82-ea4b-451c-95c8-3c1b0c962506 req-a9f1243f-cc56-4520-9d97-8139f9be678c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee54a04f-6360-4f81-a7ba-68d65e8d8d36", "name": "network-vif-plugged", "status": "completed", "tag": "6c19a1ab-152a-407c-bec3-017d592a748b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:31.556460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f4030f82-ea4b-451c-95c8-3c1b0c962506 req-a9f1243f-cc56-4520-9d97-8139f9be678c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.557598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f4030f82-ea4b-451c-95c8-3c1b0c962506 req-a9f1243f-cc56-4520-9d97-8139f9be678c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.562427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f4030f82-ea4b-451c-95c8-3c1b0c962506 req-a9f1243f-cc56-4520-9d97-8139f9be678c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.576552 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f4030f82-ea4b-451c-95c8-3c1b0c962506 req-a9f1243f-cc56-4520-9d97-8139f9be678c service nova] Creating event network-vif-plugged:6c19a1ab-152a-407c-bec3-017d592a748b for instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 on nch1-master-1 Oct 01 20:52:31.586417 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f4030f82-ea4b-451c-95c8-3c1b0c962506 req-a9f1243f-cc56-4520-9d97-8139f9be678c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062119 Oct 01 20:52:31.591359 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 446/870] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:31.597465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:31.598426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:31.604765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.605349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.605884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.608048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.608697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.609232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.673066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:31.685397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:31.687108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:31.688381 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4de23a03-a515-4d9f-927a-a15c414fbb2a tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2" status: 200 len: 1338 microversion: 2.47 time: 0.202331 Oct 01 20:52:31.689759 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 425/871] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:31 2022] GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 => generated 1338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:31.695426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ba90b93-2c3f-4c58-a031-d8f4a0e0bc31 tempest-FlavorsV255TestJSON-52140128 tempest-FlavorsV255TestJSON-52140128-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:31.727877 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ba90b93-2c3f-4c58-a031-d8f4a0e0bc31 tempest-FlavorsV255TestJSON-52140128 tempest-FlavorsV255TestJSON-52140128-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/208271781" status: 200 len: 446 microversion: 2.55 time: 0.036136 Oct 01 20:52:31.728755 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 426/872] 10.222.0.17 () {62 vars in 1216 bytes} [Sat Oct 1 20:52:31 2022] PUT /compute/v2.1/flavors/208271781 => generated 446 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:52:31.737796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:31.742630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:31.743333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:31.750953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.751393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.751872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.753165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.753672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.754137 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c7df0ace-4ea1-4be9-a039-10fbe6ad3049 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1271 microversion: 2.1 time: 0.160612 Oct 01 20:52:31.754266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.766904 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 447/873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:31 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:31.771402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:31.771402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:31.777048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.777564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.778168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:31.779039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:31.779504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:31.779933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:32.104522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:32.114712 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-99e68087-ba5d-4440-9879-95e90a7a5eea tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1462 microversion: 2.1 time: 0.350167 Oct 01 20:52:32.115305 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 448/874] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:31 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1462 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:32.128440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-382f5601-0e22-4617-87d1-a532e573e146 tempest-FlavorsV255TestJSON-389529931 tempest-FlavorsV255TestJSON-389529931-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:32.137516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:32.149630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:32.152290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:32.153727 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a8e402db-ad72-4007-8984-f949c360df8d tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1786 microversion: 2.42 time: 0.415205 Oct 01 20:52:32.154835 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 427/875] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:31 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1786 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:32.160984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:32.162032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:32.169593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:32.170302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:32.170993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:32.172195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:32.174268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:32.175138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:32.180958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:32.218331 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-382f5601-0e22-4617-87d1-a532e573e146 tempest-FlavorsV255TestJSON-389529931 tempest-FlavorsV255TestJSON-389529931-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.101508 Oct 01 20:52:32.219357 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 449/876] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Oct 1 20:52:32 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:32.224804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cc808e18-d131-4ff8-be51-23f00ced02a3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'create', calling method: .version_select at 0x7f41737bdca0>, body: {"keypair": {"name": "tempest-keypair-194715992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi8C2NrKQmJcRzEJHS/tQYO//iiefeYHniMl0yshuAkxbN9/73xgWFXYLxJ6GgYiIB6eFSMYFQ78x9Pax3PnfOhlbW18/7HaWJp8owxZ+6PHyt9XnLKsFbs94eHqWHp/A=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:32.247772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-cc808e18-d131-4ff8-be51-23f00ced02a3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:32.254195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-cc808e18-d131-4ff8-be51-23f00ced02a3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for user e5bfbc1e512a445ca7527f3d79e40d16 and project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:32.286110 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cc808e18-d131-4ff8-be51-23f00ced02a3 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065605 Oct 01 20:52:32.287128 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 450/877] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:52:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:32.292044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2a10ec1f-3433-4eab-b048-24829fbd0b70 tempest-FlavorsV255TestJSON-389529931 tempest-FlavorsV255TestJSON-389529931-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:32.322771 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2a10ec1f-3433-4eab-b048-24829fbd0b70 tempest-FlavorsV255TestJSON-389529931 tempest-FlavorsV255TestJSON-389529931-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.034235 Oct 01 20:52:32.323755 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 451/878] 10.222.0.17 () {60 vars in 1166 bytes} [Sat Oct 1 20:52:32 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:32.343224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e1215e85-ee88-4a16-a599-34cce3c037e5 tempest-FlavorsV255TestJSON-52140128 tempest-FlavorsV255TestJSON-52140128-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:32.368266 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e1215e85-ee88-4a16-a599-34cce3c037e5 tempest-FlavorsV255TestJSON-52140128 tempest-FlavorsV255TestJSON-52140128-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/208271781" status: 202 len: 0 microversion: 2.55 time: 0.029902 Oct 01 20:52:32.369472 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 452/879] 10.222.0.17 () {60 vars in 1199 bytes} [Sat Oct 1 20:52:32 2022] DELETE /compute/v2.1/flavors/208271781 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:52:32.381007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b4bed18-747d-4524-b1db-cb35f25ca637 tempest-FlavorsV255TestJSON-52140128 tempest-FlavorsV255TestJSON-52140128-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:32.412147 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b4bed18-747d-4524-b1db-cb35f25ca637 tempest-FlavorsV255TestJSON-52140128 tempest-FlavorsV255TestJSON-52140128-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.038170 Oct 01 20:52:32.413027 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 453/880] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Oct 1 20:52:32 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:32.516902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:32.518828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:32.537174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:32.539282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:32.540658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:32.541940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:32.543090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:32.543736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:32.695282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:32.706353 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05ef3e2d-827e-4d27-9610-37919538eebf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1503 microversion: 2.1 time: 0.549709 Oct 01 20:52:32.707969 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 428/881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:32 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1503 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:32.715979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:32.717157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:32.724545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:32.725340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:32.726030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:32.727013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:32.727708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:32.728346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.325686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.342056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.347347 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9ff19a02-77ce-49b9-8234-99f91d332efc tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1318 microversion: 2.1 time: 0.842649 Oct 01 20:52:33.368042 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 454/882] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:32 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1318 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:52:33.376711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.390103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.391477 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a7d7b380-f83b-4c82-a353-7d8c293ea3da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.681705 Oct 01 20:52:33.393441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:33.394130 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 429/883] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:32 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:33.406855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:33.407032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:33.407032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:33.411267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:33.415043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:33.415043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.415635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:33.417807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:33.418837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.421450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:33.421450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:33.423276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.425608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:33.431655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:33.432046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.541276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.551104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.553256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.554798 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3b056793-b511-43c4-b769-46338eb4e8dc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2" status: 200 len: 1338 microversion: 2.47 time: 0.198941 Oct 01 20:52:33.555694 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 455/884] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:33 2022] GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 => generated 1338 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:33.561453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:33.562323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:33.569026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:33.569738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:33.570344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.571223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:33.571835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:33.572414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.816916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.825789 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45240d2b-e62c-4425-8b6f-79df4840ef65 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1313 microversion: 2.1 time: 0.430325 Oct 01 20:52:33.826593 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 430/885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:33 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:33.843943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5a8ee2f2-1673-4e76-82e2-3e1c8c206ea1 req-04278b65-bdb7-4b01-899a-5932a785b46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e87f64-79a1-4ba9-872c-ae22c7846863", "name": "network-vif-plugged", "status": "completed", "tag": "997b440d-6bb5-41f4-9988-30ada9875cc0"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:33.856584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a8ee2f2-1673-4e76-82e2-3e1c8c206ea1 req-04278b65-bdb7-4b01-899a-5932a785b46a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:33.857075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a8ee2f2-1673-4e76-82e2-3e1c8c206ea1 req-04278b65-bdb7-4b01-899a-5932a785b46a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:33.857522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a8ee2f2-1673-4e76-82e2-3e1c8c206ea1 req-04278b65-bdb7-4b01-899a-5932a785b46a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.870413 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5a8ee2f2-1673-4e76-82e2-3e1c8c206ea1 req-04278b65-bdb7-4b01-899a-5932a785b46a service nova] Creating event network-vif-plugged:997b440d-6bb5-41f4-9988-30ada9875cc0 for instance 47e87f64-79a1-4ba9-872c-ae22c7846863 on nch1-master-1 Oct 01 20:52:33.875745 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5a8ee2f2-1673-4e76-82e2-3e1c8c206ea1 req-04278b65-bdb7-4b01-899a-5932a785b46a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047301 Oct 01 20:52:33.876582 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 431/886] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:33.882824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:33.883540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:33.890045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:33.890571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:33.891013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.891956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:33.892583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:33.893709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:33.898261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.911772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.915062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:33.917134 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e62a5528-328c-41ff-a30e-9ce3aa45c768 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1832 microversion: 2.42 time: 0.359373 Oct 01 20:52:33.918274 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 456/887] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:33 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1832 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:34.107763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:34.127921 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8cbcced-0d13-4789-aa52-0130211bf5f5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1503 microversion: 2.1 time: 0.249307 Oct 01 20:52:34.131303 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 432/888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:33 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:34.379155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:34.380093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:34.388435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:34.389127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:34.389728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:34.391778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:34.392404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:34.393055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:34.422441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:34.423088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:34.432414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:34.432916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:34.433365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:34.434087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:34.434573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:34.435502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:35.237420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:35.245126 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3d269831-412c-42a8-921c-df88677d7a55 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1318 microversion: 2.1 time: 0.872702 Oct 01 20:52:35.246058 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 457/889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:34 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1318 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:35.250642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:35.251247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:35.257079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:35.257573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:35.258006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:35.258964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:35.259418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:35.259834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:35.301416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:35.312485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:35.317358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:35.318548 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dd581ae6-008b-4eb5-872d-5c6926745ad0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1410 microversion: 2.25 time: 0.900000 Oct 01 20:52:35.320195 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 433/890] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:34 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1410 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:35.347972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-567fa9c0-00a5-4cb9-85de-c34704dda804 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '.version_select at 0x7f4173905670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:35.351891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-567fa9c0-00a5-4cb9-85de-c34704dda804 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:35.352396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-567fa9c0-00a5-4cb9-85de-c34704dda804 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:35.352842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-567fa9c0-00a5-4cb9-85de-c34704dda804 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:35.365402 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-567fa9c0-00a5-4cb9-85de-c34704dda804 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.022802 Oct 01 20:52:35.367856 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 434/891] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:52:35 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:35.376137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:35.377728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:35.386235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:35.387206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:35.387851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:35.389737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:35.390226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:35.391048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:35.391693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:35.401029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:35.406391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:35.407749 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-301df4d6-8669-4067-aa2a-05e71ba55ecc tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2" status: 200 len: 1359 microversion: 2.47 time: 0.160702 Oct 01 20:52:35.408765 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 458/892] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:35 2022] GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:35.415523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:35.418394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:35.427234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:35.428079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:35.430569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:35.433414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:35.434797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:35.436509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:35.947996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:35.960929 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d7e5e4c-7e63-4bdd-8f28-34e50a587191 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1313 microversion: 2.1 time: 0.585937 Oct 01 20:52:35.960929 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 435/893] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:35 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:35.972029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:35.977705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:35.991529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:35.992035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:35.992671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:35.993424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:35.994069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:35.994701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:36.049146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:36.076669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:36.078858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:36.080746 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5c969065-b20a-4f04-9b4e-8e07426c4ec0 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1832 microversion: 2.42 time: 0.669989 Oct 01 20:52:36.092626 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 459/894] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:35 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1832 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:36.102043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b4f0d3e3-3a06-4e3c-a6c7-2412a50dfe0a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:36.109074 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b4f0d3e3-3a06-4e3c-a6c7-2412a50dfe0a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013476 Oct 01 20:52:36.116824 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 460/895] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:52:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:36.116824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b950422f-7555-4a90-bfc5-ccf62d7da1ff tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1532611534"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:36.116824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b950422f-7555-4a90-bfc5-ccf62d7da1ff tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:36.123768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b950422f-7555-4a90-bfc5-ccf62d7da1ff tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:36.124256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b950422f-7555-4a90-bfc5-ccf62d7da1ff tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:36.124696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b950422f-7555-4a90-bfc5-ccf62d7da1ff tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:36.125415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b950422f-7555-4a90-bfc5-ccf62d7da1ff tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:36.125859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b950422f-7555-4a90-bfc5-ccf62d7da1ff tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:36.126281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b950422f-7555-4a90-bfc5-ccf62d7da1ff tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:36.130408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:36.340945 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b950422f-7555-4a90-bfc5-ccf62d7da1ff tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "POST /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2/action" status: 202 len: 52 microversion: 2.47 time: 0.229706 Oct 01 20:52:36.343883 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 461/896] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:52:36 2022] POST /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2/action => generated 52 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 01 20:52:36.352932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-35b7dc2d-3642-493f-85fc-bae420bf20c8 req-5921bba0-1c03-4bc2-94b1-97d9fbca86c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361e1137-8abf-43c9-866f-a04c644a7cb5", "tag": "4ec6d856-8127-478c-b1bb-08df9b750874"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:36.365097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-35b7dc2d-3642-493f-85fc-bae420bf20c8 req-5921bba0-1c03-4bc2-94b1-97d9fbca86c4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:36.365870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-35b7dc2d-3642-493f-85fc-bae420bf20c8 req-5921bba0-1c03-4bc2-94b1-97d9fbca86c4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:36.366669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-35b7dc2d-3642-493f-85fc-bae420bf20c8 req-5921bba0-1c03-4bc2-94b1-97d9fbca86c4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:36.387206 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-35b7dc2d-3642-493f-85fc-bae420bf20c8 req-5921bba0-1c03-4bc2-94b1-97d9fbca86c4 service nova] Creating event network-changed:4ec6d856-8127-478c-b1bb-08df9b750874 for instance 361e1137-8abf-43c9-866f-a04c644a7cb5 on nch2-master-1 Oct 01 20:52:36.395078 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-35b7dc2d-3642-493f-85fc-bae420bf20c8 req-5921bba0-1c03-4bc2-94b1-97d9fbca86c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049579 Oct 01 20:52:36.396071 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 462/897] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:36.401423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-918bef98-1ade-4f49-ac38-b04a8fadc04a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1663119833", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:36.424796 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-918bef98-1ade-4f49-ac38-b04a8fadc04a tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.027050 Oct 01 20:52:36.425979 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 463/898] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Oct 1 20:52:36 2022] POST /compute/v2.1/flavors => generated 499 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:36.438281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:36.439227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:36.452388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:36.453818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:36.454617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:36.456976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:36.457960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:36.459416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:36.545404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:36.553228 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-61855af0-370d-4f7f-8bad-f58203b08db3 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1493 microversion: 2.1 time: 0.593611 Oct 01 20:52:36.553794 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 436/899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:35 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1493 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:36.558213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:36.558835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:36.567257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:36.568490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:36.568946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:36.569654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:36.570284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:36.570748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.025516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.033624 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9cd5e867-955c-46e7-8ec0-612902fedb88 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1318 microversion: 2.1 time: 0.599525 Oct 01 20:52:37.034207 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 464/900] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:36 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:37.049005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:37.049604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:37.055854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.056402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.057020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.057741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.058240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.058730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.081586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.086988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:52:37.091569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.093063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.094446 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6c2c86b9-2b3c-456b-9e1c-d25730433745 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1606 microversion: 2.25 time: 0.539740 Oct 01 20:52:37.095963 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 437/901] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:36 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1606 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:37.108035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-afcd9df4-91da-47f8-9760-794b7450c7c0 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:37.123885 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-afcd9df4-91da-47f8-9760-794b7450c7c0 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026596 Oct 01 20:52:37.125003 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 438/902] 10.222.0.17 () {58 vars in 1182 bytes} [Sat Oct 1 20:52:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:52:37.265699 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-32187e01-031b-446a-8ddf-c79d6148d315 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "DELETE /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2" status: 204 len: 0 microversion: 2.47 time: 0.228420 Oct 01 20:52:37.270618 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 465/903] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:52:37 2022] DELETE /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:52:37.279206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-796e4b90-fed0-438b-b6af-fba92673b8c3 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '.version_select at 0x7f4173754310>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:37.284729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-796e4b90-fed0-438b-b6af-fba92673b8c3 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.285215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-796e4b90-fed0-438b-b6af-fba92673b8c3 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.285659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-796e4b90-fed0-438b-b6af-fba92673b8c3 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.295248 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-796e4b90-fed0-438b-b6af-fba92673b8c3 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.023520 Oct 01 20:52:37.295874 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 466/904] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:52:37 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:37.310576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:37.311116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:37.318283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.318816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.319424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.320138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.320603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.321035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.331582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Calling method '.version_select at 0x7f4173ab45e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:37.333729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.334230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.334706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.353682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.354165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.354661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.365856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.366337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.366857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.373050 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c06333f3-5717-43e6-b713-6bd815d08c6a tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.246734 Oct 01 20:52:37.373645 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 439/905] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:52:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:37.378179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:37.378814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:37.384849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.385362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.385800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.386509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.386969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.387393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.604393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.612589 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d62de7b5-8627-4b49-a187-508096f47384 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1313 microversion: 2.1 time: 0.306320 Oct 01 20:52:37.613186 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 467/906] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:37 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:37.618058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b7ac41d4-a78d-4c8e-b38c-ef35d1ef3530 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:37.618582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b7ac41d4-a78d-4c8e-b38c-ef35d1ef3530 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:37.624855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ac41d4-a78d-4c8e-b38c-ef35d1ef3530 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.625338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ac41d4-a78d-4c8e-b38c-ef35d1ef3530 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.626165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ac41d4-a78d-4c8e-b38c-ef35d1ef3530 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.626912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ac41d4-a78d-4c8e-b38c-ef35d1ef3530 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.627756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ac41d4-a78d-4c8e-b38c-ef35d1ef3530 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.628469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ac41d4-a78d-4c8e-b38c-ef35d1ef3530 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.725804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.737344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.738851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.740356 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35a2371d-288a-447c-8b8c-205d4f370941 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1853 microversion: 2.42 time: 0.365779 Oct 01 20:52:37.740930 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 440/907] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:37 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1853 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:37.747194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:37.748259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:37.757986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.758746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.759480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.760660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.761454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.761991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.811674 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b7ac41d4-a78d-4c8e-b38c-ef35d1ef3530 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.197195 Oct 01 20:52:37.812348 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 468/908] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Oct 1 20:52:37 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:52:37.822750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1234721855", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "94475597-5908-4582-897b-4fe8787d64c4"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:37.898261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:52:37.923335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.933992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.936140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:37.937583 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-647a3214-25f4-4378-8b38-2f8cea42d0c6 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2" status: 200 len: 1365 microversion: 2.47 time: 0.195431 Oct 01 20:52:37.938415 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 441/909] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:37 2022] GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:37.944598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e9b80836-b82d-4617-b1bf-b343c7d018a0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:37.945349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e9b80836-b82d-4617-b1bf-b343c7d018a0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:37.964807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9b80836-b82d-4617-b1bf-b343c7d018a0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.965418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9b80836-b82d-4617-b1bf-b343c7d018a0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.965944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9b80836-b82d-4617-b1bf-b343c7d018a0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:37.968238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9b80836-b82d-4617-b1bf-b343c7d018a0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:37.969298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9b80836-b82d-4617-b1bf-b343c7d018a0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:37.969865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9b80836-b82d-4617-b1bf-b343c7d018a0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:38.710409 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e9b80836-b82d-4617-b1bf-b343c7d018a0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1644 microversion: 2.1 time: 0.770921 Oct 01 20:52:38.711527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 442/910] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:37 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1644 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:38.848828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:38.875980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c162004-a721-4000-b1a5-01f5214ff4f5 tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] Calling method '.version_select at 0x7f41738dc0d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:38.878738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4c162004-a721-4000-b1a5-01f5214ff4f5 tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'bb9e693c893b44aeafd7aee7cf30613d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ae697418f542acb416e10094c204c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c162004-a721-4000-b1a5-01f5214ff4f5 tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] Request method failure captured: Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hypervisors/nch1-master-1/search HTTP/1.1 Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKiTAJpx4XUZO-8593oFqKNqlxxkpbACQN78CoymJLDQeF472A6ZHzaTVGkOksuQ-Y3AGwu55YHjpHeckFnIxkTxNSlDZd99UptcmKwr2e7xkx1IDUOSxoLAyzcayYRF8LZuQ52lA9UCJGAd-nYHIm3dm8PazLNb6KAwRuTAeMOcG2A Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 65ae697418f542acb416e10094c204c3 Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1807517738 Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:52:38.880756 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_65ae697418f542acb416e10094c204c3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65ae697418f542acb416e10094c204c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/65ae697418f542acb416e10094c204c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65ae697418f542acb416e10094c204c3"}]}] Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1807517738 Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 65ae697418f542acb416e10094c204c3 Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1807517738 Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: bb9e693c893b44aeafd7aee7cf30613d Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 01 20:52:38.882713 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'nch1-master-1'} Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:52:38.883565 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 01 20:52:38.884762 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:38.886968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c162004-a721-4000-b1a5-01f5214ff4f5 tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:38.886968 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4c162004-a721-4000-b1a5-01f5214ff4f5 tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.170046 Oct 01 20:52:38.888446 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 443/911] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Oct 1 20:52:38 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 176 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:52:38.893478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:38.894100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:38.905774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:38.906288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:38.907651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:38.909531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:38.910664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:38.911461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:38.941989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:52:38.942418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:52:38.943268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:52:38.943967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:52:38.944555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:52:38.966849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:38.967665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:38.968182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:38.969085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:38.969822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:38.970330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:38.991489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:38.997637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for user e5bfbc1e512a445ca7527f3d79e40d16 and project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:39.023274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:52:39.026200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:52:39.083072 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-134bbf42-f8a9-4f45-b56c-d6d68fa8021c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.269328 Oct 01 20:52:39.084423 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 469/912] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:52:39.090029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-fbe0de71-df32-4109-a2c2-3d9be671c9b3 req-1a2a3b5e-787f-40f2-ae09-8be97ac298ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "tag": "e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba"}, {"name": "network-changed", "server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "tag": "6f2ebed3-0185-425f-97ad-a2760826ab42"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:39.103443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fbe0de71-df32-4109-a2c2-3d9be671c9b3 req-1a2a3b5e-787f-40f2-ae09-8be97ac298ac service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:39.104079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fbe0de71-df32-4109-a2c2-3d9be671c9b3 req-1a2a3b5e-787f-40f2-ae09-8be97ac298ac service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:39.104611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fbe0de71-df32-4109-a2c2-3d9be671c9b3 req-1a2a3b5e-787f-40f2-ae09-8be97ac298ac service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:39.118573 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-fbe0de71-df32-4109-a2c2-3d9be671c9b3 req-1a2a3b5e-787f-40f2-ae09-8be97ac298ac service nova] Creating event network-changed:e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:52:39.119277 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-fbe0de71-df32-4109-a2c2-3d9be671c9b3 req-1a2a3b5e-787f-40f2-ae09-8be97ac298ac service nova] Creating event network-changed:6f2ebed3-0185-425f-97ad-a2760826ab42 for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:52:39.129505 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-fbe0de71-df32-4109-a2c2-3d9be671c9b3 req-1a2a3b5e-787f-40f2-ae09-8be97ac298ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043294 Oct 01 20:52:39.130127 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 470/913] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:39.135865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:39.148222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:39.155807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:39.156321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:39.156768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:39.157490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:39.157956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:39.158431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:39.266197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:39.276088 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b45d734d-c3cb-4683-8d2d-3270d85ed4b3 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1468 microversion: 2.1 time: 0.386585 Oct 01 20:52:39.295106 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 444/914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:38 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1468 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:39.302067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:39.302590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:39.326044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:39.326469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:39.327404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:39.327665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:39.328128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:39.328557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:39.686290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:39.705605 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-45a39b91-9668-46f3-916f-a8a92b7589d9 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1313 microversion: 2.1 time: 0.573913 Oct 01 20:52:39.706463 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 471/915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:39 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:39.712234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4007410b-56c3-474d-95ac-d69f7bceb062 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Calling method '.version_select at 0x7f4173834f70>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:39.713970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4007410b-56c3-474d-95ac-d69f7bceb062 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:39.714460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4007410b-56c3-474d-95ac-d69f7bceb062 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:39.714924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4007410b-56c3-474d-95ac-d69f7bceb062 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:39.725315 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-4007410b-56c3-474d-95ac-d69f7bceb062 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4007410b-56c3-474d-95ac-d69f7bceb062 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Request method failure captured: Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKiUGm_NO7pLuwsxCWgj1zkb3msJQ7GyrXr10t0b4UrTMab9OHFPABI--vgIJmDCsnJGaQiPReyKX9EajN5N7giZljBS6t4313O5O8tQXEMwQ98C70CIYmZALyCFTAGljGw-uDBk-1ry66yXRB-VNwjNWApMDluFg-h0HR7YFa_eNqU Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 308124c6e0594e5e8b0e8955f5bf9f35 Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-396685200 Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:52:39.727170 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_308124c6e0594e5e8b0e8955f5bf9f35", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/308124c6e0594e5e8b0e8955f5bf9f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/308124c6e0594e5e8b0e8955f5bf9f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/308124c6e0594e5e8b0e8955f5bf9f35"}]}] Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-396685200 Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 308124c6e0594e5e8b0e8955f5bf9f35 Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-396685200 Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: b627dc12e22b4c369eea7aab80e1d11b Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 01 20:52:39.729645 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:39.730631 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:39.732076 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:39.732076 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:39.732076 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:39.732076 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 01 20:52:39.732076 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:39.732076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4007410b-56c3-474d-95ac-d69f7bceb062 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:39.734105 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4007410b-56c3-474d-95ac-d69f7bceb062 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.024046 Oct 01 20:52:39.734105 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 472/916] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 20:52:39 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:52:39.746925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1375543778", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "e7712b88-b266-47cd-9f95-cfb0ee26fa9f"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:39.766957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:39.848659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] validate_networks() for [('e7712b88-b266-47cd-9f95-cfb0ee26fa9f', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:52:39.983866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:39.994664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:39.996721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:39.998097 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a021dc87-38d6-4d0f-b2c3-af8d6daada1c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1853 microversion: 2.42 time: 0.701793 Oct 01 20:52:39.998880 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 445/917] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:39 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1853 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:40.024911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:40.026987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:40.037972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.039334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.039980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.041344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.042017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.042652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.190546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:40.200763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:40.202588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:40.203954 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bee567aa-10db-4aec-b8eb-afb54f453229 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2" status: 200 len: 1365 microversion: 2.47 time: 0.203095 Oct 01 20:52:40.204616 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 446/918] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:39 2022] GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:40.209482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d16d38fd-143c-4214-b4d7-5f3581ef9a23 req-3f6220e4-2588-4c01-b9cc-781bac0756da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee54a04f-6360-4f81-a7ba-68d65e8d8d36", "tag": "6c19a1ab-152a-407c-bec3-017d592a748b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:40.222860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d16d38fd-143c-4214-b4d7-5f3581ef9a23 req-3f6220e4-2588-4c01-b9cc-781bac0756da service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.223466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d16d38fd-143c-4214-b4d7-5f3581ef9a23 req-3f6220e4-2588-4c01-b9cc-781bac0756da service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.224440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d16d38fd-143c-4214-b4d7-5f3581ef9a23 req-3f6220e4-2588-4c01-b9cc-781bac0756da service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.239110 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d16d38fd-143c-4214-b4d7-5f3581ef9a23 req-3f6220e4-2588-4c01-b9cc-781bac0756da service nova] Creating event network-changed:6c19a1ab-152a-407c-bec3-017d592a748b for instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 on nch1-master-1 Oct 01 20:52:40.245422 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d16d38fd-143c-4214-b4d7-5f3581ef9a23 req-3f6220e4-2588-4c01-b9cc-781bac0756da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039294 Oct 01 20:52:40.250008 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 447/919] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:40.255690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:40.256651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:40.264350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.265307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.265939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.267138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.267653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.268091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.433677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:40.438087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:40.444121 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e42b6c47-1349-40ef-a4ed-bc70beb8185a tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1331 microversion: 2.1 time: 0.192859 Oct 01 20:52:40.445384 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 448/920] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:40 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1331 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:40.461686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:40.462238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:40.470110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.470697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.471153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.471972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.472413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.481479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.514138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lazy-loading 'flavor' on Instance uuid 47e87f64-79a1-4ba9-872c-ae22c7846863 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:52:40.587455 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2f6e7420-d488-4b35-99e1-9f05528cf117 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863/action" status: 202 len: 0 microversion: 2.1 time: 0.139215 Oct 01 20:52:40.591174 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 449/921] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:52:40 2022] POST /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:40.593177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Calling method '.version_select at 0x7f4173b3e9d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:40.595004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.595563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.596577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.610735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.611267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.611710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.621692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.622186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.623086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.628947 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba0d8dae-da5e-4922-8ef6-4f450fb98ad5 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039526 Oct 01 20:52:40.629810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 450/922] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:52:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:40.639420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:40.640170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:40.643863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:40.647917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.648422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.648866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.649577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:40.650678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:40.651120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:40.998813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:52:40.999865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:52:41.000677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:52:41.002205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:52:41.003197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:52:41.013762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.014642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.015373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.016351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.017049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.018318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.057048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for project 237c6bad691343e7a7e64304f55e01e9. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:52:41.063372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for user a749a74841e840e2b8de67fb9562bf51 and project 237c6bad691343e7a7e64304f55e01e9. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:52:41.079424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:52:41.083065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:52:41.090868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:41.114912 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebb1fc8d-70ba-4c8b-9f5c-4c5ea18a53e0 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1476 microversion: 2.1 time: 0.484003 Oct 01 20:52:41.136365 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 451/923] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:40 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1476 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:41.141527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb687905-9cc0-4cbd-b142-3125bd6885fd tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] Calling method '.version_select at 0x7f41738a1c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:41.145502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eb687905-9cc0-4cbd-b142-3125bd6885fd tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'bb9e693c893b44aeafd7aee7cf30613d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ae697418f542acb416e10094c204c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:41.146339 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bf414f45-d4f4-44f8-af38-b5c1cd74e299 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411522 Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb687905-9cc0-4cbd-b142-3125bd6885fd tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] Request method failure captured: Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKiTAJpx4XUZO-8593oFqKNqlxxkpbACQN78CoymJLDQeF472A6ZHzaTVGkOksuQ-Y3AGwu55YHjpHeckFnIxkTxNSlDZd99UptcmKwr2e7xkx1IDUOSxoLAyzcayYRF8LZuQ52lA9UCJGAd-nYHIm3dm8PazLNb6KAwRuTAeMOcG2A Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 65ae697418f542acb416e10094c204c3 Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1807517738 Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:52:41.150215 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_65ae697418f542acb416e10094c204c3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65ae697418f542acb416e10094c204c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/65ae697418f542acb416e10094c204c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/65ae697418f542acb416e10094c204c3"}]}] Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1807517738 Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 65ae697418f542acb416e10094c204c3 Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1807517738 Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: bb9e693c893b44aeafd7aee7cf30613d Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 01 20:52:41.151591 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1'} Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:52:41.152335 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 01 20:52:41.153448 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:41.155439 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 473/924] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:52:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:52:41.157161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb687905-9cc0-4cbd-b142-3125bd6885fd tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:41.159485 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb687905-9cc0-4cbd-b142-3125bd6885fd tempest-HypervisorAdminNegativeUnderV252Test-1807517738 tempest-HypervisorAdminNegativeUnderV252Test-1807517738-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.021819 Oct 01 20:52:41.161615 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 452/925] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Oct 1 20:52:41 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:52:41.164069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:41.164318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:41.171744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.172377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.172659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:41.173046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.173284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:41.174577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.175464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.176119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.181112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.182585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.183489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.184740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.185360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.185954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.777977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:41.789347 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a185226c-132c-4e4a-9a10-7cb3faccc531 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1313 microversion: 2.1 time: 0.631487 Oct 01 20:52:41.791135 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 474/926] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:41 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:41.796497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:41.799870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:41.801285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:41.824810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:41.827684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:41.829330 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-549ee902-c0ea-4ed7-a446-24374caba8b8 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.663890 Oct 01 20:52:41.830562 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 453/927] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:41 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:41.841829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.842334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.842986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.851043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-50742c31-42fc-4b65-b04f-8339770a2b52 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Calling method '.version_select at 0x7f4173afaf70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:41.851940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.852526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.854568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.854707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50742c31-42fc-4b65-b04f-8339770a2b52 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.856815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50742c31-42fc-4b65-b04f-8339770a2b52 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.858576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50742c31-42fc-4b65-b04f-8339770a2b52 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.879210 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-50742c31-42fc-4b65-b04f-8339770a2b52 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] HTTP exception thrown: No hypervisor matching '5c8af330-0d0b-42f1-9318-fba934b3f78f' could be found. Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-50742c31-42fc-4b65-b04f-8339770a2b52 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Request method failure captured: Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-hypervisors/5c8af330-0d0b-42f1-9318-fba934b3f78f/servers HTTP/1.1 Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKiUGm_NO7pLuwsxCWgj1zkb3msJQ7GyrXr10t0b4UrTMab9OHFPABI--vgIJmDCsnJGaQiPReyKX9EajN5N7giZljBS6t4313O5O8tQXEMwQ98C70CIYmZALyCFTAGljGw-uDBk-1ry66yXRB-VNwjNWApMDluFg-h0HR7YFa_eNqU Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 308124c6e0594e5e8b0e8955f5bf9f35 Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-396685200 Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:52:41.880894 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_308124c6e0594e5e8b0e8955f5bf9f35", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/308124c6e0594e5e8b0e8955f5bf9f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/308124c6e0594e5e8b0e8955f5bf9f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/308124c6e0594e5e8b0e8955f5bf9f35"}]}] Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-396685200 Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 308124c6e0594e5e8b0e8955f5bf9f35 Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-396685200 Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: b627dc12e22b4c369eea7aab80e1d11b Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: exception: No hypervisor matching '5c8af330-0d0b-42f1-9318-fba934b3f78f' could be found. Oct 01 20:52:41.882434 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5c8af330-0d0b-42f1-9318-fba934b3f78f'} Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5c8af330-0d0b-42f1-9318-fba934b3f78f' could be found. Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:41.883355 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:41.884698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:41.884698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:41.884698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:41.884698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:41.884698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5c8af330-0d0b-42f1-9318-fba934b3f78f' could be found. Oct 01 20:52:41.884698 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:41.885796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-50742c31-42fc-4b65-b04f-8339770a2b52 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] Returning 404 to user: No hypervisor matching '5c8af330-0d0b-42f1-9318-fba934b3f78f' could be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:41.888222 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-50742c31-42fc-4b65-b04f-8339770a2b52 tempest-HypervisorAdminNegativeUnderV252Test-396685200 tempest-HypervisorAdminNegativeUnderV252Test-396685200-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/5c8af330-0d0b-42f1-9318-fba934b3f78f/servers" status: 404 len: 123 microversion: 2.1 time: 0.056502 Oct 01 20:52:41.899604 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 454/928] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Oct 1 20:52:41 2022] GET /compute/v2.1/os-hypervisors/5c8af330-0d0b-42f1-9318-fba934b3f78f/servers => generated 123 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:52:41.934631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-74feca9d-7ce2-4143-b2d3-6934031d4c6e req-90bfd37c-262f-47c8-9745-d2335909b69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "tag": "763cb4a6-c74b-499d-b2d2-9e97df7f57dd"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:41.963616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-74feca9d-7ce2-4143-b2d3-6934031d4c6e req-90bfd37c-262f-47c8-9745-d2335909b69f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:41.966752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-74feca9d-7ce2-4143-b2d3-6934031d4c6e req-90bfd37c-262f-47c8-9745-d2335909b69f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:41.967657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-74feca9d-7ce2-4143-b2d3-6934031d4c6e req-90bfd37c-262f-47c8-9745-d2335909b69f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:41.989231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-74feca9d-7ce2-4143-b2d3-6934031d4c6e req-90bfd37c-262f-47c8-9745-d2335909b69f service nova] Creating event network-changed:763cb4a6-c74b-499d-b2d2-9e97df7f57dd for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:52:42.006715 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-74feca9d-7ce2-4143-b2d3-6934031d4c6e req-90bfd37c-262f-47c8-9745-d2335909b69f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098443 Oct 01 20:52:42.009265 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 455/929] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:42.042605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:42.044771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:42.063745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:42.066393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:42.067021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:42.067703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:42.069842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:42.070337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:42.165370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:42.175871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:42.176416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:42.176731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:42.179582 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d09ce0fe-c63b-4b2c-92cb-90871bf37bfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1215 microversion: 2.1 time: 0.382782 Oct 01 20:52:42.180121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lazy-loading 'fault' on Instance uuid 066c9890-b991-4b11-9d7e-14a131ae5cf2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:52:42.181214 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 475/930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:41 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1215 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:42.193158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:42.196469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:42.216528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:42.218050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:42.219366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:42.222874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:42.225750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:42.226603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:42.421580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:42.431468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:42.433230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3cecdbd13d74f4397e0f3f34b9d64f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1a8f4f8745388760db1428e4c1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:42.435067 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a17d78a5-4140-45a2-b8d0-8b6277bf1900 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2" status: 200 len: 1370 microversion: 2.47 time: 0.423611 Oct 01 20:52:42.446529 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 456/931] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:42 2022] GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 => generated 1370 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:42.446529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:42.446529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:42.449663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:42.450423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:42.451063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:42.453134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:42.453768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:42.454358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:43.339055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:43.351360 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c820b64f-0829-40a3-9245-75a16fda2925 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1379 microversion: 2.1 time: 1.168267 Oct 01 20:52:43.352198 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 476/932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:42 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1379 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:43.372408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:43.374882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:43.401278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:43.401746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:43.403747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:43.405431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:43.409834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:43.410330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:43.513396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:43.526752 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ab6cea8-33bf-4759-a355-a43955c5b9d9 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1459 microversion: 2.1 time: 1.089516 Oct 01 20:52:43.527355 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 457/933] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:42 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1459 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:43.532773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:43.537962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:43.546022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:43.546782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:43.547522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:43.548271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:43.548852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:43.549302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:43.954390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:43.963853 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-79f5be09-4f8e-4c90-b0b9-a894579f8820 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1313 microversion: 2.1 time: 0.610385 Oct 01 20:52:43.964930 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 477/934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:43 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:43.988123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-33350654-f278-4e29-b14a-53b855805433 req-851a7ffe-0dde-4f7f-a4e3-19729229610b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361e1137-8abf-43c9-866f-a04c644a7cb5", "name": "network-vif-plugged", "status": "completed", "tag": "4ec6d856-8127-478c-b1bb-08df9b750874"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:44.002717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-33350654-f278-4e29-b14a-53b855805433 req-851a7ffe-0dde-4f7f-a4e3-19729229610b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.003482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-33350654-f278-4e29-b14a-53b855805433 req-851a7ffe-0dde-4f7f-a4e3-19729229610b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.004082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-33350654-f278-4e29-b14a-53b855805433 req-851a7ffe-0dde-4f7f-a4e3-19729229610b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.020926 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-33350654-f278-4e29-b14a-53b855805433 req-851a7ffe-0dde-4f7f-a4e3-19729229610b service nova] Creating event network-vif-plugged:4ec6d856-8127-478c-b1bb-08df9b750874 for instance 361e1137-8abf-43c9-866f-a04c644a7cb5 on nch2-master-1 Oct 01 20:52:44.047636 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-33350654-f278-4e29-b14a-53b855805433 req-851a7ffe-0dde-4f7f-a4e3-19729229610b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056741 Oct 01 20:52:44.053723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:44.055050 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 478/935] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:44.065184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:44.065643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:44.066555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:44.068464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:44.069672 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71c12c16-cc2e-4a14-9245-f7b8d370ed76 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.540888 Oct 01 20:52:44.075955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.077577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.079273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.081663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.082372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.083141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.083258 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 458/936] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:43 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:44.095309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4a02e954-453a-4894-92b1-9f6c5c7ded5a req-4a25318c-e9a1-4602-bf1e-f6603c3154b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1818557f-9772-403d-bfa8-d226f1063f2f", "tag": "1dee487a-adae-475f-aff1-35bf8657a7f3"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:44.107049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4a02e954-453a-4894-92b1-9f6c5c7ded5a req-4a25318c-e9a1-4602-bf1e-f6603c3154b7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.107593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4a02e954-453a-4894-92b1-9f6c5c7ded5a req-4a25318c-e9a1-4602-bf1e-f6603c3154b7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.108008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4a02e954-453a-4894-92b1-9f6c5c7ded5a req-4a25318c-e9a1-4602-bf1e-f6603c3154b7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.121010 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4a02e954-453a-4894-92b1-9f6c5c7ded5a req-4a25318c-e9a1-4602-bf1e-f6603c3154b7 service nova] Creating event network-changed:1dee487a-adae-475f-aff1-35bf8657a7f3 for instance 1818557f-9772-403d-bfa8-d226f1063f2f on nch1-master-1 Oct 01 20:52:44.127578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4a02e954-453a-4894-92b1-9f6c5c7ded5a req-4a25318c-e9a1-4602-bf1e-f6603c3154b7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041773 Oct 01 20:52:44.128738 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 459/937] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:44.134389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:44.135317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] [instance: 066c9890-b991-4b11-9d7e-14a131ae5cf2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:44.142334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.142866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.143376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.144577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.144980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.145423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.163532 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] HTTP exception thrown: Instance 066c9890-b991-4b11-9d7e-14a131ae5cf2 could not be found. Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Request method failure captured: Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 HTTP/1.1 Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKiLHWyfnt8xFBnyOy99oQKdo7UmdFzTzqOSnIBGviNZ8x_wNNniRdK6oCwjSu6T5VcCQ8XVNJs_-TciOGYjJUET6NUT9FTExbp-K2kuA3VgwtM3McQG7ZLH7g9ypeRo7-a8qYYi1u_Vtr4bkpGNjY8BkSIaHoN_11LrRV5gCboFAFk Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.47 Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ec1c1a8f4f8745388760db1428e4c1b5 Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersAaction247Test-1065315350 Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:52:44.165400 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec1c1a8f4f8745388760db1428e4c1b5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec1c1a8f4f8745388760db1428e4c1b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec1c1a8f4f8745388760db1428e4c1b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec1c1a8f4f8745388760db1428e4c1b5"}]}] Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersAaction247Test-1065315350 Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ec1c1a8f4f8745388760db1428e4c1b5 Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersAaction247Test-1065315350 Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersAaction247Test-1065315350-project Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: b3cecdbd13d74f4397e0f3f34b9d64f0 Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersAaction247Test-1065315350-project Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 066c9890-b991-4b11-9d7e-14a131ae5cf2 could not be found. Oct 01 20:52:44.167236 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '066c9890-b991-4b11-9d7e-14a131ae5cf2'} Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066c9890-b991-4b11-9d7e-14a131ae5cf2 could not be found. Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:44.168210 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066c9890-b991-4b11-9d7e-14a131ae5cf2 could not be found. Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066c9890-b991-4b11-9d7e-14a131ae5cf2 could not be found. Oct 01 20:52:44.169714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:44.171524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] Returning 404 to user: Instance 066c9890-b991-4b11-9d7e-14a131ae5cf2 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:44.171524 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-917d90b7-1f5b-48d5-802a-3ded974ec8d1 tempest-ServersAaction247Test-1065315350 tempest-ServersAaction247Test-1065315350-project] 10.222.0.17 "GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2" status: 404 len: 111 microversion: 2.47 time: 0.038775 Oct 01 20:52:44.171524 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 460/938] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:44 2022] GET /compute/v2.1/servers/066c9890-b991-4b11-9d7e-14a131ae5cf2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:52:44.176411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-caa38e3e-3b01-4dd7-91b4-db79dabe877a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:44.176884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-caa38e3e-3b01-4dd7-91b4-db79dabe877a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:44.184178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa38e3e-3b01-4dd7-91b4-db79dabe877a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.185319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa38e3e-3b01-4dd7-91b4-db79dabe877a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.185963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa38e3e-3b01-4dd7-91b4-db79dabe877a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.186916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa38e3e-3b01-4dd7-91b4-db79dabe877a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.187495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa38e3e-3b01-4dd7-91b4-db79dabe877a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.188010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa38e3e-3b01-4dd7-91b4-db79dabe877a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.291098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:44.301048 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e9c4bbc8-e5db-4626-97fe-b0e59a99897b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1269 microversion: 2.1 time: 0.243944 Oct 01 20:52:44.302145 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 479/939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:44 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1269 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:44.309277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7aaeddbb-e5e3-4c2a-9ab6-df1a0b180661 req-a21b4569-8617-4e7b-9f6d-5a92305c3b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "tag": "8e13aabc-dce0-48f9-99b6-bb6839ff32cf"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:44.324796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7aaeddbb-e5e3-4c2a-9ab6-df1a0b180661 req-a21b4569-8617-4e7b-9f6d-5a92305c3b86 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.325353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7aaeddbb-e5e3-4c2a-9ab6-df1a0b180661 req-a21b4569-8617-4e7b-9f6d-5a92305c3b86 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.326003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7aaeddbb-e5e3-4c2a-9ab6-df1a0b180661 req-a21b4569-8617-4e7b-9f6d-5a92305c3b86 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.341542 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7aaeddbb-e5e3-4c2a-9ab6-df1a0b180661 req-a21b4569-8617-4e7b-9f6d-5a92305c3b86 service nova] Creating event network-changed:8e13aabc-dce0-48f9-99b6-bb6839ff32cf for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:52:44.348811 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7aaeddbb-e5e3-4c2a-9ab6-df1a0b180661 req-a21b4569-8617-4e7b-9f6d-5a92305c3b86 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044870 Oct 01 20:52:44.351274 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 480/940] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:44.375930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:44.385744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:44.408696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.409580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.410419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.411342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:44.412880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:44.414393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:44.464952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:44.942695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:44.953093 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-48bf1c1c-ff1c-44ec-aab8-02bbe5a268b4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1379 microversion: 2.1 time: 0.581913 Oct 01 20:52:44.962389 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 481/941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:44 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1379 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:52:44.997409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:44.998572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:45.014133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:45.015391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:45.016241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:45.017638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:45.018823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:45.019379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:45.119655 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-caa38e3e-3b01-4dd7-91b4-db79dabe877a tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1610 microversion: 2.1 time: 0.948658 Oct 01 20:52:45.121235 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 461/942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:44 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1610 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:45.140904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:45.141528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:45.148678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:45.149171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:45.149613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:45.150322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:45.150996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:45.151593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:45.946980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:45.955774 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-10c47fea-90c3-4c60-9186-c3e22a0209d7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1313 microversion: 2.1 time: 0.966337 Oct 01 20:52:45.956555 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 482/943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:44 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1313 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:45.973270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-782da1e7-3d8e-443b-b862-618e4eaa8985 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:45.981264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-782da1e7-3d8e-443b-b862-618e4eaa8985 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:45.981927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-782da1e7-3d8e-443b-b862-618e4eaa8985 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:45.983067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-782da1e7-3d8e-443b-b862-618e4eaa8985 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:45.983910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-782da1e7-3d8e-443b-b862-618e4eaa8985 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:45.984906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-782da1e7-3d8e-443b-b862-618e4eaa8985 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:45.985556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-782da1e7-3d8e-443b-b862-618e4eaa8985 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.014006 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-782da1e7-3d8e-443b-b862-618e4eaa8985 tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056269 Oct 01 20:52:46.015032 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 483/944] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Oct 1 20:52:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:46.030357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:46.031039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:46.039882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.040627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.041587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.042534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.043202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.043806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.081034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:46.090990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:46.092451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:46.093645 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-10f797cf-5479-456a-8292-bbd7879624ab tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.971468 Oct 01 20:52:46.094524 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 462/945] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:45 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:46.118882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:46.119495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:46.125592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.126199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.127078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.128169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.128866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.129365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.488092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:46.497781 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-29d2df79-6f82-41e2-ba89-b74955c5ab5d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1311 microversion: 2.1 time: 0.473629 Oct 01 20:52:46.498999 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 484/946] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:46 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1311 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:46.500083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:46.506110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:46.508670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:46.511262 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f13e9f3c-ffa7-469f-b553-1d1b445e6cb6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1379 microversion: 2.1 time: 0.402776 Oct 01 20:52:46.519421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.520180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.520618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.521364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.521957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.522701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.531555 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 463/947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:46 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1379 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:46.556472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Lazy-loading 'flavor' on Instance uuid 47e87f64-79a1-4ba9-872c-ae22c7846863 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:52:46.574568 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 47e87f64-79a1-4ba9-872c-ae22c7846863 while it is in vm_state suspended Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Request method failure captured: Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863/action HTTP/1.1 Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 97 Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKhhkT30UDYhgY37FhRiZF2E7fpPT2e0MiuY4GP_34vlECo0rlpYj3Cn1mEFiTKMUaOCIkqlD_RWBDUiaOb802kzYuqddfwgp6qZ-QwrwsXQ_rGmcXfr-z25YZReiKB3Qtj6yk27BInmZKDwW1hElFSPKravCVqd2rj1_6H37Q1svaM Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 1ab469e2d1a04a368860f8a96492940f Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-LiveMigrationNegativeTest-2120192844 Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:52:46.576810 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ab469e2d1a04a368860f8a96492940f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab469e2d1a04a368860f8a96492940f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ab469e2d1a04a368860f8a96492940f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab469e2d1a04a368860f8a96492940f"}]}] Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-LiveMigrationNegativeTest-2120192844 Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 1ab469e2d1a04a368860f8a96492940f Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2120192844 Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-LiveMigrationNegativeTest-2120192844-project-admin Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: dfd53627e013481fb9fb43b94d43db47 Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-LiveMigrationNegativeTest-2120192844-project-admin Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} Oct 01 20:52:46.578527 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: exception: Cannot 'os-migrateLive' instance 47e87f64-79a1-4ba9-872c-ae22c7846863 while it is in vm_state suspended Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '47e87f64-79a1-4ba9-872c-ae22c7846863', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 01 20:52:46.579412 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47e87f64-79a1-4ba9-872c-ae22c7846863 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:52:46.580733 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 47e87f64-79a1-4ba9-872c-ae22c7846863 while it is in vm_state suspended Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 47e87f64-79a1-4ba9-872c-ae22c7846863 while it is in vm_state suspended Oct 01 20:52:46.582136 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:52:46.584411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 47e87f64-79a1-4ba9-872c-ae22c7846863 while it is in vm_state suspended {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:46.585603 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-056732a8-3225-4b4e-a56a-ae3a53127a1d tempest-LiveMigrationNegativeTest-2120192844 tempest-LiveMigrationNegativeTest-2120192844-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863/action" status: 409 len: 155 microversion: 2.1 time: 0.085196 Oct 01 20:52:46.586435 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 485/948] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:52:46 2022] POST /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863/action => generated 155 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:52:46.598092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:46.598686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:46.606408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.607135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.607729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.608615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.609261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.609843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.641985 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:52:46.806012 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-40b3e448-94a0-49de-a3fe-08374cc0c36e tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "DELETE /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 204 len: 0 microversion: 2.1 time: 0.212960 Oct 01 20:52:46.807530 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 486/949] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:52:46 2022] DELETE /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:52:46.814602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b56364af-2439-4eed-afd7-83fe9beab6d6 req-62d7b8d7-0f2a-4a82-bd50-ad41035beb7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "tag": "f09e681e-660d-4b59-82a1-b74fb5573e9e"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:46.827006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b56364af-2439-4eed-afd7-83fe9beab6d6 req-62d7b8d7-0f2a-4a82-bd50-ad41035beb7b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.828425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b56364af-2439-4eed-afd7-83fe9beab6d6 req-62d7b8d7-0f2a-4a82-bd50-ad41035beb7b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.829237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b56364af-2439-4eed-afd7-83fe9beab6d6 req-62d7b8d7-0f2a-4a82-bd50-ad41035beb7b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.844817 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b56364af-2439-4eed-afd7-83fe9beab6d6 req-62d7b8d7-0f2a-4a82-bd50-ad41035beb7b service nova] Creating event network-changed:f09e681e-660d-4b59-82a1-b74fb5573e9e for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:52:46.853366 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b56364af-2439-4eed-afd7-83fe9beab6d6 req-62d7b8d7-0f2a-4a82-bd50-ad41035beb7b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044217 Oct 01 20:52:46.853995 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 487/950] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:46.859105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:46.859880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:46.867589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.868155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.868843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.869770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:46.870921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:46.871606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:46.910212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c70f8aed-e402-460f-8e7f-91dbe092cc51 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Action: 'update', calling method: .version_select at 0x7f41739c1040>, body: {"quota_set": {"ram": "5120"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:47.153690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:47.162363 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fbe9eda0-caed-4241-b343-55ae35ae7014 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1465 microversion: 2.1 time: 0.307165 Oct 01 20:52:47.175030 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 488/951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:46 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1465 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:47.179089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70f8aed-e402-460f-8e7f-91dbe092cc51 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.179886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70f8aed-e402-460f-8e7f-91dbe092cc51 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.180340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70f8aed-e402-460f-8e7f-91dbe092cc51 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:47.181173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70f8aed-e402-460f-8e7f-91dbe092cc51 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.181760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70f8aed-e402-460f-8e7f-91dbe092cc51 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.182265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70f8aed-e402-460f-8e7f-91dbe092cc51 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:47.183364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:47.184801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:47.191344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.192072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.192694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:47.193576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.194394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.195003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:47.292054 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c70f8aed-e402-460f-8e7f-91dbe092cc51 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/27fa2a1f8926420c8c7cdaa9048527c8" status: 200 len: 240 microversion: 2.36 time: 0.756046 Oct 01 20:52:47.292690 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 464/952] 10.222.0.17 () {62 vars in 1303 bytes} [Sat Oct 1 20:52:46 2022] PUT /compute/v2.1/os-quota-sets/27fa2a1f8926420c8c7cdaa9048527c8 => generated 240 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:52:47.297433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:47.298053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:47.304936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.305437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.305879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:47.306677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.307383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.307979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:47.707627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:47.717630 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ed3e8d7a-d41a-470f-bfa0-fcd8824c3a99 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1462 microversion: 2.1 time: 0.540820 Oct 01 20:52:47.718575 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 489/953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:47 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1462 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:47.724741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7f6463a3-25e2-4d23-b575-994fac8e0cf2 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Calling method '.version_select at 0x7f41737c8700>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:47.756733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:47.779360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:47.780947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:47.782149 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d13d51fc-e265-437b-a620-688a95f52f25 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.488518 Oct 01 20:52:47.783273 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 465/954] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:47 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:47.788069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:47.788880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:47.805121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.805902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.806519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:47.807395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.808006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.808583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:47.985666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f6463a3-25e2-4d23-b575-994fac8e0cf2 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.986344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f6463a3-25e2-4d23-b575-994fac8e0cf2 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.987111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f6463a3-25e2-4d23-b575-994fac8e0cf2 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:47.988182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f6463a3-25e2-4d23-b575-994fac8e0cf2 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:47.988954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f6463a3-25e2-4d23-b575-994fac8e0cf2 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:47.989760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f6463a3-25e2-4d23-b575-994fac8e0cf2 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.024200 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7f6463a3-25e2-4d23-b575-994fac8e0cf2 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/27fa2a1f8926420c8c7cdaa9048527c8/detail" status: 200 len: 672 microversion: 2.36 time: 0.304237 Oct 01 20:52:48.025340 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 490/955] 10.222.0.17 () {60 vars in 1304 bytes} [Sat Oct 1 20:52:47 2022] GET /compute/v2.1/os-quota-sets/27fa2a1f8926420c8c7cdaa9048527c8/detail => generated 672 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:52:48.031594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:48.032540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:48.061873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.065189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.068900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.071745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.073565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.075456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.092938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:48.103492 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0fcd498f-6771-4ce1-ae45-2bdb8a2b3a04 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1311 microversion: 2.1 time: 0.318847 Oct 01 20:52:48.104981 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 466/956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:47 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1311 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:48.344797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-167ecf44-adfd-41dc-824c-56c8ce05ff48 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Calling method '.version_select at 0x7f4173ac2f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:48.364295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-167ecf44-adfd-41dc-824c-56c8ce05ff48 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.365020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-167ecf44-adfd-41dc-824c-56c8ce05ff48 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.365490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-167ecf44-adfd-41dc-824c-56c8ce05ff48 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.388605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-167ecf44-adfd-41dc-824c-56c8ce05ff48 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.389412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-167ecf44-adfd-41dc-824c-56c8ce05ff48 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.390116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-167ecf44-adfd-41dc-824c-56c8ce05ff48 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.414576 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-167ecf44-adfd-41dc-824c-56c8ce05ff48 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/a1c660e5e0f14f16b4b2b43e89609bb2?start=2022-09-30T20%3A52%3A47.736857&end=2022-10-02T20%3A52%3A47.736857" status: 200 len: 694 microversion: 2.1 time: 0.307291 Oct 01 20:52:48.415493 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 467/957] 10.222.0.17 () {58 vars in 1412 bytes} [Sat Oct 1 20:52:48 2022] GET /compute/v2.1/os-simple-tenant-usage/a1c660e5e0f14f16b4b2b43e89609bb2?start=2022-09-30T20%3A52%3A47.736857&end=2022-10-02T20%3A52%3A47.736857 => generated 694 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:48.450962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:48.451933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:48.458670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.459556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.460161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.461051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.461178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:48.462255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.462967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.472733 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b2be6353-52af-4fd2-bbbe-31e107984204 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1379 microversion: 2.1 time: 0.445946 Oct 01 20:52:48.486867 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 491/958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:48 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1379 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:48.491412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:48.493891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Action: 'update', calling method: .version_select at 0x7f41737bb550>, body: {"quota_set": {"ram": "2048"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:48.591955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.594657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.595403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.596451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.599327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.600015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.650566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.651451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.652372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.653355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.654041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.655252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.733830 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-94ffdf1f-072a-4d14-8bb8-b8265597dc0f tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/27fa2a1f8926420c8c7cdaa9048527c8?user_id=fd267ab95c8a412aae5da7e8e4036f22" status: 200 len: 240 microversion: 2.36 time: 0.245270 Oct 01 20:52:48.734800 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 492/959] 10.222.0.17 () {62 vars in 1384 bytes} [Sat Oct 1 20:52:48 2022] PUT /compute/v2.1/os-quota-sets/27fa2a1f8926420c8c7cdaa9048527c8?user_id=fd267ab95c8a412aae5da7e8e4036f22 => generated 240 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:52:48.740931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6837b914-941d-419a-8501-8087873c3ebe tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '.version_select at 0x7f41736caf70>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:48.758181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6837b914-941d-419a-8501-8087873c3ebe tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.758826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6837b914-941d-419a-8501-8087873c3ebe tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.759926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6837b914-941d-419a-8501-8087873c3ebe tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.783454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6837b914-941d-419a-8501-8087873c3ebe tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.784331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6837b914-941d-419a-8501-8087873c3ebe tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.785133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6837b914-941d-419a-8501-8087873c3ebe tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.790899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:48.806990 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f0585a9c-44cc-41c9-8837-0f60ae7e5acd tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1465 microversion: 2.1 time: 0.369937 Oct 01 20:52:48.807787 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 468/960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:48 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1465 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:48.814456 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6837b914-941d-419a-8501-8087873c3ebe tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/a1c660e5e0f14f16b4b2b43e89609bb2?start=2022-09-30T20%3A52%3A47.736857&end=2022-10-02T20%3A52%3A47.736857" status: 200 len: 694 microversion: 2.1 time: 0.076828 Oct 01 20:52:48.815870 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 493/961] 10.222.0.17 () {58 vars in 1412 bytes} [Sat Oct 1 20:52:48 2022] GET /compute/v2.1/os-simple-tenant-usage/a1c660e5e0f14f16b4b2b43e89609bb2?start=2022-09-30T20%3A52%3A47.736857&end=2022-10-02T20%3A52%3A47.736857 => generated 694 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:48.825852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:48.826582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:48.831918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2ee20f2-68db-40dd-9b1a-becd82f8dad4 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] Calling method '.version_select at 0x7f417397bd30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:48.834146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.834739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.835530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.836580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.838020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.838727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:48.969102 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2ee20f2-68db-40dd-9b1a-becd82f8dad4 tempest-QuotasAdminTestV236-2041601533 tempest-QuotasAdminTestV236-2041601533-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/27fa2a1f8926420c8c7cdaa9048527c8?user_id=fd267ab95c8a412aae5da7e8e4036f22" status: 200 len: 282 microversion: 2.36 time: 0.160118 Oct 01 20:52:48.970585 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 469/962] 10.222.0.17 () {60 vars in 1364 bytes} [Sat Oct 1 20:52:48 2022] GET /compute/v2.1/os-quota-sets/27fa2a1f8926420c8c7cdaa9048527c8?user_id=fd267ab95c8a412aae5da7e8e4036f22 => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:52:48.984992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8afdad5a-ccbc-4670-a07a-3fd5039596f8 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Calling method '.version_select at 0x7f41738a1430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:48.996987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8afdad5a-ccbc-4670-a07a-3fd5039596f8 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:48.998164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8afdad5a-ccbc-4670-a07a-3fd5039596f8 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:48.999136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8afdad5a-ccbc-4670-a07a-3fd5039596f8 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.016017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8afdad5a-ccbc-4670-a07a-3fd5039596f8 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.016864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8afdad5a-ccbc-4670-a07a-3fd5039596f8 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.017596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8afdad5a-ccbc-4670-a07a-3fd5039596f8 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.103166 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8afdad5a-ccbc-4670-a07a-3fd5039596f8 tempest-TenantUsagesTestJSON-268853844 tempest-TenantUsagesTestJSON-268853844-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-30T20%3A52%3A47.736857&end=2022-10-02T20%3A52%3A47.736857&detailed=1" status: 200 len: 11078 microversion: 2.1 time: 0.122252 Oct 01 20:52:49.103787 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 470/963] 10.222.0.17 () {58 vars in 1335 bytes} [Sat Oct 1 20:52:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-30T20%3A52%3A47.736857&end=2022-10-02T20%3A52%3A47.736857&detailed=1 => generated 11078 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:52:49.122264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-621340b6-7102-4bc4-be8d-a3e9b157b86b req-959a11d1-343f-4409-af91-e94bf7e0815b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc3d670b-2ef6-4707-86ae-f91be8167888", "tag": "93297d56-6416-43dd-8e55-db06d23206f3"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:49.123323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-621340b6-7102-4bc4-be8d-a3e9b157b86b req-959a11d1-343f-4409-af91-e94bf7e0815b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.123323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-621340b6-7102-4bc4-be8d-a3e9b157b86b req-959a11d1-343f-4409-af91-e94bf7e0815b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.123721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-621340b6-7102-4bc4-be8d-a3e9b157b86b req-959a11d1-343f-4409-af91-e94bf7e0815b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.137194 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-621340b6-7102-4bc4-be8d-a3e9b157b86b req-959a11d1-343f-4409-af91-e94bf7e0815b service nova] Creating event network-changed:93297d56-6416-43dd-8e55-db06d23206f3 for instance fc3d670b-2ef6-4707-86ae-f91be8167888 on nch1-master-1 Oct 01 20:52:49.144045 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-621340b6-7102-4bc4-be8d-a3e9b157b86b req-959a11d1-343f-4409-af91-e94bf7e0815b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038789 Oct 01 20:52:49.146157 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 471/964] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:49.153437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:49.154431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:49.162301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.163062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.163995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.164930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.165573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.166323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.204746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:52:49.323047 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab16db7a-23cf-4cab-8741-b173848b74e2 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "DELETE /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 204 len: 0 microversion: 2.1 time: 0.173931 Oct 01 20:52:49.324632 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 472/965] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:52:49 2022] DELETE /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:52:49.335790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:49.337643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:49.349839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.351383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.352053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.353076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.353785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.355188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.593132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:49.616017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:49.619612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:49.624565 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-528b7578-7bc0-4b7e-8b73-d2f25131dc79 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.807823 Oct 01 20:52:49.625510 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 494/966] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:48 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:49.654724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:49.655807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:49.682636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.683326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.683795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.684545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.685178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.685773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.899379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:49.919572 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e18bfedb-7b0a-4c34-a424-b4d2cb8f0897 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1311 microversion: 2.1 time: 0.591523 Oct 01 20:52:49.922365 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 473/967] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:49 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1311 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:49.939820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:49.940774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:49.953240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.955072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.955817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:49.956776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:49.957588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:49.958276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:50.148415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:50.162744 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2659570d-0a91-409d-93cb-69b4d8cb0ae7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1468 microversion: 2.1 time: 0.534558 Oct 01 20:52:50.165310 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 495/968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:49 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1468 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:50.175622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:50.176366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:50.190994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:50.191735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:50.193037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:50.193930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:50.194568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:50.195323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:50.363073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:50.373116 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b9cbc64-0622-4893-ab15-2389225002ad tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1379 microversion: 2.1 time: 0.449249 Oct 01 20:52:50.390731 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 474/969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:49 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1379 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:50.477023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:50.491385 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-48fc8aa4-1314-4305-84f9-c0f86337eb91 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 200 len: 1423 microversion: 2.1 time: 0.324809 Oct 01 20:52:50.508957 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 496/970] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:50 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 1423 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:50.660118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:50.662368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:50.671749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:50.680977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:50.681991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:50.683122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:50.685105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:50.686013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:50.786763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d3956d11-16d7-46e8-b4da-9c616ca667a6 req-a7ba550e-3282-442e-9dae-ecf98a55483c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1818557f-9772-403d-bfa8-d226f1063f2f", "name": "network-vif-plugged", "status": "completed", "tag": "1dee487a-adae-475f-aff1-35bf8657a7f3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:50.812966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d3956d11-16d7-46e8-b4da-9c616ca667a6 req-a7ba550e-3282-442e-9dae-ecf98a55483c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:50.813507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d3956d11-16d7-46e8-b4da-9c616ca667a6 req-a7ba550e-3282-442e-9dae-ecf98a55483c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:50.814306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d3956d11-16d7-46e8-b4da-9c616ca667a6 req-a7ba550e-3282-442e-9dae-ecf98a55483c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:50.854134 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d3956d11-16d7-46e8-b4da-9c616ca667a6 req-a7ba550e-3282-442e-9dae-ecf98a55483c service nova] Creating event network-vif-plugged:1dee487a-adae-475f-aff1-35bf8657a7f3 for instance 1818557f-9772-403d-bfa8-d226f1063f2f on nch1-master-1 Oct 01 20:52:50.866465 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d3956d11-16d7-46e8-b4da-9c616ca667a6 req-a7ba550e-3282-442e-9dae-ecf98a55483c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084211 Oct 01 20:52:50.900041 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 497/971] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:50.946338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:50.947241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:50.965917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:50.966530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:50.966985 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:50.973971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:50.976478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:50.977152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:51.316869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:51.332264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:51.335313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:51.337066 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c8b70f7-65dc-4371-a107-2d574ff32d10 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.683008 Oct 01 20:52:51.338330 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 475/972] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:50 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:51.343264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0caf337a-f9fd-4e4a-8ebd-0338d6d22210 req-8db7a2e9-a244-46d1-8047-181a5d5ce8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "tag": "e3c20a77-5ca5-4d7e-9621-467c8ec0eded"}, {"server_uuid": "47e87f64-79a1-4ba9-872c-ae22c7846863", "name": "network-vif-deleted", "tag": "997b440d-6bb5-41f4-9988-30ada9875cc0"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:51.361840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0caf337a-f9fd-4e4a-8ebd-0338d6d22210 req-8db7a2e9-a244-46d1-8047-181a5d5ce8a2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:51.362053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0caf337a-f9fd-4e4a-8ebd-0338d6d22210 req-8db7a2e9-a244-46d1-8047-181a5d5ce8a2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:51.362587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0caf337a-f9fd-4e4a-8ebd-0338d6d22210 req-8db7a2e9-a244-46d1-8047-181a5d5ce8a2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:51.377796 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0caf337a-f9fd-4e4a-8ebd-0338d6d22210 req-8db7a2e9-a244-46d1-8047-181a5d5ce8a2 service nova] Creating event network-changed:e3c20a77-5ca5-4d7e-9621-467c8ec0eded for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:52:51.379014 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0caf337a-f9fd-4e4a-8ebd-0338d6d22210 req-8db7a2e9-a244-46d1-8047-181a5d5ce8a2 service nova] Creating event network-vif-deleted:997b440d-6bb5-41f4-9988-30ada9875cc0 for instance 47e87f64-79a1-4ba9-872c-ae22c7846863 on nch1-master-1 Oct 01 20:52:51.393290 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0caf337a-f9fd-4e4a-8ebd-0338d6d22210 req-8db7a2e9-a244-46d1-8047-181a5d5ce8a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053557 Oct 01 20:52:51.394363 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 476/973] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:51.400966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:51.402340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:51.409714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:51.410546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:51.411203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:51.412527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:51.413210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:51.413899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:51.676272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:51.684865 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8ef1a9e9-fc66-42e8-8351-077c7bc7f4b4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1311 microversion: 2.1 time: 0.744035 Oct 01 20:52:51.698959 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 498/974] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:50 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1311 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:52:51.709656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:51.710555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:51.719358 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:51.720318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:51.721010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:51.722002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:51.722765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:51.723746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:52.674125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245b8304f604cfc97da73b4dc884bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c660e5e0f14f16b4b2b43e89609bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:52.695327 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-125c28e9-cf4a-46ec-b1b4-e838d98c1dd7 tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 200 len: 1468 microversion: 2.1 time: 1.298854 Oct 01 20:52:52.697199 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 477/975] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:51 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 1468 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:52.705342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:52.709690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 47e87f64-79a1-4ba9-872c-ae22c7846863] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:52.717694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:52.718983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:52.719506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:52.720775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:52.721436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:52.721871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:52.738111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] HTTP exception thrown: Instance 47e87f64-79a1-4ba9-872c-ae22c7846863 could not be found. Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Request method failure captured: Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 HTTP/1.1 Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKhfRiJYCoUey2SUwlDCjGT0uFyOEfZJ-OVnPMG0n1IQ2VF63siya7VnK1ThVaJy8fEm_mmSD7rSAGtP10GvGJzvpQsK6bpBMaYbN5Qvms1XoEXgJhzKdwxNXbIA0yk6qj68GggWT54xb0LYTuEc1N_VUeA4Sb_7MpZCFEAUzhoiOtc Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 963f525498ef4ebdb9db327df62bd68a Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveMigrationNegativeTest-1420816106 Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:52:52.739815 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_963f525498ef4ebdb9db327df62bd68a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/963f525498ef4ebdb9db327df62bd68a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/963f525498ef4ebdb9db327df62bd68a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/963f525498ef4ebdb9db327df62bd68a"}]}] Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveMigrationNegativeTest-1420816106 Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 963f525498ef4ebdb9db327df62bd68a Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1420816106 Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveMigrationNegativeTest-1420816106-project Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 04add76a65d74165b65189a5fd1f47ed Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveMigrationNegativeTest-1420816106-project Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 47e87f64-79a1-4ba9-872c-ae22c7846863 could not be found. Oct 01 20:52:52.741224 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '47e87f64-79a1-4ba9-872c-ae22c7846863'} Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e87f64-79a1-4ba9-872c-ae22c7846863 could not be found. Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:52.742018 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e87f64-79a1-4ba9-872c-ae22c7846863 could not be found. Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e87f64-79a1-4ba9-872c-ae22c7846863 could not be found. Oct 01 20:52:52.745350 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:52.746439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Returning 404 to user: Instance 47e87f64-79a1-4ba9-872c-ae22c7846863 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:52.746439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c16d2e8-9b01-4d2e-8358-6df569789c5a tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863" status: 404 len: 111 microversion: 2.1 time: 0.042548 Oct 01 20:52:52.746439 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 478/976] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:52 2022] GET /compute/v2.1/servers/47e87f64-79a1-4ba9-872c-ae22c7846863 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:52:52.748084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-04024fab-fdc1-45eb-b5ee-e7436311af45 req-3a40025c-5b42-483d-b50d-7af2b1999e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361e1137-8abf-43c9-866f-a04c644a7cb5", "name": "network-vif-deleted", "tag": "4ec6d856-8127-478c-b1bb-08df9b750874"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:52.758318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-04024fab-fdc1-45eb-b5ee-e7436311af45 req-3a40025c-5b42-483d-b50d-7af2b1999e75 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:52.758831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-04024fab-fdc1-45eb-b5ee-e7436311af45 req-3a40025c-5b42-483d-b50d-7af2b1999e75 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:52.759266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-04024fab-fdc1-45eb-b5ee-e7436311af45 req-3a40025c-5b42-483d-b50d-7af2b1999e75 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:52.771602 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-04024fab-fdc1-45eb-b5ee-e7436311af45 req-3a40025c-5b42-483d-b50d-7af2b1999e75 service nova] Creating event network-vif-deleted:4ec6d856-8127-478c-b1bb-08df9b750874 for instance 361e1137-8abf-43c9-866f-a04c644a7cb5 on nch2-master-1 Oct 01 20:52:52.776545 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-04024fab-fdc1-45eb-b5ee-e7436311af45 req-3a40025c-5b42-483d-b50d-7af2b1999e75 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033305 Oct 01 20:52:52.777392 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 479/977] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:52.783534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:52.784240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:52.790653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:52.791213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:52.791649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:52.792373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:52.792992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:52.793420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:52.843923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:52.852996 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4a9685a8-5ef9-4e07-86d9-e07103e127e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1379 microversion: 2.1 time: 1.152473 Oct 01 20:52:52.854139 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 499/978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:51 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1379 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:52.858974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:52.859763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:52.862455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:52.867340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:52.868017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:52.868619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:52.869483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:52.870202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:52.870967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:52.876698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:53.565682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:53.574633 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a90bbe21-e697-4094-a8b7-b072b2b3a0ad tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1311 microversion: 2.1 time: 0.719067 Oct 01 20:52:53.575851 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 500/979] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:52 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1311 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:53.582737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:53.583416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:53.599993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:53.600839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:53.601609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:53.603272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:53.603948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:53.604721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:53.625526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:53.643191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:53.648344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:53.649997 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-27cf4394-88a4-40cc-82fc-a956ebcb7e68 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.871322 Oct 01 20:52:53.653702 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 480/980] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:52 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:53.675336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:52:53.724333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:53.724912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] [instance: 361e1137-8abf-43c9-866f-a04c644a7cb5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:53.735200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:53.736193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:53.737338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:53.738344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:53.739046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:53.739686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:53.762095 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] HTTP exception thrown: Instance 361e1137-8abf-43c9-866f-a04c644a7cb5 could not be found. Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Request method failure captured: Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 HTTP/1.1 Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKiHtvYO3UX4_S4g-xUEMQOAilJo35itXReedKz2TtrCncvCwtDHArnA23lNePLsTmacWoDwKKrpfDLh5wOdcwWF7A1noS3rTpSPOAqJyiNbQOKsZDJEIlG5Wz2wZg1QAcf-xRnSDMThuv21Kl0VodpiUeK1cvfGKICZtyJ5_WMK310 Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a1c660e5e0f14f16b4b2b43e89609bb2 Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TenantUsagesTestJSON-347663638 Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:52:53.770734 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a1c660e5e0f14f16b4b2b43e89609bb2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a1c660e5e0f14f16b4b2b43e89609bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a1c660e5e0f14f16b4b2b43e89609bb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a1c660e5e0f14f16b4b2b43e89609bb2"}]}] Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TenantUsagesTestJSON-347663638 Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a1c660e5e0f14f16b4b2b43e89609bb2 Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TenantUsagesTestJSON-347663638 Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TenantUsagesTestJSON-347663638-project Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3245b8304f604cfc97da73b4dc884bd5 Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TenantUsagesTestJSON-347663638-project Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 361e1137-8abf-43c9-866f-a04c644a7cb5 could not be found. Oct 01 20:52:53.772117 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '361e1137-8abf-43c9-866f-a04c644a7cb5'} Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361e1137-8abf-43c9-866f-a04c644a7cb5 could not be found. Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:53.772884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361e1137-8abf-43c9-866f-a04c644a7cb5 could not be found. Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361e1137-8abf-43c9-866f-a04c644a7cb5 could not be found. Oct 01 20:52:53.774073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:53.780927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] Returning 404 to user: Instance 361e1137-8abf-43c9-866f-a04c644a7cb5 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:53.782454 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6dbbe8e0-c877-4d89-813a-259b95eed60a tempest-TenantUsagesTestJSON-347663638 tempest-TenantUsagesTestJSON-347663638-project] 10.222.0.17 "GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5" status: 404 len: 111 microversion: 2.1 time: 0.064393 Oct 01 20:52:53.784043 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 481/981] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:53 2022] GET /compute/v2.1/servers/361e1137-8abf-43c9-866f-a04c644a7cb5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:52:53.799366 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d9775911-18b4-428c-bb20-91374673fc57 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "DELETE /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 204 len: 0 microversion: 2.1 time: 0.221160 Oct 01 20:52:53.801580 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 501/982] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:52:53 2022] DELETE /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:52:53.822861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:53.827687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:53.843899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:53.846822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:53.847781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:53.851027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:53.852774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:53.853856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:53.887975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:53.889489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:53.898704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:53.899713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:53.900564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:53.901749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:53.902372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:53.903524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:54.378316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:54.387454 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-004bfed9-2c10-4844-a1ab-49afde169262 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1475 microversion: 2.1 time: 0.581833 Oct 01 20:52:54.397929 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 482/983] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:53 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1475 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:54.402828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c352dcc0-d334-4916-adf7-8602805ee1a0 req-7a3a6816-10d3-4370-a875-98240af5b8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "tag": "3c68fc4b-2f4b-4e13-93c2-8872ece1ad74"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:54.419590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:54.429212 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f3716764-d71a-4c47-b5f0-0da0f5f2779d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1529 microversion: 2.1 time: 0.555593 Oct 01 20:52:54.442900 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 502/984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:53 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1529 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:54.448751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c352dcc0-d334-4916-adf7-8602805ee1a0 req-7a3a6816-10d3-4370-a875-98240af5b8de service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:54.449420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c352dcc0-d334-4916-adf7-8602805ee1a0 req-7a3a6816-10d3-4370-a875-98240af5b8de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:54.450031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c352dcc0-d334-4916-adf7-8602805ee1a0 req-7a3a6816-10d3-4370-a875-98240af5b8de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:54.451547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:54.452168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:54.465664 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c352dcc0-d334-4916-adf7-8602805ee1a0 req-7a3a6816-10d3-4370-a875-98240af5b8de service nova] Creating event network-changed:3c68fc4b-2f4b-4e13-93c2-8872ece1ad74 for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:52:54.492547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:54.494584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c352dcc0-d334-4916-adf7-8602805ee1a0 req-7a3a6816-10d3-4370-a875-98240af5b8de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095188 Oct 01 20:52:54.495578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:54.496052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:54.496831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:54.497236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:54.497670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:54.498841 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 483/985] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:54.598375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:54.599121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:54.608830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:54.612033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:54.613759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:54.615736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:54.618085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:54.618729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:55.193482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:55.204862 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3000efaa-d7e9-4078-805c-fafd3f7c726a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1311 microversion: 2.1 time: 0.610105 Oct 01 20:52:55.211454 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 484/986] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:54 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1311 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:52:55.227677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:55.228408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:55.237153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:55.237705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:55.238272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:55.239974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:55.240677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:55.241981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:55.271637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:55.284029 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2b2fd824-ab8d-4094-b4d0-0d3a3efbde26 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1529 microversion: 2.1 time: 0.836164 Oct 01 20:52:55.286952 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 503/987] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:54 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1529 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:52:55.308652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a57c7dc9-f109-4947-9f73-0430f9c77aea tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:55.335916 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a57c7dc9-f109-4947-9f73-0430f9c77aea tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/94475597-5908-4582-897b-4fe8787d64c4" status: 202 len: 0 microversion: 2.1 time: 0.030803 Oct 01 20:52:55.337187 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 504/988] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:52:55 2022] DELETE /compute/v2.1/flavors/94475597-5908-4582-897b-4fe8787d64c4 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:55.347079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9728582a-750a-46e6-8037-0afc66dd9338 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:55.379736 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9728582a-750a-46e6-8037-0afc66dd9338 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038435 Oct 01 20:52:55.398596 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 505/989] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:52:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:55.405273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:55.408997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:55.416264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:55.416791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:55.417227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:55.418150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:55.418653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:55.419158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:55.461659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:55.467891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Old instance type tempest-test_resize_flavor_-1663119833, new instance type m1.heat {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 20:52:55.474820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:52:55.475486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:52:55.475960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:52:55.476353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:52:55.476755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:52:55.561684 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5985b6d7-a6f8-419c-a1fd-9abb12222fa1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f/action" status: 202 len: 0 microversion: 2.1 time: 0.161649 Oct 01 20:52:55.562892 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 506/990] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:52:55 2022] POST /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:52:55.568681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:55.569388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:55.577307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:55.577882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:55.578397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:55.579307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:55.579832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:55.580337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:56.375715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:56.419278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:56.420936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:56.422153 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a0e6306a-fe03-4ae6-b311-a6e21de10b28 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 1.208059 Oct 01 20:52:56.422749 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 485/991] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:55 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:56.465770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:56.468825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:56.476563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:56.477598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:56.478353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:56.479452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:56.480241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:56.480891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:56.513446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:56.532764 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-11684431-348b-4c2f-9678-cdc7ae6b44c2 tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1475 microversion: 2.1 time: 0.965345 Oct 01 20:52:56.534097 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 507/992] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:55 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1475 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:56.550981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:56.554460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:56.562283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:56.563172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:56.564899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:56.565766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:56.566590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:56.567179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:57.011505 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:57.025783 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-33bdefac-1f4b-4ff0-a99e-fb7628b46716 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1311 microversion: 2.1 time: 0.484187 Oct 01 20:52:57.026409 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 508/993] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:56 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1311 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:57.039251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7de047a7-07db-43b9-a505-f3c02759b1d3 req-fbe25611-00b3-4613-a82d-1a95a28886f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3d670b-2ef6-4707-86ae-f91be8167888", "name": "network-vif-plugged", "status": "completed", "tag": "93297d56-6416-43dd-8e55-db06d23206f3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:57.052749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7de047a7-07db-43b9-a505-f3c02759b1d3 req-fbe25611-00b3-4613-a82d-1a95a28886f6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:57.053845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7de047a7-07db-43b9-a505-f3c02759b1d3 req-fbe25611-00b3-4613-a82d-1a95a28886f6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:57.055367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7de047a7-07db-43b9-a505-f3c02759b1d3 req-fbe25611-00b3-4613-a82d-1a95a28886f6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:57.078325 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7de047a7-07db-43b9-a505-f3c02759b1d3 req-fbe25611-00b3-4613-a82d-1a95a28886f6 service nova] Creating event network-vif-plugged:93297d56-6416-43dd-8e55-db06d23206f3 for instance fc3d670b-2ef6-4707-86ae-f91be8167888 on nch1-master-1 Oct 01 20:52:57.089967 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7de047a7-07db-43b9-a505-f3c02759b1d3 req-fbe25611-00b3-4613-a82d-1a95a28886f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059837 Oct 01 20:52:57.091464 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 509/994] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:57.204889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:57.218921 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c1995096-a057-467c-b56a-7066ceaba4f8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1538 microversion: 2.1 time: 0.764866 Oct 01 20:52:57.222926 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 486/995] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:56 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1538 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:57.457391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:57.459541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:57.486599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:57.487331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:57.487795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:57.488559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:57.489055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:57.490611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:57.561485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:57.562093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:57.578544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:57.579911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:57.580518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:57.581437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:57.581903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:57.582329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:57.840322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04add76a65d74165b65189a5fd1f47ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963f525498ef4ebdb9db327df62bd68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:57.849871 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-69f4b000-e082-4681-bd3c-c9350c8e40be tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 200 len: 1433 microversion: 2.1 time: 0.292128 Oct 01 20:52:57.853561 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 487/996] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:57 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 1433 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:52:57.873808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-830573c9-1d88-4518-8fbd-98f176ce9d2e req-f109fd2c-8ba9-450d-9ecd-2065c5dcccde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c88671-ff54-4647-96ce-a5fabf200cc6", "name": "network-vif-deleted", "tag": "fa02211a-74c3-4a29-abe0-4a0d42899f3e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:52:57.910589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-830573c9-1d88-4518-8fbd-98f176ce9d2e req-f109fd2c-8ba9-450d-9ecd-2065c5dcccde service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:57.911084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-830573c9-1d88-4518-8fbd-98f176ce9d2e req-f109fd2c-8ba9-450d-9ecd-2065c5dcccde service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:57.911521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-830573c9-1d88-4518-8fbd-98f176ce9d2e req-f109fd2c-8ba9-450d-9ecd-2065c5dcccde service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:57.947015 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-830573c9-1d88-4518-8fbd-98f176ce9d2e req-f109fd2c-8ba9-450d-9ecd-2065c5dcccde service nova] Creating event network-vif-deleted:fa02211a-74c3-4a29-abe0-4a0d42899f3e for instance 45c88671-ff54-4647-96ce-a5fabf200cc6 on nch2-master-1 Oct 01 20:52:57.955728 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-830573c9-1d88-4518-8fbd-98f176ce9d2e req-f109fd2c-8ba9-450d-9ecd-2065c5dcccde service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098870 Oct 01 20:52:57.957155 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 488/997] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:52:58.051318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:58.051807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:58.059080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:58.060072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:58.061216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:58.062288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:58.068085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:58.068688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:58.095116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:58.134002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:58.135604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:58.136897 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c8b2d5da-8e9f-4fec-8baf-16443fa83aec tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.688820 Oct 01 20:52:58.137837 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 510/998] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:57 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:58.257884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:58.260030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:58.272224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:58.273031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:58.273784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:58.274728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:58.276092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:58.276862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:58.640450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:58.648037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:58.655049 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-43a2a663-8e1b-461d-a6f9-9908e11d49f6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1311 microversion: 2.1 time: 0.609351 Oct 01 20:52:58.671492 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 489/999] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:58 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1311 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:52:58.727829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=37 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:58.783191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=15 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:58.881479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:58.882951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] [instance: 45c88671-ff54-4647-96ce-a5fabf200cc6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:58.897463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:58.899435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:58.900280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:58.901388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:58.902461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:58.903448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:58.911968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:58.924928 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e442042c-f661-4075-9da8-a0e51f3102ee tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1538 microversion: 2.1 time: 0.680645 Oct 01 20:52:58.925541 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 511/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:58 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1538 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:52:58.962431 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] HTTP exception thrown: Instance 45c88671-ff54-4647-96ce-a5fabf200cc6 could not be found. Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Request method failure captured: Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 HTTP/1.1 Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKhfRiJYCoUey2SUwlDCjGT0uFyOEfZJ-OVnPMG0n1IQ2VF63siya7VnK1ThVaJy8fEm_mmSD7rSAGtP10GvGJzvpQsK6bpBMaYbN5Qvms1XoEXgJhzKdwxNXbIA0yk6qj68GggWT54xb0LYTuEc1N_VUeA4Sb_7MpZCFEAUzhoiOtc Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 963f525498ef4ebdb9db327df62bd68a Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveMigrationNegativeTest-1420816106 Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:52:58.965356 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_963f525498ef4ebdb9db327df62bd68a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/963f525498ef4ebdb9db327df62bd68a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/963f525498ef4ebdb9db327df62bd68a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/963f525498ef4ebdb9db327df62bd68a"}]}] Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveMigrationNegativeTest-1420816106 Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 963f525498ef4ebdb9db327df62bd68a Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1420816106 Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveMigrationNegativeTest-1420816106-project Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 04add76a65d74165b65189a5fd1f47ed Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveMigrationNegativeTest-1420816106-project Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 45c88671-ff54-4647-96ce-a5fabf200cc6 could not be found. Oct 01 20:52:58.966730 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '45c88671-ff54-4647-96ce-a5fabf200cc6'} Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c88671-ff54-4647-96ce-a5fabf200cc6 could not be found. Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:52:58.967585 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c88671-ff54-4647-96ce-a5fabf200cc6 could not be found. Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c88671-ff54-4647-96ce-a5fabf200cc6 could not be found. Oct 01 20:52:58.968983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:52:58.972170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] Returning 404 to user: Instance 45c88671-ff54-4647-96ce-a5fabf200cc6 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:52:58.973256 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29326432-2251-410b-9792-20e3cc7ed75f tempest-LiveMigrationNegativeTest-1420816106 tempest-LiveMigrationNegativeTest-1420816106-project] 10.222.0.17 "GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6" status: 404 len: 111 microversion: 2.1 time: 0.096867 Oct 01 20:52:58.977426 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 490/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:58 2022] GET /compute/v2.1/servers/45c88671-ff54-4647-96ce-a5fabf200cc6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:52:59.166405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:59.167055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:59.184426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:59.184927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:59.185364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:59.186086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:59.186718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:59.187148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:59.678049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:59.679316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:59.684971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:59.687990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:59.689769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:52:59.691886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:59.692803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:59.693450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:59.694257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:59.694817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:59.695312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:59.905929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:59.917501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:59.919378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:52:59.920839 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-75d93f21-c8c1-46e3-aeed-2f82161f6c91 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.758332 Oct 01 20:52:59.935543 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 512/1002] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:52:59 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:52:59.968660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:52:59.972646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:52:59.981981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:59.983035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:59.984007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:52:59.985029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:52:59.990820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:52:59.991568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:01.000296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:01.011723 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0cae04b8-5d03-4224-9034-264cd8415a53 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1495 microversion: 2.1 time: 1.337516 Oct 01 20:53:01.015872 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 491/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:59 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1495 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:01.221780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:01.233656 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9bff45b8-f66c-4a12-8fa5-f07bf55e78ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1538 microversion: 2.1 time: 1.274660 Oct 01 20:53:01.257078 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 513/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:52:59 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1538 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:01.274427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:01.279178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:01.296583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:01.297333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:01.303385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:01.304337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:01.305363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:01.305674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:01.425479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-142307721", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "ec752203-5965-4ae7-9a1e-81aacba30368"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:01.498667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] validate_networks() for [('ec752203-5965-4ae7-9a1e-81aacba30368', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:53:01.803896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:01.822251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:01.823965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:01.825888 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-426835b5-4483-4062-a125-3731256baec4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.567466 Oct 01 20:53:01.826721 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 514/1005] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:01 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:01.841279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0033a9ab-926c-4cc1-8c91-dea5414edc1c tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:01.842204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0033a9ab-926c-4cc1-8c91-dea5414edc1c tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:01.868576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0033a9ab-926c-4cc1-8c91-dea5414edc1c tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:01.869518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0033a9ab-926c-4cc1-8c91-dea5414edc1c tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:01.870203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0033a9ab-926c-4cc1-8c91-dea5414edc1c tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:01.871216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0033a9ab-926c-4cc1-8c91-dea5414edc1c tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:01.871801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0033a9ab-926c-4cc1-8c91-dea5414edc1c tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:01.872341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0033a9ab-926c-4cc1-8c91-dea5414edc1c tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:02.274817 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0033a9ab-926c-4cc1-8c91-dea5414edc1c tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1646 microversion: 2.1 time: 0.442663 Oct 01 20:53:02.279993 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 515/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:01 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1646 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:02.309009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:02.310409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:02.324681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:02.325596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:02.326322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:02.328441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:02.330178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:02.330829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:02.387257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:02.771367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:02.781380 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-84987cd8-e73a-4b26-b79c-29b900bdd63e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.499928 Oct 01 20:53:02.785538 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 516/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:02 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:02.808289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bee44a85-dac4-4806-85b8-33eb841fa8a7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:02.808871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bee44a85-dac4-4806-85b8-33eb841fa8a7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:02.826193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee44a85-dac4-4806-85b8-33eb841fa8a7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:02.826740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee44a85-dac4-4806-85b8-33eb841fa8a7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:02.831792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee44a85-dac4-4806-85b8-33eb841fa8a7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:02.832723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee44a85-dac4-4806-85b8-33eb841fa8a7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:02.833491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee44a85-dac4-4806-85b8-33eb841fa8a7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:02.833944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee44a85-dac4-4806-85b8-33eb841fa8a7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:02.960166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:53:02.960883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:53:02.962615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:53:02.963369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:53:02.964501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:53:02.989087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:02.990020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:02.991495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:02.993462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:02.996881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:02.999378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:03.070500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Getting quotas for project caba560a5eaa46c1b816e09230b5a1d9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:03.091653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Getting quotas for user d270f04a32ac44bc88fc57f8e765111e and project caba560a5eaa46c1b816e09230b5a1d9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:03.136145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:53:03.143129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:53:03.295673 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e936a7c-afd9-4a4f-a814-656788df8043 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.277069 Oct 01 20:53:03.297590 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 492/1008] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:53:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:53:03.304460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:03.305991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:03.317880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:03.318738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:03.319359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:03.320954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:03.323037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:03.323975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:03.412327 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bee44a85-dac4-4806-85b8-33eb841fa8a7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1646 microversion: 2.1 time: 0.622649 Oct 01 20:53:03.430583 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 517/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:02 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1646 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:03.435518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4a4c1c08-755b-4a73-9ab8-f0bd72f33431 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:03.437559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4a4c1c08-755b-4a73-9ab8-f0bd72f33431 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:03.661105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4a4c1c08-755b-4a73-9ab8-f0bd72f33431 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:03.673827 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4a4c1c08-755b-4a73-9ab8-f0bd72f33431 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1215 microversion: 2.1 time: 0.254594 Oct 01 20:53:03.677197 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 518/1010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:03 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:03.699872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3f4d97b8-5dfb-4849-8bbe-c583cde1feb7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:03.711381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f4d97b8-5dfb-4849-8bbe-c583cde1feb7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:03.714793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f4d97b8-5dfb-4849-8bbe-c583cde1feb7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:03.720943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f4d97b8-5dfb-4849-8bbe-c583cde1feb7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:03.726280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f4d97b8-5dfb-4849-8bbe-c583cde1feb7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:03.727043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f4d97b8-5dfb-4849-8bbe-c583cde1feb7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:03.730289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f4d97b8-5dfb-4849-8bbe-c583cde1feb7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:03.809856 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3f4d97b8-5dfb-4849-8bbe-c583cde1feb7 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.129171 Oct 01 20:53:03.812299 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 519/1011] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Oct 1 20:53:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:03.817867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:03.819062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:03.831545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:03.832437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:03.833053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:03.834188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:03.835426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:03.836382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:04.213058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:04.230675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:04.235172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:04.237912 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b258bf15-4249-48ad-b9f1-eaec4275bd52 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.937053 Oct 01 20:53:04.238694 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 493/1012] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:03 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:04.248984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18be9a0e-c576-4f4e-9046-d383649ad257 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:04.252668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-18be9a0e-c576-4f4e-9046-d383649ad257 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:04.268362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18be9a0e-c576-4f4e-9046-d383649ad257 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:04.269053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18be9a0e-c576-4f4e-9046-d383649ad257 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:04.273485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18be9a0e-c576-4f4e-9046-d383649ad257 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:04.274355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18be9a0e-c576-4f4e-9046-d383649ad257 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:04.275038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18be9a0e-c576-4f4e-9046-d383649ad257 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:04.275638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18be9a0e-c576-4f4e-9046-d383649ad257 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:04.366315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:04.381892 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b108e070-2e1f-4825-b3fa-3aa42fabef91 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.565763 Oct 01 20:53:04.382749 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 520/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:03 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:04.481521 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-18be9a0e-c576-4f4e-9046-d383649ad257 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888/action" status: 202 len: 0 microversion: 2.1 time: 0.238682 Oct 01 20:53:04.482752 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 494/1014] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:53:04 2022] POST /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:53:04.491058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a2b9b557-5169-4f24-8d7b-4742cb782888 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:04.492432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a2b9b557-5169-4f24-8d7b-4742cb782888 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:04.500417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2b9b557-5169-4f24-8d7b-4742cb782888 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:04.501854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2b9b557-5169-4f24-8d7b-4742cb782888 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:04.503696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2b9b557-5169-4f24-8d7b-4742cb782888 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:04.504940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2b9b557-5169-4f24-8d7b-4742cb782888 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:04.505793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2b9b557-5169-4f24-8d7b-4742cb782888 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:04.506398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2b9b557-5169-4f24-8d7b-4742cb782888 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:04.701056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:04.701774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:04.709847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:04.710354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:04.713056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:04.721567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:04.722075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:04.722915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:04.925050 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a2b9b557-5169-4f24-8d7b-4742cb782888 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1651 microversion: 2.1 time: 0.437800 Oct 01 20:53:04.928607 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 521/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:04 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1651 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:04.990261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:05.001138 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84ac11ea-3267-45c8-866b-6e7d78c35196 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1211 microversion: 2.1 time: 0.301832 Oct 01 20:53:05.003687 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 495/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:04 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1211 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:05.268672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:05.269354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:05.281277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:05.282512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:05.289799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:05.289799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:05.289799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:05.289799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:05.503134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-279e04e3-357e-4548-bafb-bd54a4bca0e0 tempest-NetworksTest-151032207 tempest-NetworksTest-151032207-project-admin] Calling method '.version_select at 0x7f417384d790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:06.001691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:06.014285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:06.020197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:06.027406 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9d0fbff4-81af-4e57-b2e4-a482378f73cd tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.763396 Oct 01 20:53:06.028531 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 522/1017] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:05 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:06.042439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:06.043293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:06.055917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:06.056898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:06.057325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:06.058477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:06.058477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:06.059561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:06.073895 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-279e04e3-357e-4548-bafb-bd54a4bca0e0 tempest-NetworksTest-151032207 tempest-NetworksTest-151032207-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks" status: 200 len: 9462 microversion: 2.1 time: 0.782316 Oct 01 20:53:06.074701 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 496/1018] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:53:05 2022] GET /compute/v2.1/os-networks => generated 9462 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:53:06.081149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebc46fa0-f61a-4325-b80f-38e2c39076c6 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:06.084028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebc46fa0-f61a-4325-b80f-38e2c39076c6 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:06.102790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc46fa0-f61a-4325-b80f-38e2c39076c6 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:06.106538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc46fa0-f61a-4325-b80f-38e2c39076c6 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:06.108166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc46fa0-f61a-4325-b80f-38e2c39076c6 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:06.116159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc46fa0-f61a-4325-b80f-38e2c39076c6 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:06.116914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc46fa0-f61a-4325-b80f-38e2c39076c6 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:06.118339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc46fa0-f61a-4325-b80f-38e2c39076c6 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:06.592783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:06.602911 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebc46fa0-f61a-4325-b80f-38e2c39076c6 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1631 microversion: 2.1 time: 0.526113 Oct 01 20:53:06.604604 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 497/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:06 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1631 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:06.618777 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-710a3be1-59ec-4706-8aa1-6d61edfb01d2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.587868 Oct 01 20:53:06.621446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:06.622677 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 523/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:06 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:06.623590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:06.633010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8cbd6728-5c70-489c-a7a6-b5e7d7802042 tempest-NetworksTest-151032207 tempest-NetworksTest-151032207-project-admin] Calling method '.version_select at 0x7f4173615c10>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:06.654554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:06.661916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:06.662833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:06.663779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:06.664722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:06.665441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:06.793717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:06.809464 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-40062806-3423-4100-a438-b85a9a29be78 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1273 microversion: 2.1 time: 0.203457 Oct 01 20:53:06.830180 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 498/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:06 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:06.853166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:06.856819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:06.864890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:06.865419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:06.866466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:06.867467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:06.868369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:06.868966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:06.911742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lazy-loading 'flavor' on Instance uuid fc3d670b-2ef6-4707-86ae-f91be8167888 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:53:06.935302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Going to try to live migrate instance to nch2-master-1 {{(pid=140438) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 20:53:07.329642 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8cbd6728-5c70-489c-a7a6-b5e7d7802042 tempest-NetworksTest-151032207 tempest-NetworksTest-151032207-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks/bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249" status: 200 len: 652 microversion: 2.1 time: 0.704604 Oct 01 20:53:07.332521 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 524/1022] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 20:53:06 2022] GET /compute/v2.1/os-networks/bb20eb3e-f9a1-43cb-ac7d-f5ec6751a249 => generated 652 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:07.351935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:07.353235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:07.370860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:07.371377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:07.371829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:07.373293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:07.373823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:07.389147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:08.427057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:08.456377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:08.457926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:08.459217 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-003e276d-072f-4289-94b5-7b9f07290877 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 1.125349 Oct 01 20:53:08.460993 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 525/1023] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:07 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:08.466418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-301f698e-ec94-49c3-9245-c7a7c293f3a9 tempest-NetworksTest-151032207 tempest-NetworksTest-151032207-project-admin] Calling method '.version_select at 0x7f4173649d30>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:09.263430 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-301f698e-ec94-49c3-9245-c7a7c293f3a9 tempest-NetworksTest-151032207 tempest-NetworksTest-151032207-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks" status: 200 len: 9462 microversion: 2.1 time: 0.801086 Oct 01 20:53:09.264479 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 526/1024] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:53:08 2022] GET /compute/v2.1/os-networks => generated 9462 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:09.269570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:09.272067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:09.288249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:09.289295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:09.289973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:09.291339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:09.292114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:09.293751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:09.683849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:09.704781 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-602dd4bc-6b59-482b-bf90-a7a5817f0b16 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.439012 Oct 01 20:53:09.705659 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 527/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:09 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:09.726141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:09.726895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:09.738395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:09.740783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:09.741235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:09.742199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:09.742696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:09.743125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:10.038776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:10.047512 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-036d13e6-2d10-4129-bc0e-b99a4fce8a69 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888/action" status: 202 len: 0 microversion: 2.1 time: 3.215332 Oct 01 20:53:10.049297 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 499/1026] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:53:06 2022] POST /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888/action => generated 0 bytes in 3218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:53:10.049559 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-173eb94e-7fcb-4cdc-912d-8b3892c76b7a tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1315 microversion: 2.1 time: 0.342661 Oct 01 20:53:10.050313 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 528/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:09 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:10.056575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:10.057419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:10.070222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:10.071045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:10.071958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:10.073204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:10.074557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:10.075235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:10.361852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-755a1af8-38c1-4616-944d-51cf01851822 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Action: 'create', calling method: .version_select at 0x7f41737d10d0>, body: {"pool": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:10.732666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:10.750616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:10.754186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:10.759254 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ce557008-7bfb-49a3-8f8b-9495503d6599 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.707750 Oct 01 20:53:10.760270 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 529/1028] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:10 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:11.221651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1748603607", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "865ef00f-9395-4fab-b79f-2237ecbc6955"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:11.297604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] validate_networks() for [('865ef00f-9395-4fab-b79f-2237ecbc6955', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:53:12.643140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:53:12.644558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:53:12.645702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:53:12.646300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:53:12.647199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:53:12.657948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:12.658717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:12.664249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:12.665678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:12.666330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:12.667273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:12.704452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Getting quotas for project 1a2694c8af60455aa9db5997c53adbdc. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:12.712330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Getting quotas for user f4de9e6274c041da9c366ea00c0bf769 and project 1a2694c8af60455aa9db5997c53adbdc. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:12.735375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:53:12.740443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:53:12.845985 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-79233e05-1cec-4f13-a530-d22e09914831 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.083435 Oct 01 20:53:12.848063 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 530/1029] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:53:12.857940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:12.869347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:12.880704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:12.881407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:12.882048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:12.882975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:12.883636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:12.884746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:13.037983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:13.116188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:13.512757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:13.524826 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1e98f2ad-3a1c-4ff3-8e8c-854d9d2a23bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1505 microversion: 2.1 time: 0.674669 Oct 01 20:53:13.525647 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 531/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:12 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1505 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:13.533216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:13.534147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:13.541315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:13.543222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:13.543825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:13.544887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:13.545588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:13.546369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:14.047028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:14.055379 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7c883c75-1345-405c-b2c6-c1e70f8066b6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.528457 Oct 01 20:53:14.055991 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 532/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:13 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:14.061564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:14.062183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:14.069686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:14.070705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:14.071161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:14.071877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:14.072337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:14.072768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:14.393791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:14.401784 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6cb54690-ce94-473d-babd-af7cc991fc97 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1315 microversion: 2.1 time: 0.344605 Oct 01 20:53:14.402369 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 533/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:14 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:14.408499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-44b38c4c-adb4-41c8-a513-79544a9e0b80 req-17712553-aa21-4500-811e-5134567e7cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16dbeaba-b86b-4a6c-a711-cf432c8680d9", "tag": "0a0f154d-a6dc-40d0-bf25-ee963c5036de"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:14.421709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-44b38c4c-adb4-41c8-a513-79544a9e0b80 req-17712553-aa21-4500-811e-5134567e7cca service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:14.422205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-44b38c4c-adb4-41c8-a513-79544a9e0b80 req-17712553-aa21-4500-811e-5134567e7cca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:14.422687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-44b38c4c-adb4-41c8-a513-79544a9e0b80 req-17712553-aa21-4500-811e-5134567e7cca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:14.436672 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-44b38c4c-adb4-41c8-a513-79544a9e0b80 req-17712553-aa21-4500-811e-5134567e7cca service nova] Creating event network-changed:0a0f154d-a6dc-40d0-bf25-ee963c5036de for instance 16dbeaba-b86b-4a6c-a711-cf432c8680d9 on nch2-master-1 Oct 01 20:53:14.442175 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-44b38c4c-adb4-41c8-a513-79544a9e0b80 req-17712553-aa21-4500-811e-5134567e7cca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038356 Oct 01 20:53:14.443317 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 534/1033] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:14.448635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:14.449536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:14.452856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:14.457805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:14.458590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:14.459214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:14.460098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:14.460720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:14.461304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:14.507352 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-755a1af8-38c1-4616-944d-51cf01851822 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.454962 Oct 01 20:53:14.510757 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 500/1034] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:53:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:14.518403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:14.519153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:14.529159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:14.529781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:14.530859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:14.531725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:14.532228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:14.532665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:14.645463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:14.653439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5fc019e4-e8d8-4c7c-8f9a-b78d930ef88e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1276 microversion: 2.1 time: 0.141432 Oct 01 20:53:14.654013 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 501/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:14 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:14.797436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:14.808614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:14.810066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:14.816584 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-86f094a3-731f-42ec-8302-86f7a5e1546a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.372063 Oct 01 20:53:14.817607 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 535/1036] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:14 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:14.822763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d2c16b82-dbe0-4c1e-81e7-39bd531ae7f4 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Action: 'create', calling method: .version_select at 0x7f417370e5e0>, body: {"pool": null} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:14.831479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-447971618", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:14.913537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:53:15.389292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:53:15.389906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:53:15.390402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:53:15.391078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:53:15.391538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:53:15.407502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:15.408501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:15.409412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:15.410547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:15.411392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:15.412017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:15.437410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:15.443894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:15.458147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:53:15.461586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:53:15.523037 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd224093-b655-46f7-bf94-93af55c4fc70 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867862 Oct 01 20:53:15.530983 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 502/1037] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:53:15.536404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:15.537339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:15.552975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:15.553738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:15.554393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:15.555403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:15.556811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:15.557417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:16.023482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:16.040814 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cfe9abf7-7081-4fea-873e-6138ea09a6fd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1505 microversion: 2.1 time: 0.508258 Oct 01 20:53:16.053480 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 503/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:15 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:16.065735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:16.066361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:16.072500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:16.073262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:16.074095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:16.075073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:16.076089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:16.076089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:16.554923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:16.569653 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-93f75338-e3d6-4d57-9db4-a92115950820 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.514214 Oct 01 20:53:16.570759 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 504/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:16 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:16.591106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:16.591822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:16.598862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:16.599645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:16.599645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:16.600446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:16.600983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:16.601629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:17.432539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:17.440807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4e214c8-2a91-424d-8563-3ead61f3eef0 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1315 microversion: 2.1 time: 0.853808 Oct 01 20:53:17.442187 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 505/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:16 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:17.447134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:17.448034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:17.455831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:17.456616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:17.457165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:17.458004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:17.458910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:17.459596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:17.609590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:17.619901 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34b27f5e-0f87-4dd8-bf99-8f62cffd14ec tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1274 microversion: 2.1 time: 0.176388 Oct 01 20:53:17.621046 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 506/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:17 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:17.626596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:17.627419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:17.633737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:17.635412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:17.636169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:17.637054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:17.637682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:17.638312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:17.660651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:18.111988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid ee54a04f-6360-4f81-a7ba-68d65e8d8d36 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:53:18.133155 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-52f32086-3fef-419e-b4db-0c0f3fc78181 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 2342 microversion: 2.25 time: 0.510756 Oct 01 20:53:18.134531 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 507/1042] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:17 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 2342 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:18.155506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:18.157121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:18.166096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.166884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.167548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.168460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.169111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.169739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.280923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:18.288722 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-443f42d0-d932-4220-aa32-ac3964811948 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1282 microversion: 2.1 time: 0.152924 Oct 01 20:53:18.289302 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 508/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:18 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1282 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:18.301879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:18.302777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:18.309384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.310125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.310597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.311474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.312333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.313482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.315654 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d2c16b82-dbe0-4c1e-81e7-39bd531ae7f4 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.496956 Oct 01 20:53:18.316564 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 536/1044] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:53:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:18.321574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ace745c2-dd0d-46e0-b5da-ff46dd604c39 req-039e3a9e-952e-4e44-bb8b-808c177a37f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3d670b-2ef6-4707-86ae-f91be8167888", "name": "network-vif-unplugged", "status": "completed", "tag": "93297d56-6416-43dd-8e55-db06d23206f3"}, {"name": "network-changed", "server_uuid": "fc3d670b-2ef6-4707-86ae-f91be8167888", "tag": "93297d56-6416-43dd-8e55-db06d23206f3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:18.342704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ace745c2-dd0d-46e0-b5da-ff46dd604c39 req-039e3a9e-952e-4e44-bb8b-808c177a37f4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.343383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ace745c2-dd0d-46e0-b5da-ff46dd604c39 req-039e3a9e-952e-4e44-bb8b-808c177a37f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.344165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ace745c2-dd0d-46e0-b5da-ff46dd604c39 req-039e3a9e-952e-4e44-bb8b-808c177a37f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.358723 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ace745c2-dd0d-46e0-b5da-ff46dd604c39 req-039e3a9e-952e-4e44-bb8b-808c177a37f4 service nova] Creating event network-vif-unplugged:93297d56-6416-43dd-8e55-db06d23206f3 for instance fc3d670b-2ef6-4707-86ae-f91be8167888 on nch1-master-1 Oct 01 20:53:18.359601 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ace745c2-dd0d-46e0-b5da-ff46dd604c39 req-039e3a9e-952e-4e44-bb8b-808c177a37f4 service nova] Creating event network-changed:93297d56-6416-43dd-8e55-db06d23206f3 for instance fc3d670b-2ef6-4707-86ae-f91be8167888 on nch1-master-1 Oct 01 20:53:18.365245 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ace745c2-dd0d-46e0-b5da-ff46dd604c39 req-039e3a9e-952e-4e44-bb8b-808c177a37f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.047536 Oct 01 20:53:18.366053 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 537/1045] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:18.371460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:18.372162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:18.379164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.379659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.380097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.380797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.381424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.381849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.822836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:18.829060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:18.841700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:18.843009 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9084fac6-2aa8-4b28-8fd7-c77391fbdefd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1505 microversion: 2.1 time: 0.474981 Oct 01 20:53:18.844971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:18.845299 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 538/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:18 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:18.848111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-56de5dc2-a95e-4aac-b071-7829a90ac5eb tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.556222 Oct 01 20:53:18.849413 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 509/1047] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:18 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:18.874102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:18.874971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:18.883093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fdd4b1e2-247b-4e2c-b397-25165e823d9e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:18.883777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.884521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.885177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.886215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.887326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.888253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.896231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdd4b1e2-247b-4e2c-b397-25165e823d9e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.901190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdd4b1e2-247b-4e2c-b397-25165e823d9e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.901713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdd4b1e2-247b-4e2c-b397-25165e823d9e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.903098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdd4b1e2-247b-4e2c-b397-25165e823d9e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:18.905600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdd4b1e2-247b-4e2c-b397-25165e823d9e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:18.907041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdd4b1e2-247b-4e2c-b397-25165e823d9e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:18.958735 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fdd4b1e2-247b-4e2c-b397-25165e823d9e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.107486 Oct 01 20:53:18.959887 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 510/1048] 10.222.0.17 () {60 vars in 1217 bytes} [Sat Oct 1 20:53:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:53:18.966456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e64a88f-2c9c-49ee-ac72-e6fde2623633 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Action: 'create', calling method: .version_select at 0x7f41737dbaf0>, body: {"pool": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:19.612839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:19.617543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:19.636491 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-14c52030-91ad-4c54-9968-af85f4f89645 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.788509 Oct 01 20:53:19.640030 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 539/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:18 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:19.655364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:19.658776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:19.685479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:19.687236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:19.688936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:19.690132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:19.690833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:19.691464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:20.167930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:20.175779 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-73784b49-b17f-43b9-af6d-bf85d5309278 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1315 microversion: 2.1 time: 0.533375 Oct 01 20:53:20.176383 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 540/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:19 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:20.194569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:20.195196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:20.201249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:20.201734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:20.202173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:20.202897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:20.203850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:20.204274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:21.127195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:21.136681 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-34e3c361-5b8c-4d96-965e-1416c204283f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1316 microversion: 2.1 time: 0.959084 Oct 01 20:53:21.146986 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 541/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:20 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1316 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:21.146986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:21.146986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:21.153083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:21.153860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:21.154797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:21.155560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:21.156900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:21.157524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:21.648879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:21.656790 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9644e94d-1cb8-4d63-8eb2-3fa03e55df88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1324 microversion: 2.1 time: 0.517500 Oct 01 20:53:21.657377 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 542/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:21 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1324 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:21.661930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:21.662550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:21.669618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:21.670365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:21.670835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:21.672316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:21.672973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:21.673407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:22.177302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:22.188449 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c56e047c-c881-4d56-93d3-88c129618dfc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1505 microversion: 2.1 time: 0.530021 Oct 01 20:53:22.198880 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 543/1053] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:21 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:22.204775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:22.205624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:22.211763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:22.212258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:22.212701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:22.213402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:22.213865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:22.214292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:22.683879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:22.722898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:22.829806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:22.841901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:22.843983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:22.845621 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-257b56e7-097b-4dc0-96d1-532618f1a463 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.645316 Oct 01 20:53:22.846415 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 544/1054] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:22 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:22.852855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b120f13f-7129-4b56-8000-94c52ca2a2dc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ffa640e-11d3-4b20-a2d6-2b0316d715b0", "device": "/dev/xvdb"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:22.855931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b120f13f-7129-4b56-8000-94c52ca2a2dc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:22.863524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b120f13f-7129-4b56-8000-94c52ca2a2dc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:22.864378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b120f13f-7129-4b56-8000-94c52ca2a2dc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:22.864991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b120f13f-7129-4b56-8000-94c52ca2a2dc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:22.865705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b120f13f-7129-4b56-8000-94c52ca2a2dc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:22.866230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b120f13f-7129-4b56-8000-94c52ca2a2dc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:22.866770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b120f13f-7129-4b56-8000-94c52ca2a2dc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:23.135072 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b120f13f-7129-4b56-8000-94c52ca2a2dc tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "POST /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.286289 Oct 01 20:53:23.141401 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 545/1055] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Oct 1 20:53:22 2022] POST /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:53:23.154321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:23.159404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:23.168515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:23.169180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:23.172176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:23.173889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:23.174749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:23.175361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:23.986107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:23.995155 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ed7d75f6-46c8-4673-854e-8248ff2726eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.857997 Oct 01 20:53:23.996036 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 546/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:23 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:24.002232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:24.003282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:24.011362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.012076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.012708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.013554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.014146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.015619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.057108 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e64a88f-2c9c-49ee-ac72-e6fde2623633 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.095631 Oct 01 20:53:24.058288 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 511/1057] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:53:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:24.070868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:24.071742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:24.081545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.082282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.082948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.083836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.084465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.085063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.360319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:24.371224 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-97a9ff2e-d39a-4e7d-a0fd-ed36d448653d tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1315 microversion: 2.1 time: 0.373937 Oct 01 20:53:24.372617 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 547/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:23 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:24.377949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a8570dfe-2497-4db7-a3d0-4952b6ad20d6 req-c64412ea-634d-4d53-af6c-c33923cd552e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e5943e-d2fe-4e7b-9140-ffe35a8aca4c", "tag": "a390abec-97aa-4416-8c5b-b217df3504f2"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:24.394904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:24.403854 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f06abc54-05a1-47f1-a428-a7a4eb842d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1316 microversion: 2.1 time: 0.343528 Oct 01 20:53:24.404455 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 512/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:24 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:24.406926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a8570dfe-2497-4db7-a3d0-4952b6ad20d6 req-c64412ea-634d-4d53-af6c-c33923cd552e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.407631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a8570dfe-2497-4db7-a3d0-4952b6ad20d6 req-c64412ea-634d-4d53-af6c-c33923cd552e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.408077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a8570dfe-2497-4db7-a3d0-4952b6ad20d6 req-c64412ea-634d-4d53-af6c-c33923cd552e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.417009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:24.417641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:24.430594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.431103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.432398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.433130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.433602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.434044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.435342 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a8570dfe-2497-4db7-a3d0-4952b6ad20d6 req-c64412ea-634d-4d53-af6c-c33923cd552e service nova] Creating event network-changed:a390abec-97aa-4416-8c5b-b217df3504f2 for instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c on nch2-master-1 Oct 01 20:53:24.440869 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a8570dfe-2497-4db7-a3d0-4952b6ad20d6 req-c64412ea-634d-4d53-af6c-c33923cd552e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067000 Oct 01 20:53:24.441825 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 548/1060] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:24.446839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:24.447541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:24.455758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.456474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.456912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.457826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.458407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.458809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.652612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:24.655507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:24.661051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-53cc40e6-4f97-4f43-b796-ffd97fb77be8 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1324 microversion: 2.1 time: 0.247885 Oct 01 20:53:24.661638 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 513/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:24 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:24.663956 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dbd6301c-d5a6-4b5c-8377-9e6d24110b09 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1480 microversion: 2.1 time: 0.221001 Oct 01 20:53:24.664679 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 549/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:24 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1480 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:24.669130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d5272da8-7fba-4835-8518-a03d1c297bfd tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Action: 'create', calling method: .version_select at 0x7f41736028b0>, body: {"pool": null} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:24.676519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:24.677203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:24.683705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.684212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.684664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.685559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.686027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.686465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.934073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:24.943694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:24.945275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:24.946437 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f170723b-5b6f-4299-b58a-0ab8a59d336a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.283870 Oct 01 20:53:24.947104 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 514/1063] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:24 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:24.958681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5aadc392-a88a-494e-a822-c85709b8fd08 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '.version_select at 0x7f41738224c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:24.958681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5aadc392-a88a-494e-a822-c85709b8fd08 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.958681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5aadc392-a88a-494e-a822-c85709b8fd08 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.958681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5aadc392-a88a-494e-a822-c85709b8fd08 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.967155 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5aadc392-a88a-494e-a822-c85709b8fd08 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.019075 Oct 01 20:53:24.967742 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 515/1064] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:53:24 2022] GET /compute/v2.1/os-migrations => generated 2729 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:24.983922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-31d41512-9c54-480a-a9e3-08f18577d852 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:24.984562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-31d41512-9c54-480a-a9e3-08f18577d852 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:24.990634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31d41512-9c54-480a-a9e3-08f18577d852 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.991117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31d41512-9c54-480a-a9e3-08f18577d852 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.991835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31d41512-9c54-480a-a9e3-08f18577d852 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:24.992712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31d41512-9c54-480a-a9e3-08f18577d852 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:24.993174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31d41512-9c54-480a-a9e3-08f18577d852 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:24.993597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31d41512-9c54-480a-a9e3-08f18577d852 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:25.210043 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-31d41512-9c54-480a-a9e3-08f18577d852 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1631 microversion: 2.1 time: 0.229637 Oct 01 20:53:25.210762 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 516/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:24 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1631 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:53:25.215777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:25.216648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:25.223278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:25.223848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:25.224362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:25.225161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:25.225936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:25.226444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:25.451106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:25.531963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:25.540362 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f5a8be17-54ad-4f38-806f-0176d0eac79b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.328344 Oct 01 20:53:25.540924 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 517/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:25 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:25.547071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1098737f-3c2c-469e-a80b-5bce99e52664 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Action: 'create', calling method: .version_select at 0x7f417383b820>, body: {"keypair": {"name": "tempest-keypair-1509059810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdLViXvLR8GgIzN5qbibtlorH2/RBKDdW4JmvE+oC05QgEDNSUWRXo+PKcOoLJFi5nCz+c49shnIyj3Z/S8qTlmu2dGwowgDX7FX3/DposrrUB1Et7Ruybzyy0FV3Pu4Q=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:25.565193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1098737f-3c2c-469e-a80b-5bce99e52664 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for project 237c6bad691343e7a7e64304f55e01e9. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:25.573830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1098737f-3c2c-469e-a80b-5bce99e52664 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for user a749a74841e840e2b8de67fb9562bf51 and project 237c6bad691343e7a7e64304f55e01e9. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:25.603836 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1098737f-3c2c-469e-a80b-5bce99e52664 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061411 Oct 01 20:53:25.604566 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 518/1067] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:53:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:25.609272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:25.609892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:25.616371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:25.616866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:25.617424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:25.618817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:25.619287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:25.619721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:25.941945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:25.951604 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75c9d265-f643-4ed5-a00f-90b36fba1e74 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1315 microversion: 2.1 time: 0.345972 Oct 01 20:53:25.952305 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 519/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:25 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:25.960377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:25.961666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:25.972088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:25.972688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:25.973230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:25.974158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:25.975282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:25.975835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:26.262512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:26.279560 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9f417411-f3b8-49b7-8b26-7608ce9dba89 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1316 microversion: 2.1 time: 0.321712 Oct 01 20:53:26.282709 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 520/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:25 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:26.290416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:26.291490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:26.298854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:26.299583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:26.300583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:26.301470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:26.302538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:26.303213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:26.654077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:26.667990 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-db91add9-7468-4d58-9c6e-e4b320c57551 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1324 microversion: 2.1 time: 0.383757 Oct 01 20:53:26.680566 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 521/1070] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:26 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:26.694015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:26.694723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:26.713054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:26.713804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:26.715398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:26.715772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:26.717378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:26.717926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:26.753822 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d5272da8-7fba-4835-8518-a03d1c297bfd tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.087583 Oct 01 20:53:26.759059 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 550/1071] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:53:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:26.766187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-556214a6-7d13-42c0-8704-7193f472b56a req-715abd7b-3cc5-4e1e-b8c2-abfc1344c1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c51efc3-f63a-4767-a6b1-ea93db136447", "tag": "da9dc053-8628-4335-88b6-12d5540ec545"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:26.791850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-556214a6-7d13-42c0-8704-7193f472b56a req-715abd7b-3cc5-4e1e-b8c2-abfc1344c1b3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:26.792638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-556214a6-7d13-42c0-8704-7193f472b56a req-715abd7b-3cc5-4e1e-b8c2-abfc1344c1b3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:26.793227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-556214a6-7d13-42c0-8704-7193f472b56a req-715abd7b-3cc5-4e1e-b8c2-abfc1344c1b3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:26.808913 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-556214a6-7d13-42c0-8704-7193f472b56a req-715abd7b-3cc5-4e1e-b8c2-abfc1344c1b3 service nova] Creating event network-changed:da9dc053-8628-4335-88b6-12d5540ec545 for instance 8c51efc3-f63a-4767-a6b1-ea93db136447 on nch1-master-1 Oct 01 20:53:26.815380 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-556214a6-7d13-42c0-8704-7193f472b56a req-715abd7b-3cc5-4e1e-b8c2-abfc1344c1b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054749 Oct 01 20:53:26.816504 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 551/1072] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:26.822413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:26.823506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:26.833442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:26.834378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:26.834842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:26.837392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:26.838397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:26.839380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:27.103522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:27.104128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:27.121152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:27.122041 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b324333a-5b31-40d9-9d83-8580c2ab0cf2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.303718 Oct 01 20:53:27.122961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:27.134672 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 552/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:26 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:27.134672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d65735e3-0e2d-4f53-a4b8-a465c440ac31 req-b32af76e-45ac-49ea-bdfc-76f160a25aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-plugged", "status": "completed", "tag": "e3c20a77-5ca5-4d7e-9621-467c8ec0eded"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:27.136620 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba915267-f55a-4e1f-8d0b-1444cfae04ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.455317 Oct 01 20:53:27.142436 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 522/1074] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:26 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:27.149078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92678f4c-31db-410f-a020-62b22a90056e tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Calling method '.version_select at 0x7f4173822c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:27.153169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d65735e3-0e2d-4f53-a4b8-a465c440ac31 req-b32af76e-45ac-49ea-bdfc-76f160a25aa0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:27.153835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d65735e3-0e2d-4f53-a4b8-a465c440ac31 req-b32af76e-45ac-49ea-bdfc-76f160a25aa0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:27.154332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d65735e3-0e2d-4f53-a4b8-a465c440ac31 req-b32af76e-45ac-49ea-bdfc-76f160a25aa0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:27.180034 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d65735e3-0e2d-4f53-a4b8-a465c440ac31 req-b32af76e-45ac-49ea-bdfc-76f160a25aa0 service nova] Creating event network-vif-plugged:e3c20a77-5ca5-4d7e-9621-467c8ec0eded for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:53:27.187892 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d65735e3-0e2d-4f53-a4b8-a465c440ac31 req-b32af76e-45ac-49ea-bdfc-76f160a25aa0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060107 Oct 01 20:53:27.189404 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 553/1075] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:27.195424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:27.196477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:27.204308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:27.204931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:27.205270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:27.205984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:27.206451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:27.206911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:27.399804 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92678f4c-31db-410f-a020-62b22a90056e tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/3a400c8a-bcda-4c7e-bf4f-5e49e9943d20" status: 200 len: 142 microversion: 2.1 time: 0.255447 Oct 01 20:53:27.401318 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 523/1076] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 20:53:27 2022] GET /compute/v2.1/os-floating-ips/3a400c8a-bcda-4c7e-bf4f-5e49e9943d20 => generated 142 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:27.407604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:27.408655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:27.415010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:27.415635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:27.416082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:27.416812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:27.417260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:27.421330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:27.426197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:27.430811 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-397cceec-097e-4274-a999-791fe52fb309 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1315 microversion: 2.1 time: 0.240030 Oct 01 20:53:27.431605 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 554/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:27 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:27.436765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2011442695", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "e7712b88-b266-47cd-9f95-cfb0ee26fa9f"}], "security_groups": [{"name": "tempest-securitygroup--254386267"}], "key_name": "tempest-keypair-1509059810", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:27.591635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] validate_networks() for [('e7712b88-b266-47cd-9f95-cfb0ee26fa9f', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:53:27.647929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:27.657131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e505b3f4-dfc6-46fd-b8d9-fbc54fda537e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1316 microversion: 2.1 time: 0.254587 Oct 01 20:53:27.665403 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 524/1078] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:27 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:27.676145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b674015-f3ea-4155-b5ef-0f6b546980bc tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Calling method '.version_select at 0x7f41739058b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:28.705578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:53:28.706233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:53:28.706853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:53:28.707468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:53:28.708183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:53:28.720384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:28.721028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:28.721907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:28.723136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:28.723765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:28.724366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:28.742929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for project 237c6bad691343e7a7e64304f55e01e9. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:28.750033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for user a749a74841e840e2b8de67fb9562bf51 and project 237c6bad691343e7a7e64304f55e01e9. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:28.764831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:53:28.767894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:53:28.826236 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-da8419a8-f301-468e-86a5-aa6bf79a508a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.393356 Oct 01 20:53:28.828245 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 555/1079] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:53:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:53:28.842406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:28.844046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:28.855275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:28.857828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:28.858474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:28.859631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:28.862247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:28.863281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:28.932258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:29.170290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:29.181321 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b674015-f3ea-4155-b5ef-0f6b546980bc tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/3a400c8a-bcda-4c7e-bf4f-5e49e9943d20" status: 202 len: 0 microversion: 2.1 time: 1.522529 Oct 01 20:53:29.181930 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b2252e91-35e5-4dad-b59d-2455a14c448c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1324 microversion: 2.1 time: 0.350631 Oct 01 20:53:29.182070 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 525/1080] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:53:27 2022] DELETE /compute/v2.1/os-floating-ips/3a400c8a-bcda-4c7e-bf4f-5e49e9943d20 => generated 0 bytes in 1524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:53:29.183103 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 556/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:28 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:29.187547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:29.190821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:29.195548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:29.200269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.201082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.201860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.203496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.204191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.204624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.205549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:29.206245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:29.215342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.216213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.216837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.217700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.219955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.220565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.446508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:29.454918 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2fe49426-6b92-498b-a05b-81fcb009d159 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1543 microversion: 2.1 time: 0.271828 Oct 01 20:53:29.455596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 526/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:29 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1543 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:29.460126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:29.460734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:29.466359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.467092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.467533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.468278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.469228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.469659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.474769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:29.484000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:29.485600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:29.486764 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-19ecbd5b-0135-415b-8ba5-20385e5b4893 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.302244 Oct 01 20:53:29.487313 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 557/1083] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:29 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:29.491783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:29.492383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:29.497936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.498426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.498899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.500176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.500715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.501416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.834670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:29.837231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:29.846154 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-60479c24-914d-4680-ae57-a1c8ac24293e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1316 microversion: 2.1 time: 0.357806 Oct 01 20:53:29.847014 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 558/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:29 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:29.852301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:29.853086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:29.860073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.860733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.861054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:29.861513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.862398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:29.863045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:29.863630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:29.878609 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c449abf-23e3-4d48-9396-c5883f49cc7f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1315 microversion: 2.1 time: 0.421852 Oct 01 20:53:29.879644 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 527/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:29 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:29.901483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-301802ba-66ef-46c7-9f71-2c4dfda2004e tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Calling method '.version_select at 0x7f4173822a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:30.065912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:30.075537 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-986de328-6f9a-4a4d-a4fa-7911d61973df tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1287 microversion: 2.1 time: 0.227192 Oct 01 20:53:30.076682 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 559/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:29 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1287 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:30.082485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-plugged", "status": "completed", "tag": "8e13aabc-dce0-48f9-99b6-bb6839ff32cf"}, {"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-plugged", "status": "completed", "tag": "763cb4a6-c74b-499d-b2d2-9e97df7f57dd"}, {"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-plugged", "status": "completed", "tag": "e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba"}, {"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-plugged", "status": "completed", "tag": "6f2ebed3-0185-425f-97ad-a2760826ab42"}, {"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-plugged", "status": "completed", "tag": "f09e681e-660d-4b59-82a1-b74fb5573e9e"}, {"server_uuid": "16dbeaba-b86b-4a6c-a711-cf432c8680d9", "name": "network-vif-plugged", "status": "completed", "tag": "0a0f154d-a6dc-40d0-bf25-ee963c5036de"}, {"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-plugged", "status": "completed", "tag": "3c68fc4b-2f4b-4e13-93c2-8872ece1ad74"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:30.095583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:30.096075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:30.096614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:30.110191 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Creating event network-vif-plugged:8e13aabc-dce0-48f9-99b6-bb6839ff32cf for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:53:30.110813 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Creating event network-vif-plugged:763cb4a6-c74b-499d-b2d2-9e97df7f57dd for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:53:30.111412 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Creating event network-vif-plugged:e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:53:30.111989 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Creating event network-vif-plugged:6f2ebed3-0185-425f-97ad-a2760826ab42 for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:53:30.112561 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Creating event network-vif-plugged:f09e681e-660d-4b59-82a1-b74fb5573e9e for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:53:30.113131 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Creating event network-vif-plugged:0a0f154d-a6dc-40d0-bf25-ee963c5036de for instance 16dbeaba-b86b-4a6c-a711-cf432c8680d9 on nch2-master-1 Oct 01 20:53:30.113696 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] Creating event network-vif-plugged:3c68fc4b-2f4b-4e13-93c2-8872ece1ad74 for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:53:30.121249 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c15e2020-4c8c-404c-a908-3dcc0df2b535 req-20abdea8-dd61-4994-8372-3d51c2505cf8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.042568 Oct 01 20:53:30.121858 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 560/1087] 10.222.0.17 () {64 vars in 1318 bytes} [Sat Oct 1 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:30.127630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:30.128335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:30.134606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:30.135107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:30.135547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:30.136251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:30.136708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:30.137138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:30.426738 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-301802ba-66ef-46c7-9f71-2c4dfda2004e tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.545790 Oct 01 20:53:30.427483 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 528/1088] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Oct 1 20:53:29 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:53:30.433773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:30.434401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:30.442478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:30.444062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:30.445252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:30.446201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:30.446890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:30.448069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:30.544944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid ee54a04f-6360-4f81-a7ba-68d65e8d8d36 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:53:30.578190 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8d016d6b-5110-46ad-8a93-178b981e6e4d tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 2420 microversion: 2.25 time: 0.454705 Oct 01 20:53:30.579183 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 561/1089] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:30 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 2420 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:30.584488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bd0d5d4b-9c1c-4a02-9bfb-f09b57b52add tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Calling method '.version_select at 0x7f41736caaf0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:31.118524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:31.127343 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fb1e995e-938c-49a2-9cac-4f4019672497 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1324 microversion: 2.1 time: 0.698656 Oct 01 20:53:31.128267 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 529/1090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:30 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1324 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:31.147009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:31.147875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:31.155913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:31.156420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:31.157377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:31.158095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:31.158875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:31.159311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:31.165091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:31.174430 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bd0d5d4b-9c1c-4a02-9bfb-f09b57b52add tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.593316 Oct 01 20:53:31.175681 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 562/1091] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 20:53:30 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:31.192909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:31.194462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:31.205197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:31.206322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:31.207227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:31.208041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:31.210148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:31.210710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:31.586449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:31.595046 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-40d0805c-cec6-41de-af88-6e46f4e95a9e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1542 microversion: 2.1 time: 0.465491 Oct 01 20:53:31.595629 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 530/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:31 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1542 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:31.600396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:31.604262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:31.611797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:31.612579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:31.613192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:31.614068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:31.614710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:31.615286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:31.649643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'flavor' on Instance uuid ee54a04f-6360-4f81-a7ba-68d65e8d8d36 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:53:31.669004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:31.672177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Going to try to live migrate instance to nch2-master-1 {{(pid=140438) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 20:53:31.689848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:31.691343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:31.692554 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-513eeba3-e002-453a-b312-0e4ac86bc574 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1874 microversion: 2.42 time: 0.505738 Oct 01 20:53:31.694641 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 563/1093] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:31 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1874 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:31.711013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:31.712115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:31.721986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:31.723196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:31.729229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:31.731116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:31.732579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:31.733370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:32.501143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:32.532569 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e8cf9e04-5a84-4c19-a4de-61fb4b226267 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1316 microversion: 2.1 time: 0.830305 Oct 01 20:53:32.533115 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 564/1094] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:31 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:32.548984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:32.550146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:32.564941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:32.565442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:32.566765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:32.567630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:32.568274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:32.568862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:32.911064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:32.918983 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0911568b-fd96-4def-adfc-30fea74a4e77 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1502 microversion: 2.1 time: 0.383271 Oct 01 20:53:32.919641 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 565/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:32 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1502 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:32.925113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:32.925727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:32.931614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:32.932531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:32.932531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:32.933252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:32.933723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:32.934157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:33.064836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:33.073201 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-afad1831-7a84-4f36-845c-77d55a3f941e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1360 microversion: 2.1 time: 0.152283 Oct 01 20:53:33.073885 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 566/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:32 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:33.078974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-084bdb14-def4-4967-becc-b43d3c9ffbcc tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Calling method '.version_select at 0x7f4173615310>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:34.033060 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-084bdb14-def4-4967-becc-b43d3c9ffbcc tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/ac8ead2c-4dda-4c7f-b12f-16f2428b0b36" status: 202 len: 0 microversion: 2.1 time: 0.958014 Oct 01 20:53:34.033949 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 567/1097] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:53:33 2022] DELETE /compute/v2.1/os-floating-ips/ac8ead2c-4dda-4c7f-b12f-16f2428b0b36 => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:53:34.038583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-63ae752d-d06b-4598-829d-1dc6f6b7d3d5 req-d2fe40d7-91e0-4045-a57d-d6aff5acdfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1818557f-9772-403d-bfa8-d226f1063f2f", "name": "network-vif-unplugged", "status": "completed", "tag": "1dee487a-adae-475f-aff1-35bf8657a7f3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:34.050828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-63ae752d-d06b-4598-829d-1dc6f6b7d3d5 req-d2fe40d7-91e0-4045-a57d-d6aff5acdfa7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.051327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-63ae752d-d06b-4598-829d-1dc6f6b7d3d5 req-d2fe40d7-91e0-4045-a57d-d6aff5acdfa7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.051769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-63ae752d-d06b-4598-829d-1dc6f6b7d3d5 req-d2fe40d7-91e0-4045-a57d-d6aff5acdfa7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.063289 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-63ae752d-d06b-4598-829d-1dc6f6b7d3d5 req-d2fe40d7-91e0-4045-a57d-d6aff5acdfa7 service nova] Creating event network-vif-unplugged:1dee487a-adae-475f-aff1-35bf8657a7f3 for instance 1818557f-9772-403d-bfa8-d226f1063f2f on nch2-master-1 Oct 01 20:53:34.069034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-63ae752d-d06b-4598-829d-1dc6f6b7d3d5 req-d2fe40d7-91e0-4045-a57d-d6aff5acdfa7 service nova] Instance 1818557f-9772-403d-bfa8-d226f1063f2f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:53:34.079943 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-63ae752d-d06b-4598-829d-1dc6f6b7d3d5 req-d2fe40d7-91e0-4045-a57d-d6aff5acdfa7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044813 Oct 01 20:53:34.080552 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 568/1098] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:34.088577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-288d382f-5c1d-4087-853e-0c37b5ec5f42 req-5972bbb4-a410-48d0-b910-e84808c4d8ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed59d2f-d270-4882-b32b-89be0dedc71f", "tag": "66d65798-4e84-432e-b05a-65e6432c780b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:34.101471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-288d382f-5c1d-4087-853e-0c37b5ec5f42 req-5972bbb4-a410-48d0-b910-e84808c4d8ed service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.101963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-288d382f-5c1d-4087-853e-0c37b5ec5f42 req-5972bbb4-a410-48d0-b910-e84808c4d8ed service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.102400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-288d382f-5c1d-4087-853e-0c37b5ec5f42 req-5972bbb4-a410-48d0-b910-e84808c4d8ed service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.114348 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-288d382f-5c1d-4087-853e-0c37b5ec5f42 req-5972bbb4-a410-48d0-b910-e84808c4d8ed service nova] Creating event network-changed:66d65798-4e84-432e-b05a-65e6432c780b for instance bed59d2f-d270-4882-b32b-89be0dedc71f on nch1-master-1 Oct 01 20:53:34.119265 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-288d382f-5c1d-4087-853e-0c37b5ec5f42 req-5972bbb4-a410-48d0-b910-e84808c4d8ed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035211 Oct 01 20:53:34.119877 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 569/1099] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:34.124798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-8a6c4343-a132-4b01-bcf4-afef7efee089 req-e4e5ef12-c393-4d2c-a9a2-d224ca663efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c51efc3-f63a-4767-a6b1-ea93db136447", "name": "network-vif-plugged", "status": "completed", "tag": "da9dc053-8628-4335-88b6-12d5540ec545"}, {"server_uuid": "57e5943e-d2fe-4e7b-9140-ffe35a8aca4c", "name": "network-vif-plugged", "status": "completed", "tag": "a390abec-97aa-4416-8c5b-b217df3504f2"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:34.135264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8a6c4343-a132-4b01-bcf4-afef7efee089 req-e4e5ef12-c393-4d2c-a9a2-d224ca663efc service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.135756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8a6c4343-a132-4b01-bcf4-afef7efee089 req-e4e5ef12-c393-4d2c-a9a2-d224ca663efc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.136196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8a6c4343-a132-4b01-bcf4-afef7efee089 req-e4e5ef12-c393-4d2c-a9a2-d224ca663efc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.148692 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-8a6c4343-a132-4b01-bcf4-afef7efee089 req-e4e5ef12-c393-4d2c-a9a2-d224ca663efc service nova] Creating event network-vif-plugged:da9dc053-8628-4335-88b6-12d5540ec545 for instance 8c51efc3-f63a-4767-a6b1-ea93db136447 on nch1-master-1 Oct 01 20:53:34.149209 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-8a6c4343-a132-4b01-bcf4-afef7efee089 req-e4e5ef12-c393-4d2c-a9a2-d224ca663efc service nova] Creating event network-vif-plugged:a390abec-97aa-4416-8c5b-b217df3504f2 for instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c on nch2-master-1 Oct 01 20:53:34.157515 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-8a6c4343-a132-4b01-bcf4-afef7efee089 req-e4e5ef12-c393-4d2c-a9a2-d224ca663efc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036389 Oct 01 20:53:34.158104 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 570/1100] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:34.163272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:34.163973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:34.170023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.170547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.170994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.172300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.172763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.173193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.304877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:34.312564 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-52bf8fde-b296-4dac-ab44-bc1020d582dc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1324 microversion: 2.1 time: 0.153309 Oct 01 20:53:34.313145 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 571/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:34 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1324 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:34.317945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:34.318614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:34.324138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.324628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.325075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.325823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.326285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.326746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.509257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:34.518801 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d33d9977-fdfb-40ba-98d0-d62f5d9e1a20 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1474 microversion: 2.1 time: 0.204624 Oct 01 20:53:34.519384 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 572/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:34 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1474 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:34.525137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:34.525885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:34.532630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.533323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.533771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.534479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.534970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.535398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.713838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:34.723710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:34.725161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:34.726382 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-21f54e5e-0ca0-4bd7-853d-494bdb1c3cb4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2830 microversion: 2.42 time: 0.205914 Oct 01 20:53:34.726982 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 573/1103] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:34 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2830 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:34.731704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3af54b3c-a207-43b7-bbe0-f62e27c0af12 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:34.732200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3af54b3c-a207-43b7-bbe0-f62e27c0af12 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:34.737896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3af54b3c-a207-43b7-bbe0-f62e27c0af12 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.738387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3af54b3c-a207-43b7-bbe0-f62e27c0af12 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.738858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3af54b3c-a207-43b7-bbe0-f62e27c0af12 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.739727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3af54b3c-a207-43b7-bbe0-f62e27c0af12 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.741850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3af54b3c-a207-43b7-bbe0-f62e27c0af12 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.741850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3af54b3c-a207-43b7-bbe0-f62e27c0af12 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.807477 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3af54b3c-a207-43b7-bbe0-f62e27c0af12 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.079401 Oct 01 20:53:34.808098 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 574/1104] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Oct 1 20:53:34 2022] DELETE /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9/os-server-password => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:53:34.813527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:34.814415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:34.820600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.821118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.821559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.822266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:34.822752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:34.823182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:34.958225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:34.966151 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9eb57aec-e502-4c59-a0d9-d609010bbc7d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1316 microversion: 2.1 time: 0.157022 Oct 01 20:53:34.966673 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 575/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:34 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:34.971001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0de6ba80-ebc8-4fb2-8ab4-375a879d1fa5 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Calling method '.version_select at 0x7f417369d700>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:35.582555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:36.023729 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0de6ba80-ebc8-4fb2-8ab4-375a879d1fa5 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/9241ef90-08e0-4e51-820a-035e66c58eff" status: 202 len: 0 microversion: 2.1 time: 1.055987 Oct 01 20:53:36.024323 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 576/1106] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:53:34 2022] DELETE /compute/v2.1/os-floating-ips/9241ef90-08e0-4e51-820a-035e66c58eff => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:53:36.030273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:36.031767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:36.038323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.038850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.039296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.041062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.041529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.042016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.057758 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-03379b7b-bc83-4307-baa9-0a944f396893 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/action" status: 202 len: 0 microversion: 2.25 time: 4.460522 Oct 01 20:53:36.061959 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 531/1107] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:53:31 2022] POST /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/action => generated 0 bytes in 4465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:53:36.067832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-311daae0-d941-4991-89fe-4f5a39b80fae tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:36.068426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-311daae0-d941-4991-89fe-4f5a39b80fae tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:36.077185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-311daae0-d941-4991-89fe-4f5a39b80fae tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.078276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-311daae0-d941-4991-89fe-4f5a39b80fae tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.078960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-311daae0-d941-4991-89fe-4f5a39b80fae tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.079860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-311daae0-d941-4991-89fe-4f5a39b80fae tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.080333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-311daae0-d941-4991-89fe-4f5a39b80fae tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.080770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-311daae0-d941-4991-89fe-4f5a39b80fae tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.240103 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-311daae0-d941-4991-89fe-4f5a39b80fae tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.176849 Oct 01 20:53:36.251298 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 532/1108] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Oct 1 20:53:36 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131/os-interface => generated 1830 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:36.257331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d5644faa-cafd-4ca3-96f0-ee3397cc053f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:36.258060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d5644faa-cafd-4ca3-96f0-ee3397cc053f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:36.265657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5644faa-cafd-4ca3-96f0-ee3397cc053f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.266526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5644faa-cafd-4ca3-96f0-ee3397cc053f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.267292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5644faa-cafd-4ca3-96f0-ee3397cc053f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.268307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5644faa-cafd-4ca3-96f0-ee3397cc053f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.268989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5644faa-cafd-4ca3-96f0-ee3397cc053f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.269636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5644faa-cafd-4ca3-96f0-ee3397cc053f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.284775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:36.296629 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-afa2f9ea-2b12-4c4b-b362-f4cbc4826c1c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1360 microversion: 2.1 time: 0.270454 Oct 01 20:53:36.297382 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 577/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:36 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1360 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:36.302299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:36.303263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:36.309484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.310259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.310982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.312469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.313282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.314528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.318046 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d5644faa-cafd-4ca3-96f0-ee3397cc053f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.065214 Oct 01 20:53:36.322686 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 533/1110] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Oct 1 20:53:36 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9/os-server-password => generated 16 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:53:36.329898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:36.330539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:36.337171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.337860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.338310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.339077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.339538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.339961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.528782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:36.542177 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-56b0534d-c1c5-45ef-b642-f1c330a5413a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1324 microversion: 2.1 time: 0.243510 Oct 01 20:53:36.556304 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 578/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:36 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:36.570572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:36.582546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:36.583173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:36.584556 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77527ba9-c96d-4ea1-919c-1712c4b070c9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1471 microversion: 2.1 time: 0.259393 Oct 01 20:53:36.586077 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 534/1112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:36 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:36.599622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.600153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df377483-709f-4585-89db-947080519920 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] Calling method '.version_select at 0x7f4173787af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:36.600438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.600892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.602696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:36.603299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:36.604511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:36.610483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:37.228175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:37.236900 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ace91f2b-5cec-4e08-a7c4-6e9e1e4c24b9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1466 microversion: 2.1 time: 0.679169 Oct 01 20:53:37.237588 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 579/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:36 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1466 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:37.259760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:37.260367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:37.267740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:37.268255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:37.268699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:37.269411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:37.270120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:37.271230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:37.647503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:37.656725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:37.658180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:37.660270 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2895ccc9-1715-4fba-aa29-2d998a2e20b1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.408688 Oct 01 20:53:37.661940 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 580/1114] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:37 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:37.668556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b9e157db-471d-432c-8c72-1e76c65127d5 req-40c27103-4aeb-447a-898d-d2ecdfb69a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1818557f-9772-403d-bfa8-d226f1063f2f", "tag": "1dee487a-adae-475f-aff1-35bf8657a7f3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:37.681378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b9e157db-471d-432c-8c72-1e76c65127d5 req-40c27103-4aeb-447a-898d-d2ecdfb69a3d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:37.682052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b9e157db-471d-432c-8c72-1e76c65127d5 req-40c27103-4aeb-447a-898d-d2ecdfb69a3d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:37.682581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b9e157db-471d-432c-8c72-1e76c65127d5 req-40c27103-4aeb-447a-898d-d2ecdfb69a3d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:37.695961 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b9e157db-471d-432c-8c72-1e76c65127d5 req-40c27103-4aeb-447a-898d-d2ecdfb69a3d service nova] Creating event network-changed:1dee487a-adae-475f-aff1-35bf8657a7f3 for instance 1818557f-9772-403d-bfa8-d226f1063f2f on nch2-master-1 Oct 01 20:53:37.701603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-b9e157db-471d-432c-8c72-1e76c65127d5 req-40c27103-4aeb-447a-898d-d2ecdfb69a3d service nova] Instance 1818557f-9772-403d-bfa8-d226f1063f2f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:53:37.713070 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b9e157db-471d-432c-8c72-1e76c65127d5 req-40c27103-4aeb-447a-898d-d2ecdfb69a3d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049726 Oct 01 20:53:37.713683 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 581/1115] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:37.719641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:37.720233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:37.724314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:37.729072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:37.729573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:37.730227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:37.731249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:37.733150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:37.734485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:37.767586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:53:37.886832 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a7804166-d42c-4a39-8a5f-fcb24eb25d5f tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 204 len: 0 microversion: 2.1 time: 0.171203 Oct 01 20:53:37.888525 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 582/1116] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:53:37 2022] DELETE /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:53:37.899647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:37.901393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:37.909213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:37.910139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:37.911020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:37.912694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:37.913404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:37.914339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:37.965093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:37.965741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:37.966285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:37.967824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:37.968390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:37.968981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:37.998749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:38.005042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for user e5bfbc1e512a445ca7527f3d79e40d16 and project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:38.152175 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ce953ff6-0cc8-4e08-86ad-f3bb34380169 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f/action" status: 202 len: 0 microversion: 2.1 time: 0.260135 Oct 01 20:53:38.157337 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 583/1117] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:53:37 2022] POST /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:53:38.256556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d891fb4-a939-4a5d-90a8-20829f41b4a5 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:38.257244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3d891fb4-a939-4a5d-90a8-20829f41b4a5 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:38.265477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d891fb4-a939-4a5d-90a8-20829f41b4a5 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:38.265477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d891fb4-a939-4a5d-90a8-20829f41b4a5 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:38.266435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d891fb4-a939-4a5d-90a8-20829f41b4a5 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:38.267149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d891fb4-a939-4a5d-90a8-20829f41b4a5 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:38.267768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d891fb4-a939-4a5d-90a8-20829f41b4a5 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:38.268207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d891fb4-a939-4a5d-90a8-20829f41b4a5 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:38.356983 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df377483-709f-4585-89db-947080519920 tempest-FloatingIPDetailsTestJSON-1859227876 tempest-FloatingIPDetailsTestJSON-1859227876-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/584581a4-c2f3-4593-b54c-53ea50d8f517" status: 202 len: 0 microversion: 2.1 time: 1.760734 Oct 01 20:53:38.359100 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 535/1118] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:53:36 2022] DELETE /compute/v2.1/os-floating-ips/584581a4-c2f3-4593-b54c-53ea50d8f517 => generated 0 bytes in 1772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:53:38.364680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:38.366010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:38.379378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:38.380719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:38.381562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:38.382525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:38.383199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:38.383786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:38.718960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:38.732871 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d9a53756-a16e-4a61-ae68-1345fbbb67c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1360 microversion: 2.1 time: 0.372346 Oct 01 20:53:38.734169 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 536/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:38 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1360 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:38.740706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:38.741315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:38.750946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:38.751612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:38.752249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:38.753006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:38.753789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:38.754385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:38.758751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:38.867344 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3d891fb4-a939-4a5d-90a8-20829f41b4a5 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1617 microversion: 2.1 time: 0.708703 Oct 01 20:53:38.883503 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 584/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:38 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1617 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:38.892068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-26ba0f8a-68f8-4b3c-9534-577b2b9a89ce req-b622c884-4901-4c20-935a-4a4e13f6de8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "tag": "e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:38.902074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-26ba0f8a-68f8-4b3c-9534-577b2b9a89ce req-b622c884-4901-4c20-935a-4a4e13f6de8e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:38.902594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-26ba0f8a-68f8-4b3c-9534-577b2b9a89ce req-b622c884-4901-4c20-935a-4a4e13f6de8e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:38.903030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-26ba0f8a-68f8-4b3c-9534-577b2b9a89ce req-b622c884-4901-4c20-935a-4a4e13f6de8e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:38.922156 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-26ba0f8a-68f8-4b3c-9534-577b2b9a89ce req-b622c884-4901-4c20-935a-4a4e13f6de8e service nova] Creating event network-changed:e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:53:38.928117 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-26ba0f8a-68f8-4b3c-9534-577b2b9a89ce req-b622c884-4901-4c20-935a-4a4e13f6de8e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043283 Oct 01 20:53:38.928732 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 585/1121] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:38.933808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:38.934525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:38.942675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:38.943171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:38.943605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:38.944320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:38.944770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:38.945193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:39.155505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:39.164401 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f0c2f51b-a627-4ab0-b33b-94dbe4a87263 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1521 microversion: 2.1 time: 0.428334 Oct 01 20:53:39.179702 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 537/1122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:38 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:39.201913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:39.202983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:39.213159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:39.214385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:39.215096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:39.216048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:39.216742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:39.219880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:39.683065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd270f04a32ac44bc88fc57f8e765111e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caba560a5eaa46c1b816e09230b5a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:39.695194 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0226b839-84f1-4605-a584-338eee1b4cf3 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 200 len: 1508 microversion: 2.1 time: 0.765206 Oct 01 20:53:39.695988 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 586/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:38 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 1508 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:39.710836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a3cd9acd-5cf7-43f5-bb39-1b947ea69d51 req-6dff6feb-3dec-4664-8fa2-d16264b66210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed59d2f-d270-4882-b32b-89be0dedc71f", "name": "network-vif-plugged", "status": "completed", "tag": "66d65798-4e84-432e-b05a-65e6432c780b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:39.720416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a3cd9acd-5cf7-43f5-bb39-1b947ea69d51 req-6dff6feb-3dec-4664-8fa2-d16264b66210 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:39.720898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a3cd9acd-5cf7-43f5-bb39-1b947ea69d51 req-6dff6feb-3dec-4664-8fa2-d16264b66210 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:39.721327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a3cd9acd-5cf7-43f5-bb39-1b947ea69d51 req-6dff6feb-3dec-4664-8fa2-d16264b66210 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:39.959171 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a3cd9acd-5cf7-43f5-bb39-1b947ea69d51 req-6dff6feb-3dec-4664-8fa2-d16264b66210 service nova] Creating event network-vif-plugged:66d65798-4e84-432e-b05a-65e6432c780b for instance bed59d2f-d270-4882-b32b-89be0dedc71f on nch1-master-1 Oct 01 20:53:39.965483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:39.965927 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a3cd9acd-5cf7-43f5-bb39-1b947ea69d51 req-6dff6feb-3dec-4664-8fa2-d16264b66210 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267706 Oct 01 20:53:39.967383 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 587/1124] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:39.976420 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-670e16c2-4391-4595-ae54-76b769478ab2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1470 microversion: 2.1 time: 0.795406 Oct 01 20:53:39.977023 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 538/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:39 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1470 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:39.980648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:39.982186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:39.987517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30948e38-0916-4cdc-9c9a-6b8388dc3005 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Action: 'create', calling method: .version_select at 0x7f4173a7c550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1620714332", "policies": ["affinity"]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:39.990559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:39.995910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:39.996588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:39.998384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:39.999144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:39.999761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:40.056059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-30948e38-0916-4cdc-9c9a-6b8388dc3005 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:40.067224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-30948e38-0916-4cdc-9c9a-6b8388dc3005 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:40.129049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-30948e38-0916-4cdc-9c9a-6b8388dc3005 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:40.137493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-30948e38-0916-4cdc-9c9a-6b8388dc3005 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:40.155714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-30948e38-0916-4cdc-9c9a-6b8388dc3005 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.177591 Oct 01 20:53:40.157163 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 539/1126] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Oct 1 20:53:39 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:40.162359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a01dda47-7e6c-4ca5-b21c-f0d24aab6901 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Action: 'create', calling method: .version_select at 0x7f41737d1a60>, body: {"pool": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:40.600476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:40.610079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:40.611563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:40.613140 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a5c889a0-f49b-4131-8cda-62800c0b9efd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.643957 Oct 01 20:53:40.614224 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 588/1127] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:39 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:40.631397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:40.632311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:40.638709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:40.639636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:40.640254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:40.641220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:40.641842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:40.642453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:41.083043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:41.090854 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-991d654a-496f-4bec-8701-2fda51e9fce5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1360 microversion: 2.1 time: 0.463185 Oct 01 20:53:41.091424 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 589/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:40 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1360 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:41.111683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-399347334", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fdce9808-1c48-473e-b790-269b25808432"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:41.163940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:53:42.022184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:53:42.022687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:53:42.023165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:53:42.023581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:53:42.023997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:53:42.054515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:42.055019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:42.055760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:42.056536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:42.056992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:42.057685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:42.079738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:42.085761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:42.102944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Going to run 2 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:53:42.105433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:53:42.150483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140437) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 01 20:53:42.174927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:42.181683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:42.229044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:42.234148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:42.247905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=2ec44930-5588-48ae-8253-56af3ab60310,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:53:42.298521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:42.303506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:42.335779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:42.342807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:42.349040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:42.385663 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ff4bec09-9a9a-46b1-a3ab-c044922e3bde tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.278257 Oct 01 20:53:42.386478 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 590/1129] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:53:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 1294 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 01 20:53:42.393507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:42.394123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] [instance: 16dbeaba-b86b-4a6c-a711-cf432c8680d9] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:42.400331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:42.400791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:42.401292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:42.402002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:42.402467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:42.402921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:42.416932 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] HTTP exception thrown: Instance 16dbeaba-b86b-4a6c-a711-cf432c8680d9 could not be found. Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Request method failure captured: Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 HTTP/1.1 Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKisHb4F4XFBZiGbg75gopJg15VyPsQMs4zo02AJVYiHpIw23cTJdG4Cbf_n7fOusJK13o6ngAa8GKQqtuWV6kMBGqDx59PH6Hav575WFM-iUSaJPh6Ah1KuoQkbChPMLDAxvbVM1lJDMiHBUiUkOhD-5DqfazvEMgF3dcRVHHVmYNU Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: caba560a5eaa46c1b816e09230b5a1d9 Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerPasswordTestJSON-553688405 Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:53:42.418671 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_caba560a5eaa46c1b816e09230b5a1d9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/caba560a5eaa46c1b816e09230b5a1d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/caba560a5eaa46c1b816e09230b5a1d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/caba560a5eaa46c1b816e09230b5a1d9"}]}] Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerPasswordTestJSON-553688405 Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: caba560a5eaa46c1b816e09230b5a1d9 Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerPasswordTestJSON-553688405 Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerPasswordTestJSON-553688405-project Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: d270f04a32ac44bc88fc57f8e765111e Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerPasswordTestJSON-553688405-project Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 16dbeaba-b86b-4a6c-a711-cf432c8680d9 could not be found. Oct 01 20:53:42.420213 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '16dbeaba-b86b-4a6c-a711-cf432c8680d9'} Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16dbeaba-b86b-4a6c-a711-cf432c8680d9 could not be found. Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:53:42.422220 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16dbeaba-b86b-4a6c-a711-cf432c8680d9 could not be found. Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16dbeaba-b86b-4a6c-a711-cf432c8680d9 could not be found. Oct 01 20:53:42.424148 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:53:42.427558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] Returning 404 to user: Instance 16dbeaba-b86b-4a6c-a711-cf432c8680d9 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:53:42.427558 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-53a4c0e9-b5a8-4c88-98dd-f7ac21d98b85 tempest-ServerPasswordTestJSON-553688405 tempest-ServerPasswordTestJSON-553688405-project] 10.222.0.17 "GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9" status: 404 len: 111 microversion: 2.1 time: 0.032764 Oct 01 20:53:42.427558 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 591/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:42 2022] GET /compute/v2.1/servers/16dbeaba-b86b-4a6c-a711-cf432c8680d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:53:42.427558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-293c96c1-6358-402d-8be3-832b498627a1 req-68c3ba5b-e88b-45eb-9844-0ac312146ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16dbeaba-b86b-4a6c-a711-cf432c8680d9", "name": "network-vif-deleted", "tag": "0a0f154d-a6dc-40d0-bf25-ee963c5036de"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:42.435020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-293c96c1-6358-402d-8be3-832b498627a1 req-68c3ba5b-e88b-45eb-9844-0ac312146ff9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:42.435503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-293c96c1-6358-402d-8be3-832b498627a1 req-68c3ba5b-e88b-45eb-9844-0ac312146ff9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:42.436900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-293c96c1-6358-402d-8be3-832b498627a1 req-68c3ba5b-e88b-45eb-9844-0ac312146ff9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:42.451291 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-293c96c1-6358-402d-8be3-832b498627a1 req-68c3ba5b-e88b-45eb-9844-0ac312146ff9 service nova] Creating event network-vif-deleted:0a0f154d-a6dc-40d0-bf25-ee963c5036de for instance 16dbeaba-b86b-4a6c-a711-cf432c8680d9 on nch2-master-1 Oct 01 20:53:42.459818 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-293c96c1-6358-402d-8be3-832b498627a1 req-68c3ba5b-e88b-45eb-9844-0ac312146ff9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037603 Oct 01 20:53:42.460725 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 592/1131] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:42.466346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:42.467254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:42.475854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:42.476429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:42.476946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:42.477730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:42.478268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:42.478797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:43.030801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:43.045294 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cb124511-d3a4-4698-9ab4-039ed412c6d4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1470 microversion: 2.1 time: 0.580218 Oct 01 20:53:43.045294 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 593/1132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:42 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1470 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:43.057589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:43.058279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:43.070244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:43.071916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:43.074857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:43.076867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:43.077645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:43.078912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:43.963933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:43.966538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:43.976561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:43.978028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:43.979279 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f31df26d-f932-4ada-9334-6a709a415faa tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.932320 Oct 01 20:53:43.979859 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 594/1133] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:43 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:43.984692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-69c4b28a-2510-4b68-a56a-cd425539f964 req-b185465f-127c-4b19-ac84-da0e4f259213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1818557f-9772-403d-bfa8-d226f1063f2f", "name": "network-vif-plugged", "status": "completed", "tag": "1dee487a-adae-475f-aff1-35bf8657a7f3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:43.998674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-69c4b28a-2510-4b68-a56a-cd425539f964 req-b185465f-127c-4b19-ac84-da0e4f259213 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.000314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-69c4b28a-2510-4b68-a56a-cd425539f964 req-b185465f-127c-4b19-ac84-da0e4f259213 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.001101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-69c4b28a-2510-4b68-a56a-cd425539f964 req-b185465f-127c-4b19-ac84-da0e4f259213 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.015661 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-69c4b28a-2510-4b68-a56a-cd425539f964 req-b185465f-127c-4b19-ac84-da0e4f259213 service nova] Creating event network-vif-plugged:1dee487a-adae-475f-aff1-35bf8657a7f3 for instance 1818557f-9772-403d-bfa8-d226f1063f2f on nch2-master-1 Oct 01 20:53:44.021445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-69c4b28a-2510-4b68-a56a-cd425539f964 req-b185465f-127c-4b19-ac84-da0e4f259213 service nova] Instance 1818557f-9772-403d-bfa8-d226f1063f2f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:53:44.083106 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-69c4b28a-2510-4b68-a56a-cd425539f964 req-b185465f-127c-4b19-ac84-da0e4f259213 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097803 Oct 01 20:53:44.087983 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 595/1134] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:44.093991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:44.099631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:44.117067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.119548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.120428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.121527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.122343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.123037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.397194 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a01dda47-7e6c-4ca5-b21c-f0d24aab6901 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.238783 Oct 01 20:53:44.398416 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 540/1135] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 20:53:40 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:44.408233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:44.415452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:44.417126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Searching by: {'deleted': False, 'project_id': '44683518fe3d46c58b139727cf0c9515'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:53:44.429359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.430236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.430920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.432273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.432983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.433689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.469713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:44.495756 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4663d951-cde1-46f7-82c9-3cb0f64ffec1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1543 microversion: 2.1 time: 0.405791 Oct 01 20:53:44.497002 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 596/1136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:44 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1543 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:44.502187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:44.504993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:44.517630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.523103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.524802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.525771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.526390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.529107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.615375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:53:44.731512 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2af91a66-3362-4065-9106-51b017e5e618 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.327280 Oct 01 20:53:44.739705 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 541/1137] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 20:53:44 2022] GET /compute/v2.1/servers => generated 1001 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:44.739705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-773b4b2f-d8ac-4888-872a-de83e497d11e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:44.739705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-773b4b2f-d8ac-4888-872a-de83e497d11e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:44.747716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-773b4b2f-d8ac-4888-872a-de83e497d11e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.748185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-773b4b2f-d8ac-4888-872a-de83e497d11e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.748629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-773b4b2f-d8ac-4888-872a-de83e497d11e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.749579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:44.750372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-773b4b2f-d8ac-4888-872a-de83e497d11e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.750893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-773b4b2f-d8ac-4888-872a-de83e497d11e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.751569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-773b4b2f-d8ac-4888-872a-de83e497d11e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.758905 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-887b301b-0387-46db-add6-8c61d7e8a6d8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1470 microversion: 2.1 time: 0.260593 Oct 01 20:53:44.778811 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 597/1138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:44 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:44.790030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e34e9b14-04e7-4a03-bdcb-a063b6bf5523 req-4653d71e-9bdc-4c19-bc31-ed813b05460e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee54a04f-6360-4f81-a7ba-68d65e8d8d36", "name": "network-vif-unplugged", "status": "completed", "tag": "6c19a1ab-152a-407c-bec3-017d592a748b"}, {"name": "network-changed", "server_uuid": "ee54a04f-6360-4f81-a7ba-68d65e8d8d36", "tag": "6c19a1ab-152a-407c-bec3-017d592a748b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:44.803059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e34e9b14-04e7-4a03-bdcb-a063b6bf5523 req-4653d71e-9bdc-4c19-bc31-ed813b05460e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.803546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e34e9b14-04e7-4a03-bdcb-a063b6bf5523 req-4653d71e-9bdc-4c19-bc31-ed813b05460e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.803982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e34e9b14-04e7-4a03-bdcb-a063b6bf5523 req-4653d71e-9bdc-4c19-bc31-ed813b05460e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.825206 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e34e9b14-04e7-4a03-bdcb-a063b6bf5523 req-4653d71e-9bdc-4c19-bc31-ed813b05460e service nova] Creating event network-vif-unplugged:6c19a1ab-152a-407c-bec3-017d592a748b for instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 on nch1-master-1 Oct 01 20:53:44.825734 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e34e9b14-04e7-4a03-bdcb-a063b6bf5523 req-4653d71e-9bdc-4c19-bc31-ed813b05460e service nova] Creating event network-changed:6c19a1ab-152a-407c-bec3-017d592a748b for instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 on nch1-master-1 Oct 01 20:53:44.844207 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e34e9b14-04e7-4a03-bdcb-a063b6bf5523 req-4653d71e-9bdc-4c19-bc31-ed813b05460e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.062386 Oct 01 20:53:44.845613 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 598/1139] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:44.869885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-922875978", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "865ef00f-9395-4fab-b79f-2237ecbc6955"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:44.893760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-773b4b2f-d8ac-4888-872a-de83e497d11e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160140 Oct 01 20:53:44.895715 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 542/1140] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 20:53:44 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:44.900809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:44.901428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:44.913848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.914748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.915419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.916512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:44.917469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:44.918154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:44.956088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] validate_networks() for [('865ef00f-9395-4fab-b79f-2237ecbc6955', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:53:45.064357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:45.073610 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24fca38b-ed27-4210-84af-0188914e2c0a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1270 microversion: 2.1 time: 0.176619 Oct 01 20:53:45.074393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 543/1141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:44 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:45.079283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:45.079897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:45.087152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:45.087505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:45.087959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:45.088681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:45.089126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:45.089565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:45.399577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:45.422920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:45.425142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:45.426745 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d78f183-c53a-4582-a3c2-3ca770569d64 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.351447 Oct 01 20:53:45.451930 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 544/1142] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:45 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:45.786216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:45.786854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:45.794796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:45.796213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:45.796804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:45.798008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:45.798753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:45.799339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:46.143868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:53:46.144860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:53:46.145509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:53:46.146111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:53:46.146737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:53:46.158211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:46.158934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:46.159546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:46.160463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:46.161126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:46.161562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:46.183879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Getting quotas for project 1a2694c8af60455aa9db5997c53adbdc. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:46.192383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Getting quotas for user f4de9e6274c041da9c366ea00c0bf769 and project 1a2694c8af60455aa9db5997c53adbdc. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:46.208530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:53:46.211275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:53:46.265094 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fd96d7b1-2b4f-4233-8d8e-97c3ae6b9926 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417136 Oct 01 20:53:46.266434 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 599/1143] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:53:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:53:46.272644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:46.273549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:46.282061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:46.282887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:46.283523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:46.284437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:46.285342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:46.286220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:46.650521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:46.683312 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0254460f-a498-4f99-88ab-d656b25c81b2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1470 microversion: 2.1 time: 0.900900 Oct 01 20:53:46.689606 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 545/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:45 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1470 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:46.694870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-464b4f2d-8cb5-424e-a342-0fd5a83d8f35 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:46.703111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-464b4f2d-8cb5-424e-a342-0fd5a83d8f35 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:46.735776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:46.745666 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f7384a85-d07d-499d-958f-05cf6db42037 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1276 microversion: 2.1 time: 0.477880 Oct 01 20:53:46.749555 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 600/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:46 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1276 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:46.760500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:46.761353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:46.773648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:46.774367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:46.775117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:46.776145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:46.776985 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:46.777884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:46.902647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-464b4f2d-8cb5-424e-a342-0fd5a83d8f35 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:46.914942 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-464b4f2d-8cb5-424e-a342-0fd5a83d8f35 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1223 microversion: 2.1 time: 0.223697 Oct 01 20:53:46.915624 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 546/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:46 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1223 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:47.152465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:47.173910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:47.177479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:47.178707 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eea47daa-de29-4949-b8d2-d78d24fc7d43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.427892 Oct 01 20:53:47.191795 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 601/1147] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:46 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:47.711843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:47.712529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:47.720721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:47.721230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:47.721672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:47.722655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:47.723129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:47.723556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:47.774710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:47.775605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:47.787890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:47.792580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:47.793227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:47.794789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:47.800011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:47.800737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:48.142475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:48.157210 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bee55551-1dcd-4cf8-9dc7-e59f361446ab tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1276 microversion: 2.1 time: 0.386588 Oct 01 20:53:48.157857 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 602/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:47 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:53:48.169930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:48.170629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:48.195473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:48.197583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:48.202248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:48.204542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:48.206306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:48.207622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:48.460791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:48.488235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:48.489257 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a94d3c0e-7555-46e1-b25a-3119b2fb0bc9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1283 microversion: 2.1 time: 0.325887 Oct 01 20:53:48.492716 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 603/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:48 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1283 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:48.504384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-41558ff9-45e7-442d-916b-dce0cdc8d66d req-efc6a4f9-10e0-4c06-8461-768b51986c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed59d2f-d270-4882-b32b-89be0dedc71f", "tag": "66d65798-4e84-432e-b05a-65e6432c780b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:48.513800 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da6e1813-7936-4313-a28e-db4555b182ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1536 microversion: 2.1 time: 0.805694 Oct 01 20:53:48.529178 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 547/1150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:47 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1536 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:48.534923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:48.535772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:48.535979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-41558ff9-45e7-442d-916b-dce0cdc8d66d req-efc6a4f9-10e0-4c06-8461-768b51986c45 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:48.536713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-41558ff9-45e7-442d-916b-dce0cdc8d66d req-efc6a4f9-10e0-4c06-8461-768b51986c45 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:48.537311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-41558ff9-45e7-442d-916b-dce0cdc8d66d req-efc6a4f9-10e0-4c06-8461-768b51986c45 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:48.547232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:48.548040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:48.549806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:48.552419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:48.561829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:48.562619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:48.577621 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-41558ff9-45e7-442d-916b-dce0cdc8d66d req-efc6a4f9-10e0-4c06-8461-768b51986c45 service nova] Creating event network-changed:66d65798-4e84-432e-b05a-65e6432c780b for instance bed59d2f-d270-4882-b32b-89be0dedc71f on nch1-master-1 Oct 01 20:53:48.589972 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-41558ff9-45e7-442d-916b-dce0cdc8d66d req-efc6a4f9-10e0-4c06-8461-768b51986c45 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095692 Oct 01 20:53:48.596149 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 604/1151] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:49.184959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:49.185683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:49.200149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:49.200678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:49.201394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:49.202934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:49.203350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:49.216690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:49.418263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:49.441557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:49.444298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:49.449520 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76e9b36a-4840-47e4-ae7c-d6b4cb0dc854 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.918906 Oct 01 20:53:49.451272 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 548/1152] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:48 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:49.542978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:49.547166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:49.568398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:49.568954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:49.569594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:49.570329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:49.570827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:49.571435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:49.614077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:49.913884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:49.925661 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-72d0495d-1707-47d6-b2a4-ca1ac07df2d9 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1281 microversion: 2.1 time: 0.408669 Oct 01 20:53:49.929052 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 549/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:49 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1281 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:49.941508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:49.942370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:49.954229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:49.954766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:49.959221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:49.960122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:49.960615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:49.961067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:50.718153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:50.727188 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-07c714ff-a276-49e2-81b1-7b3173b0561c tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1318 microversion: 2.1 time: 1.547308 Oct 01 20:53:50.727952 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 605/1154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:49 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1318 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:53:50.737357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:50.738862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:50.749725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:50.750393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:50.751149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:50.751980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:50.752691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:50.753324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:50.954843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:50.975587 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5d9f8545-eb8c-4e23-9562-737ec4445067 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1536 microversion: 2.1 time: 1.044858 Oct 01 20:53:50.977064 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 550/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:49 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1536 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:50.983396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6eac444a-ee2d-4e98-802f-40ab00df250d req-bef1586f-4c89-4f39-8613-4d78652bc1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1818557f-9772-403d-bfa8-d226f1063f2f", "name": "network-vif-unplugged", "status": "completed", "tag": "1dee487a-adae-475f-aff1-35bf8657a7f3"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:51.007124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6eac444a-ee2d-4e98-802f-40ab00df250d req-bef1586f-4c89-4f39-8613-4d78652bc1e8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:51.009409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6eac444a-ee2d-4e98-802f-40ab00df250d req-bef1586f-4c89-4f39-8613-4d78652bc1e8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:51.010057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6eac444a-ee2d-4e98-802f-40ab00df250d req-bef1586f-4c89-4f39-8613-4d78652bc1e8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:51.095634 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6eac444a-ee2d-4e98-802f-40ab00df250d req-bef1586f-4c89-4f39-8613-4d78652bc1e8 service nova] Creating event network-vif-unplugged:1dee487a-adae-475f-aff1-35bf8657a7f3 for instance 1818557f-9772-403d-bfa8-d226f1063f2f on nch1-master-1 Oct 01 20:53:51.108188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-6eac444a-ee2d-4e98-802f-40ab00df250d req-bef1586f-4c89-4f39-8613-4d78652bc1e8 service nova] Instance 1818557f-9772-403d-bfa8-d226f1063f2f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:53:51.136296 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6eac444a-ee2d-4e98-802f-40ab00df250d req-bef1586f-4c89-4f39-8613-4d78652bc1e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152773 Oct 01 20:53:51.137839 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 551/1156] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:51.146407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:51.148071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:51.156330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:51.157200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:51.157918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:51.158892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:51.159991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:51.160819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:51.465999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:51.483561 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9fc2622b-8330-4a4d-b443-60483357a17a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1281 microversion: 2.1 time: 0.337458 Oct 01 20:53:51.510037 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 552/1157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:51 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1281 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:51.527396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:51.549817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:51.552777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:51.556792 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d4a8d639-ffbc-46d0-8e32-2256bb4c229c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.827551 Oct 01 20:53:51.558259 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 606/1158] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:50 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:51.754696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:51.755788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:51.767407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:51.768777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:51.770953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:51.773078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:51.773774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:51.777123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:52.004558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:52.005184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:52.015371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:52.018871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:52.023090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:52.023927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:52.024435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:52.024879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:52.542466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:52.573035 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-334c14f7-cb4e-4ef6-8208-7090da83975a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1318 microversion: 2.1 time: 0.821594 Oct 01 20:53:52.578043 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 553/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:51 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1318 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:52.584456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:52.586361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:52.616902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:52.619542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:52.620537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:52.622429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:52.624999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:52.625662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:52.752810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:52.767564 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bcfd938c-285e-43c3-b60d-d182c191755c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1536 microversion: 2.1 time: 0.764918 Oct 01 20:53:52.771098 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 607/1160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:51 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1536 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:52.781463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:52.782436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:52.795104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:52.796182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:52.796987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:52.798246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:52.799266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:52.800115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:53.198026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:53.211494 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e26c74ed-e6ba-4646-b7f2-1b63b6d88c6d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1323 microversion: 2.1 time: 0.631867 Oct 01 20:53:53.212759 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 554/1161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:52 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1323 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:53.226940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-92a3a996-4b58-43cc-9108-72270579d369 req-d080e80f-adbe-4348-b13e-6489cd964f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1818557f-9772-403d-bfa8-d226f1063f2f", "tag": "1dee487a-adae-475f-aff1-35bf8657a7f3"}, {"name": "network-changed", "server_uuid": "77a4e4e5-a2d3-4ef7-a9fc-5905102864df", "tag": "6ec345d7-85eb-444e-9419-7bdc55b67d3a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:53.246985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-92a3a996-4b58-43cc-9108-72270579d369 req-d080e80f-adbe-4348-b13e-6489cd964f7f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:53.247233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-92a3a996-4b58-43cc-9108-72270579d369 req-d080e80f-adbe-4348-b13e-6489cd964f7f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:53.249111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-92a3a996-4b58-43cc-9108-72270579d369 req-d080e80f-adbe-4348-b13e-6489cd964f7f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:53.285890 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-92a3a996-4b58-43cc-9108-72270579d369 req-d080e80f-adbe-4348-b13e-6489cd964f7f service nova] Creating event network-changed:1dee487a-adae-475f-aff1-35bf8657a7f3 for instance 1818557f-9772-403d-bfa8-d226f1063f2f on nch1-master-1 Oct 01 20:53:53.286598 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-92a3a996-4b58-43cc-9108-72270579d369 req-d080e80f-adbe-4348-b13e-6489cd964f7f service nova] Creating event network-changed:6ec345d7-85eb-444e-9419-7bdc55b67d3a for instance 77a4e4e5-a2d3-4ef7-a9fc-5905102864df on nch2-master-1 Oct 01 20:53:53.308491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-92a3a996-4b58-43cc-9108-72270579d369 req-d080e80f-adbe-4348-b13e-6489cd964f7f service nova] Instance 1818557f-9772-403d-bfa8-d226f1063f2f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:53:53.332188 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-92a3a996-4b58-43cc-9108-72270579d369 req-d080e80f-adbe-4348-b13e-6489cd964f7f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.117635 Oct 01 20:53:53.332817 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 555/1162] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:53.607008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:53.609075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:53.616230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:53.617490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:53.618231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:53.619475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:53.620764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:53.621465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:53.825183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:53.835417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:53.837282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:53.838797 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2f80d1e2-8301-4d5a-bf26-5062a938b4d9 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 1.065945 Oct 01 20:53:53.839930 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 608/1163] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:52 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:53.845541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:53.846923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:53.855372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:53.856214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:53.856897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:53.858352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:53.858910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:53.859351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:54.193207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:54.205482 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc1ceceb-b568-44d6-8aed-d8931b399b9a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1318 microversion: 2.1 time: 0.603405 Oct 01 20:53:54.206361 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 556/1164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:53 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:53:54.239894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:54.240522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:54.248708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:54.249253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:54.249877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:54.250974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:54.252310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:54.252997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:54.342748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:54.355983 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-979a0661-2541-4416-8437-27b06dc5595e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1536 microversion: 2.1 time: 0.510777 Oct 01 20:53:54.357216 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 609/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:53 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1536 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:54.363562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-6869c655-c955-4d36-9f64-34d0716994d7 req-328f750b-1914-41a5-90c3-f994fe05408f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec44930-5588-48ae-8253-56af3ab60310", "tag": "ecbb28ab-d141-46cd-9031-9cb3e8005cd8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:54.377407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6869c655-c955-4d36-9f64-34d0716994d7 req-328f750b-1914-41a5-90c3-f994fe05408f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:54.378279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6869c655-c955-4d36-9f64-34d0716994d7 req-328f750b-1914-41a5-90c3-f994fe05408f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:54.378973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6869c655-c955-4d36-9f64-34d0716994d7 req-328f750b-1914-41a5-90c3-f994fe05408f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:54.392875 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-6869c655-c955-4d36-9f64-34d0716994d7 req-328f750b-1914-41a5-90c3-f994fe05408f service nova] Creating event network-changed:ecbb28ab-d141-46cd-9031-9cb3e8005cd8 for instance 2ec44930-5588-48ae-8253-56af3ab60310 on nch2-master-1 Oct 01 20:53:54.403015 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-6869c655-c955-4d36-9f64-34d0716994d7 req-328f750b-1914-41a5-90c3-f994fe05408f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043675 Oct 01 20:53:54.406638 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 610/1166] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:54.546014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:54.644722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:54.659172 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-66277e2a-5508-463d-9e6d-9801fe2c9344 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1323 microversion: 2.1 time: 0.423110 Oct 01 20:53:54.660613 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 557/1167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:54 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1323 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:54.866520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:54.868110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:54.881196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:54.883781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:54.884498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:54.887000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:54.887789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:54.889422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:55.229457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:55.230511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:55.247087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:55.247847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:55.248526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:55.249413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:55.250037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:55.250897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:55.665197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:55.683435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:55.685699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:55.688117 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-afaaf547-2648-433f-8973-951f20190e29 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.826759 Oct 01 20:53:55.692251 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 611/1168] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:54 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:55.697445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:55.704187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:55.720554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:55.721083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:55.721533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:55.722274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:55.722768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:55.723626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:56.177438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=9 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:56.182689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:56.197386 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4cec586d-cd60-4b31-b6e5-3ef848cda8d4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1318 microversion: 2.1 time: 0.971608 Oct 01 20:53:56.198429 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 558/1169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:55 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1318 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:56.213500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:56.256383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:56.257511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:56.286947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:56.288343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:56.289686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:56.296050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:56.297600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:56.298423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:56.604009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:56.618440 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2568d5ba-e48b-49c5-ad1e-8f50dd29cd6f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1529 microversion: 2.1 time: 0.924785 Oct 01 20:53:56.625505 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 612/1170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:55 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1529 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:56.633303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-16cf9610-4021-4996-9bdc-04a471cea4f0 req-ad8c4a2e-9ddf-4fba-a66f-2a282a2c7d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3763bd-cd0f-4912-874b-b6ed42228c7b", "tag": "6030cb83-5eac-4c1d-9806-6b492776785a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:56.657745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-16cf9610-4021-4996-9bdc-04a471cea4f0 req-ad8c4a2e-9ddf-4fba-a66f-2a282a2c7d09 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:56.660396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-16cf9610-4021-4996-9bdc-04a471cea4f0 req-ad8c4a2e-9ddf-4fba-a66f-2a282a2c7d09 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:56.662807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-16cf9610-4021-4996-9bdc-04a471cea4f0 req-ad8c4a2e-9ddf-4fba-a66f-2a282a2c7d09 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:56.693498 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-16cf9610-4021-4996-9bdc-04a471cea4f0 req-ad8c4a2e-9ddf-4fba-a66f-2a282a2c7d09 service nova] Creating event network-changed:6030cb83-5eac-4c1d-9806-6b492776785a for instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b on nch1-master-1 Oct 01 20:53:56.708542 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-16cf9610-4021-4996-9bdc-04a471cea4f0 req-ad8c4a2e-9ddf-4fba-a66f-2a282a2c7d09 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080850 Oct 01 20:53:56.712647 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 613/1171] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:56.726766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:56.728628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:56.741189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:56.741998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:56.742741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:56.743701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:56.744393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:56.745156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:56.909580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:57.323364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:57.346555 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bda99690-7ba6-4c98-8eef-ee5defd6d15a tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1323 microversion: 2.1 time: 1.146493 Oct 01 20:53:57.347690 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 559/1172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:56 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1323 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:57.359682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:57.361847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:57.393976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:57.396163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:57.397013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:57.398036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:57.398815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:57.399472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:57.603586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:57.620742 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1cb13e30-9f95-4891-a6f8-c41216c1d723 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1529 microversion: 2.1 time: 0.905736 Oct 01 20:53:57.621350 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 614/1173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:56 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1529 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:57.637803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:57.638588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:57.656524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:57.657055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:57.657533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:57.662718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:57.663556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:57.664845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:57.672121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:57.886828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:57.922179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:57.926801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:57.929146 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8246ca5a-c3ef-49f4-91be-c8974eb4c383 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.580245 Oct 01 20:53:57.943822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:57.957265 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f91e610c-4206-4b16-b4d0-58f6c240c3b3 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1318 microversion: 2.1 time: 0.332883 Oct 01 20:53:57.959109 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 560/1174] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:57 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:53:57.964327 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 615/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:57 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:57.969333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7db4484-636f-40be-9689-2f134df7e61f tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:57.977237 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d7db4484-636f-40be-9689-2f134df7e61f tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] HTTP exception thrown: Flavor 94475597-5908-4582-897b-4fe8787d64c4 could not be found. Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7db4484-636f-40be-9689-2f134df7e61f tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Request method failure captured: Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/flavors/94475597-5908-4582-897b-4fe8787d64c4 HTTP/1.1 Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfgrvoBnYlro3OTr8bqKck9dAvgHsn2l2LUtEFEP6moT8OrAS48TWboKqleFK5k0rkZymjrXDlUGw2pSmwg6UvyuHtRgRsypm8XibkK_lcqHCDP3v3y8TYV7OgFdU39ngLOoCfqrxkMroewa_M-9z0QQizZV6jv-aaExP-gJVgyOXE Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9efda885854e4211bc1145a488270fbc Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-MigrationsAdminTest-251349309 Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:53:57.979622 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9efda885854e4211bc1145a488270fbc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9efda885854e4211bc1145a488270fbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9efda885854e4211bc1145a488270fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9efda885854e4211bc1145a488270fbc"}]}] Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-MigrationsAdminTest-251349309 Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9efda885854e4211bc1145a488270fbc Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-MigrationsAdminTest-251349309 Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-MigrationsAdminTest-251349309-project-admin Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: b12f27914a4544cf82521abd3e7db9a7 Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-MigrationsAdminTest-251349309-project-admin Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: exception: Flavor 94475597-5908-4582-897b-4fe8787d64c4 could not be found. Oct 01 20:53:57.981009 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '94475597-5908-4582-897b-4fe8787d64c4'} Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 94475597-5908-4582-897b-4fe8787d64c4 could not be found. Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:53:57.981811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 94475597-5908-4582-897b-4fe8787d64c4 could not be found. Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 94475597-5908-4582-897b-4fe8787d64c4 could not be found. Oct 01 20:53:57.983187 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:53:57.989229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-71068664-94d6-4e39-b50a-f780ca71440f req-0200131b-837d-4747-9a63-38cec029129d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a4e4e5-a2d3-4ef7-a9fc-5905102864df", "name": "network-vif-plugged", "status": "completed", "tag": "6ec345d7-85eb-444e-9419-7bdc55b67d3a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:57.990281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7db4484-636f-40be-9689-2f134df7e61f tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Returning 404 to user: Flavor 94475597-5908-4582-897b-4fe8787d64c4 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:53:57.991413 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d7db4484-636f-40be-9689-2f134df7e61f tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/94475597-5908-4582-897b-4fe8787d64c4" status: 404 len: 109 microversion: 2.1 time: 0.030890 Oct 01 20:53:57.992594 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 561/1176] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:53:57 2022] DELETE /compute/v2.1/flavors/94475597-5908-4582-897b-4fe8787d64c4 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:53:58.013129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-71068664-94d6-4e39-b50a-f780ca71440f req-0200131b-837d-4747-9a63-38cec029129d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:58.014616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-71068664-94d6-4e39-b50a-f780ca71440f req-0200131b-837d-4747-9a63-38cec029129d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:58.015277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-71068664-94d6-4e39-b50a-f780ca71440f req-0200131b-837d-4747-9a63-38cec029129d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:58.041075 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-71068664-94d6-4e39-b50a-f780ca71440f req-0200131b-837d-4747-9a63-38cec029129d service nova] Creating event network-vif-plugged:6ec345d7-85eb-444e-9419-7bdc55b67d3a for instance 77a4e4e5-a2d3-4ef7-a9fc-5905102864df on nch2-master-1 Oct 01 20:53:58.064812 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-71068664-94d6-4e39-b50a-f780ca71440f req-0200131b-837d-4747-9a63-38cec029129d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079854 Oct 01 20:53:58.066565 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 616/1177] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:53:58.240771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-964593577", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:53:58.338364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:53:58.379982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:58.381210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:58.392127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:58.393143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:58.393846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:58.394797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:58.396937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:58.397733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:58.754273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:58.765560 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-697a7a8f-86af-4ecb-b041-67bbebf92738 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1323 microversion: 2.1 time: 0.397535 Oct 01 20:53:58.766360 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 617/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:58 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:58.786340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:53:58.786856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:53:58.787341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:53:58.787760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:53:58.788438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:53:58.798693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:58.799522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:58.799886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:58.801116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:58.806867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:58.807325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:58.829414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:53:58.834036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:53:58.835928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Getting quotas for user e5bfbc1e512a445ca7527f3d79e40d16 and project 08fae3c0a9324c68b16dd495478a89e3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:53:58.854817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:53:58.858470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:53:58.919536 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3284a4e6-8c7c-47f2-a9c0-be84003b6b41 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682152 Oct 01 20:53:58.926186 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 562/1179] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:53:58.932411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bcfb8e30-0262-4608-8af1-a4fdb2da04cb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:58.933273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bcfb8e30-0262-4608-8af1-a4fdb2da04cb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:58.963010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:58.963550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:59.013311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:59.016929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:59.017670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:59.018684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:59.019713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:59.020365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:59.436165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bcfb8e30-0262-4608-8af1-a4fdb2da04cb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:59.448031 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bcfb8e30-0262-4608-8af1-a4fdb2da04cb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1212 microversion: 2.1 time: 0.519382 Oct 01 20:53:59.465441 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 618/1180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:58 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1212 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:53:59.478615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:59.479684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:59.492511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:59.494347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:59.495307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:59.496607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:59.497380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:59.498919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:59.892625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:59.903572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:59.906382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:53:59.907887 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45f81771-b12a-4290-abb3-40b6f8236f44 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1812 microversion: 2.25 time: 0.949702 Oct 01 20:53:59.908650 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 563/1181] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:53:58 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1812 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:53:59.914208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:53:59.915095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:53:59.922522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:59.924020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:59.924907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:53:59.925833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:53:59.926582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:53:59.927228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:00.111777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:00.123570 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c2d85da1-481e-445c-b7d8-cf366dad2a50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1318 microversion: 2.1 time: 0.654655 Oct 01 20:54:00.126815 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 619/1182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:59 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:00.135208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-db3cdea8-50a7-4ce1-b526-7938f1717e40 req-821153b8-0b94-4a16-8a88-abe0de377c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1818557f-9772-403d-bfa8-d226f1063f2f", "name": "network-vif-plugged", "status": "completed", "tag": "1dee487a-adae-475f-aff1-35bf8657a7f3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:00.164753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-db3cdea8-50a7-4ce1-b526-7938f1717e40 req-821153b8-0b94-4a16-8a88-abe0de377c7e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:00.165627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-db3cdea8-50a7-4ce1-b526-7938f1717e40 req-821153b8-0b94-4a16-8a88-abe0de377c7e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:00.166241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-db3cdea8-50a7-4ce1-b526-7938f1717e40 req-821153b8-0b94-4a16-8a88-abe0de377c7e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:00.186005 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-db3cdea8-50a7-4ce1-b526-7938f1717e40 req-821153b8-0b94-4a16-8a88-abe0de377c7e service nova] Creating event network-vif-plugged:1dee487a-adae-475f-aff1-35bf8657a7f3 for instance 1818557f-9772-403d-bfa8-d226f1063f2f on nch1-master-1 Oct 01 20:54:00.208877 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-db3cdea8-50a7-4ce1-b526-7938f1717e40 req-821153b8-0b94-4a16-8a88-abe0de377c7e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078214 Oct 01 20:54:00.211239 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 620/1183] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:54:00.312090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:00.325434 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2d567b5-ca0f-45d1-a927-2881b6f1082b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1323 microversion: 2.1 time: 0.412270 Oct 01 20:54:00.327033 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 564/1184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:53:59 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:00.492389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:00.493470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:00.513010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:00.515406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:00.516182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:00.517121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:00.517751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:00.518341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:00.672009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:00.682442 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5c4cd593-62f0-470b-ac7f-25d1c144de2b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1264 microversion: 2.1 time: 0.210653 Oct 01 20:54:00.684115 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 621/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:00 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:00.937641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:00.939090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:00.958021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:00.958851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:00.959541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:00.960523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:00.961182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:00.961818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:01.153822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:01.155137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:01.167949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:01.168591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:01.171359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:01.172500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:01.173058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:01.173700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:01.203267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:01.225058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:01.228567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:01.231357 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc6c637d-9895-4bc8-b6a3-7f0864fa294c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1802 microversion: 2.25 time: 0.297516 Oct 01 20:54:01.255922 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 565/1186] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:00 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1802 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:01.261974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-382d4005-6f67-40ad-9de1-ff5da0dca06e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '.version_select at 0x7f41736ac670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:01.266103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-382d4005-6f67-40ad-9de1-ff5da0dca06e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:01.266928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-382d4005-6f67-40ad-9de1-ff5da0dca06e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:01.267930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-382d4005-6f67-40ad-9de1-ff5da0dca06e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:01.294060 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-382d4005-6f67-40ad-9de1-ff5da0dca06e tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 3625 microversion: 2.25 time: 0.035523 Oct 01 20:54:01.309764 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 566/1187] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Oct 1 20:54:01 2022] GET /compute/v2.1/os-migrations => generated 3625 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:01.324362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:01.327311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:01.382206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:01.387205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:01.390855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:01.391939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:01.392648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:01.393346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:02.488467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid ee54a04f-6360-4f81-a7ba-68d65e8d8d36 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:02.519702 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1786ef36-84be-4ce4-aeb7-803eb3df9f5a tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 2420 microversion: 2.25 time: 1.199721 Oct 01 20:54:02.526102 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 567/1188] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:01 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 2420 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:54:02.559905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:02.566133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:02.592433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:02.596050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:02.596892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:02.597963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:02.604663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:02.606256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:02.754066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:02.769045 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6a264893-3ddb-46be-866b-8a309a0846e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1318 microversion: 2.1 time: 1.620315 Oct 01 20:54:02.778819 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 622/1189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:01 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1318 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:02.785466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:02.786415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:02.796751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:02.798107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:02.800090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:02.801231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:02.801871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:02.802670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:03.020098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:03.034090 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-60e5d3c8-dcab-4a47-938e-b0b45df7faf8 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1270 microversion: 2.1 time: 0.253421 Oct 01 20:54:03.047501 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 623/1190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:02 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:03.059080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:03.064976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:03.081300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:03.085172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:03.087479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:03.090377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:03.092143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:03.094796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:03.168743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:03.177676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:03.183950 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dee53e0b-944c-42a7-bd57-ae920663de8b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1323 microversion: 2.1 time: 0.656354 Oct 01 20:54:03.190483 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 568/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:02 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1323 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:03.806972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:03.808269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:03.824683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:03.827931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:03.828589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:03.832163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:03.832888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:03.834548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:03.900435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid ee54a04f-6360-4f81-a7ba-68d65e8d8d36 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:03.924561 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-826ac0fb-c216-47c9-acd3-af552fca9967 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 2420 microversion: 2.25 time: 0.875624 Oct 01 20:54:03.925434 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 624/1192] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:03 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 2420 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:03.930697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7e3bb599-6728-49de-aed1-e22064b378ce req-49663847-68bd-497b-ad11-b9afd68918f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec44930-5588-48ae-8253-56af3ab60310", "name": "network-vif-plugged", "status": "completed", "tag": "ecbb28ab-d141-46cd-9031-9cb3e8005cd8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:03.943148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7e3bb599-6728-49de-aed1-e22064b378ce req-49663847-68bd-497b-ad11-b9afd68918f8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:03.944336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7e3bb599-6728-49de-aed1-e22064b378ce req-49663847-68bd-497b-ad11-b9afd68918f8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:03.944927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7e3bb599-6728-49de-aed1-e22064b378ce req-49663847-68bd-497b-ad11-b9afd68918f8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:03.960608 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7e3bb599-6728-49de-aed1-e22064b378ce req-49663847-68bd-497b-ad11-b9afd68918f8 service nova] Creating event network-vif-plugged:ecbb28ab-d141-46cd-9031-9cb3e8005cd8 for instance 2ec44930-5588-48ae-8253-56af3ab60310 on nch2-master-1 Oct 01 20:54:03.967386 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7e3bb599-6728-49de-aed1-e22064b378ce req-49663847-68bd-497b-ad11-b9afd68918f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039828 Oct 01 20:54:03.969356 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 625/1193] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:04.063727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:04.064720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:04.072786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:04.073544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:04.074330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:04.075250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:04.076551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:04.077141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:04.232284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:04.240755 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6344c9e5-c2f8-401e-917c-bd75e75fa4ab tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1270 microversion: 2.1 time: 0.181972 Oct 01 20:54:04.241713 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 626/1194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:04 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:04.270816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:04.271607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:04.278887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:04.279702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:04.280775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:04.281681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:04.282335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:04.283002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:04.288471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:04.328177 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98240d90-781c-4a89-a71e-e77457c72a4b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1318 microversion: 2.1 time: 0.522384 Oct 01 20:54:04.328971 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 569/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:03 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:04.346532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:04.348884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:04.364259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:04.365819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:04.368227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:04.370138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:04.370869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:04.371535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:04.454024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lazy-loading 'services' on Instance uuid ee54a04f-6360-4f81-a7ba-68d65e8d8d36 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:04.710283 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c6e72308-3905-4b92-9903-1ada707a39db tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-volume_attachments/2ffa640e-11d3-4b20-a2d6-2b0316d715b0" status: 202 len: 0 microversion: 2.25 time: 0.452047 Oct 01 20:54:04.711462 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 627/1196] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Oct 1 20:54:04 2022] DELETE /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-volume_attachments/2ffa640e-11d3-4b20-a2d6-2b0316d715b0 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:54:04.722192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-db05d6e2-9960-4e2c-8dad-8eba4a5c9489 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:04.731388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-db05d6e2-9960-4e2c-8dad-8eba4a5c9489 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:04.744862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db05d6e2-9960-4e2c-8dad-8eba4a5c9489 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:04.748153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db05d6e2-9960-4e2c-8dad-8eba4a5c9489 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:04.753524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db05d6e2-9960-4e2c-8dad-8eba4a5c9489 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:04.758368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db05d6e2-9960-4e2c-8dad-8eba4a5c9489 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:04.759297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db05d6e2-9960-4e2c-8dad-8eba4a5c9489 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:04.759954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db05d6e2-9960-4e2c-8dad-8eba4a5c9489 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:04.833901 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-db05d6e2-9960-4e2c-8dad-8eba4a5c9489 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117785 Oct 01 20:54:04.836142 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 628/1197] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Oct 1 20:54:04 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:54:05.016086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:05.019822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1603899123", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:05.049202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:05.050872 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e37bf149-8ba7-4f57-a2ce-f88942605252 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1323 microversion: 2.1 time: 0.719049 Oct 01 20:54:05.055275 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 570/1198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:04 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1323 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:05.095483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] validate_networks() for [('ccf65e83-da30-4831-845a-74261cf0c33e', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:54:05.272840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:05.273914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:05.281452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:05.282238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:05.282869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:05.285091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:05.285901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:05.286571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:05.880129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:05.892860 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0820b4b2-8b97-4e38-b3b5-f2260b3f459d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1312 microversion: 2.1 time: 0.626040 Oct 01 20:54:05.893433 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 571/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:05 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:05.901117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:05.902242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:05.920157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:05.920656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:05.922127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:05.923340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:05.924156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:05.924641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:06.448449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:54:06.449102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:54:06.451576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:54:06.452232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:54:06.452660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:06.453121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:54:06.466091 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5f4e59ba-cb3e-44c7-b0cf-4e1003817d99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1318 microversion: 2.1 time: 0.570731 Oct 01 20:54:06.468419 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 572/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:05 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:06.482891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-13fc353e-1ba3-494f-844d-f4122390dabf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:06.490022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-13fc353e-1ba3-494f-844d-f4122390dabf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:06.497270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:06.498733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:06.499430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:06.500420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:06.501146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:06.501899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:06.505980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fc353e-1ba3-494f-844d-f4122390dabf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:06.506637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fc353e-1ba3-494f-844d-f4122390dabf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:06.507919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fc353e-1ba3-494f-844d-f4122390dabf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:06.510684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fc353e-1ba3-494f-844d-f4122390dabf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:06.512043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fc353e-1ba3-494f-844d-f4122390dabf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:06.514236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fc353e-1ba3-494f-844d-f4122390dabf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:06.524867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Getting quotas for project bcaab3f0817043c682737e94bb1dd1ac. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:06.535153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Getting quotas for user 725f68beba264c2eafc951f8300eba32 and project bcaab3f0817043c682737e94bb1dd1ac. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:06.554831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:54:06.557385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:54:06.586170 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-13fc353e-1ba3-494f-844d-f4122390dabf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.114656 Oct 01 20:54:06.588880 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 573/1201] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Oct 1 20:54:06 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:06.597690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-68077cba-8d40-40f5-8d69-d993e699d843 req-67a357e1-d3b9-467e-9061-d86d3acec4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3763bd-cd0f-4912-874b-b6ed42228c7b", "name": "network-vif-plugged", "status": "completed", "tag": "6030cb83-5eac-4c1d-9806-6b492776785a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:06.613425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-68077cba-8d40-40f5-8d69-d993e699d843 req-67a357e1-d3b9-467e-9061-d86d3acec4ab service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:06.614197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-68077cba-8d40-40f5-8d69-d993e699d843 req-67a357e1-d3b9-467e-9061-d86d3acec4ab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:06.614924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-68077cba-8d40-40f5-8d69-d993e699d843 req-67a357e1-d3b9-467e-9061-d86d3acec4ab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:06.629119 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-68077cba-8d40-40f5-8d69-d993e699d843 req-67a357e1-d3b9-467e-9061-d86d3acec4ab service nova] Creating event network-vif-plugged:6030cb83-5eac-4c1d-9806-6b492776785a for instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b on nch1-master-1 Oct 01 20:54:06.635641 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-68077cba-8d40-40f5-8d69-d993e699d843 req-67a357e1-d3b9-467e-9061-d86d3acec4ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043344 Oct 01 20:54:06.636543 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 574/1202] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:06.643107 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-69e8ae09-51c4-4af4-9e52-b7204774fc13 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.700224 Oct 01 20:54:06.645398 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 629/1203] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:54:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:54:06.682935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:06.686450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:06.727000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:06.731205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:06.733678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:06.734742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:06.735927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:06.736745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:06.779453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2115656645", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "00c1b669-0633-4d9a-bca2-2a3af62ab8df"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:06.886420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] validate_networks() for [('00c1b669-0633-4d9a-bca2-2a3af62ab8df', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:54:07.898744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:07.917933 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37a8d1be-2474-4744-9154-52041e66aee1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1323 microversion: 2.1 time: 1.279794 Oct 01 20:54:07.918893 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 575/1204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:06 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1323 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:07.945131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:07.946292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:07.965164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:07.966152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:07.970553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:07.972575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:07.973860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:07.974852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:08.477937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:08.493328 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5dacb75d-8710-44e5-98e5-e5d9e9fd52e0 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1210 microversion: 2.1 time: 0.565978 Oct 01 20:54:08.506515 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 576/1205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:07 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1210 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:08.511169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:08.511820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:08.524480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:08.525524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:08.526197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:08.527267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:08.528203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:08.530730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:08.578947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:54:08.579698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:54:08.580381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:54:08.580822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:54:08.581354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:54:08.598870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:08.599472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:08.599973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:08.601024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:08.601698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:08.602517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:08.628262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Getting quotas for project 9c0b38cea2c345c68c51c4d8cb9c07e7. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:08.636042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Getting quotas for user 1d180849a694494e89843c0c315acd6d and project 9c0b38cea2c345c68c51c4d8cb9c07e7. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:08.655656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:54:08.660281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:54:08.791610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:08.794216 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3e51073c-5043-4074-a5f5-09ea76397a88 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.145308 Oct 01 20:54:08.806274 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 630/1206] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:54:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:54:08.812071 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ac705dc-fb98-436b-b6c8-293ceda718e6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1312 microversion: 2.1 time: 0.316880 Oct 01 20:54:08.815006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 577/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:08 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1312 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:08.819340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:08.835531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:08.842121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:08.853488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:08.854305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:08.854962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:08.856647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:08.857979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:08.859187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:08.867957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:09.010238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ab65b24e-0105-4919-a2f8-d0b76c7892c8 req-93f589c5-ad93-46c4-942d-1a11154eeba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e", "tag": "9b68231b-ea01-4f80-9d40-3d0180818f18"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:09.046945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ab65b24e-0105-4919-a2f8-d0b76c7892c8 req-93f589c5-ad93-46c4-942d-1a11154eeba5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:09.047996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ab65b24e-0105-4919-a2f8-d0b76c7892c8 req-93f589c5-ad93-46c4-942d-1a11154eeba5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:09.048471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ab65b24e-0105-4919-a2f8-d0b76c7892c8 req-93f589c5-ad93-46c4-942d-1a11154eeba5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:09.061419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ab65b24e-0105-4919-a2f8-d0b76c7892c8 req-93f589c5-ad93-46c4-942d-1a11154eeba5 service nova] Creating event network-changed:9b68231b-ea01-4f80-9d40-3d0180818f18 for instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e on nch1-master-1 Oct 01 20:54:09.067568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ab65b24e-0105-4919-a2f8-d0b76c7892c8 req-93f589c5-ad93-46c4-942d-1a11154eeba5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251395 Oct 01 20:54:09.068854 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 578/1208] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:09.076754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85f9b275-d4ed-4309-93d7-008c31e781e7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:09.078585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-85f9b275-d4ed-4309-93d7-008c31e781e7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:09.201513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-85f9b275-d4ed-4309-93d7-008c31e781e7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:09.211137 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85f9b275-d4ed-4309-93d7-008c31e781e7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 200 len: 1208 microversion: 2.1 time: 0.139680 Oct 01 20:54:09.225686 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 579/1209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:09 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:09.231379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:09.232820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:09.248603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:09.250137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:09.252345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:09.254413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:09.256290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:09.272173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:09.420802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:09.431024 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6bd3b9de-e57f-4ada-b01d-3c95eba2d7a2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1467 microversion: 2.1 time: 0.622327 Oct 01 20:54:09.452851 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 631/1210] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:08 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1467 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:09.464151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:09.473710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:09.484723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:09.485241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:09.485690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:09.486441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:09.486938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:09.487373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:10.246420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:10.256227 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-837fa442-7f3e-4533-b6aa-6fff386640ad tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1323 microversion: 2.1 time: 1.036995 Oct 01 20:54:10.261435 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 580/1211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:09 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1323 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:10.275602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:10.276521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:10.292557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:10.293495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:10.294196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:10.298948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:10.299940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:10.300646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:10.540174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:10.552762 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-14b39f23-1cda-4bc0-9857-97f11a24005a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1272 microversion: 2.1 time: 0.287867 Oct 01 20:54:10.553758 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 581/1212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:10 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1272 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:10.570406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:10.571438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:10.580766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:10.582459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:10.583398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:10.585063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:10.585894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:10.586739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:10.773902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:10.786936 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0e0829fe-3c67-416d-afde-9de0b09ef1b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df" status: 200 len: 1466 microversion: 2.1 time: 1.326855 Oct 01 20:54:10.787777 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 632/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:09 2022] GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df => generated 1466 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:54:10.803988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:10.803988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:10.825128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:10.825128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:10.825128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:10.825128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:10.825716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:10.825716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:10.968136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:10.979196 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-26ad90bf-58a6-44bd-9519-424788801195 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 200 len: 1260 microversion: 2.1 time: 0.189140 Oct 01 20:54:10.987038 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 633/1214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:10 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:10.988931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:10.995877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:10.997023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Searching by: {'reservation_id': 'r-1q3ahd05', 'deleted': False, 'project_id': '44683518fe3d46c58b139727cf0c9515'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:54:11.005952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:11.006349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:11.006818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:11.007769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:11.008233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:11.009389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:11.021941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:11.036874 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-39d09239-53d9-4faf-86cc-1ca9c4df43c1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1312 microversion: 2.1 time: 0.471901 Oct 01 20:54:11.050527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 582/1215] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:10 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1312 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:11.050527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-189821334", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e94323fd-d911-423e-a839-fc9242e1930f"}], "block_device_mapping_v2": [{"uuid": "0657d824-3635-4137-a555-f2ea7736e55a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:11.171142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] validate_networks() for [('e94323fd-d911-423e-a839-fc9242e1930f', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:54:11.265024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:54:11.336303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:11.414634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:11.423853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:11.424958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:11.426304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:11.846917 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-69b81104-83ad-495c-acfe-5bac657402b1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?reservation_id=r-1q3ahd05" status: 200 len: 2926 microversion: 2.1 time: 0.863686 Oct 01 20:54:11.848799 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 634/1216] 10.222.0.17 () {58 vars in 1197 bytes} [Sat Oct 1 20:54:10 2022] GET /compute/v2.1/servers/detail?reservation_id=r-1q3ahd05 => generated 2926 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:11.854091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:11.854967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:11.871512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:11.872218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:11.873410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:11.874127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:11.875285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:11.875817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.115286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:54:12.115847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:54:12.116268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:54:12.116723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:54:12.117156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:54:12.121019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:12.127949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.128477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.129100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.130024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.130682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.131342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.132928 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5967626c-7c3e-420d-a61f-ed7dd9a387e0 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 200 len: 1520 microversion: 2.1 time: 0.282739 Oct 01 20:54:12.134175 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 635/1217] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:11 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:12.142535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:12.143700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:12.149190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:12.153938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.154979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.155746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Getting quotas for user aa72870453cd4b958725801b842c7a28 and project 76e0a9843d9c41f7b2fae591dc09d9d2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:12.155898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.157021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.158107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.159841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.234759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:54:12.237380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0657d824-3635-4137-a555-f2ea7736e55a',volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:54:12.337558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:12.347498 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6ab5320a-797d-415a-b5cf-6f38c5a6273d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1314 microversion: 2.1 time: 0.211750 Oct 01 20:54:12.355613 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 636/1218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:12 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:12.355613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-331b6c50-a847-4848-bfe5-b7cb9c701107 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:12.372389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.compute.server_groups [None req-331b6c50-a847-4848-bfe5-b7cb9c701107 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Querying cell 2663fce6-13d1-4945-900e-d818f7f389c0(cell1) for 2 instances {{(pid=140437) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 01 20:54:12.373374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-331b6c50-a847-4848-bfe5-b7cb9c701107 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.374254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-331b6c50-a847-4848-bfe5-b7cb9c701107 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.374897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-331b6c50-a847-4848-bfe5-b7cb9c701107 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.416408 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-331b6c50-a847-4848-bfe5-b7cb9c701107 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/fdce9808-1c48-473e-b790-269b25808432" status: 200 len: 266 microversion: 2.1 time: 0.066541 Oct 01 20:54:12.419180 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-944608fe-c172-45f5-a8aa-57b70be639bd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.374882 Oct 01 20:54:12.426892 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 583/1219] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:54:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 20:54:12.426892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:12.426892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:12.428780 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 637/1220] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:54:12 2022] GET /compute/v2.1/os-server-groups/fdce9808-1c48-473e-b790-269b25808432 => generated 266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:12.433712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:12.434328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:12.443540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.444049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.444483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.445195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.446690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.447527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.447683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.448704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.448824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.449186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.453034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.453196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.619667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:12.637247 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-17868f33-6906-485b-88a8-acb9d722f250 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 200 len: 1260 microversion: 2.1 time: 0.215725 Oct 01 20:54:12.655134 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 584/1221] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:12 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:12.667257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.87"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:12.674853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:12.696680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.697201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.697653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.698392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:12.698911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:12.699334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:12.757291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "refresh_cache-57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:54:12.757743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquired lock "refresh_cache-57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:54:13.545678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:13.576864 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5783ff17-492a-481a-956b-46d694a059eb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1312 microversion: 2.1 time: 1.143697 Oct 01 20:54:13.578780 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 638/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:12 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1312 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:13.589269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e25979e0-b506-4f36-8270-67ed59551963 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:13.590000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e25979e0-b506-4f36-8270-67ed59551963 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:13.604180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e25979e0-b506-4f36-8270-67ed59551963 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:13.604983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e25979e0-b506-4f36-8270-67ed59551963 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:13.605611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e25979e0-b506-4f36-8270-67ed59551963 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:13.608738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e25979e0-b506-4f36-8270-67ed59551963 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:13.609492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e25979e0-b506-4f36-8270-67ed59551963 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:13.610791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e25979e0-b506-4f36-8270-67ed59551963 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:14.269175 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e25979e0-b506-4f36-8270-67ed59551963 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 200 len: 1618 microversion: 2.1 time: 0.688565 Oct 01 20:54:14.271062 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 639/1223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:13 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 1618 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:14.276572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:14.277459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:14.283878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:14.284604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:14.285334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:14.286458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:14.287180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:14.287851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:14.492063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:14.506465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:14.508642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:14.523970 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c5817bf4-b636-43a2-b6cd-3b7d70c03e14 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1232 microversion: 2.25 time: 0.238353 Oct 01 20:54:14.528357 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 640/1224] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:14 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1232 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:14.535561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:14.539251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:14.551112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:14.552411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:14.553072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:14.554049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:14.555078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:14.555746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:15.610620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:15.619174 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8c11dbfe-76e4-4ae5-a6b8-84f999b9af1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1314 microversion: 2.1 time: 1.088952 Oct 01 20:54:15.619759 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 641/1225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:14 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:15.625566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:15.626401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:15.635866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:15.636367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:15.636812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:15.637524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:15.638713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:15.639233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:16.075181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:16.084029 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f078f53e-0231-41fd-bcf3-2b967f24a3bd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 200 len: 1308 microversion: 2.1 time: 0.462442 Oct 01 20:54:16.085095 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 642/1226] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:15 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 1308 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:16.090035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c96b4ae0-cb85-45d9-abb6-e2d907dace9d tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:16.090804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c96b4ae0-cb85-45d9-abb6-e2d907dace9d tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:16.097828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96b4ae0-cb85-45d9-abb6-e2d907dace9d tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:16.098656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96b4ae0-cb85-45d9-abb6-e2d907dace9d tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:16.099339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96b4ae0-cb85-45d9-abb6-e2d907dace9d tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:16.100285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96b4ae0-cb85-45d9-abb6-e2d907dace9d tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:16.100983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96b4ae0-cb85-45d9-abb6-e2d907dace9d tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:16.101644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96b4ae0-cb85-45d9-abb6-e2d907dace9d tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:16.522085 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c96b4ae0-cb85-45d9-abb6-e2d907dace9d tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df" status: 200 len: 1617 microversion: 2.1 time: 0.435624 Oct 01 20:54:16.529330 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 643/1227] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:16 2022] GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df => generated 1617 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:16.587129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-150234af-1805-4a37-b7b5-0b21c8bdcfed req-fcda65e6-7fed-4479-bb19-5ba24f79e65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bec5b02-88e5-450e-b5ee-61fc18b2349b", "tag": "a5ebda0b-ad93-4580-a18d-ceef18a4df2b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:16.601172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-150234af-1805-4a37-b7b5-0b21c8bdcfed req-fcda65e6-7fed-4479-bb19-5ba24f79e65d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:16.601548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-150234af-1805-4a37-b7b5-0b21c8bdcfed req-fcda65e6-7fed-4479-bb19-5ba24f79e65d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:16.601991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-150234af-1805-4a37-b7b5-0b21c8bdcfed req-fcda65e6-7fed-4479-bb19-5ba24f79e65d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:16.615316 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-150234af-1805-4a37-b7b5-0b21c8bdcfed req-fcda65e6-7fed-4479-bb19-5ba24f79e65d service nova] Creating event network-changed:a5ebda0b-ad93-4580-a18d-ceef18a4df2b for instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b on nch1-master-1 Oct 01 20:54:16.620376 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-150234af-1805-4a37-b7b5-0b21c8bdcfed req-fcda65e6-7fed-4479-bb19-5ba24f79e65d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096410 Oct 01 20:54:16.621855 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 644/1228] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:16.629018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:16.629738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:16.637719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:16.639115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:16.639757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:16.640652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:16.641279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:16.641868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:17.155353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:17.165910 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-667e58ce-6774-44a9-b6a9-ad3ff83b9f7c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1312 microversion: 2.1 time: 0.542605 Oct 01 20:54:17.166923 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 645/1229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:16 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1312 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:17.172684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:17.173421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:17.179550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:17.180329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:17.180862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:17.181700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:17.182394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:17.183138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:17.214048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Building network info cache for instance {{(pid=140438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 20:54:18.014450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:18.032403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:18.034361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:18.035921 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0da63788-6856-4840-8590-76656f0df88c tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1280 microversion: 2.25 time: 0.867811 Oct 01 20:54:18.037945 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 646/1230] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:17 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1280 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:18.052156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-13364b84-0ba6-4a06-99f9-8b42f639bca9 req-3ed8d782-31b8-48eb-8c57-8f01fa9b5017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fe3865-129e-47db-a49c-cae3dded681f", "tag": "dc4e575f-951d-4f79-be51-61c297320479"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:18.070450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-13364b84-0ba6-4a06-99f9-8b42f639bca9 req-3ed8d782-31b8-48eb-8c57-8f01fa9b5017 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:18.070971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-13364b84-0ba6-4a06-99f9-8b42f639bca9 req-3ed8d782-31b8-48eb-8c57-8f01fa9b5017 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:18.071410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-13364b84-0ba6-4a06-99f9-8b42f639bca9 req-3ed8d782-31b8-48eb-8c57-8f01fa9b5017 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:18.083570 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-13364b84-0ba6-4a06-99f9-8b42f639bca9 req-3ed8d782-31b8-48eb-8c57-8f01fa9b5017 service nova] Creating event network-changed:dc4e575f-951d-4f79-be51-61c297320479 for instance 19fe3865-129e-47db-a49c-cae3dded681f on nch1-master-1 Oct 01 20:54:18.089626 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-13364b84-0ba6-4a06-99f9-8b42f639bca9 req-3ed8d782-31b8-48eb-8c57-8f01fa9b5017 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041303 Oct 01 20:54:18.090547 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 647/1231] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:18.096258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f3ea3065-427e-4dd3-84c6-f75731396115 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Action: 'create', calling method: .version_select at 0x7f41736151f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1666231242", "policies": ["anti-affinity"]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:18.121645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-f3ea3065-427e-4dd3-84c6-f75731396115 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_groups'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:18.128825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-f3ea3065-427e-4dd3-84c6-f75731396115 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_groups'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:18.191940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-f3ea3065-427e-4dd3-84c6-f75731396115 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_groups'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:18.197241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-f3ea3065-427e-4dd3-84c6-f75731396115 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_groups'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:18.210939 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f3ea3065-427e-4dd3-84c6-f75731396115 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.118879 Oct 01 20:54:18.211551 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 648/1232] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Oct 1 20:54:18 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:18.216695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:18.217422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:18.224186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:18.224908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:18.226165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:18.227170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:18.227794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:18.228385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:18.651634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:18.662994 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-56a6e5cf-c456-451f-a96a-cf4e641d16c8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1314 microversion: 2.1 time: 0.450049 Oct 01 20:54:18.663845 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 649/1233] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:18 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:18.730431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-dc7d108b-78db-4480-92ae-d444a904bf6c req-c1873bfe-4019-4fad-ab14-57d34562ddb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e", "name": "network-vif-plugged", "status": "completed", "tag": "9b68231b-ea01-4f80-9d40-3d0180818f18"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:18.737083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:18.741647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-dc7d108b-78db-4480-92ae-d444a904bf6c req-c1873bfe-4019-4fad-ab14-57d34562ddb6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:18.742573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-dc7d108b-78db-4480-92ae-d444a904bf6c req-c1873bfe-4019-4fad-ab14-57d34562ddb6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:18.743358 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-dc7d108b-78db-4480-92ae-d444a904bf6c req-c1873bfe-4019-4fad-ab14-57d34562ddb6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:18.757638 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-dc7d108b-78db-4480-92ae-d444a904bf6c req-c1873bfe-4019-4fad-ab14-57d34562ddb6 service nova] Creating event network-vif-plugged:9b68231b-ea01-4f80-9d40-3d0180818f18 for instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e on nch1-master-1 Oct 01 20:54:18.762618 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-dc7d108b-78db-4480-92ae-d444a904bf6c req-c1873bfe-4019-4fad-ab14-57d34562ddb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096117 Oct 01 20:54:18.763752 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 650/1234] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:18.769346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:18.770043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:18.776384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:18.776875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:18.777311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:18.778016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:18.778474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:18.779480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:19.090123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:19.098069 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e8a98203-978d-4a95-86c3-5800a7696210 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 200 len: 1308 microversion: 2.1 time: 0.332957 Oct 01 20:54:19.098767 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 651/1235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:18 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:19.110675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:19.110675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:19.110675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:19.110675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:19.111084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:19.111559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:19.112184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:19.113692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:19.196451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Updating instance_info_cache with network_info: [{"id": "a390abec-97aa-4416-8c5b-b217df3504f2", "address": "fa:16:3e:f9:81:ac", "network": {"id": "865ef00f-9395-4fab-b79f-2237ecbc6955", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1577587393-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a2694c8af60455aa9db5997c53adbdc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa390abec-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 20:54:19.212017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Releasing lock "refresh_cache-57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:54:19.213312 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc8727b5-f456-452b-b360-18af5f662c96 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "POST /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c/action" status: 202 len: 0 microversion: 2.1 time: 6.556793 Oct 01 20:54:19.217766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 585/1236] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:12 2022] POST /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c/action => generated 0 bytes in 6562 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 01 20:54:19.223934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1696286534", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "feda80dc-d885-4f9c-897d-e6bd50684bcb"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:19.285246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:54:19.427594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:19.435963 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eb676249-2722-458a-b780-cd14358d1b48 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1312 microversion: 2.1 time: 0.336134 Oct 01 20:54:19.436540 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 652/1237] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:19 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:19.441360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:19.441965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:19.449000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:19.449494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:19.450123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:19.451034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:19.451651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:19.452246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:19.723446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:19.733877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:19.735378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:19.736787 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-86175398-6ab5-4b86-95d8-249b6b25511e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1280 microversion: 2.25 time: 0.299123 Oct 01 20:54:19.737268 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 653/1238] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:19 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1280 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:19.741928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.87"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:19.745192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:19.754658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:19.755080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:19.755716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:19.756435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:19.756925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:19.757349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:19.759346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:54:19.759912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:54:19.760569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:54:19.761071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:54:19.765087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:54:19.774295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:19.788426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "refresh_cache-3d3763bd-cd0f-4912-874b-b6ed42228c7b" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:54:19.788837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquired lock "refresh_cache-3d3763bd-cd0f-4912-874b-b6ed42228c7b" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:54:19.797372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:19.798138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:19.798296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:19.799683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:19.800310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:19.800944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:19.835031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:19.843897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:19.859172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Going to run 2 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:54:19.861773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 3d5200d5-8702-4469-a18f-480ef4f6210c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:54:19.904964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140438) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 01 20:54:19.927690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:19.934064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:19.944344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:19.982377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:19.988494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:20.005945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=3d5200d5-8702-4469-a18f-480ef4f6210c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:54:20.060865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:20.066190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:20.101525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:20.107543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:20.146925 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2e6cd24c-f1c8-4763-aedc-dd7f5fbd9c7a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.927474 Oct 01 20:54:20.150752 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 586/1239] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:54:19 2022] POST /compute/v2.1/servers => generated 32 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 01 20:54:20.152560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:20.153199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:20.163460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:20.163974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:20.164419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:20.165158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:20.165613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:20.166047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:20.808569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:20.820675 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-297d87c9-0bdc-4f7b-91aa-e610511c0b7b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1314 microversion: 2.1 time: 0.672006 Oct 01 20:54:20.821673 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 587/1240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:20 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:20.826594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:20.827462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:20.835510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:20.836244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:20.836928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:20.837997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:20.838569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:20.839683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:20.870388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:21.110955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:21.244651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:21.254599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c04688f-5af2-4f06-afb2-f77ba927f4dd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 200 len: 1308 microversion: 2.1 time: 0.431475 Oct 01 20:54:21.256866 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 588/1241] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:20 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 1308 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:21.260954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:21.267165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:21.268957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Searching by: {'deleted': False, 'project_id': '44683518fe3d46c58b139727cf0c9515'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:54:21.276260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:21.276934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:21.277563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:21.278903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:21.279572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:21.280446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:21.311793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:54:21.341958 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-682ca6a3-474e-486b-aba1-199444550bf2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.085190 Oct 01 20:54:21.349868 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 589/1242] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 20:54:21 2022] GET /compute/v2.1/servers => generated 1663 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:21.349868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8e576a7b-9327-4bf2-9f93-600c985a9663 req-bda99f42-63b1-4255-881e-e7ecd8e49e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e5943e-d2fe-4e7b-9140-ffe35a8aca4c", "tag": "a390abec-97aa-4416-8c5b-b217df3504f2"}, {"name": "network-changed", "server_uuid": "b894bd4e-ce19-41b9-81ee-64786805990e", "tag": "ddea4550-4948-4507-8a91-c65d3ab874a0"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:21.358906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8e576a7b-9327-4bf2-9f93-600c985a9663 req-bda99f42-63b1-4255-881e-e7ecd8e49e47 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:21.359399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8e576a7b-9327-4bf2-9f93-600c985a9663 req-bda99f42-63b1-4255-881e-e7ecd8e49e47 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:21.360670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8e576a7b-9327-4bf2-9f93-600c985a9663 req-bda99f42-63b1-4255-881e-e7ecd8e49e47 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:21.375798 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8e576a7b-9327-4bf2-9f93-600c985a9663 req-bda99f42-63b1-4255-881e-e7ecd8e49e47 service nova] Creating event network-changed:a390abec-97aa-4416-8c5b-b217df3504f2 for instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c on nch2-master-1 Oct 01 20:54:21.376692 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8e576a7b-9327-4bf2-9f93-600c985a9663 req-bda99f42-63b1-4255-881e-e7ecd8e49e47 service nova] Creating event network-changed:ddea4550-4948-4507-8a91-c65d3ab874a0 for instance b894bd4e-ce19-41b9-81ee-64786805990e on nch2-master-1 Oct 01 20:54:21.386380 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8e576a7b-9327-4bf2-9f93-600c985a9663 req-bda99f42-63b1-4255-881e-e7ecd8e49e47 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040311 Oct 01 20:54:21.387036 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 590/1243] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:21.394876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:21.395852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:21.402843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:21.403813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:21.404444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:21.405399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:21.406037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:21.406729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:21.789307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:21.797878 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b34f5aa0-0c31-43f8-bdc1-1ff8a8ef55a2 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1312 microversion: 2.1 time: 0.408073 Oct 01 20:54:21.798479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 591/1244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:21 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1312 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:21.803146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:21.803753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:21.810265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:21.811142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:21.811687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:21.812682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:21.813588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:21.814123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:22.132391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:22.145345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:22.148106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:22.149720 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fba1b937-d58c-4c1b-a0e3-16e33b294976 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1280 microversion: 2.25 time: 0.350192 Oct 01 20:54:22.150615 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 592/1245] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:21 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1280 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:22.159151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1236561d-4232-4ded-a8fb-f99c3ba63c5f req-a0f636fc-15f4-4662-aa81-9a585edc3a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bec5b02-88e5-450e-b5ee-61fc18b2349b", "name": "network-vif-plugged", "status": "completed", "tag": "a5ebda0b-ad93-4580-a18d-ceef18a4df2b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:22.174215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1236561d-4232-4ded-a8fb-f99c3ba63c5f req-a0f636fc-15f4-4662-aa81-9a585edc3a21 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:22.175198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1236561d-4232-4ded-a8fb-f99c3ba63c5f req-a0f636fc-15f4-4662-aa81-9a585edc3a21 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:22.176041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1236561d-4232-4ded-a8fb-f99c3ba63c5f req-a0f636fc-15f4-4662-aa81-9a585edc3a21 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:22.191466 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1236561d-4232-4ded-a8fb-f99c3ba63c5f req-a0f636fc-15f4-4662-aa81-9a585edc3a21 service nova] Creating event network-vif-plugged:a5ebda0b-ad93-4580-a18d-ceef18a4df2b for instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b on nch1-master-1 Oct 01 20:54:22.197591 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1236561d-4232-4ded-a8fb-f99c3ba63c5f req-a0f636fc-15f4-4662-aa81-9a585edc3a21 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045430 Oct 01 20:54:22.198399 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 593/1246] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:22.204924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:22.205660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:22.212572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:22.213522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:22.213966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:22.215015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:22.216266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:22.216876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:22.321669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:22.329377 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-96defdf9-82ab-40f6-b6a9-2501191b858d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1271 microversion: 2.1 time: 0.129544 Oct 01 20:54:22.342758 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 594/1247] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:22 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:22.342758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:22.342758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:22.347224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:22.347744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:22.348197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:22.348934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:22.349398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:22.349831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:23.012428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:23.037222 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad01931c-ba62-45c0-bc65-830ab9ffa78f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1314 microversion: 2.1 time: 0.705858 Oct 01 20:54:23.058584 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 595/1248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:22 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:23.058584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:23.058584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:23.071649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:23.071975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:23.072563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:23.074660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:23.075255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:23.075613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:23.464675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:23.472959 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b587fa4-e7b5-4081-a69b-02cf549c93ce tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 200 len: 1308 microversion: 2.1 time: 0.424926 Oct 01 20:54:23.486972 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 596/1249] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:23 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:23.492745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:23.493615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:23.501454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:23.502105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:23.503033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:23.504211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:23.504945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:23.505503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:23.785076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:23.793781 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ac89aa2-2a45-455d-a68f-f3ec3cb8dccc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1462 microversion: 2.1 time: 0.305223 Oct 01 20:54:23.795099 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 597/1250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:23 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1462 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:23.800123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:23.801417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:23.808915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:23.810223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:23.810984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:23.812109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:23.812790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:23.813687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:24.143741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:24.161625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:24.164542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:24.166295 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cfeb62c0-8107-480a-8ef7-c32c8f64dd15 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1280 microversion: 2.25 time: 0.370137 Oct 01 20:54:24.167099 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 598/1251] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:23 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1280 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:24.172083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:24.172816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:24.179045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:24.180368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:24.181448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:24.182396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:24.183219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:24.184161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:24.325344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:24.348856 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6fdb6a2b-29f5-41c2-87ee-44151752e6f2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1277 microversion: 2.1 time: 0.180426 Oct 01 20:54:24.349711 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 599/1252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:24 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:24.368127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84fb379b-4cbd-4795-b1d4-63139d411e1c tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:24.368919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84fb379b-4cbd-4795-b1d4-63139d411e1c tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:24.376115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84fb379b-4cbd-4795-b1d4-63139d411e1c tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:24.376972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84fb379b-4cbd-4795-b1d4-63139d411e1c tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:24.377661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84fb379b-4cbd-4795-b1d4-63139d411e1c tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:24.379021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84fb379b-4cbd-4795-b1d4-63139d411e1c tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:24.379714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84fb379b-4cbd-4795-b1d4-63139d411e1c tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:24.380922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84fb379b-4cbd-4795-b1d4-63139d411e1c tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:24.422855 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.network.neutron [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] re-assign floating IP 172.35.1.87 from instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c Oct 01 20:54:24.477583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Building network info cache for instance {{(pid=140437) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 20:54:24.816516 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84fb379b-4cbd-4795-b1d4-63139d411e1c tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1613 microversion: 2.1 time: 0.465218 Oct 01 20:54:24.830673 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 600/1253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:24 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1613 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:24.836026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:24.836656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:24.846658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:24.847260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:24.847718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:24.848448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:24.848985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:24.851548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:25.320422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:25.347537 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4a46ec3-bbf4-4df6-889e-7080b69e6c68 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1314 microversion: 2.1 time: 0.515450 Oct 01 20:54:25.366784 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 601/1254] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:24 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:25.373770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-06b42fdb-5522-42a3-8298-8cd9b9cd137b req-99a84454-e3cd-477f-9ec1-128a3486e1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e5943e-d2fe-4e7b-9140-ffe35a8aca4c", "tag": "a390abec-97aa-4416-8c5b-b217df3504f2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:25.391812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-06b42fdb-5522-42a3-8298-8cd9b9cd137b req-99a84454-e3cd-477f-9ec1-128a3486e1cd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:25.392679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-06b42fdb-5522-42a3-8298-8cd9b9cd137b req-99a84454-e3cd-477f-9ec1-128a3486e1cd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:25.393457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-06b42fdb-5522-42a3-8298-8cd9b9cd137b req-99a84454-e3cd-477f-9ec1-128a3486e1cd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:25.412488 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-06b42fdb-5522-42a3-8298-8cd9b9cd137b req-99a84454-e3cd-477f-9ec1-128a3486e1cd service nova] Creating event network-changed:a390abec-97aa-4416-8c5b-b217df3504f2 for instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c on nch2-master-1 Oct 01 20:54:25.420834 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-06b42fdb-5522-42a3-8298-8cd9b9cd137b req-99a84454-e3cd-477f-9ec1-128a3486e1cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051349 Oct 01 20:54:25.421468 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 602/1255] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:25.432706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:25.433935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:25.443657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:25.444721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:25.449163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:25.452624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:25.460072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:25.460876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:26.120065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:26.161691 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37177a16-03dc-4cc9-9d74-f6d1bc7b4879 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 200 len: 1486 microversion: 2.1 time: 0.737254 Oct 01 20:54:26.175911 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 603/1256] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:25 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 1486 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:26.191957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:26.192834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:26.200653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:26.201493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:26.202206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:26.203177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:26.203823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:26.204256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:26.243907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b12f27914a4544cf82521abd3e7db9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efda885854e4211bc1145a488270fbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:26.244499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] flavor_id is None. Assuming migration. {{(pid=140438) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 01 20:54:26.244946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140438) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 20:54:26.348985 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Updating instance_info_cache with network_info: [{"id": "a390abec-97aa-4416-8c5b-b217df3504f2", "address": "fa:16:3e:f9:81:ac", "network": {"id": "865ef00f-9395-4fab-b79f-2237ecbc6955", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1577587393-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a2694c8af60455aa9db5997c53adbdc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa390abec-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140437) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 20:54:26.362471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Building network info cache for instance {{(pid=140437) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 20:54:26.608323 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac0a5ea6-68e9-4ca2-98c4-158afd1f9331 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e/action" status: 202 len: 0 microversion: 2.1 time: 0.430793 Oct 01 20:54:26.609835 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 604/1257] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:26 2022] POST /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:54:26.619367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:26.620737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:26.630913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:26.631756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:26.633724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:26.634733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:26.635558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:26.636223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:26.644554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:27.120905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:27.144435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:27.146175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:27.147837 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-10248f12-ca57-43f6-8f24-f1e128c2fe7e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1280 microversion: 2.25 time: 0.535755 Oct 01 20:54:27.149328 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 605/1258] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:26 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1280 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:27.155001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cdb55b20-6800-4ae1-8afc-027d6e193b2a req-d5da9dc0-8d37-4ddf-a254-d5cea92bfbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fe3865-129e-47db-a49c-cae3dded681f", "name": "network-vif-plugged", "status": "completed", "tag": "dc4e575f-951d-4f79-be51-61c297320479"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:27.169586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cdb55b20-6800-4ae1-8afc-027d6e193b2a req-d5da9dc0-8d37-4ddf-a254-d5cea92bfbb2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:27.170096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cdb55b20-6800-4ae1-8afc-027d6e193b2a req-d5da9dc0-8d37-4ddf-a254-d5cea92bfbb2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:27.170533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cdb55b20-6800-4ae1-8afc-027d6e193b2a req-d5da9dc0-8d37-4ddf-a254-d5cea92bfbb2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:27.185292 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cdb55b20-6800-4ae1-8afc-027d6e193b2a req-d5da9dc0-8d37-4ddf-a254-d5cea92bfbb2 service nova] Creating event network-vif-plugged:dc4e575f-951d-4f79-be51-61c297320479 for instance 19fe3865-129e-47db-a49c-cae3dded681f on nch1-master-1 Oct 01 20:54:27.192258 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cdb55b20-6800-4ae1-8afc-027d6e193b2a req-d5da9dc0-8d37-4ddf-a254-d5cea92bfbb2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041622 Oct 01 20:54:27.194046 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 606/1259] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:27.200809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:27.201861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:27.210620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:27.211188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:27.211638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:27.213483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:27.213975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:27.214409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:27.771422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:27.781385 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd70a325-e871-4add-9b17-420c5e1cc498 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1319 microversion: 2.1 time: 0.586066 Oct 01 20:54:27.795746 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 607/1260] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:27 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:27.808412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b354e39-ae85-4839-a3bc-d52a0766ebf1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:27.809087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b354e39-ae85-4839-a3bc-d52a0766ebf1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:27.817596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b354e39-ae85-4839-a3bc-d52a0766ebf1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:27.818328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b354e39-ae85-4839-a3bc-d52a0766ebf1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:27.818996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b354e39-ae85-4839-a3bc-d52a0766ebf1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:27.820386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b354e39-ae85-4839-a3bc-d52a0766ebf1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:27.821200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b354e39-ae85-4839-a3bc-d52a0766ebf1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:27.821863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b354e39-ae85-4839-a3bc-d52a0766ebf1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:27.916175 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b354e39-ae85-4839-a3bc-d52a0766ebf1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b/action" status: 202 len: 0 microversion: 2.1 time: 0.118377 Oct 01 20:54:27.917667 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 608/1261] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:27 2022] POST /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:54:27.925969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:27.926803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:27.935512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:27.936180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:27.936924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:27.938297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:27.939147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:27.939723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:28.204630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=24 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:28.232763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Updating instance_info_cache with network_info: [{"id": "6030cb83-5eac-4c1d-9806-6b492776785a", "address": "fa:16:3e:d9:a7:e9", "network": {"id": "865ef00f-9395-4fab-b79f-2237ecbc6955", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1577587393-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a2694c8af60455aa9db5997c53adbdc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6030cb83-5e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140437) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 20:54:28.251257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Releasing lock "refresh_cache-3d3763bd-cd0f-4912-874b-b6ed42228c7b" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:54:28.252210 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e6b4369d-fe01-4c9d-a0f2-e05e75188ec5 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "POST /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b/action" status: 202 len: 0 microversion: 2.1 time: 8.513842 Oct 01 20:54:28.252835 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 654/1262] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:19 2022] POST /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b/action => generated 0 bytes in 8515 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 01 20:54:28.261841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:28.262551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:28.282633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:28.286001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:28.286936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:28.288528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:28.289249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:28.291779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:28.325055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:28.335952 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-328350dc-6bcc-4286-8e38-68290e64aa55 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1314 microversion: 2.1 time: 0.415719 Oct 01 20:54:28.336530 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 609/1263] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:27 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:28.342877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9d705761-8770-422b-a484-9119f67213d7 req-eaa7d632-9b35-44dd-8ead-72f405033aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3763bd-cd0f-4912-874b-b6ed42228c7b", "tag": "6030cb83-5eac-4c1d-9806-6b492776785a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:28.372187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9d705761-8770-422b-a484-9119f67213d7 req-eaa7d632-9b35-44dd-8ead-72f405033aef service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:28.375846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9d705761-8770-422b-a484-9119f67213d7 req-eaa7d632-9b35-44dd-8ead-72f405033aef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:28.376774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9d705761-8770-422b-a484-9119f67213d7 req-eaa7d632-9b35-44dd-8ead-72f405033aef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:28.415529 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9d705761-8770-422b-a484-9119f67213d7 req-eaa7d632-9b35-44dd-8ead-72f405033aef service nova] Creating event network-changed:6030cb83-5eac-4c1d-9806-6b492776785a for instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b on nch1-master-1 Oct 01 20:54:28.428610 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9d705761-8770-422b-a484-9119f67213d7 req-eaa7d632-9b35-44dd-8ead-72f405033aef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090345 Oct 01 20:54:28.429519 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 610/1264] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:28.443463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:28.444878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:28.457859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:28.458918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:28.459693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:28.460833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:28.462928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:28.463669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:29.018714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:29.030862 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7ffaf363-697e-45be-bf2c-8c147548f06d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1471 microversion: 2.1 time: 0.774219 Oct 01 20:54:29.036371 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 655/1265] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:28 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1471 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:29.071886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:29.072587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:29.083777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:29.084714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:29.085462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:29.086735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:29.087439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:29.088142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:29.321191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:29.340038 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dde7e637-eba1-4de6-9927-752dba5c4499 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 200 len: 1471 microversion: 2.1 time: 0.907321 Oct 01 20:54:29.360425 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 611/1266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:28 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 1471 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:29.371076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.87"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:29.637283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:29.646398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:29.651640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:29.656856 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f05707fa-636c-40a6-b28d-3268dba069d1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1280 microversion: 2.25 time: 0.617528 Oct 01 20:54:29.681194 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 656/1267] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:29 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1280 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:29.687555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:29.688542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:29.695536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:29.696958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:29.697649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:29.698669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:29.699359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:29.700057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:29.845585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:29.852117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:29.852627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:29.853079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:29.867962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:29.868486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:29.868947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:30.114827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=30 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:30.352871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:30.363973 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4c6d6467-06a5-4817-83c9-5e8bb5dac467 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1319 microversion: 2.1 time: 0.679656 Oct 01 20:54:30.364568 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 657/1268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:29 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:30.384953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:30.385956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:30.393371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:30.393998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:30.394588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:30.395485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:30.396028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:30.396509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:30.659696 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] HTTP exception thrown: Floating IP 172.35.1.87 is not associated with instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c. Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Request method failure captured: Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c/action HTTP/1.1 Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 48 Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKi19JknQGY7AYXG594IhsfzB8NR4uc0dFDEzc35D-pTt67GETfC2QVlMQ_A8LDm-djdzq061VeprbhVbhWZEW3QAM74SGGswx8lku8tEluPmqOGrByFGdwDlv9E1DeqsPYkXsKm5m6GPngh7Di7nlLMBhLFS52aQNm94cbK_ksfuzI Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 1a2694c8af60455aa9db5997c53adbdc Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:54:30.661883 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a2694c8af60455aa9db5997c53adbdc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a2694c8af60455aa9db5997c53adbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a2694c8af60455aa9db5997c53adbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a2694c8af60455aa9db5997c53adbdc"}]}] Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 1a2694c8af60455aa9db5997c53adbdc Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FloatingIPsAssociationTestJSON-374272004-project Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f4de9e6274c041da9c366ea00c0bf769 Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-374272004-project Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: {"removeFloatingIp": {"address": "172.35.1.87"}} Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:54:30.663806 ncdv-master-1 devstack@n-api.service[140438]: exception: Floating IP 172.35.1.87 is not associated with instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c. Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '57e5943e-d2fe-4e7b-9140-ffe35a8aca4c', 'body': {'removeFloatingIp': {'address': '172.35.1.87'}}} Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.1.87 is not associated with instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c. Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:54:30.664823 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:30.668217 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:54:30.668217 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:54:30.668217 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:54:30.668217 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:54:30.668217 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.1.87 is not associated with instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c. Oct 01 20:54:30.668217 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:54:30.668217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Returning 409 to user: Floating IP 172.35.1.87 is not associated with instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:54:30.668217 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec9609ef-c89b-44cf-b648-ea9e299a26bd tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "POST /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c/action" status: 409 len: 145 microversion: 2.1 time: 1.300647 Oct 01 20:54:30.671372 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 612/1269] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:29 2022] POST /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c/action => generated 145 bytes in 1307 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:54:30.680475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dbb86f64-d6a0-4e95-baa8-0ea823de9743 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-254698676"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:30.683147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dbb86f64-d6a0-4e95-baa8-0ea823de9743 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:30.691318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb86f64-d6a0-4e95-baa8-0ea823de9743 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:30.691824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb86f64-d6a0-4e95-baa8-0ea823de9743 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:30.692275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb86f64-d6a0-4e95-baa8-0ea823de9743 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:30.693346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb86f64-d6a0-4e95-baa8-0ea823de9743 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:30.693995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb86f64-d6a0-4e95-baa8-0ea823de9743 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:30.694467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb86f64-d6a0-4e95-baa8-0ea823de9743 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:30.888058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:30.899816 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3c177763-13f2-439c-874b-3f2bcbbcb9d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1501 microversion: 2.1 time: 0.523818 Oct 01 20:54:30.900512 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 658/1270] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:30 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1501 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:30.906514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-09f9b0e1-94d0-4223-be5f-8ec2dd1ab9fe req-3092670c-c792-4634-92c7-ddfb7ce4694c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b894bd4e-ce19-41b9-81ee-64786805990e", "name": "network-vif-plugged", "status": "completed", "tag": "ddea4550-4948-4507-8a91-c65d3ab874a0"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:30.927479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-09f9b0e1-94d0-4223-be5f-8ec2dd1ab9fe req-3092670c-c792-4634-92c7-ddfb7ce4694c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:30.928149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-09f9b0e1-94d0-4223-be5f-8ec2dd1ab9fe req-3092670c-c792-4634-92c7-ddfb7ce4694c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:30.928647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-09f9b0e1-94d0-4223-be5f-8ec2dd1ab9fe req-3092670c-c792-4634-92c7-ddfb7ce4694c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:30.936719 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dbb86f64-d6a0-4e95-baa8-0ea823de9743 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b/action" status: 202 len: 0 microversion: 2.1 time: 0.265459 Oct 01 20:54:30.937932 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 613/1271] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:30 2022] POST /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 20:54:30.944679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:30.945573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:30.953287 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-09f9b0e1-94d0-4223-be5f-8ec2dd1ab9fe req-3092670c-c792-4634-92c7-ddfb7ce4694c service nova] Creating event network-vif-plugged:ddea4550-4948-4507-8a91-c65d3ab874a0 for instance b894bd4e-ce19-41b9-81ee-64786805990e on nch2-master-1 Oct 01 20:54:30.954483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:30.957375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:30.957926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:30.959810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:30.961783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:30.961783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:30.961993 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-09f9b0e1-94d0-4223-be5f-8ec2dd1ab9fe req-3092670c-c792-4634-92c7-ddfb7ce4694c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059010 Oct 01 20:54:30.969933 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 659/1272] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:30.978527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-da02ee6e-bf32-4e8c-8c80-e0678c95a11b req-7376a459-5744-4d51-8fb6-61233f6aec19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5", "tag": "809f3c73-a9c0-49e1-aa63-ab6c8475dc33"}, {"name": "network-changed", "server_uuid": "3d5200d5-8702-4469-a18f-480ef4f6210c", "tag": "fe73a873-9bad-492e-9df0-e646f2d24659"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:30.998142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-da02ee6e-bf32-4e8c-8c80-e0678c95a11b req-7376a459-5744-4d51-8fb6-61233f6aec19 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:30.999301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-da02ee6e-bf32-4e8c-8c80-e0678c95a11b req-7376a459-5744-4d51-8fb6-61233f6aec19 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:30.999836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-da02ee6e-bf32-4e8c-8c80-e0678c95a11b req-7376a459-5744-4d51-8fb6-61233f6aec19 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.030291 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-da02ee6e-bf32-4e8c-8c80-e0678c95a11b req-7376a459-5744-4d51-8fb6-61233f6aec19 service nova] Creating event network-changed:809f3c73-a9c0-49e1-aa63-ab6c8475dc33 for instance 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 on nch1-master-1 Oct 01 20:54:31.031001 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-da02ee6e-bf32-4e8c-8c80-e0678c95a11b req-7376a459-5744-4d51-8fb6-61233f6aec19 service nova] Creating event network-changed:fe73a873-9bad-492e-9df0-e646f2d24659 for instance 3d5200d5-8702-4469-a18f-480ef4f6210c on nch2-master-1 Oct 01 20:54:31.049460 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-da02ee6e-bf32-4e8c-8c80-e0678c95a11b req-7376a459-5744-4d51-8fb6-61233f6aec19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074827 Oct 01 20:54:31.050440 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 660/1273] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:31.057356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6e346389-c366-4dc3-9c12-e35bf0da3038 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:31.058070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6e346389-c366-4dc3-9c12-e35bf0da3038 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:31.067321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e346389-c366-4dc3-9c12-e35bf0da3038 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.068775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e346389-c366-4dc3-9c12-e35bf0da3038 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.069318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e346389-c366-4dc3-9c12-e35bf0da3038 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.070426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e346389-c366-4dc3-9c12-e35bf0da3038 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.071020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e346389-c366-4dc3-9c12-e35bf0da3038 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.071498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e346389-c366-4dc3-9c12-e35bf0da3038 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.178079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:31.187714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-08ce23d4-a733-46c4-a372-4d6b746cd849 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.247824 Oct 01 20:54:31.188799 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 614/1274] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:30 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:31.193563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.87"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:31.286371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:31.286875 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6e346389-c366-4dc3-9c12-e35bf0da3038 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1813 microversion: 2.1 time: 0.235014 Oct 01 20:54:31.287567 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 661/1275] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:31 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1813 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:31.292110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:31.292722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:31.298782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.299282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.299728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.300439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.300900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.301337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.354225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:31.356734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:31.362446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.362983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.363435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.364214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.364693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.365331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.502264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:31.511694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:31.513721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:31.514900 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-be25a075-daa5-409a-9357-1f7b807a8fe6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1280 microversion: 2.25 time: 0.226467 Oct 01 20:54:31.515470 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 662/1276] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:31 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1280 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:31.520690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:31.523193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:31.530658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.531353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.532001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.532879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.533509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.534094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.558131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lazy-loading 'flavor' on Instance uuid 19fe3865-129e-47db-a49c-cae3dded681f {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:31.618402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "refresh_cache-3d3763bd-cd0f-4912-874b-b6ed42228c7b" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:54:31.619025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquired lock "refresh_cache-3d3763bd-cd0f-4912-874b-b6ed42228c7b" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:54:31.644973 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cfbc0ad5-2cba-4f3b-98e6-2247d0665985 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "POST /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f/action" status: 200 len: 32 microversion: 2.1 time: 0.128036 Oct 01 20:54:31.650173 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 663/1277] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:31 2022] POST /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f/action => generated 32 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:54:31.651078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-97b9415b-467d-48fa-9fb9-e1d8750f09f0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41780773a0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:31.700669 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-97b9415b-467d-48fa-9fb9-e1d8750f09f0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.053195 Oct 01 20:54:31.702586 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 664/1278] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:31 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:31.705677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d24e9fb3-1eab-4317-a4cf-ca11215c45ad tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:31.709308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d24e9fb3-1eab-4317-a4cf-ca11215c45ad tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.709784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d24e9fb3-1eab-4317-a4cf-ca11215c45ad tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.710241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d24e9fb3-1eab-4317-a4cf-ca11215c45ad tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.711003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d24e9fb3-1eab-4317-a4cf-ca11215c45ad tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.711473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d24e9fb3-1eab-4317-a4cf-ca11215c45ad tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.711903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d24e9fb3-1eab-4317-a4cf-ca11215c45ad tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.737432 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d24e9fb3-1eab-4317-a4cf-ca11215c45ad tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035061 Oct 01 20:54:31.738058 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 665/1279] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Oct 1 20:54:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:31.742883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:31.743850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:31.751261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.751837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.752243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:31.752945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:31.753500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:31.753856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:32.480118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:32.494357 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7bd82432-8d98-4366-bdc7-5020983c5dc8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1319 microversion: 2.1 time: 0.754998 Oct 01 20:54:32.505596 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 666/1280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:31 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1319 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:32.521183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:32.522087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:32.530112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:32.531243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:32.532120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:32.533251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:32.541687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:32.544939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:32.924714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:32.934046 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dea2091a-1abd-4947-82fe-0c3ca60dd576 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.426944 Oct 01 20:54:32.934849 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 667/1281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:32 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:32.940200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:32.941370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:32.947911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:32.948447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:32.949183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:32.950598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:32.951277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:32.951777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:33.311680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:33.321546 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9e1cdb7d-c06d-42db-9af1-292a492520ce tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.384907 Oct 01 20:54:33.322204 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 668/1282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:32 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:33.338183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:33.338835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:33.345803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:33.346346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:33.346783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:33.348408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:33.348934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:33.349411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:33.671223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Building network info cache for instance {{(pid=140438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 20:54:33.877601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:33.891595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:33.908642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:33.912524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:33.934743 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-31cb9f7b-f4dd-43fc-a3f8-c62562dbae9e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1280 microversion: 2.25 time: 0.590426 Oct 01 20:54:33.936125 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 669/1283] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:33 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1280 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:33.948600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c17d6d3a-2091-4cbe-8c8d-da225894c9d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41737bd1f0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:34.039314 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c17d6d3a-2091-4cbe-8c8d-da225894c9d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.101876 Oct 01 20:54:34.048070 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 670/1284] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:33 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:34.059970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-37fcb9fc-58e1-47e7-ad37-fe3ce22b082b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f83c038c-0838-41d4-b421-20d53a0dec11", "device": "/dev/xvdb"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:34.062801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-37fcb9fc-58e1-47e7-ad37-fe3ce22b082b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:34.084055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37fcb9fc-58e1-47e7-ad37-fe3ce22b082b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:34.084504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37fcb9fc-58e1-47e7-ad37-fe3ce22b082b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:34.085155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37fcb9fc-58e1-47e7-ad37-fe3ce22b082b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:34.086064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37fcb9fc-58e1-47e7-ad37-fe3ce22b082b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:34.086631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37fcb9fc-58e1-47e7-ad37-fe3ce22b082b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:34.087084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37fcb9fc-58e1-47e7-ad37-fe3ce22b082b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:34.668207 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-37fcb9fc-58e1-47e7-ad37-fe3ce22b082b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "POST /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618670 Oct 01 20:54:34.669711 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 671/1285] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 20:54:34 2022] POST /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:34.678625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:34.679659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:34.691980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:34.693224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:34.693844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:34.695446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:34.696092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:34.696693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.156931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Updating instance_info_cache with network_info: [{"id": "6030cb83-5eac-4c1d-9806-6b492776785a", "address": "fa:16:3e:d9:a7:e9", "network": {"id": "865ef00f-9395-4fab-b79f-2237ecbc6955", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1577587393-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a2694c8af60455aa9db5997c53adbdc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6030cb83-5e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 20:54:35.178219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Releasing lock "refresh_cache-3d3763bd-cd0f-4912-874b-b6ed42228c7b" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:54:35.180149 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5ebedb83-e409-412c-8792-b18d5f4468bc tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "POST /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b/action" status: 202 len: 0 microversion: 2.1 time: 3.989690 Oct 01 20:54:35.181444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 615/1286] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:31 2022] POST /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b/action => generated 0 bytes in 3992 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 01 20:54:35.189764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-89136052-6560-47c1-94ac-b0fc80be282f req-1fa26592-3c40-4f3e-9fe6-3d0089c2f469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3763bd-cd0f-4912-874b-b6ed42228c7b", "tag": "6030cb83-5eac-4c1d-9806-6b492776785a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:35.196986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:35.206088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-89136052-6560-47c1-94ac-b0fc80be282f req-1fa26592-3c40-4f3e-9fe6-3d0089c2f469 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:35.206617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-89136052-6560-47c1-94ac-b0fc80be282f req-1fa26592-3c40-4f3e-9fe6-3d0089c2f469 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:35.207219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-89136052-6560-47c1-94ac-b0fc80be282f req-1fa26592-3c40-4f3e-9fe6-3d0089c2f469 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.216511 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1501ea7e-2b5b-4e01-b508-4a428753a764 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1319 microversion: 2.1 time: 0.543394 Oct 01 20:54:35.226523 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 672/1287] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:34 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:35.226523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:35.226915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:35.241771 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-89136052-6560-47c1-94ac-b0fc80be282f req-1fa26592-3c40-4f3e-9fe6-3d0089c2f469 service nova] Creating event network-changed:6030cb83-5eac-4c1d-9806-6b492776785a for instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b on nch1-master-1 Oct 01 20:54:35.245640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:35.246425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:35.248749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.250701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:35.251240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:35.251540 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-89136052-6560-47c1-94ac-b0fc80be282f req-1fa26592-3c40-4f3e-9fe6-3d0089c2f469 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067857 Oct 01 20:54:35.252718 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 616/1288] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:35.253225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.260147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:35.261329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:35.277798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:35.278331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:35.279280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.280042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:35.280854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:35.282114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.693120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:35.702999 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d4d11a12-9931-49c3-a81e-ed5db64ffa37 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.484242 Oct 01 20:54:35.703794 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 673/1289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:35 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:35.709856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:35.710636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:35.718694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:35.719568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:35.720002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:35.720475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.722022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:35.722721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:35.723446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.734055 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b212c3b0-18d5-4ed6-af00-6afed999e9c4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.479652 Oct 01 20:54:35.735278 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 617/1290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:35 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:35.740498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f68ff92f-7507-4c39-9e13-b6a1cde35d4f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173a22310>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:35.856611 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f68ff92f-7507-4c39-9e13-b6a1cde35d4f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.119024 Oct 01 20:54:35.857232 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 618/1291] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:35 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:35.867939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:35.868463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:35.887913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:35.889761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:35.893396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.907392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:35.908198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:35.908664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:35.999654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:54:36.036154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:36.056192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:36.067771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:36.069011 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5ca85d5d-0622-49a3-8ca9-990b84e456d0 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1476 microversion: 2.25 time: 0.363535 Oct 01 20:54:36.069587 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 674/1292] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:35 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1476 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:36.100370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:36.101639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:36.116327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:36.119888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:36.123527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:36.126272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:36.130389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:36.132697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:36.250213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6d08fd7-3df2-42ef-9aeb-44b65243436b tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 204 len: 0 microversion: 2.1 time: 0.391561 Oct 01 20:54:36.254699 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 619/1293] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:54:35 2022] DELETE /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:54:36.273279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:36.275778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:36.297238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:36.297802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:36.298307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:36.299105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:36.299716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:36.303971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:36.346244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:36.476140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid b894bd4e-ce19-41b9-81ee-64786805990e {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:36.494214 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-88a10785-20ca-471c-af97-663be08e70eb tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1968 microversion: 2.25 time: 0.397895 Oct 01 20:54:36.507822 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 675/1294] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:36 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1968 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:36.523394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.87"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:36.526049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:36.533621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:36.534699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:36.535391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:36.536484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:36.537177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:36.538246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:36.582158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "refresh_cache-57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:54:36.582735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquired lock "refresh_cache-57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:54:36.607694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:36.619224 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-031c3a61-4acb-4495-825f-e00d4eff39d6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1319 microversion: 2.1 time: 0.362836 Oct 01 20:54:36.620153 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 620/1295] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:36 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:36.626534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e87e735a-b2fb-4a65-91cf-52e842010963 req-672d73ae-923f-49f6-aece-34ddcda0b81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5200d5-8702-4469-a18f-480ef4f6210c", "name": "network-vif-plugged", "status": "completed", "tag": "fe73a873-9bad-492e-9df0-e646f2d24659"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:36.637685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e87e735a-b2fb-4a65-91cf-52e842010963 req-672d73ae-923f-49f6-aece-34ddcda0b81f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:36.638180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e87e735a-b2fb-4a65-91cf-52e842010963 req-672d73ae-923f-49f6-aece-34ddcda0b81f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:36.638650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e87e735a-b2fb-4a65-91cf-52e842010963 req-672d73ae-923f-49f6-aece-34ddcda0b81f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:36.652995 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e87e735a-b2fb-4a65-91cf-52e842010963 req-672d73ae-923f-49f6-aece-34ddcda0b81f service nova] Creating event network-vif-plugged:fe73a873-9bad-492e-9df0-e646f2d24659 for instance 3d5200d5-8702-4469-a18f-480ef4f6210c on nch2-master-1 Oct 01 20:54:36.658441 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e87e735a-b2fb-4a65-91cf-52e842010963 req-672d73ae-923f-49f6-aece-34ddcda0b81f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 Oct 01 20:54:36.659310 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 621/1296] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:36.664275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:36.665020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:36.680842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:36.681390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:36.682059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:36.682813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:36.683384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:36.683891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:37.004523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid b894bd4e-ce19-41b9-81ee-64786805990e {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:37.018398 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b10fa0c9-3c02-4265-9dc7-9492e8429eb2 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1968 microversion: 2.25 time: 0.357892 Oct 01 20:54:37.019143 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 622/1297] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:36 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1968 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:37.024052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:37.024919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:37.032543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:37.033451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:37.034134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:37.035186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:37.035883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:37.036545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:37.281516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:37.290020 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20070b98-0538-456b-9991-b185c93fddf1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.269412 Oct 01 20:54:37.290622 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 623/1298] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:37 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:37.295834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:37.296454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:37.302374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:37.302914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:37.303368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:37.304077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:37.304543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:37.304977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:37.591218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:37.600628 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f47f9d2b-44bf-49f4-88f8-813ba35d5f47 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.308287 Oct 01 20:54:37.601360 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 624/1299] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:37 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:37.612091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fcda175a-437d-416f-ad93-2e60371378f1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173b27b80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:37.712724 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fcda175a-437d-416f-ad93-2e60371378f1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.106336 Oct 01 20:54:37.713775 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 625/1300] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:37 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:37.722233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6fe44397-e0dc-43c5-8219-f5aa816b1dea tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:37.727238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe44397-e0dc-43c5-8219-f5aa816b1dea tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:37.727739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe44397-e0dc-43c5-8219-f5aa816b1dea tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:37.728183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe44397-e0dc-43c5-8219-f5aa816b1dea tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:37.730261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe44397-e0dc-43c5-8219-f5aa816b1dea tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:37.730792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe44397-e0dc-43c5-8219-f5aa816b1dea tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:37.731449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe44397-e0dc-43c5-8219-f5aa816b1dea tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:37.761309 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6fe44397-e0dc-43c5-8219-f5aa816b1dea tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046211 Oct 01 20:54:37.762901 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 626/1301] 10.222.0.17 () {60 vars in 1217 bytes} [Sat Oct 1 20:54:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:54:37.767750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:37.768628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:37.775832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:37.776510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:37.777338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:37.778230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:37.778868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:37.780155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:38.076599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:38.088274 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e07acc8-e8d3-48ce-a072-158130a3610a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1319 microversion: 2.1 time: 0.323359 Oct 01 20:54:38.111040 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 627/1302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:37 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:38.116099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:38.119131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:38.129764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:38.131629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:38.132241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:38.134905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:38.136439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:38.137866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:38.177972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'flavor' on Instance uuid b894bd4e-ce19-41b9-81ee-64786805990e {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:38.240651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Going to try to live migrate instance to nch1-master-1 {{(pid=140438) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 20:54:38.794262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Building network info cache for instance {{(pid=140437) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 20:54:40.323179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Updating instance_info_cache with network_info: [{"id": "a390abec-97aa-4416-8c5b-b217df3504f2", "address": "fa:16:3e:f9:81:ac", "network": {"id": "865ef00f-9395-4fab-b79f-2237ecbc6955", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1577587393-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a2694c8af60455aa9db5997c53adbdc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa390abec-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140437) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 20:54:40.353106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Releasing lock "refresh_cache-57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:54:40.354362 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-54099659-4d9a-448f-9530-c8212b79b680 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "POST /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c/action" status: 202 len: 0 microversion: 2.1 time: 3.844942 Oct 01 20:54:40.355132 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 676/1303] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:36 2022] POST /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c/action => generated 0 bytes in 3847 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 01 20:54:40.368561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:40.373755 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5e64de91-823a-47b5-9ad2-f931b830dbb3 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e/action" status: 202 len: 0 microversion: 2.25 time: 2.261611 Oct 01 20:54:40.379210 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 628/1304] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:54:38 2022] POST /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e/action => generated 0 bytes in 2267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:54:40.393656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:40.455604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:40.457627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:40.458460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:40.462670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:40.463443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:40.464141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:40.590540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:40.591285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:40.602297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:40.603764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:40.604435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:40.606220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:40.606939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:40.607692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:40.998557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:41.013258 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df468e24-c4af-4fef-a069-5bde467105f6 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.632012 Oct 01 20:54:41.013987 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 629/1305] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:40 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:41.018767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1d9284d4-f575-4c04-aa0b-d12875d74b65 req-3dbc0fdc-76d6-42c8-9e3e-664b648a1346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bec5b02-88e5-450e-b5ee-61fc18b2349b", "name": "network-vif-plugged", "status": "completed", "tag": "a5ebda0b-ad93-4580-a18d-ceef18a4df2b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:41.023248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:41.032699 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a8c433e2-2541-4579-86e7-9b6ea9fd22e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.672883 Oct 01 20:54:41.037085 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 677/1306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:40 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:41.060411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff2f5863-d6d2-4d6d-8d5f-f1990f55a226 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41736e9a60>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:41.070383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d9284d4-f575-4c04-aa0b-d12875d74b65 req-3dbc0fdc-76d6-42c8-9e3e-664b648a1346 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:41.071143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d9284d4-f575-4c04-aa0b-d12875d74b65 req-3dbc0fdc-76d6-42c8-9e3e-664b648a1346 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:41.071932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d9284d4-f575-4c04-aa0b-d12875d74b65 req-3dbc0fdc-76d6-42c8-9e3e-664b648a1346 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:41.092264 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1d9284d4-f575-4c04-aa0b-d12875d74b65 req-3dbc0fdc-76d6-42c8-9e3e-664b648a1346 service nova] Creating event network-vif-plugged:a5ebda0b-ad93-4580-a18d-ceef18a4df2b for instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b on nch1-master-1 Oct 01 20:54:41.098646 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1d9284d4-f575-4c04-aa0b-d12875d74b65 req-3dbc0fdc-76d6-42c8-9e3e-664b648a1346 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082980 Oct 01 20:54:41.100107 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 630/1307] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:41.107467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7c6bb259-ba2c-46d5-b2c6-00f05aaa2794 req-ba292464-f6e7-44dd-b991-44d5e290fc68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e5943e-d2fe-4e7b-9140-ffe35a8aca4c", "tag": "a390abec-97aa-4416-8c5b-b217df3504f2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:41.127957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c6bb259-ba2c-46d5-b2c6-00f05aaa2794 req-ba292464-f6e7-44dd-b991-44d5e290fc68 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:41.128993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c6bb259-ba2c-46d5-b2c6-00f05aaa2794 req-ba292464-f6e7-44dd-b991-44d5e290fc68 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:41.129591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c6bb259-ba2c-46d5-b2c6-00f05aaa2794 req-ba292464-f6e7-44dd-b991-44d5e290fc68 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:41.153485 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7c6bb259-ba2c-46d5-b2c6-00f05aaa2794 req-ba292464-f6e7-44dd-b991-44d5e290fc68 service nova] Creating event network-changed:a390abec-97aa-4416-8c5b-b217df3504f2 for instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c on nch2-master-1 Oct 01 20:54:41.155572 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ff2f5863-d6d2-4d6d-8d5f-f1990f55a226 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.117127 Oct 01 20:54:41.162212 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7c6bb259-ba2c-46d5-b2c6-00f05aaa2794 req-ba292464-f6e7-44dd-b991-44d5e290fc68 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060491 Oct 01 20:54:41.165662 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 678/1308] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:41 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:41.167253 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 631/1309] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:41.172446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:41.173489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:41.176553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-100827cf-447c-4ef1-98e2-ee305660df7e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '.version_select at 0x7f4173fd6d30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:41.180900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:41.181589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:41.182359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:41.183502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:41.184988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:41.185903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:41.718641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:41.723753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:41.741143 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2ff73664-bb1a-4cf8-aea6-d52daab40724 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1319 microversion: 2.1 time: 0.573586 Oct 01 20:54:41.746752 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 679/1310] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:41 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:41.756794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:41.758945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:41.770056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:41.771044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:41.771855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:41.772836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:41.774085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:41.775037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:41.812024 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-100827cf-447c-4ef1-98e2-ee305660df7e tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/41a64f1b-9978-48e4-b6d7-e74c393d3fc1" status: 200 len: 184 microversion: 2.1 time: 0.642920 Oct 01 20:54:41.813930 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 632/1311] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 20:54:41 2022] GET /compute/v2.1/os-floating-ips/41a64f1b-9978-48e4-b6d7-e74c393d3fc1 => generated 184 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:41.824650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a7057f2f-da5d-4508-bec2-2abd75cc3d2b tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:41.826655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a7057f2f-da5d-4508-bec2-2abd75cc3d2b tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:41.842169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7057f2f-da5d-4508-bec2-2abd75cc3d2b tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:41.844915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7057f2f-da5d-4508-bec2-2abd75cc3d2b tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:41.845701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7057f2f-da5d-4508-bec2-2abd75cc3d2b tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:41.846816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7057f2f-da5d-4508-bec2-2abd75cc3d2b tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:41.849196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7057f2f-da5d-4508-bec2-2abd75cc3d2b tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:41.850195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7057f2f-da5d-4508-bec2-2abd75cc3d2b tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:42.148843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:42.163906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:42.166653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:42.168792 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-389b3270-3194-4377-8da5-9eb688633f90 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.420687 Oct 01 20:54:42.170407 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 680/1312] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:41 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:42.179068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.87"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:42.195220 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a7057f2f-da5d-4508-bec2-2abd75cc3d2b tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1859 microversion: 2.1 time: 0.379961 Oct 01 20:54:42.196625 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 633/1313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:41 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1859 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:42.204878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:42.205789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:42.212842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:42.213623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:42.214343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:42.216066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:42.217017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:42.217746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:42.370934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:42.379605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:42.380569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:42.383315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:42.385496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:42.394097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:42.395192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:42.445091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:42.458559 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38af695e-8694-48c1-917e-44be788c7c14 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.260364 Oct 01 20:54:42.460093 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 634/1314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:42 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:42.469835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:42.473782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:42.487520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:42.488026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:42.489127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:42.490590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:42.491227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:42.492180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:42.764511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:42.773866 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b3a844d9-90c3-4ce0-b4e4-e2b1a4cee40b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.312727 Oct 01 20:54:42.779056 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 635/1315] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:42 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:42.786013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c32bc37b-f943-412b-9564-590faf3385d1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4178405b80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:42.810562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "refresh_cache-57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 20:54:42.811098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquired lock "refresh_cache-57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 20:54:42.849756 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c32bc37b-f943-412b-9564-590faf3385d1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.069478 Oct 01 20:54:42.850600 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 636/1316] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:42 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:42.869773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:42.875864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:42.888132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:42.888627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:42.896822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:42.898213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:42.899117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:42.900139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:42.941273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lazy-loading 'flavor' on Instance uuid bed59d2f-d270-4882-b32b-89be0dedc71f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:42.961640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Going to try to live migrate instance to nch2-master-1 {{(pid=140438) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 20:54:43.632323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Building network info cache for instance {{(pid=140437) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 20:54:44.409774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Updating instance_info_cache with network_info: [{"id": "a390abec-97aa-4416-8c5b-b217df3504f2", "address": "fa:16:3e:f9:81:ac", "network": {"id": "865ef00f-9395-4fab-b79f-2237ecbc6955", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1577587393-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a2694c8af60455aa9db5997c53adbdc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa390abec-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140437) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 20:54:44.428862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Releasing lock "refresh_cache-57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" {{(pid=140437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 20:54:44.429865 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d5120c9d-99ef-44d8-8a3d-b31ff1075cc1 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "POST /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c/action" status: 202 len: 0 microversion: 2.1 time: 2.258248 Oct 01 20:54:44.434844 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 681/1317] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:42 2022] POST /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c/action => generated 0 bytes in 2259 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 01 20:54:44.439823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:44.440687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:44.447053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:44.448408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:44.449090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:44.450517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:44.451150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:44.451746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:44.732386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:44.745580 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-71d77a98-b119-45b6-9893-70aaa169c131 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1319 microversion: 2.1 time: 0.310088 Oct 01 20:54:44.748528 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 682/1318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:44 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:44.755714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f54ab543-43e3-459d-b44f-0ea2ee5ce524 req-b779ab86-b16a-4f2a-863a-4a8aa17ec8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3763bd-cd0f-4912-874b-b6ed42228c7b", "name": "network-vif-deleted", "tag": "6030cb83-5eac-4c1d-9806-6b492776785a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:44.789580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f54ab543-43e3-459d-b44f-0ea2ee5ce524 req-b779ab86-b16a-4f2a-863a-4a8aa17ec8de service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:44.790927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f54ab543-43e3-459d-b44f-0ea2ee5ce524 req-b779ab86-b16a-4f2a-863a-4a8aa17ec8de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:44.791637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f54ab543-43e3-459d-b44f-0ea2ee5ce524 req-b779ab86-b16a-4f2a-863a-4a8aa17ec8de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:44.835901 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f54ab543-43e3-459d-b44f-0ea2ee5ce524 req-b779ab86-b16a-4f2a-863a-4a8aa17ec8de service nova] Creating event network-vif-deleted:6030cb83-5eac-4c1d-9806-6b492776785a for instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b on nch1-master-1 Oct 01 20:54:44.845600 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f54ab543-43e3-459d-b44f-0ea2ee5ce524 req-b779ab86-b16a-4f2a-863a-4a8aa17ec8de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095415 Oct 01 20:54:44.846736 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 683/1319] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:44.855221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:44.856899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:44.874356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:44.875462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:44.876241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:44.877205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:44.878041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:44.878534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:44.894053 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05b62cd0-eccb-48ca-9323-4eafc6edbbf0 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/action" status: 202 len: 0 microversion: 2.1 time: 2.034223 Oct 01 20:54:44.894942 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 637/1320] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:54:42 2022] POST /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/action => generated 0 bytes in 2044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:54:44.899629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8eff4e8d-f269-436d-945f-d1292ce7efee req-635ca424-8203-4989-be7f-219983abf617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5", "name": "network-vif-plugged", "status": "completed", "tag": "809f3c73-a9c0-49e1-aa63-ab6c8475dc33"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:44.915950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8eff4e8d-f269-436d-945f-d1292ce7efee req-635ca424-8203-4989-be7f-219983abf617 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:44.916709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8eff4e8d-f269-436d-945f-d1292ce7efee req-635ca424-8203-4989-be7f-219983abf617 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:44.917219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8eff4e8d-f269-436d-945f-d1292ce7efee req-635ca424-8203-4989-be7f-219983abf617 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:44.927850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:44.930136 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8eff4e8d-f269-436d-945f-d1292ce7efee req-635ca424-8203-4989-be7f-219983abf617 service nova] Creating event network-vif-plugged:809f3c73-a9c0-49e1-aa63-ab6c8475dc33 for instance 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 on nch1-master-1 Oct 01 20:54:44.940599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8eff4e8d-f269-436d-945f-d1292ce7efee req-635ca424-8203-4989-be7f-219983abf617 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044265 Oct 01 20:54:44.941305 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 638/1321] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:44.947905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:44.948871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:44.956677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:44.957479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:44.958131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:44.960056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:44.960737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:44.961372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:45.150175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:45.169806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:45.173959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:45.182056 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b1c71a19-1311-436e-82b8-2ebf49f35acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.329741 Oct 01 20:54:45.183273 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 684/1322] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:44 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:45.191459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:45.192394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:45.204776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:45.205860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:45.206570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:45.207715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:45.208443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:45.209093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:45.316079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:45.324905 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2fb098ba-9fb5-45c2-b0e3-582bb4200c65 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.381983 Oct 01 20:54:45.328140 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 639/1323] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:44 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:45.335680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85299ccb-f8e7-4b36-acae-a69abb8b1f39 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173c3d1f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:45.410614 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85299ccb-f8e7-4b36-acae-a69abb8b1f39 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.081140 Oct 01 20:54:45.411813 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 640/1324] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:45 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:45.416875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:45.417381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:45.424764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:45.425319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:45.425764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:45.426754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:45.427436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:45.428039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:45.444406 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] HTTP exception thrown: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Request method failure captured: Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b HTTP/1.1 Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKi19JknQGY7AYXG594IhsfzB8NR4uc0dFDEzc35D-pTt67GETfC2QVlMQ_A8LDm-djdzq061VeprbhVbhWZEW3QAM74SGGswx8lku8tEluPmqOGrByFGdwDlv9E1DeqsPYkXsKm5m6GPngh7Di7nlLMBhLFS52aQNm94cbK_ksfuzI Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 1a2694c8af60455aa9db5997c53adbdc Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:54:45.447887 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a2694c8af60455aa9db5997c53adbdc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a2694c8af60455aa9db5997c53adbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a2694c8af60455aa9db5997c53adbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a2694c8af60455aa9db5997c53adbdc"}]}] Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 1a2694c8af60455aa9db5997c53adbdc Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FloatingIPsAssociationTestJSON-374272004-project Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f4de9e6274c041da9c366ea00c0bf769 Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-374272004-project Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.450261 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '3d3763bd-cd0f-4912-874b-b6ed42228c7b'} Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:54:45.451254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.452897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.454458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:45.461203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:45.461203 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e6cc149d-6703-45fc-a09c-a9f127c56918 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.274440 Oct 01 20:54:45.462833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Returning 404 to user: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:54:45.463770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c688926-859b-4277-852e-7a1c1b64e7e4 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 404 len: 111 microversion: 2.1 time: 0.050591 Oct 01 20:54:45.464451 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 641/1325] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:54:45 2022] DELETE /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:54:45.470185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:45.471098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:45.474872 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 685/1326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:45 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:45.479173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:45.479899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:45.481166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:45.481540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:45.482166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 3d3763bd-cd0f-4912-874b-b6ed42228c7b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:45.482676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:45.483454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:45.484054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:45.492212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:45.492719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:45.493168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:45.494215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:45.494873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:45.496047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:45.515750 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] HTTP exception thrown: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Request method failure captured: Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b HTTP/1.1 Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKi19JknQGY7AYXG594IhsfzB8NR4uc0dFDEzc35D-pTt67GETfC2QVlMQ_A8LDm-djdzq061VeprbhVbhWZEW3QAM74SGGswx8lku8tEluPmqOGrByFGdwDlv9E1DeqsPYkXsKm5m6GPngh7Di7nlLMBhLFS52aQNm94cbK_ksfuzI Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 1a2694c8af60455aa9db5997c53adbdc Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:54:45.517531 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a2694c8af60455aa9db5997c53adbdc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a2694c8af60455aa9db5997c53adbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a2694c8af60455aa9db5997c53adbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a2694c8af60455aa9db5997c53adbdc"}]}] Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 1a2694c8af60455aa9db5997c53adbdc Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FloatingIPsAssociationTestJSON-374272004-project Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f4de9e6274c041da9c366ea00c0bf769 Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-374272004-project Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.519200 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '3d3763bd-cd0f-4912-874b-b6ed42228c7b'} Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:54:45.519979 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. Oct 01 20:54:45.521346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:45.522484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Returning 404 to user: Instance 3d3763bd-cd0f-4912-874b-b6ed42228c7b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:54:45.522484 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ba18354c-bfa4-49f2-a222-c8ab793c4b2d tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b" status: 404 len: 111 microversion: 2.1 time: 0.043363 Oct 01 20:54:45.522484 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 686/1327] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:45 2022] GET /compute/v2.1/servers/3d3763bd-cd0f-4912-874b-b6ed42228c7b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:54:45.530986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dca45b94-d4cb-4c5d-8acc-abd192ba0789 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '.version_select at 0x7f41738ac790>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:46.212945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:46.229811 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7b274f24-1a76-4beb-a6fb-20031af8f391 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.763474 Oct 01 20:54:46.231167 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 642/1328] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:45 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:46.251150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:46.252068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:46.268541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:46.269473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:46.270158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:46.271390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:46.272088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:46.273191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:46.667165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:46.685489 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3d5b070-e3b0-4359-84a9-5c3a4ee2ecc6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1319 microversion: 2.1 time: 0.451000 Oct 01 20:54:46.686050 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 643/1329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:46 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:46.697575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:46.698638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:46.708505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:46.709103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:46.710461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:46.711372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:46.712963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:46.713704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:47.072294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:47.088292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:47.092223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:47.094585 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-be04c877-bdcc-4395-82c5-5be53e9f5a9f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.407223 Oct 01 20:54:47.096345 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 644/1330] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:46 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:47.104056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:47.105968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:47.115176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:47.116002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:47.117125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:47.118199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:47.118977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:47.120682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:47.452394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:47.464494 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-40e9cb42-253b-43d2-be34-6a0fe5450463 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.366663 Oct 01 20:54:47.465747 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 645/1331] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:47 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:47.482364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e5feff2c-f34f-4210-990a-39eb99636135 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41737fdee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:47.542766 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e5feff2c-f34f-4210-990a-39eb99636135 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.064888 Oct 01 20:54:47.543332 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 646/1332] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:47 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:47.556698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:47.557325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:47.566138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:47.567057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:47.567575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:47.568329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:47.568799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:47.569582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:47.743293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:47.900823 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dca45b94-d4cb-4c5d-8acc-abd192ba0789 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/41a64f1b-9978-48e4-b6d7-e74c393d3fc1" status: 202 len: 0 microversion: 2.1 time: 2.376436 Oct 01 20:54:47.902748 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 687/1333] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:54:45 2022] DELETE /compute/v2.1/os-floating-ips/41a64f1b-9978-48e4-b6d7-e74c393d3fc1 => generated 0 bytes in 2379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:54:47.912459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-cc39a53a-12e3-4c21-8819-db5b6fcaae34 req-4c51a717-8b91-4a02-8d8d-04fd43c3f34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e5943e-d2fe-4e7b-9140-ffe35a8aca4c", "tag": "a390abec-97aa-4416-8c5b-b217df3504f2"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:47.943386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cc39a53a-12e3-4c21-8819-db5b6fcaae34 req-4c51a717-8b91-4a02-8d8d-04fd43c3f34c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:47.948034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cc39a53a-12e3-4c21-8819-db5b6fcaae34 req-4c51a717-8b91-4a02-8d8d-04fd43c3f34c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:47.948800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cc39a53a-12e3-4c21-8819-db5b6fcaae34 req-4c51a717-8b91-4a02-8d8d-04fd43c3f34c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:47.981188 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-cc39a53a-12e3-4c21-8819-db5b6fcaae34 req-4c51a717-8b91-4a02-8d8d-04fd43c3f34c service nova] Creating event network-changed:a390abec-97aa-4416-8c5b-b217df3504f2 for instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c on nch2-master-1 Oct 01 20:54:47.990314 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-cc39a53a-12e3-4c21-8819-db5b6fcaae34 req-4c51a717-8b91-4a02-8d8d-04fd43c3f34c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086035 Oct 01 20:54:47.993057 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 688/1334] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:48.004040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:48.005973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:48.018072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.019668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.020502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.034249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.037764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.040879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.224543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:48.235637 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-749e4ba6-9372-4faa-b4a4-15aa2b54f336 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.682337 Oct 01 20:54:48.250810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 647/1335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:47 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:48.260340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:48.262850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:48.272344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.276166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.277646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.279074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.279755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.280593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.520579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:48.550300 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-37728b56-c8ae-4a0a-9207-61ef696adfbd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.555797 Oct 01 20:54:48.561216 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 689/1336] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:47 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:48.569772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:48.571321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:48.580969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.581494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.581927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.582729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.583232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.583887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.597898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:48.607131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3003b85e-8ab5-438e-9747-fd0ecd7baaa7 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1468 microversion: 2.1 time: 0.354717 Oct 01 20:54:48.620356 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 648/1337] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:48 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1468 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:48.624149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:54:48.631456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:48.632092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:48.639282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.640200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.640816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.641714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.642351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.642966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.760672 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-91f9895e-ef9f-46c0-a59c-bb42b8802e30 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 204 len: 0 microversion: 2.1 time: 0.196899 Oct 01 20:54:48.761631 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 690/1338] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:54:48 2022] DELETE /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:54:48.770656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:48.773067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:48.781104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:48.783781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.784888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.786196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.787383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:48.788073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:48.789098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:48.862564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:48.876250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:48.878905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:48.880962 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b683641a-c156-4378-bed2-d6e4cba731e5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.258723 Oct 01 20:54:48.895589 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 649/1339] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:48 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:48.914695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d98ff1f5-ad58-4ce3-904a-8227b29f618a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173bc8a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:48.997514 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d98ff1f5-ad58-4ce3-904a-8227b29f618a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.100358 Oct 01 20:54:48.998196 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 650/1340] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:48 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:49.012876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:49.015174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 3d5200d5-8702-4469-a18f-480ef4f6210c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:49.034706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.035713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.036848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.038400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.040484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.041264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.093275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:49.111279 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5b92853b-1021-4ad6-b49b-e46378adcb7b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.346286 Oct 01 20:54:49.112790 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 691/1341] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:48 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:49.124287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:49.125166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:49.138477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.139490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.140065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.141024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.141972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.143226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.459786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:49.468474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:49.476007 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0fae7914-5941-497f-b36e-14f4d206a4c6 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1527 microversion: 2.1 time: 0.361490 Oct 01 20:54:49.477337 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 692/1342] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:49 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1527 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:49.484710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:49.485823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:49.500449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.500607 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b76f69d2-5842-4f9a-824b-20346670c010 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c" status: 200 len: 1469 microversion: 2.1 time: 0.494063 Oct 01 20:54:49.501400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.502185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.503734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.505313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.506043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.506411 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 651/1343] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:48 2022] GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c => generated 1469 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:49.528194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:49.536296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:49.538174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Searching by: {'reservation_id': 'r-noh3rsau', 'deleted': False, 'project_id': '44683518fe3d46c58b139727cf0c9515'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:54:49.544822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.545313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.545861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.546628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.547681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.548131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.689539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:54:49.735871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:49.749232 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-452bacf4-b01e-4fd3-bf46-13a3f341351f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.270074 Oct 01 20:54:49.765871 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 693/1344] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:49 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:49.765871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:49.765871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:49.766345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.767605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.771175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.771175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.771175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.771175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:49.793498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:49.802539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:49.803011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:49.803453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.014106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:50.023360 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-67d8fa71-e5e1-4c8a-bee1-9d4a1f159673 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.271655 Oct 01 20:54:50.027969 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 694/1345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:49 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:50.055426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:50.057454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:50.058924 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e9132d57-1505-4eb2-bc2c-34e2fc1bf493 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?reservation_id=r-noh3rsau" status: 200 len: 2930 microversion: 2.1 time: 0.537409 Oct 01 20:54:50.063931 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 652/1346] 10.222.0.17 () {58 vars in 1197 bytes} [Sat Oct 1 20:54:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-noh3rsau => generated 2930 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:50.074551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.075477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.076263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.076869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-47e73f0f-0ad7-4370-ace9-2c4d7df16bea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173c3de50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:50.077553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.078218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.079029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.151575 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-47e73f0f-0ad7-4370-ace9-2c4d7df16bea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.086424 Oct 01 20:54:50.153791 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 653/1347] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:50 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:50.158761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7d68b89a-342b-4a94-83f8-aa374483ff81 req-e095e7a2-47d2-40a5-a5a8-a5e1f0e39e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b894bd4e-ce19-41b9-81ee-64786805990e", "name": "network-vif-unplugged", "status": "completed", "tag": "ddea4550-4948-4507-8a91-c65d3ab874a0"}, {"name": "network-changed", "server_uuid": "b894bd4e-ce19-41b9-81ee-64786805990e", "tag": "ddea4550-4948-4507-8a91-c65d3ab874a0"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:50.169206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7d68b89a-342b-4a94-83f8-aa374483ff81 req-e095e7a2-47d2-40a5-a5a8-a5e1f0e39e99 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.169995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7d68b89a-342b-4a94-83f8-aa374483ff81 req-e095e7a2-47d2-40a5-a5a8-a5e1f0e39e99 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.170656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7d68b89a-342b-4a94-83f8-aa374483ff81 req-e095e7a2-47d2-40a5-a5a8-a5e1f0e39e99 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.186914 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7d68b89a-342b-4a94-83f8-aa374483ff81 req-e095e7a2-47d2-40a5-a5a8-a5e1f0e39e99 service nova] Creating event network-vif-unplugged:ddea4550-4948-4507-8a91-c65d3ab874a0 for instance b894bd4e-ce19-41b9-81ee-64786805990e on nch2-master-1 Oct 01 20:54:50.187506 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7d68b89a-342b-4a94-83f8-aa374483ff81 req-e095e7a2-47d2-40a5-a5a8-a5e1f0e39e99 service nova] Creating event network-changed:ddea4550-4948-4507-8a91-c65d3ab874a0 for instance b894bd4e-ce19-41b9-81ee-64786805990e on nch2-master-1 Oct 01 20:54:50.193854 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7d68b89a-342b-4a94-83f8-aa374483ff81 req-e095e7a2-47d2-40a5-a5a8-a5e1f0e39e99 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.038626 Oct 01 20:54:50.194877 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 654/1348] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:50.200781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-22faf9fc-6fff-4358-a7fd-500504b70f6b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:50.220835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.server_groups [None req-22faf9fc-6fff-4358-a7fd-500504b70f6b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Querying cell 2663fce6-13d1-4945-900e-d818f7f389c0(cell1) for 2 instances {{(pid=140438) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 01 20:54:50.221561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22faf9fc-6fff-4358-a7fd-500504b70f6b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.222045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22faf9fc-6fff-4358-a7fd-500504b70f6b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.222478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22faf9fc-6fff-4358-a7fd-500504b70f6b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.251379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:50.259202 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-22faf9fc-6fff-4358-a7fd-500504b70f6b tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/feda80dc-d885-4f9c-897d-e6bd50684bcb" status: 200 len: 271 microversion: 2.1 time: 0.063056 Oct 01 20:54:50.262390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:50.264454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:50.265958 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 655/1349] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:54:50 2022] GET /compute/v2.1/os-server-groups/feda80dc-d885-4f9c-897d-e6bd50684bcb => generated 271 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:50.266442 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a8898f83-fb24-4c75-bd30-5e444e9ed76a tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.236969 Oct 01 20:54:50.279597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:50.279597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:50.279597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.279597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.281461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.281461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.282547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.282547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.294211 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 695/1350] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:50 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:50.300290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5462979d-961e-4ca1-8baf-4a5a59561b79 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:50.301200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5462979d-961e-4ca1-8baf-4a5a59561b79 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:50.311248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5462979d-961e-4ca1-8baf-4a5a59561b79 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.312085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5462979d-961e-4ca1-8baf-4a5a59561b79 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.313000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5462979d-961e-4ca1-8baf-4a5a59561b79 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.315051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5462979d-961e-4ca1-8baf-4a5a59561b79 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.316764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5462979d-961e-4ca1-8baf-4a5a59561b79 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.317730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5462979d-961e-4ca1-8baf-4a5a59561b79 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.521992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:50.534457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21aac0a3-98f8-4de0-b92b-08029aaef876 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.267246 Oct 01 20:54:50.535212 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 656/1351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:50 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:50.540176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:50.540796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:50.548434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.548933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.549374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.550097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.550567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.551062 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5462979d-961e-4ca1-8baf-4a5a59561b79 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1619 microversion: 2.1 time: 0.239975 Oct 01 20:54:50.551213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.551974 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 696/1352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:50 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1619 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:50.577586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8976d266-b75f-46a2-8d54-2bad208a8058 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:50.578218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8976d266-b75f-46a2-8d54-2bad208a8058 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] [instance: 3d5200d5-8702-4469-a18f-480ef4f6210c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:50.587192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8976d266-b75f-46a2-8d54-2bad208a8058 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.587804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8976d266-b75f-46a2-8d54-2bad208a8058 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.588316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8976d266-b75f-46a2-8d54-2bad208a8058 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.589154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8976d266-b75f-46a2-8d54-2bad208a8058 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.590204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8976d266-b75f-46a2-8d54-2bad208a8058 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.590729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8976d266-b75f-46a2-8d54-2bad208a8058 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.796941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:50.807051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad13fd81-6029-45e7-8f2e-7a5950341661 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1527 microversion: 2.1 time: 0.270684 Oct 01 20:54:50.810533 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8976d266-b75f-46a2-8d54-2bad208a8058 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c" status: 200 len: 1620 microversion: 2.1 time: 0.236535 Oct 01 20:54:50.811539 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 697/1353] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:50 2022] GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c => generated 1620 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:54:50.817425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:50.817425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:50.819453 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 657/1354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:50 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1527 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:50.824748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.825320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.825832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.826651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:50.827163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:50.827742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:50.914425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-299309001", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8c51efc3-f63a-4767-a6b1-ea93db136447"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:50.992618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:54:51.111090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:51.121860 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3eb5127c-7421-4932-973e-34b366a63eec tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.309180 Oct 01 20:54:51.122448 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 698/1355] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:50 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:51.127092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:51.127690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:51.146522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:51.147492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:51.148149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:51.149075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:51.149993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:51.150734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:51.389653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:51.407122 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6fdc8a22-0148-4b00-ac33-9cb063d3f381 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.282898 Oct 01 20:54:51.415022 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 699/1356] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:51 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:51.419154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:54:51.419593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:54:51.420197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:54:51.420710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:54:51.421117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:54:51.423708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6bf77e83-4345-4502-9a17-6fa59b180b9a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41736e91f0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:51.432584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:51.433851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:51.434397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:51.435267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:51.435871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:51.436516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:51.459094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:51.467443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:51.483036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:54:51.485811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:54:51.508237 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6bf77e83-4345-4502-9a17-6fa59b180b9a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.091635 Oct 01 20:54:51.509010 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 700/1357] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:51 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:51.524488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:51.525213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:51.540908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:51.541502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:51.542013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:51.542979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:51.543485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:51.543917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:51.547767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:51.622718 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-708b8cd5-7dee-4cb4-a66e-4714ec2ed5f1 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710211 Oct 01 20:54:51.625843 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 658/1358] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:54:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:54:51.645662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:51.647243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:51.660394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:51.662038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:51.663063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:51.663602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:51.664545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:51.665294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:51.861131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:51.878791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:51.881496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:51.881668 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6631c9b3-e2f7-4815-9b26-0b35edcf4bd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.362024 Oct 01 20:54:51.882299 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 701/1359] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:51 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:51.893167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-24bdedbd-c80c-4016-9612-6784b4117666 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:51.893797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-24bdedbd-c80c-4016-9612-6784b4117666 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:52.056385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-24bdedbd-c80c-4016-9612-6784b4117666 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:52.068577 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-24bdedbd-c80c-4016-9612-6784b4117666 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1216 microversion: 2.1 time: 0.185143 Oct 01 20:54:52.082516 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 702/1360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:51 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1216 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:52.085123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:52.085820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:52.096486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:52.097179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:52.097751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:52.098626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:52.099827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:52.100485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:52.109175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:52.118958 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d59ea441-5e9c-4b4d-a1ad-cf4b6ccf8ee5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.491115 Oct 01 20:54:52.119752 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 659/1361] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:51 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:52.155768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:52.156485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:52.166346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:52.166886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:52.167329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:52.168694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:52.169654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:52.170182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:52.435682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:52.461362 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d80ce586-4c01-4db3-b5ba-5affcd67854c tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1485 microversion: 2.1 time: 0.389978 Oct 01 20:54:52.483783 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 703/1362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:52 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1485 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:52.497164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:52.499598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:52.519113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:52.521768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:52.523786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:52.526724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:52.528049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:52.534018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:52.576482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:52.591345 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dbb259f8-c2c8-4c5b-ab28-9778634950dc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.443423 Oct 01 20:54:52.614338 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 660/1363] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:52 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:52.627242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1a30ec99-c40a-4699-b094-7d0402481e40 req-969cc646-19bb-4bd3-baed-591e2be6fd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e5943e-d2fe-4e7b-9140-ffe35a8aca4c", "name": "network-vif-deleted", "tag": "a390abec-97aa-4416-8c5b-b217df3504f2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:52.646435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a30ec99-c40a-4699-b094-7d0402481e40 req-969cc646-19bb-4bd3-baed-591e2be6fd0c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:52.647016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a30ec99-c40a-4699-b094-7d0402481e40 req-969cc646-19bb-4bd3-baed-591e2be6fd0c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:52.647484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a30ec99-c40a-4699-b094-7d0402481e40 req-969cc646-19bb-4bd3-baed-591e2be6fd0c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:52.652526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:52.676587 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1a30ec99-c40a-4699-b094-7d0402481e40 req-969cc646-19bb-4bd3-baed-591e2be6fd0c service nova] Creating event network-vif-deleted:a390abec-97aa-4416-8c5b-b217df3504f2 for instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c on nch2-master-1 Oct 01 20:54:52.685362 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1a30ec99-c40a-4699-b094-7d0402481e40 req-969cc646-19bb-4bd3-baed-591e2be6fd0c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069077 Oct 01 20:54:52.686398 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 661/1364] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:52.722446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bfb6390a-c5ae-42f3-85d0-9403aed97b5f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41737fd0d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:52.821072 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bfb6390a-c5ae-42f3-85d0-9403aed97b5f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1411 microversion: 2.1 time: 0.132809 Oct 01 20:54:52.821669 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 662/1365] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:52 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1411 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:52.908460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:52.909205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:52.924279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:52.935884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:52.936977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:52.941129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:52.945327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:52.947915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.020577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:53.039717 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d52a0903-6f50-4576-9d8e-00288b64b6b1 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.551618 Oct 01 20:54:53.041712 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 704/1366] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:52 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:53.095277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:53.096252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:53.112110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.117028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.130554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.133530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.134044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.134532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.153701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:54:53.465361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:53.488086 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ac46619e-5529-462b-9406-ecb99bd2687a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1268 microversion: 2.1 time: 0.390413 Oct 01 20:54:53.505211 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 705/1367] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:53 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1268 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:54:53.518428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:53.519073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:53.531932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.532447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.532888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.533641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.534098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.534541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.557451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:53.568622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:53.570466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:53.571931 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5e58658f-dbc0-4622-8229-6783d5692cd7 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.667608 Oct 01 20:54:53.573072 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 663/1368] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:52 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:54:53.583705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:53.585794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:53.600977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.602179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.618160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.621998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.624344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.626199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.687514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.688430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.689030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.689646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lazy-loading 'fault' on Instance uuid 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:53.784818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:53.786475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:53.802915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf2e899a-0128-4d61-b2d6-6cc0f0090215 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1314 microversion: 2.1 time: 0.227426 Oct 01 20:54:53.814532 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 664/1369] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:53 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:53.814759 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-33fac10a-e837-437a-adb8-69f8c891c7b5 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.300034 Oct 01 20:54:53.814856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:53.814856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:53.825230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.825736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.826358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.827171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.827669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.828309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.829654 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 706/1370] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:53 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:53.842188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:53.843448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:53.872006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.872602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.873561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:53.874656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:53.875749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:53.876951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:54.216386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:54.234739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:54.240769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:54.242624 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3063d7b0-b518-4665-b24a-2e59d6def767 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2949 microversion: 2.42 time: 0.436618 Oct 01 20:54:54.243534 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 665/1371] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:53 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2949 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:54.272926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-059aca69-e7bf-4087-8b6a-d751a306e380 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417c2ec940>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:54.279789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:54.307941 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b8217fe1-d461-431f-a37f-8509eb7105f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.465401 Oct 01 20:54:54.315099 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 707/1372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:53 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:54.330957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:54.330957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:54.366867 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-059aca69-e7bf-4087-8b6a-d751a306e380 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1420 microversion: 2.1 time: 0.108584 Oct 01 20:54:54.368429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:54.368667 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 666/1373] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:54 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:54.372480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:54.372966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:54.373709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:54.376803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79f5ed07-2d83-4590-b5e0-6dfc01de020b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:54.377597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-79f5ed07-2d83-4590-b5e0-6dfc01de020b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:54.379370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:54.379912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:54.386226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79f5ed07-2d83-4590-b5e0-6dfc01de020b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:54.388129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79f5ed07-2d83-4590-b5e0-6dfc01de020b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:54.388129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79f5ed07-2d83-4590-b5e0-6dfc01de020b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:54.388892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79f5ed07-2d83-4590-b5e0-6dfc01de020b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:54.389461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79f5ed07-2d83-4590-b5e0-6dfc01de020b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:54.390014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79f5ed07-2d83-4590-b5e0-6dfc01de020b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:54.610749 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-79f5ed07-2d83-4590-b5e0-6dfc01de020b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.240245 Oct 01 20:54:54.612660 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 667/1374] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Oct 1 20:54:54 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131/os-interface => generated 1830 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:54.620663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2548c452-4540-4bc9-a63f-1fca3310540b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4178405b80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:54.685120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:54.702632 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-457f68e6-3a33-420f-b654-4915c21a1538 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.386107 Oct 01 20:54:54.704460 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 708/1375] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:54 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:54.711618 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2548c452-4540-4bc9-a63f-1fca3310540b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 200 len: 1420 microversion: 2.1 time: 0.095800 Oct 01 20:54:54.711893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:54.712886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:54.723420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:54.724468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:54.725920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:54.727223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:54.727411 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 668/1376] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:54:54 2022] GET /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:54.728448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:54.729055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:54.736448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:54.737477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:54.747493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:54.748289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:54.749005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:54.749987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:54.750806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:54.751550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:54.895837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:54.904800 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-87808c22-2066-459d-a809-bfc10d1f5b5f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1274 microversion: 2.1 time: 0.199064 Oct 01 20:54:54.909037 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 709/1377] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:54 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:54.914099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-421b6e66-4e3a-4851-8c21-91bab70875eb tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173fd1310>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:55.016574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:55.027853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:55.029719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:55.031344 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-abeb2ecc-cff4-4dc4-82cd-7f571d884827 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.302219 Oct 01 20:54:55.032978 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 669/1378] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:54 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:55.038094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3999659c-3a27-4671-8e07-40fce0a14fac req-c6e8d6da-b205-4e53-a217-08c81450f112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed59d2f-d270-4882-b32b-89be0dedc71f", "name": "network-vif-unplugged", "status": "completed", "tag": "66d65798-4e84-432e-b05a-65e6432c780b"}, {"name": "network-changed", "server_uuid": "bed59d2f-d270-4882-b32b-89be0dedc71f", "tag": "66d65798-4e84-432e-b05a-65e6432c780b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:55.049829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3999659c-3a27-4671-8e07-40fce0a14fac req-c6e8d6da-b205-4e53-a217-08c81450f112 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.050325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3999659c-3a27-4671-8e07-40fce0a14fac req-c6e8d6da-b205-4e53-a217-08c81450f112 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.050891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3999659c-3a27-4671-8e07-40fce0a14fac req-c6e8d6da-b205-4e53-a217-08c81450f112 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.067070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3999659c-3a27-4671-8e07-40fce0a14fac req-c6e8d6da-b205-4e53-a217-08c81450f112 service nova] Creating event network-vif-unplugged:66d65798-4e84-432e-b05a-65e6432c780b for instance bed59d2f-d270-4882-b32b-89be0dedc71f on nch1-master-1 Oct 01 20:54:55.067748 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3999659c-3a27-4671-8e07-40fce0a14fac req-c6e8d6da-b205-4e53-a217-08c81450f112 service nova] Creating event network-changed:66d65798-4e84-432e-b05a-65e6432c780b for instance bed59d2f-d270-4882-b32b-89be0dedc71f on nch1-master-1 Oct 01 20:54:55.081612 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3999659c-3a27-4671-8e07-40fce0a14fac req-c6e8d6da-b205-4e53-a217-08c81450f112 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.047229 Oct 01 20:54:55.082361 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 670/1379] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:55.091322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:55.092178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:55.101139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.101781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.102341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.103331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.104048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.110805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.152333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.153462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.154113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.154358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lazy-loading 'fault' on Instance uuid 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:54:55.222327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de9e6274c041da9c366ea00c0bf769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2694c8af60455aa9db5997c53adbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:55.235269 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fdad31ef-023e-4cac-8372-9b0818cfdd88 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 200 len: 1314 microversion: 2.1 time: 0.151296 Oct 01 20:54:55.236357 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 671/1380] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:55 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:55.242589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:55.243224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:55.249993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.250769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.251961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.252919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.253593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.254305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.504731 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-421b6e66-4e3a-4851-8c21-91bab70875eb tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 204 len: 0 microversion: 2.1 time: 0.594331 Oct 01 20:54:55.505541 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 710/1381] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:54 2022] DELETE /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:54:55.510207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:55.510854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:55.517048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.517638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.518157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.519142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.519701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.520219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.714877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:55.723279 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-74ae4da0-3708-41f4-99d2-fd50053ca17e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.485511 Oct 01 20:54:55.725256 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 672/1382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:55 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:55.734677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:55.735334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:55.743541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.744354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.744955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.746061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.746668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.747609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.775724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:54:55.894535 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a89683b-db5b-44f2-b341-15d2ad8f488b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 204 len: 0 microversion: 2.1 time: 0.169290 Oct 01 20:54:55.896549 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 673/1383] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:54:55 2022] DELETE /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:54:55.917900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:55.919157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:55.927989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.928754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.929383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.930689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.932423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:55.933412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:55.944547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:55.956873 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e61773d9-63c5-4173-9da8-4460cf38c5d5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.450251 Oct 01 20:54:55.959889 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 711/1384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:55 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:55.970581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:55.977492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:55.993343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:55.998790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:56.000340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:56.003700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:56.005162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:56.007247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:56.367378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:56.384592 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ddca7ba-e275-4556-a705-b29503c14c14 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.473748 Oct 01 20:54:56.400777 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 674/1385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:55 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:56.404029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:56.411804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1516855303", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "00c1b669-0633-4d9a-bca2-2a3af62ab8df"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:56.422992 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-45a30ddb-ca52-45ed-bc42-b42256aefe99 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1316 microversion: 2.1 time: 0.458468 Oct 01 20:54:56.425257 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 712/1386] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:55 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:56.432237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:56.434242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:56.445785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:56.446603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:56.447156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:56.448042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:56.449357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:56.451157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:56.493846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] validate_networks() for [('00c1b669-0633-4d9a-bca2-2a3af62ab8df', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:54:56.916896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:56.928366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:56.931033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:56.932750 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ce88dec8-b7cf-4c91-8984-e474a35fc239 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.505933 Oct 01 20:54:56.946557 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 713/1387] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:56 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:56.946557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:56.946557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] [instance: 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:56.946557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:56.947415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:56.947767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:56.949048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:56.949633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:56.950359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:56.969446 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] HTTP exception thrown: Instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c could not be found. Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Request method failure captured: Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c HTTP/1.1 Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKi19JknQGY7AYXG594IhsfzB8NR4uc0dFDEzc35D-pTt67GETfC2QVlMQ_A8LDm-djdzq061VeprbhVbhWZEW3QAM74SGGswx8lku8tEluPmqOGrByFGdwDlv9E1DeqsPYkXsKm5m6GPngh7Di7nlLMBhLFS52aQNm94cbK_ksfuzI Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 1a2694c8af60455aa9db5997c53adbdc Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:54:56.972694 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a2694c8af60455aa9db5997c53adbdc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a2694c8af60455aa9db5997c53adbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a2694c8af60455aa9db5997c53adbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a2694c8af60455aa9db5997c53adbdc"}]}] Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 1a2694c8af60455aa9db5997c53adbdc Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-374272004 Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-FloatingIPsAssociationTestJSON-374272004-project Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f4de9e6274c041da9c366ea00c0bf769 Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-374272004-project Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c could not be found. Oct 01 20:54:56.974421 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '57e5943e-d2fe-4e7b-9140-ffe35a8aca4c'} Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c could not be found. Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:54:56.975550 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c could not be found. Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c could not be found. Oct 01 20:54:56.978253 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:54:56.979640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] Returning 404 to user: Instance 57e5943e-d2fe-4e7b-9140-ffe35a8aca4c could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:54:56.979640 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-41be4e59-e13b-4c97-b7c3-977e268c1c00 tempest-FloatingIPsAssociationTestJSON-374272004 tempest-FloatingIPsAssociationTestJSON-374272004-project] 10.222.0.17 "GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c" status: 404 len: 111 microversion: 2.1 time: 0.039103 Oct 01 20:54:56.979640 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 714/1388] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:56 2022] GET /compute/v2.1/servers/57e5943e-d2fe-4e7b-9140-ffe35a8aca4c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:54:56.982902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:56.983806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:56.992390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:56.993210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:56.994007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:56.994973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:56.995702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:56.996623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:57.422020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:57.430198 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3ca446de-e214-44a0-bf19-ec61c9abb293 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.451584 Oct 01 20:54:57.443580 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 715/1389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:56 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:57.454975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:57.461345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:57.468288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:57.469034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:57.469681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:57.470878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:57.471549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:57.472184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:57.504413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:54:57.504904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:54:57.505321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:54:57.505765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:54:57.506188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:54:57.520805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:57.521414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:57.521858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:57.523101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:57.523578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:57.524010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:57.544664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Getting quotas for project 9c0b38cea2c345c68c51c4d8cb9c07e7. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:54:57.550822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Getting quotas for user 1d180849a694494e89843c0c315acd6d and project 9c0b38cea2c345c68c51c4d8cb9c07e7. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:54:57.569273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:54:57.571655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:54:57.637033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35df7126-55be-4944-b561-f47b49600e60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234102 Oct 01 20:54:57.638022 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 675/1390] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:54:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:54:57.642151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:57.642790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:57.651515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:57.652139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:57.653095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:57.653737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:57.654555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:57.654679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:57.770578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:57.782886 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-145a6f01-f321-4e5a-9e79-7a8dca13d674 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.337962 Oct 01 20:54:57.784031 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 716/1391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:57 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:57.789557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:57.790336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:57.798017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:57.798788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:57.799652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:57.800541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:57.801934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:57.802752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:58.320071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:58.333898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6131ad08-aa63-4030-84d0-8571563c57c9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.695214 Oct 01 20:54:58.335953 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 676/1392] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:57 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:58.344544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5791d274-3627-4b3f-ace3-bcf282742944 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:58.345644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5791d274-3627-4b3f-ace3-bcf282742944 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:58.753435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:58.770953 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5f4bd9a2-eda3-442e-9c84-f9281ec36b98 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1316 microversion: 2.1 time: 0.985402 Oct 01 20:54:58.772867 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 717/1393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:57 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1316 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:58.792785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:58.793931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:58.813178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:58.815025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:58.815889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:58.817372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:58.818108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:58.818967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:58.908840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5791d274-3627-4b3f-ace3-bcf282742944 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:58.916038 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5791d274-3627-4b3f-ace3-bcf282742944 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1208 microversion: 2.1 time: 0.578670 Oct 01 20:54:58.932259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 677/1394] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:58 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1208 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:58.945326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8de2788a-1392-4fbd-aa05-8b8f74badd9a req-533bf166-7d4f-4f5a-b921-8b03936c656f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bec5b02-88e5-450e-b5ee-61fc18b2349b", "name": "network-vif-unplugged", "status": "completed", "tag": "a5ebda0b-ad93-4580-a18d-ceef18a4df2b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:58.958837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8de2788a-1392-4fbd-aa05-8b8f74badd9a req-533bf166-7d4f-4f5a-b921-8b03936c656f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:58.959726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8de2788a-1392-4fbd-aa05-8b8f74badd9a req-533bf166-7d4f-4f5a-b921-8b03936c656f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:58.960559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8de2788a-1392-4fbd-aa05-8b8f74badd9a req-533bf166-7d4f-4f5a-b921-8b03936c656f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:58.979881 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8de2788a-1392-4fbd-aa05-8b8f74badd9a req-533bf166-7d4f-4f5a-b921-8b03936c656f service nova] Creating event network-vif-unplugged:a5ebda0b-ad93-4580-a18d-ceef18a4df2b for instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b on nch1-master-1 Oct 01 20:54:58.988324 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8de2788a-1392-4fbd-aa05-8b8f74badd9a req-533bf166-7d4f-4f5a-b921-8b03936c656f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053960 Oct 01 20:54:58.989281 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 678/1395] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:59.000149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:59.001218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:59.008627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:59.009472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:59.010161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:59.011634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:59.012206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:59.013230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:59.441783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:59.465868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:59.471491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:59.474644 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-185b9093-3c41-46c8-bf55-a8b8a2d1c293 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.700133 Oct 01 20:54:59.476306 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 718/1396] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:54:58 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:54:59.489544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:59.490410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:59.501136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:59.502118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:59.503284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:59.504686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:59.505873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:59.506724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:59.693591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:59.704897 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80b9b0d7-f755-4821-8a52-f64dcfb6576d tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.713247 Oct 01 20:54:59.722198 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 679/1397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:58 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:54:59.734187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-aa3f28f0-dddf-4d11-84ed-f640af26810f req-4356e305-e97d-4c97-8bae-41a240d573f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f8e63c-9de6-41e3-83b4-bb0715083b05", "tag": "3bdc2e6e-032a-4305-bd86-e5a991fd2084"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:54:59.752009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-aa3f28f0-dddf-4d11-84ed-f640af26810f req-4356e305-e97d-4c97-8bae-41a240d573f2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:59.753041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-aa3f28f0-dddf-4d11-84ed-f640af26810f req-4356e305-e97d-4c97-8bae-41a240d573f2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:59.754105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-aa3f28f0-dddf-4d11-84ed-f640af26810f req-4356e305-e97d-4c97-8bae-41a240d573f2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:59.777037 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-aa3f28f0-dddf-4d11-84ed-f640af26810f req-4356e305-e97d-4c97-8bae-41a240d573f2 service nova] Creating event network-changed:3bdc2e6e-032a-4305-bd86-e5a991fd2084 for instance 93f8e63c-9de6-41e3-83b4-bb0715083b05 on nch2-master-1 Oct 01 20:54:59.788570 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-aa3f28f0-dddf-4d11-84ed-f640af26810f req-4356e305-e97d-4c97-8bae-41a240d573f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063476 Oct 01 20:54:59.790665 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 680/1398] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:54:59.801836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:54:59.803084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:54:59.813593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:59.814319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:59.815888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:59.816445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:54:59.817530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:54:59.818068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:54:59.976232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:54:59.989448 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7b94c1e7-763d-497f-81f8-de2e8eb98711 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.511524 Oct 01 20:54:59.991388 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 719/1399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:59 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:00.002262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d3537e36-7001-4a8f-b8ee-37b3430d7c13 req-e14cc9c4-9033-41ad-ba70-2fb603906eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bec5b02-88e5-450e-b5ee-61fc18b2349b", "name": "network-vif-deleted", "tag": "a5ebda0b-ad93-4580-a18d-ceef18a4df2b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:00.022123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d3537e36-7001-4a8f-b8ee-37b3430d7c13 req-e14cc9c4-9033-41ad-ba70-2fb603906eea service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:00.022651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d3537e36-7001-4a8f-b8ee-37b3430d7c13 req-e14cc9c4-9033-41ad-ba70-2fb603906eea service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:00.023088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d3537e36-7001-4a8f-b8ee-37b3430d7c13 req-e14cc9c4-9033-41ad-ba70-2fb603906eea service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:00.052975 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d3537e36-7001-4a8f-b8ee-37b3430d7c13 req-e14cc9c4-9033-41ad-ba70-2fb603906eea service nova] Creating event network-vif-deleted:a5ebda0b-ad93-4580-a18d-ceef18a4df2b for instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b on nch1-master-1 Oct 01 20:55:00.061202 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d3537e36-7001-4a8f-b8ee-37b3430d7c13 req-e14cc9c4-9033-41ad-ba70-2fb603906eea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068340 Oct 01 20:55:00.065079 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 720/1400] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:00.077423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:00.078337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:00.094215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:00.095079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:00.095690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:00.096602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:00.100037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:00.100732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:00.183837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:00.200702 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4d20584e-6491-4d36-a1dc-d44317da15c4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.407917 Oct 01 20:55:00.214682 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 681/1401] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:54:59 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:00.214682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:00.214682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:00.218065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:00.222328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:00.222929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:00.224159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:00.225278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:00.225789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:00.379281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:00.391979 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-91e3c1ef-2680-40d6-8316-3f4d6d43aa8a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1268 microversion: 2.1 time: 0.188997 Oct 01 20:55:00.407630 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 682/1402] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:00 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:00.477248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:00.486891 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-10dcf336-1677-4642-bc92-ad8338e1836e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1316 microversion: 2.1 time: 0.420267 Oct 01 20:55:00.487940 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 721/1403] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:00 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:00.509303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:00.510177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:00.517184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:00.518032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:00.518794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:00.520269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:00.521696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:00.522849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:00.529401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:00.728290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:00.729280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:00.744201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:00.745804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:00.746550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:00.747903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:00.748663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:00.749634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:00.838280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:00.849926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:00.851727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:00.853007 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-387adbf8-469b-4b71-b820-03e6dc34e681 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.350407 Oct 01 20:55:00.853765 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 683/1404] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:00 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:00.922932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:00.931335 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1989ddf5-a0ad-4e72-8a23-30809fa90a22 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.207490 Oct 01 20:55:00.931955 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 722/1405] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:00 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:01.017355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:01.018239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:01.029163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.029163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.029163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.029163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.029625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.029625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.205890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:01.214752 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9111a79-fd08-439e-865b-08a2ba8a2c1a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.202072 Oct 01 20:55:01.215670 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 684/1406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:01 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:01.229204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:01.230548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:01.239550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.240525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.240525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.241186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.241643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.242069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.416907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:01.422268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:01.423136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:01.426225 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0486e164-d780-4368-b279-a7a7cad388ed tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.200784 Oct 01 20:55:01.427114 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 723/1407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:01 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:01.430395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.430995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.431523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.432422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.432893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.433385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.526413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:01.536083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:01.544117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.545175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.545983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.547204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.548027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.548663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.552653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:01.555090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:01.564418 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92957485-8ff8-4896-8033-155e2425ad29 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1266 microversion: 2.1 time: 0.150882 Oct 01 20:55:01.565687 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 685/1408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:01 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:01.766907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:01.778319 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3c9948b4-e685-47e4-a44e-7946cbb7dabe tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1316 microversion: 2.1 time: 0.265557 Oct 01 20:55:01.781038 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 724/1409] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:01 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:01.879410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:01.880752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:01.893076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.896204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.896853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.898066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.898464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.899752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.955462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:01.956495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:01.970927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.972292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.973296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:01.975899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:01.976623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:01.977277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:02.066162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:02.790003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:02.801515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:02.804506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:02.805183 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-692ad194-a339-48d1-bdea-288fad5c4f6f tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1486 microversion: 2.25 time: 0.930441 Oct 01 20:55:02.805932 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 686/1410] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:01 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1486 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:02.819624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:02.820624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:02.825726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:02.840922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:02.841935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:02.842741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:02.843704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:02.844927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:02.845678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:02.860072 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f9c4992b-7563-4726-b571-ebe7ae5f5729 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1476 microversion: 2.1 time: 0.907487 Oct 01 20:55:02.876804 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 725/1411] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:01 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1476 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:02.881646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:02.882280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:02.895340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:02.897690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:02.898527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:02.901109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:02.902753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:02.904716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:03.803043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:03.808755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:03.823864 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-061d2fef-b331-4118-af36-441798dae720 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 1.015995 Oct 01 20:55:03.824773 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 687/1412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:02 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:03.829913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:03.830763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:03.841102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:03.841882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:03.842520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:03.843823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:03.844456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:03.845056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:03.853928 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-97d8ed4c-bff6-4d68-84b8-cf1a63e104d5 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.987894 Oct 01 20:55:03.856357 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 726/1413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:02 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:03.867503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:03.874123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:03.884550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:03.886213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:03.887137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:03.889141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:03.889895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:03.890791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:04.017807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:04.034873 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e67d8b98-4752-4d4b-af9c-73fda03aaed8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1266 microversion: 2.1 time: 0.207099 Oct 01 20:55:04.035977 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 688/1414] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:03 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:04.064001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:04.064687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:04.084122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:04.088323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:04.089204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:04.089979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:04.090461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:04.090925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:04.427790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:04.441734 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f321bd7e-aada-414e-938b-2641ae491745 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1316 microversion: 2.1 time: 0.583274 Oct 01 20:55:04.444019 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 727/1415] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:03 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:04.450796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:04.451677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:04.459140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:04.460315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:04.461154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:04.462081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:04.463352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:04.465479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:04.545082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:04.556224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:04.558849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:04.560370 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebff5b0a-b73e-46f0-9300-60352d3956a6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1476 microversion: 2.25 time: 0.506990 Oct 01 20:55:04.574312 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 689/1416] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:04 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1476 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:04.826672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4662aab9-7c04-4c9d-b2c7-9eff94ff1665 tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Calling method '.version_select at 0x7f417c29aaf0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:04.877294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4662aab9-7c04-4c9d-b2c7-9eff94ff1665 tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:04.879477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4662aab9-7c04-4c9d-b2c7-9eff94ff1665 tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:04.881019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4662aab9-7c04-4c9d-b2c7-9eff94ff1665 tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:04.884561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4662aab9-7c04-4c9d-b2c7-9eff94ff1665 tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:04.887394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4662aab9-7c04-4c9d-b2c7-9eff94ff1665 tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:04.895831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:04.902935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4662aab9-7c04-4c9d-b2c7-9eff94ff1665 tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:04.906727 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6e43213a-3930-45b9-94eb-b3c4045ba78b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1475 microversion: 2.1 time: 0.461232 Oct 01 20:55:04.913923 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 728/1417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:04 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1475 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:04.921881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-4b46b894-8213-4c5f-908a-994bf4c960d9 req-fbcdb569-c441-478e-b246-2e8b64dac7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e", "name": "network-vif-unplugged", "status": "completed", "tag": "9b68231b-ea01-4f80-9d40-3d0180818f18"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:04.952551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4b46b894-8213-4c5f-908a-994bf4c960d9 req-fbcdb569-c441-478e-b246-2e8b64dac7d7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:04.955643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4b46b894-8213-4c5f-908a-994bf4c960d9 req-fbcdb569-c441-478e-b246-2e8b64dac7d7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:04.956308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4b46b894-8213-4c5f-908a-994bf4c960d9 req-fbcdb569-c441-478e-b246-2e8b64dac7d7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:04.958887 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4662aab9-7c04-4c9d-b2c7-9eff94ff1665 tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] 10.222.0.17 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.384439 Oct 01 20:55:04.959709 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 690/1418] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Oct 1 20:55:04 2022] GET /compute/v2.1/limits => generated 511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:04.973468 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-4b46b894-8213-4c5f-908a-994bf4c960d9 req-fbcdb569-c441-478e-b246-2e8b64dac7d7 service nova] Creating event network-vif-unplugged:9b68231b-ea01-4f80-9d40-3d0180818f18 for instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e on nch2-master-1 Oct 01 20:55:04.990532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9c2e3849-b11c-4d12-bb31-9c2375ba327c req-1c5da3ac-b870-4bf4-a4cf-64943d96b7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f8e63c-9de6-41e3-83b4-bb0715083b05", "name": "network-vif-plugged", "status": "completed", "tag": "3bdc2e6e-032a-4305-bd86-e5a991fd2084"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:05.009509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-4b46b894-8213-4c5f-908a-994bf4c960d9 req-fbcdb569-c441-478e-b246-2e8b64dac7d7 service nova] Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:55:05.020471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9c2e3849-b11c-4d12-bb31-9c2375ba327c req-1c5da3ac-b870-4bf4-a4cf-64943d96b7c2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.020990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9c2e3849-b11c-4d12-bb31-9c2375ba327c req-1c5da3ac-b870-4bf4-a4cf-64943d96b7c2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.021444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9c2e3849-b11c-4d12-bb31-9c2375ba327c req-1c5da3ac-b870-4bf4-a4cf-64943d96b7c2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.027227 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-4b46b894-8213-4c5f-908a-994bf4c960d9 req-fbcdb569-c441-478e-b246-2e8b64dac7d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110949 Oct 01 20:55:05.028809 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 729/1419] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:05.035714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6fcfeea6-5f9f-41ef-9cc4-1c8c7bb26327 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '.version_select at 0x7f41737bb790>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:05.040339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fcfeea6-5f9f-41ef-9cc4-1c8c7bb26327 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.042118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fcfeea6-5f9f-41ef-9cc4-1c8c7bb26327 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.042838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fcfeea6-5f9f-41ef-9cc4-1c8c7bb26327 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.063399 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9c2e3849-b11c-4d12-bb31-9c2375ba327c req-1c5da3ac-b870-4bf4-a4cf-64943d96b7c2 service nova] Creating event network-vif-plugged:3bdc2e6e-032a-4305-bd86-e5a991fd2084 for instance 93f8e63c-9de6-41e3-83b4-bb0715083b05 on nch2-master-1 Oct 01 20:55:05.069531 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9c2e3849-b11c-4d12-bb31-9c2375ba327c req-1c5da3ac-b870-4bf4-a4cf-64943d96b7c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096861 Oct 01 20:55:05.070347 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6fcfeea6-5f9f-41ef-9cc4-1c8c7bb26327 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 5144 microversion: 2.25 time: 0.038717 Oct 01 20:55:05.070773 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 691/1420] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:05.072500 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 730/1421] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Oct 1 20:55:05 2022] GET /compute/v2.1/os-migrations => generated 5144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:05.090341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:05.091162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:05.106004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:05.108615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:05.117540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.118307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.118950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.119829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.120571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.121151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.121832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.122339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.123549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.124477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.124952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.125397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.412292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:05.415462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:05.421443 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-27407f50-a57e-4ba7-8c05-786aaa8a8fda tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.345827 Oct 01 20:55:05.422018 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 731/1422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:05 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:05.423711 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-884ad8c5-5a59-4bd3-aaea-29b8413a9a51 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.351434 Oct 01 20:55:05.424362 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 692/1423] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:05 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:05.428672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-651546a5-e0a2-4dea-95f7-3c9e8a8bdb5d tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1903976392", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:05.429229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:05.429849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:05.442980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.443604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.444138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.444958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.445587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.446159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.488702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-651546a5-e0a2-4dea-95f7-3c9e8a8bdb5d tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:05.774285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:05.790009 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0360d987-8452-49cc-9b39-1a0c36dc1379 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1308 microversion: 2.1 time: 0.364060 Oct 01 20:55:05.790619 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 693/1424] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:05 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:05.796168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:05.796936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:05.804104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.804841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.805491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.806203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.806690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.807405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.929300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-651546a5-e0a2-4dea-95f7-3c9e8a8bdb5d tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Getting quotas for project 0f3af8127d0c4659a2dfd3da10fb480d. Resources: dict_keys(['metadata_items']) {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:05.936149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-651546a5-e0a2-4dea-95f7-3c9e8a8bdb5d tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Getting quotas for user 0358348983a84a7d80a29622a021fa28 and project 0f3af8127d0c4659a2dfd3da10fb480d. Resources: dict_keys(['metadata_items']) {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:05.954241 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-651546a5-e0a2-4dea-95f7-3c9e8a8bdb5d tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-651546a5-e0a2-4dea-95f7-3c9e8a8bdb5d tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Request method failure captured: Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 1752 Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKknV1KjT3td7a5aQ2jNPCU-4GZjqd2kn-agyPbq7daBHx6wKyn4NRMrryHviPKWWIqfpM2ryQ_ON06fIdgGPXhNDZeVW3AmomuIdXhZMAbw7ZTE-FI7hq3hiY5HTdpOVLKsy0iQlXIkWAfJppKMhg7jiAQOhNzu50NGW6YbOupTkoc Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 0f3af8127d0c4659a2dfd3da10fb480d Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1961161314 Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0f3af8127d0c4659a2dfd3da10fb480d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0f3af8127d0c4659a2dfd3da10fb480d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0f3af8127d0c4659a2dfd3da10fb480d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0f3af8127d0c4659a2dfd3da10fb480d"}]}] Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1961161314 Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 0f3af8127d0c4659a2dfd3da10fb480d Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1961161314 Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 0358348983a84a7d80a29622a021fa28 Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1903976392", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:55:05.957890 ncdv-master-1 devstack@n-api.service[140437]: exception: Maximum number of metadata items exceeds 128 Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1903976392', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:05.960864 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 01 20:55:05.965080 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:05.968117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-651546a5-e0a2-4dea-95f7-3c9e8a8bdb5d tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:05.969120 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-651546a5-e0a2-4dea-95f7-3c9e8a8bdb5d tempest-AbsoluteLimitsNegativeTestJSON-1961161314 tempest-AbsoluteLimitsNegativeTestJSON-1961161314-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.546040 Oct 01 20:55:05.974030 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 732/1425] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Oct 1 20:55:05 2022] POST /compute/v2.1/servers => generated 87 bytes in 547 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:55:05.977588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:05.978203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:05.986847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.987406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.988128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:05.989109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:05.989773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:05.990400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:06.051111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] Lazy-loading 'services' on Instance uuid b894bd4e-ce19-41b9-81ee-64786805990e {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:06.069512 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-782690f3-1932-464b-8c95-8a5c96c04036 tempest-LiveAutoBlockMigrationV225Test-1233515141 tempest-LiveAutoBlockMigrationV225Test-1233515141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1968 microversion: 2.25 time: 0.277775 Oct 01 20:55:06.070483 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 694/1426] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:05 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1968 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:06.078207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:06.079454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:06.086975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:06.087807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:06.088500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:06.090388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:06.091101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:06.092055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:06.471112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:06.485166 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4410063a-0f14-4805-9524-14726221cb1e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1316 microversion: 2.1 time: 0.513551 Oct 01 20:55:06.488623 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 733/1427] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:05 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:06.494623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:06.496224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:06.504059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:06.504819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:06.505556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:06.506776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:06.507900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:06.508867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:06.539007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:06.547374 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dac8bbc7-7b76-4de9-8195-567d13d4591b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1475 microversion: 2.1 time: 0.475497 Oct 01 20:55:06.547961 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 695/1428] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:06 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1475 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:06.555054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:06.583191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:06.583861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:06.585926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:06.592733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:06.593466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:06.594065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:06.594992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:06.599058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:06.599872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:06.727684 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6ad507b2-1c82-4038-96fa-1eba25fbecc6 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 204 len: 0 microversion: 2.25 time: 0.236871 Oct 01 20:55:06.732860 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 734/1429] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:55:06 2022] DELETE /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:55:06.741656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:06.746977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:06.757930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:06.758504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:06.759945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:06.760742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:06.762190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:06.762934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:06.948818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:06.959365 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-848ab4db-7a72-4351-927d-2248979d272a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1718 microversion: 2.1 time: 0.391490 Oct 01 20:55:06.972261 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 696/1430] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:06 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1718 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:06.985008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:06.986108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:06.998382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:06.998924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:06.999365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:07.000079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:07.000539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:07.000964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:07.137269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:07.146313 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c2ecb780-38b8-44fb-a19d-03b8bd766c7d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1507 microversion: 2.1 time: 0.415729 Oct 01 20:55:07.158527 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 735/1431] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:06 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:07.162874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:07.163482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:07.167808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:07.174202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:07.174921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:07.175751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:07.177209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:07.177209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:07.177650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:07.289908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:07.303259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:07.305066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:07.306447 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6c604951-1623-46d0-aaf3-9ec8a7168b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1482 microversion: 2.25 time: 0.327154 Oct 01 20:55:07.307140 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 697/1432] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:06 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1482 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:07.313478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ba70c325-a9b9-4601-b4ab-6c954436a9b6 req-87dc3284-8120-455e-a5c4-dfc01c381834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e", "tag": "9b68231b-ea01-4f80-9d40-3d0180818f18"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:07.326799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ba70c325-a9b9-4601-b4ab-6c954436a9b6 req-87dc3284-8120-455e-a5c4-dfc01c381834 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:07.327371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ba70c325-a9b9-4601-b4ab-6c954436a9b6 req-87dc3284-8120-455e-a5c4-dfc01c381834 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:07.327979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ba70c325-a9b9-4601-b4ab-6c954436a9b6 req-87dc3284-8120-455e-a5c4-dfc01c381834 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:07.344941 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ba70c325-a9b9-4601-b4ab-6c954436a9b6 req-87dc3284-8120-455e-a5c4-dfc01c381834 service nova] Creating event network-changed:9b68231b-ea01-4f80-9d40-3d0180818f18 for instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e on nch2-master-1 Oct 01 20:55:07.351533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-ba70c325-a9b9-4601-b4ab-6c954436a9b6 req-87dc3284-8120-455e-a5c4-dfc01c381834 service nova] Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:55:07.363290 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ba70c325-a9b9-4601-b4ab-6c954436a9b6 req-87dc3284-8120-455e-a5c4-dfc01c381834 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054108 Oct 01 20:55:07.364801 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 698/1433] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:07.390298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:07.398589 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e4f560b0-3041-4cce-991a-3fc546ac8b47 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1308 microversion: 2.1 time: 0.246454 Oct 01 20:55:07.399428 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 736/1434] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:07 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:07.515791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:07.516804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:07.523553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:07.524343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-2f736461-7068-4b32-9c20-3e7937edc259 req-158aafb4-3094-4fea-b7e6-1d3a89630b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12bb9a33-87d3-4429-93d5-2f740d08b463", "tag": "203f0093-826e-4ebf-8795-aeac2a7fda5f"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:07.524788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:07.525603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:07.526585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:07.527272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:07.527939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:07.535508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2f736461-7068-4b32-9c20-3e7937edc259 req-158aafb4-3094-4fea-b7e6-1d3a89630b26 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:07.536231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2f736461-7068-4b32-9c20-3e7937edc259 req-158aafb4-3094-4fea-b7e6-1d3a89630b26 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:07.536733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2f736461-7068-4b32-9c20-3e7937edc259 req-158aafb4-3094-4fea-b7e6-1d3a89630b26 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:07.549454 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-2f736461-7068-4b32-9c20-3e7937edc259 req-158aafb4-3094-4fea-b7e6-1d3a89630b26 service nova] Creating event network-changed:203f0093-826e-4ebf-8795-aeac2a7fda5f for instance 12bb9a33-87d3-4429-93d5-2f740d08b463 on nch1-master-1 Oct 01 20:55:07.554630 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-2f736461-7068-4b32-9c20-3e7937edc259 req-158aafb4-3094-4fea-b7e6-1d3a89630b26 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034935 Oct 01 20:55:07.555657 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 737/1435] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:07.578694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:07.579823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:07.586892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:07.587968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:07.588648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:07.589601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:07.590252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:07.590943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:08.349460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:08.359409 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0378cfa-7951-4619-9707-334a05c0fe3e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1465 microversion: 2.1 time: 0.848897 Oct 01 20:55:08.360994 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 699/1436] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:07 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1465 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:08.366864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:08.367777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:08.376899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:08.377686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:08.379027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:08.380090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:08.380784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:08.381465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:08.403307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:08.416341 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2c3eba0e-420b-4b7d-bb55-3d2b96fe2b8b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1473 microversion: 2.1 time: 0.841542 Oct 01 20:55:08.435243 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 738/1437] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:07 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1473 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:08.440918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:08.441674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:08.448232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:08.449080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:08.449638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:08.450585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:08.451138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:08.451675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.050851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:09.063151 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0812e0bc-e0ae-419b-a7f0-ceb97f92d61c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1708 microversion: 2.1 time: 0.700732 Oct 01 20:55:09.064750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 700/1438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:08 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1708 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:09.070596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:09.071500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:09.079253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.080332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.081111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.082330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.083342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.084166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.092474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:09.130968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:09.140831 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-44105d03-0589-4d23-86cf-a1a22bd00536 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1487 microversion: 2.1 time: 0.704167 Oct 01 20:55:09.158459 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 739/1439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:08 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1487 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:09.170275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1b769042-e632-4fe1-bbed-98027bc99d51 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:09.171203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1b769042-e632-4fe1-bbed-98027bc99d51 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:09.177940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b769042-e632-4fe1-bbed-98027bc99d51 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.178798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b769042-e632-4fe1-bbed-98027bc99d51 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.179412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b769042-e632-4fe1-bbed-98027bc99d51 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.180311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b769042-e632-4fe1-bbed-98027bc99d51 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.180941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b769042-e632-4fe1-bbed-98027bc99d51 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.181541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b769042-e632-4fe1-bbed-98027bc99d51 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.391091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:09.407359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:09.409399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:09.410544 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e4ec6969-c436-4edb-bb1f-b8ed1730a540 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 200 len: 1265 microversion: 2.25 time: 0.344586 Oct 01 20:55:09.411440 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 701/1440] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:09 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:09.416397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:09.417981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:09.424756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.425859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.426305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.429953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.430971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.431888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.726790 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1b769042-e632-4fe1-bbed-98027bc99d51 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1616 microversion: 2.1 time: 0.567183 Oct 01 20:55:09.727380 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 740/1441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:09 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1616 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:09.731922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ae5942a8-a38f-4505-a8af-dbd2d8c7401a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '.version_select at 0x7f41737bbe50>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:09.735407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae5942a8-a38f-4505-a8af-dbd2d8c7401a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.735901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae5942a8-a38f-4505-a8af-dbd2d8c7401a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.736340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae5942a8-a38f-4505-a8af-dbd2d8c7401a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.753085 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ae5942a8-a38f-4505-a8af-dbd2d8c7401a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 3889 microversion: 2.1 time: 0.024426 Oct 01 20:55:09.755075 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 741/1442] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:55:09 2022] GET /compute/v2.1/os-migrations => generated 3889 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:09.762004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-24586077", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:09.819550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:09.836359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] validate_networks() for [('ccf65e83-da30-4831-845a-74261cf0c33e', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:09.846139 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-300c3d94-cb17-45f6-8d71-4457716afbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1308 microversion: 2.1 time: 0.433510 Oct 01 20:55:09.864124 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 702/1443] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:09 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:09.871620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5971098f-beac-4a2c-a39c-157271cbbeb9 req-3900b260-a08e-4169-9005-98f6c19fea0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b894bd4e-ce19-41b9-81ee-64786805990e", "name": "network-vif-deleted", "tag": "ddea4550-4948-4507-8a91-c65d3ab874a0"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:09.884025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5971098f-beac-4a2c-a39c-157271cbbeb9 req-3900b260-a08e-4169-9005-98f6c19fea0f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.884972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5971098f-beac-4a2c-a39c-157271cbbeb9 req-3900b260-a08e-4169-9005-98f6c19fea0f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.886142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5971098f-beac-4a2c-a39c-157271cbbeb9 req-3900b260-a08e-4169-9005-98f6c19fea0f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.900192 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5971098f-beac-4a2c-a39c-157271cbbeb9 req-3900b260-a08e-4169-9005-98f6c19fea0f service nova] Creating event network-vif-deleted:ddea4550-4948-4507-8a91-c65d3ab874a0 for instance b894bd4e-ce19-41b9-81ee-64786805990e on nch1-master-1 Oct 01 20:55:09.907546 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5971098f-beac-4a2c-a39c-157271cbbeb9 req-3900b260-a08e-4169-9005-98f6c19fea0f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041833 Oct 01 20:55:09.911684 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 703/1444] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:09.917409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:09.918415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:09.926703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.927503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.928159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:09.929122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:09.929792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:09.930567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:10.403201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:10.423503 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2636ea9e-eef5-43ed-aa6c-a247b13e45fb tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1470 microversion: 2.1 time: 0.510432 Oct 01 20:55:10.435438 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 704/1445] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:09 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1470 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:10.447817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e598885d-7b75-4cc4-a696-caf9d1df2e22 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:10.450422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e598885d-7b75-4cc4-a696-caf9d1df2e22 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:10.462165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e598885d-7b75-4cc4-a696-caf9d1df2e22 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:10.462725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e598885d-7b75-4cc4-a696-caf9d1df2e22 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:10.463175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e598885d-7b75-4cc4-a696-caf9d1df2e22 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:10.465939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e598885d-7b75-4cc4-a696-caf9d1df2e22 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:10.466719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e598885d-7b75-4cc4-a696-caf9d1df2e22 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:10.467165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e598885d-7b75-4cc4-a696-caf9d1df2e22 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:10.696496 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e598885d-7b75-4cc4-a696-caf9d1df2e22 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1859 microversion: 2.1 time: 0.268692 Oct 01 20:55:10.697719 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 705/1446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:10 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1859 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:10.703786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1978710882", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8c51efc3-f63a-4767-a6b1-ea93db136447"]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:10.763923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:11.008901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:11.009401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:11.009872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:11.010294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:11.011335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:11.037553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.038393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.038872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:11.047460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.048370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.049007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:11.081695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Getting quotas for project bcaab3f0817043c682737e94bb1dd1ac. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:11.091317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Getting quotas for user 725f68beba264c2eafc951f8300eba32 and project bcaab3f0817043c682737e94bb1dd1ac. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:11.107396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:55:11.109769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:55:11.123100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:11.124011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:11.124711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:11.125459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:11.126093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:11.134111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=19 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:11.138465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.139097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.148042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:11.149227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.149923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.150637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:11.161694 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-158e04a8-3b78-450e-a6a7-184c1f895226 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.405057 Oct 01 20:55:11.163345 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 742/1447] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:55:11.198446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:11.205420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:11.223510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:55:11.227338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:55:11.316429 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20b4f2dd-c53d-4848-af80-f8a4f84f6114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616858 Oct 01 20:55:11.319824 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 706/1448] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:55:11.339149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:11.339908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: b894bd4e-ce19-41b9-81ee-64786805990e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:11.351515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.351913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.352411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:11.353064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.353528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.353964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:11.379398 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] HTTP exception thrown: Instance b894bd4e-ce19-41b9-81ee-64786805990e could not be found. Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Request method failure captured: Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e HTTP/1.1 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfsmSqk7h9SKTDD74WbGPmwsUze9ym9OvIHY0vsNq0esXi_yfXtSkRfVgy3wtmKd5FIO3O7fYJJzzurbExhL4y-qoOqVzxsJm8layhI3EK3twBBsEWsg0j8jyZxrRHR4HplNxJTA87TlYmYzV5tT2QwwgzFxUTxT6geIX2juDlhnMc Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.25 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 76e0a9843d9c41f7b2fae591dc09d9d2 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76e0a9843d9c41f7b2fae591dc09d9d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76e0a9843d9c41f7b2fae591dc09d9d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76e0a9843d9c41f7b2fae591dc09d9d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76e0a9843d9c41f7b2fae591dc09d9d2"}]}] Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 76e0a9843d9c41f7b2fae591dc09d9d2 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveAutoBlockMigrationV225Test-121044104-project Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa72870453cd4b958725801b842c7a28 Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-121044104-project Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance b894bd4e-ce19-41b9-81ee-64786805990e could not be found. Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'b894bd4e-ce19-41b9-81ee-64786805990e'} Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b894bd4e-ce19-41b9-81ee-64786805990e could not be found. Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b894bd4e-ce19-41b9-81ee-64786805990e could not be found. Oct 01 20:55:11.384401 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b894bd4e-ce19-41b9-81ee-64786805990e could not be found. Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Returning 404 to user: Instance b894bd4e-ce19-41b9-81ee-64786805990e could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a4cbf8c-e9a2-42f2-a712-3d2df2741c43 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e" status: 404 len: 111 microversion: 2.25 time: 0.065738 Oct 01 20:55:11.393573 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 707/1449] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:11 2022] GET /compute/v2.1/servers/b894bd4e-ce19-41b9-81ee-64786805990e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:55:11.398090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4957e3f-e80a-4d2e-a6e0-352d1f884049 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:11.405021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b4957e3f-e80a-4d2e-a6e0-352d1f884049 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:11.413171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4957e3f-e80a-4d2e-a6e0-352d1f884049 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.413676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4957e3f-e80a-4d2e-a6e0-352d1f884049 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.414123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4957e3f-e80a-4d2e-a6e0-352d1f884049 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:11.414893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4957e3f-e80a-4d2e-a6e0-352d1f884049 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.415356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4957e3f-e80a-4d2e-a6e0-352d1f884049 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.415791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4957e3f-e80a-4d2e-a6e0-352d1f884049 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:11.505987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-60364902", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "39955cfa-7a80-488f-8df9-09e26d18ed91"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:11.607158 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4957e3f-e80a-4d2e-a6e0-352d1f884049 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "POST /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e/action" status: 202 len: 0 microversion: 2.1 time: 0.213119 Oct 01 20:55:11.610966 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 708/1450] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:55:11 2022] POST /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:55:11.612210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] validate_networks() for [('39955cfa-7a80-488f-8df9-09e26d18ed91', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:11.621897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cecf68ce-3260-42a8-88df-24a3b8b0a321 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:11.623959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cecf68ce-3260-42a8-88df-24a3b8b0a321 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:11.641326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecf68ce-3260-42a8-88df-24a3b8b0a321 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.642191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecf68ce-3260-42a8-88df-24a3b8b0a321 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.643616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecf68ce-3260-42a8-88df-24a3b8b0a321 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:11.645624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecf68ce-3260-42a8-88df-24a3b8b0a321 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:11.646902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecf68ce-3260-42a8-88df-24a3b8b0a321 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:11.647873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecf68ce-3260-42a8-88df-24a3b8b0a321 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:12.135485 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cecf68ce-3260-42a8-88df-24a3b8b0a321 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1859 microversion: 2.1 time: 0.519382 Oct 01 20:55:12.137134 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 709/1451] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:11 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1859 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:12.157895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:12.165396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:12.195186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:12.197334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:12.197943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:12.200890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:12.201501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:12.203367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:12.639533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:12.648587 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4061f94a-f072-405d-bd08-fa49bfca44fd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1308 microversion: 2.1 time: 0.510091 Oct 01 20:55:12.664914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 710/1452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:12 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1308 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:12.674538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:12.675676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:12.698352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:12.703287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:12.706352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:12.707357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:12.708295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:12.708898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:12.723959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:12.724459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:12.724851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:12.725502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:12.726138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:12.746976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:12.747398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:12.747849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:12.748634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:12.753132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:12.753588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:12.809941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:12.828754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Getting quotas for project 0edc386b86af4e77bcc8e6663b966c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:12.835798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:12.841661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Getting quotas for user 7d21433c5d434e6f85d17aad6e21f4f0 and project 0edc386b86af4e77bcc8e6663b966c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:12.867293 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6d19f4be-ee15-4c88-8686-94e5d2ad40d9 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1264 microversion: 2.1 time: 0.198241 Oct 01 20:55:12.868699 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 711/1453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:12 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:12.882013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:12.882698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:12.894003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:55:12.896118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:55:12.905519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:12.906024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:12.909033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:12.909976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:12.910640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:12.911297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:12.997420 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2779cf7c-dcd0-40fe-8123-178baf8bacc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831030 Oct 01 20:55:13.013616 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 743/1454] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:55:13.046434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:13.047087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:13.056344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:13.058420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:13.058913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:13.060148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:13.060774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:13.061463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:13.435716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:13.448520 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef35cb69-0b90-47fc-8fc4-64ada7927f77 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1269 microversion: 2.1 time: 0.575908 Oct 01 20:55:13.449738 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 712/1455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:12 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1269 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:13.455952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:13.456699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:13.470220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:13.474771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:13.475781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:13.479471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:13.480204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:13.480842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:13.711768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lazy-loading 'services' on Instance uuid bed59d2f-d270-4882-b32b-89be0dedc71f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:13.837947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:13.850216 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d77838f5-5361-489c-bae5-8f581d1b8197 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1469 microversion: 2.1 time: 0.834094 Oct 01 20:55:13.851390 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 744/1456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:13 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1469 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:13.880681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:13.881719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:13.890749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:13.891913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:13.892528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:13.894749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:13.896956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:13.897405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:13.921513 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21e96521-8837-4c40-8e1f-ec62547b9596 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-volume_attachments/f83c038c-0838-41d4-b421-20d53a0dec11" status: 202 len: 0 microversion: 2.1 time: 0.469820 Oct 01 20:55:13.922385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 713/1457] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 20:55:13 2022] DELETE /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-volume_attachments/f83c038c-0838-41d4-b421-20d53a0dec11 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:55:13.935331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-482105845", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "39955cfa-7a80-488f-8df9-09e26d18ed91"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:13.957253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:14.028998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] validate_networks() for [('39955cfa-7a80-488f-8df9-09e26d18ed91', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:14.121999 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-886e8260-4ac1-4f37-a149-b3e6cac41cf1 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 204 len: 0 microversion: 2.25 time: 0.269094 Oct 01 20:55:14.123025 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 745/1458] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:55:13 2022] DELETE /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:55:14.130117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-36f06ab1-40d3-48ab-8950-80d5b73fbbc3 req-095ec5d0-e79e-47a3-b4ee-33447f2f2de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e", "name": "network-vif-plugged", "status": "completed", "tag": "9b68231b-ea01-4f80-9d40-3d0180818f18"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:14.145911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-36f06ab1-40d3-48ab-8950-80d5b73fbbc3 req-095ec5d0-e79e-47a3-b4ee-33447f2f2de3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:14.148356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-36f06ab1-40d3-48ab-8950-80d5b73fbbc3 req-095ec5d0-e79e-47a3-b4ee-33447f2f2de3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:14.149008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-36f06ab1-40d3-48ab-8950-80d5b73fbbc3 req-095ec5d0-e79e-47a3-b4ee-33447f2f2de3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:14.181667 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-36f06ab1-40d3-48ab-8950-80d5b73fbbc3 req-095ec5d0-e79e-47a3-b4ee-33447f2f2de3 service nova] Creating event network-vif-plugged:9b68231b-ea01-4f80-9d40-3d0180818f18 for instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e on nch2-master-1 Oct 01 20:55:14.193106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-36f06ab1-40d3-48ab-8950-80d5b73fbbc3 req-095ec5d0-e79e-47a3-b4ee-33447f2f2de3 service nova] Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:55:14.212005 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-36f06ab1-40d3-48ab-8950-80d5b73fbbc3 req-095ec5d0-e79e-47a3-b4ee-33447f2f2de3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087039 Oct 01 20:55:14.213263 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 746/1459] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:14.219212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:14.220757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:14.227430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:14.228153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:14.228835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:14.231172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:14.231874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:14.232468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:14.661889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:14.670107 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-afdc81de-bb6d-41c8-ae45-07383d7d7ded tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1308 microversion: 2.1 time: 0.455375 Oct 01 20:55:14.696551 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 747/1460] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:14 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:14.702111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:14.702758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:14.728101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:14.728613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:14.729253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:14.730215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:14.730774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:14.731201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:14.892570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:14.905086 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe60a23e-0012-467d-8b30-1b36aa83369c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1270 microversion: 2.1 time: 0.207259 Oct 01 20:55:14.906420 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 748/1461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:14 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1270 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:14.922981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3a93518d-94b0-44ce-9ba3-4df92d15c2af tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:14.928007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3a93518d-94b0-44ce-9ba3-4df92d15c2af tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:14.941907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a93518d-94b0-44ce-9ba3-4df92d15c2af tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:14.942409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a93518d-94b0-44ce-9ba3-4df92d15c2af tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:14.945148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a93518d-94b0-44ce-9ba3-4df92d15c2af tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:14.946631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a93518d-94b0-44ce-9ba3-4df92d15c2af tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:14.947300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a93518d-94b0-44ce-9ba3-4df92d15c2af tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:14.947905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a93518d-94b0-44ce-9ba3-4df92d15c2af tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:14.983587 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3a93518d-94b0-44ce-9ba3-4df92d15c2af tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075835 Oct 01 20:55:14.985405 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 749/1462] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 20:55:14 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:14.990938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:14.991573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:14.998867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:14.999712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.000527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:15.001528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:15.002169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.002812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:15.009694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:15.010907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:15.011377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:15.011787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:15.012202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:15.028214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:15.028705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.029337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:15.030246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:15.035267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.035971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:15.080651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Getting quotas for project 0edc386b86af4e77bcc8e6663b966c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:15.087671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Getting quotas for user 7d21433c5d434e6f85d17aad6e21f4f0 and project 0edc386b86af4e77bcc8e6663b966c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:15.110227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:55:15.113293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:55:15.255507 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-10473705-511b-4f59-86d4-df76e63189b5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330940 Oct 01 20:55:15.256482 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 714/1463] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:55:15.278431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:15.285176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:15.303023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:15.305569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.306374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:15.309507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:15.310278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.313894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:15.364353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:15.375929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:15.380320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:15.387871 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dfa95f9d-384c-4395-9d5b-4602413cb45e tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1730 microversion: 2.25 time: 0.400900 Oct 01 20:55:15.391739 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 750/1464] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:14 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1730 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:15.404233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:15.404860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:15.421524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:15.422866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.425521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:15.431132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:15.432954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.434213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:15.784260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:15.793050 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eba224a1-561f-4129-a12c-c4d939aed3f9 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1317 microversion: 2.1 time: 0.535236 Oct 01 20:55:15.793666 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 715/1465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:15 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:15.802727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1858992145", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "451", "networks": [{"uuid": "39955cfa-7a80-488f-8df9-09e26d18ed91"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:15.850842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:15.868040 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-15dfda2d-bff9-42de-aeb9-09de1eb03ee9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1469 microversion: 2.1 time: 0.475100 Oct 01 20:55:15.895413 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 751/1466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:15 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1469 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:15.899844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] validate_networks() for [('39955cfa-7a80-488f-8df9-09e26d18ed91', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:15.905669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:15.907744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:15.921003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:15.921496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.921958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:15.924050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:15.925661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:15.928915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:16.629978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:16.660197 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3ff9879e-ebab-4824-88d3-fee33f3d52ff tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1308 microversion: 2.1 time: 0.760783 Oct 01 20:55:16.668261 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 752/1467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:15 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1308 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:16.693364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:16.702608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:16.712158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:16.713057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:16.718575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:16.720759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:16.721477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:16.722143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:17.639596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:17.649056 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cdf89e63-7fd2-4cfc-b77f-9fbb8f0fe865 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.979169 Oct 01 20:55:17.664403 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 753/1468] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:16 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:17.664403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-894a1d2f-8f79-43aa-8e31-2617f1c23c89 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:17.664403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-894a1d2f-8f79-43aa-8e31-2617f1c23c89 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:17.671186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-894a1d2f-8f79-43aa-8e31-2617f1c23c89 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:17.672013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-894a1d2f-8f79-43aa-8e31-2617f1c23c89 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:17.672771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-894a1d2f-8f79-43aa-8e31-2617f1c23c89 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:17.673182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-894a1d2f-8f79-43aa-8e31-2617f1c23c89 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:17.673649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-894a1d2f-8f79-43aa-8e31-2617f1c23c89 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:17.674085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-894a1d2f-8f79-43aa-8e31-2617f1c23c89 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:17.723631 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-894a1d2f-8f79-43aa-8e31-2617f1c23c89 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071656 Oct 01 20:55:17.724228 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 754/1469] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 20:55:17 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:55:17.730633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:17.731383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:17.738536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:17.739033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:17.739471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:17.740176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:17.740630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:17.741054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:18.016950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:18.017448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:18.018036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:18.018451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:18.018954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:18.033541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:18.034091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:18.034923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:18.035922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:18.036524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:18.037094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:18.047882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=13 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:18.060994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Getting quotas for project 0edc386b86af4e77bcc8e6663b966c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:18.067698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Getting quotas for user 7d21433c5d434e6f85d17aad6e21f4f0 and project 0edc386b86af4e77bcc8e6663b966c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:18.083263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:55:18.085601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:55:18.143639 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94c3491e-b0d9-4492-8fb1-c270815849b6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.348860 Oct 01 20:55:18.145266 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 716/1470] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:55:18.168897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-24d473e3-5a7a-4bc9-96b4-065dbd59e8db req-474899d7-4ceb-4ec4-b7e1-8f4224c2847b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bb9a33-87d3-4429-93d5-2f740d08b463", "name": "network-vif-plugged", "status": "completed", "tag": "203f0093-826e-4ebf-8795-aeac2a7fda5f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:18.180557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-24d473e3-5a7a-4bc9-96b4-065dbd59e8db req-474899d7-4ceb-4ec4-b7e1-8f4224c2847b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:18.181315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-24d473e3-5a7a-4bc9-96b4-065dbd59e8db req-474899d7-4ceb-4ec4-b7e1-8f4224c2847b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:18.182549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-24d473e3-5a7a-4bc9-96b4-065dbd59e8db req-474899d7-4ceb-4ec4-b7e1-8f4224c2847b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:18.205501 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-24d473e3-5a7a-4bc9-96b4-065dbd59e8db req-474899d7-4ceb-4ec4-b7e1-8f4224c2847b service nova] Creating event network-vif-plugged:203f0093-826e-4ebf-8795-aeac2a7fda5f for instance 12bb9a33-87d3-4429-93d5-2f740d08b463 on nch1-master-1 Oct 01 20:55:18.214863 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-24d473e3-5a7a-4bc9-96b4-065dbd59e8db req-474899d7-4ceb-4ec4-b7e1-8f4224c2847b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066640 Oct 01 20:55:18.216992 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 717/1471] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:18.227286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7f4fcfef-decc-44de-a748-1c37fbfd4148 req-133b2de6-9926-45cf-ac42-6083399d25de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae12c3c-6253-4d5b-8317-6cbb995e1249", "tag": "76ff29a6-64b9-4b28-be9e-a4d576ded38c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:18.266811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7f4fcfef-decc-44de-a748-1c37fbfd4148 req-133b2de6-9926-45cf-ac42-6083399d25de service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:18.267787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7f4fcfef-decc-44de-a748-1c37fbfd4148 req-133b2de6-9926-45cf-ac42-6083399d25de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:18.270161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7f4fcfef-decc-44de-a748-1c37fbfd4148 req-133b2de6-9926-45cf-ac42-6083399d25de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:18.312134 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7f4fcfef-decc-44de-a748-1c37fbfd4148 req-133b2de6-9926-45cf-ac42-6083399d25de service nova] Creating event network-changed:76ff29a6-64b9-4b28-be9e-a4d576ded38c for instance 2ae12c3c-6253-4d5b-8317-6cbb995e1249 on nch2-master-1 Oct 01 20:55:18.325082 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7f4fcfef-decc-44de-a748-1c37fbfd4148 req-133b2de6-9926-45cf-ac42-6083399d25de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104501 Oct 01 20:55:18.329357 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 718/1472] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:18.343823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:18.344981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:18.359997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:18.360510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:18.360958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:18.366722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:18.367221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:18.367667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:18.410989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:18.423949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:18.425336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:18.426586 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-24cb0a3f-5911-484d-ae0c-16e90041c870 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1730 microversion: 2.25 time: 0.700829 Oct 01 20:55:18.427154 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 755/1473] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:17 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1730 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:18.439986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:18.439986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:18.464170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:18.476021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:18.476370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:18.477140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:18.477838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:18.478035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:19.159402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:19.172018 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-baf321d7-b7fe-4dff-937a-f93d215a0be4 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1317 microversion: 2.1 time: 0.841194 Oct 01 20:55:19.173540 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 719/1474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:18 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1317 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:19.179482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:19.181234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:19.190564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:19.191923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:19.192375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:19.193919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:19.194589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:19.195234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:19.304762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:19.434413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:19.448198 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-777cd5b8-0a76-48fc-a805-25030185b95c tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1469 microversion: 2.1 time: 1.019334 Oct 01 20:55:19.449487 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 756/1475] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:18 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1469 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:19.456052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:19.456872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:19.465084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:19.465823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:19.466446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:19.467328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:19.467950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:19.468538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:19.647782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:19.661124 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2c344013-1bd5-4c3e-8b5c-7e4efd21fdae tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1273 microversion: 2.1 time: 0.208716 Oct 01 20:55:19.663060 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 757/1476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:19 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:19.677616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:19.682438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:19.710341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:19.711020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:19.711816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:19.712869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:19.714145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:19.715031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:19.939200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:19.948792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fcb6eb6d-ba21-4fba-9d85-5d6803814390 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1308 microversion: 2.1 time: 0.773988 Oct 01 20:55:19.963954 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 720/1477] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:19 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1308 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:19.970765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:19.983239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:19.996124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:19.997973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:19.999583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:20.000875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:20.002115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:20.003419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:20.460834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:20.484703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:20.487226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:20.488578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-28820600-ce07-4bb5-b244-479a8a487c49 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1662 microversion: 2.25 time: 0.523274 Oct 01 20:55:20.490190 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 721/1478] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:19 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1662 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:20.504849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:20.506765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:20.528010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:20.528672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:20.529572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:20.533209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:20.533861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:20.536214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:20.755749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:20.771033 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6a0789d4-f70f-4273-b04f-e1eb625373cd tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 1.105969 Oct 01 20:55:20.773109 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 758/1479] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:19 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:20.778128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ff99fa15-5dfc-48c0-9c62-a30164bf3a23 req-16044324-ddf4-4ece-855b-e275c840d93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4330370d-f790-40ef-aee0-b29ac848085e", "tag": "4031bbc7-099f-4d64-8e12-e38da43acc75"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:20.790460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ff99fa15-5dfc-48c0-9c62-a30164bf3a23 req-16044324-ddf4-4ece-855b-e275c840d93f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:20.791318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ff99fa15-5dfc-48c0-9c62-a30164bf3a23 req-16044324-ddf4-4ece-855b-e275c840d93f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:20.792017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ff99fa15-5dfc-48c0-9c62-a30164bf3a23 req-16044324-ddf4-4ece-855b-e275c840d93f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:20.796951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:20.816511 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ff99fa15-5dfc-48c0-9c62-a30164bf3a23 req-16044324-ddf4-4ece-855b-e275c840d93f service nova] Creating event network-changed:4031bbc7-099f-4d64-8e12-e38da43acc75 for instance 4330370d-f790-40ef-aee0-b29ac848085e on nch1-master-1 Oct 01 20:55:20.824874 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ff99fa15-5dfc-48c0-9c62-a30164bf3a23 req-16044324-ddf4-4ece-855b-e275c840d93f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048054 Oct 01 20:55:20.825828 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 759/1480] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:20.834220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-cf737e8f-c748-414a-bcc2-cce7b8d44744 req-f8231c79-01d8-433f-9764-a5ec9a9a8501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e", "name": "network-vif-unplugged", "status": "completed", "tag": "9b68231b-ea01-4f80-9d40-3d0180818f18"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:20.847014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cf737e8f-c748-414a-bcc2-cce7b8d44744 req-f8231c79-01d8-433f-9764-a5ec9a9a8501 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:20.848066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cf737e8f-c748-414a-bcc2-cce7b8d44744 req-f8231c79-01d8-433f-9764-a5ec9a9a8501 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:20.848858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cf737e8f-c748-414a-bcc2-cce7b8d44744 req-f8231c79-01d8-433f-9764-a5ec9a9a8501 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:20.866958 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-cf737e8f-c748-414a-bcc2-cce7b8d44744 req-f8231c79-01d8-433f-9764-a5ec9a9a8501 service nova] Creating event network-vif-unplugged:9b68231b-ea01-4f80-9d40-3d0180818f18 for instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e on nch1-master-1 Oct 01 20:55:20.873948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-cf737e8f-c748-414a-bcc2-cce7b8d44744 req-f8231c79-01d8-433f-9764-a5ec9a9a8501 service nova] Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:55:20.885998 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-cf737e8f-c748-414a-bcc2-cce7b8d44744 req-f8231c79-01d8-433f-9764-a5ec9a9a8501 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056736 Oct 01 20:55:20.886872 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 760/1481] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:20.893595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:20.894472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:20.901006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:20.901576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:20.902640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:20.903646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:20.904269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:20.904701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:21.221123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:21.230526 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a14f357a-4d55-4b6f-a0cb-189bc72e93e6 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1317 microversion: 2.1 time: 0.737411 Oct 01 20:55:21.231110 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 722/1482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:20 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1317 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:21.246336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:21.248711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:21.250817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:21.256287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:21.256774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:21.257425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:21.258166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:21.258667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:21.259092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:21.416970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:21.428020 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95498ea3-a4c0-48fe-b0ec-ab34b33e92e0 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1279 microversion: 2.1 time: 0.188098 Oct 01 20:55:21.428717 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 723/1483] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:21 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:21.435241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-708758879", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e7712b88-b266-47cd-9f95-cfb0ee26fa9f"}], "block_device_mapping_v2": [{"uuid": "bae2c97c-a30a-424b-bc18-c9977d768266", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:21.483984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:21.493806 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dd505a6e-fb7d-46f3-8565-a767c1984da0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1469 microversion: 2.1 time: 0.605420 Oct 01 20:55:21.494885 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 761/1484] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:20 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1469 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:21.506815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:21.507669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:21.516264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:21.517058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:21.517740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:21.519494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:21.520165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:21.521069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:21.527129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] validate_networks() for [('e7712b88-b266-47cd-9f95-cfb0ee26fa9f', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:22.000177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:22.018539 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a5e72620-f13b-41a4-8208-1cf07da69c40 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1486 microversion: 2.1 time: 0.522307 Oct 01 20:55:22.019841 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 762/1485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:21 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1486 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:22.025704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:22.026675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:22.035576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:22.036400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:22.037545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:22.039078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:22.039799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:22.040480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:22.146132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:22.146963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:22.147718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:22.148752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lazy-loading 'fault' on Instance uuid ee54a04f-6360-4f81-a7ba-68d65e8d8d36 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:22.320559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:22.333892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:22.335888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:22.337415 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-77cbb037-b3c5-476c-891b-92098aff4402 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 200 len: 1374 microversion: 2.25 time: 0.316323 Oct 01 20:55:22.338576 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 763/1486] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:22 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 1374 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:22.343773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:22.344705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:22.351827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:22.352663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:22.354336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:22.355491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:22.356203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:22.357068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:22.789898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:22.823523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:22.833871 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4adaba07-f494-452b-91ff-7430fba9be12 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.493513 Oct 01 20:55:22.835024 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 764/1487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:22 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:22.842821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6ca8bf2f-8c34-4004-8cf9-ab53a991abb6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:22.862768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ca8bf2f-8c34-4004-8cf9-ab53a991abb6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:22.863898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ca8bf2f-8c34-4004-8cf9-ab53a991abb6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:22.864767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ca8bf2f-8c34-4004-8cf9-ab53a991abb6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:22.911397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=16 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:22.958738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ca8bf2f-8c34-4004-8cf9-ab53a991abb6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Going to try to stop instance {{(pid=140437) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 20:55:23.034526 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6ca8bf2f-8c34-4004-8cf9-ab53a991abb6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463/action" status: 202 len: 0 microversion: 2.1 time: 0.198005 Oct 01 20:55:23.035969 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 765/1488] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:55:22 2022] POST /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:55:23.042875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:23.043990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:23.053061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:23.053646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:23.054177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:23.055291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:23.055782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:23.056234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:23.637163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:23.638273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:23.638981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:23.640054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:23.640485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:23.659828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:23.660363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:23.660806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:23.661559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:23.662067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:23.662519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:23.680296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for project 237c6bad691343e7a7e64304f55e01e9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:23.686120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Getting quotas for user a749a74841e840e2b8de67fb9562bf51 and project 237c6bad691343e7a7e64304f55e01e9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:23.691425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:23.708351 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-af9334b0-4c66-4085-a936-2b0ece7f5ae2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1317 microversion: 2.1 time: 0.670851 Oct 01 20:55:23.725882 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 766/1489] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:23 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:23.735616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:23.736455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:23.744819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:23.745603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:23.747587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:23.748555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:23.749221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:23.749876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:23.776558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:55:23.778691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bae2c97c-a30a-424b-bc18-c9977d768266',volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:55:23.941191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:23.947162 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a437d746-c0d7-49a8-8cb2-4547492dccd4 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.517178 Oct 01 20:55:23.948825 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 724/1490] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:55:23.953913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:23.955364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:23.963141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:23.963880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:23.964486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:23.965017 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8a8f96a9-a406-4fa8-aefc-1efb1e8592a4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1321 microversion: 2.1 time: 0.235487 Oct 01 20:55:23.979022 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 767/1491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:23 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:23.979022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-48fe0d68-9d38-4dc0-a1ec-ebbc964fe864 req-1e96ec2e-b497-4f31-841d-38aa3a9bda7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15da01e-ab80-469b-bec2-63336c26cf11", "tag": "09809c55-101d-4f60-a1c1-2816a5dd97d8"}, {"server_uuid": "ee54a04f-6360-4f81-a7ba-68d65e8d8d36", "name": "network-vif-deleted", "tag": "6c19a1ab-152a-407c-bec3-017d592a748b"}, {"name": "network-changed", "server_uuid": "5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e", "tag": "9b68231b-ea01-4f80-9d40-3d0180818f18"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:23.979852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:23.980718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:23.981330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:23.992209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-48fe0d68-9d38-4dc0-a1ec-ebbc964fe864 req-1e96ec2e-b497-4f31-841d-38aa3a9bda7d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:23.992708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-48fe0d68-9d38-4dc0-a1ec-ebbc964fe864 req-1e96ec2e-b497-4f31-841d-38aa3a9bda7d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:23.993199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-48fe0d68-9d38-4dc0-a1ec-ebbc964fe864 req-1e96ec2e-b497-4f31-841d-38aa3a9bda7d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.017810 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-48fe0d68-9d38-4dc0-a1ec-ebbc964fe864 req-1e96ec2e-b497-4f31-841d-38aa3a9bda7d service nova] Creating event network-changed:09809c55-101d-4f60-a1c1-2816a5dd97d8 for instance e15da01e-ab80-469b-bec2-63336c26cf11 on nch1-master-1 Oct 01 20:55:24.018336 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-48fe0d68-9d38-4dc0-a1ec-ebbc964fe864 req-1e96ec2e-b497-4f31-841d-38aa3a9bda7d service nova] Creating event network-vif-deleted:6c19a1ab-152a-407c-bec3-017d592a748b for instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 on nch2-master-1 Oct 01 20:55:24.018865 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-48fe0d68-9d38-4dc0-a1ec-ebbc964fe864 req-1e96ec2e-b497-4f31-841d-38aa3a9bda7d service nova] Creating event network-changed:9b68231b-ea01-4f80-9d40-3d0180818f18 for instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e on nch1-master-1 Oct 01 20:55:24.033639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-48fe0d68-9d38-4dc0-a1ec-ebbc964fe864 req-1e96ec2e-b497-4f31-841d-38aa3a9bda7d service nova] Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 20:55:24.059994 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-48fe0d68-9d38-4dc0-a1ec-ebbc964fe864 req-1e96ec2e-b497-4f31-841d-38aa3a9bda7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.090601 Oct 01 20:55:24.061474 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 768/1492] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:24.072691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:24.073408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:24.075950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:24.088006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.088589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.089032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.089747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.092205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.092919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.298358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:24.306288 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-18d257cd-15b5-4132-977e-1737b9b668ef tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1469 microversion: 2.1 time: 0.356224 Oct 01 20:55:24.307415 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 725/1493] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:23 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:24.335091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:24.336088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: ee54a04f-6360-4f81-a7ba-68d65e8d8d36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:24.358951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.359418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.360105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.361048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.361607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.362189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.383365 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] HTTP exception thrown: Instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 could not be found. Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Request method failure captured: Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 HTTP/1.1 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfsmSqk7h9SKTDD74WbGPmwsUze9ym9OvIHY0vsNq0esXi_yfXtSkRfVgy3wtmKd5FIO3O7fYJJzzurbExhL4y-qoOqVzxsJm8layhI3EK3twBBsEWsg0j8jyZxrRHR4HplNxJTA87TlYmYzV5tT2QwwgzFxUTxT6geIX2juDlhnMc Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.25 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 76e0a9843d9c41f7b2fae591dc09d9d2 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76e0a9843d9c41f7b2fae591dc09d9d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76e0a9843d9c41f7b2fae591dc09d9d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76e0a9843d9c41f7b2fae591dc09d9d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76e0a9843d9c41f7b2fae591dc09d9d2"}]}] Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 76e0a9843d9c41f7b2fae591dc09d9d2 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveAutoBlockMigrationV225Test-121044104-project Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa72870453cd4b958725801b842c7a28 Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-121044104-project Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 could not be found. Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'ee54a04f-6360-4f81-a7ba-68d65e8d8d36'} Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 could not be found. Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 could not be found. Oct 01 20:55:24.385996 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 could not be found. Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Returning 404 to user: Instance ee54a04f-6360-4f81-a7ba-68d65e8d8d36 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e4b343b-5553-4fb3-a2cb-d0a3ba5836d2 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36" status: 404 len: 111 microversion: 2.25 time: 0.059640 Oct 01 20:55:24.394304 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 726/1494] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:24 2022] GET /compute/v2.1/servers/ee54a04f-6360-4f81-a7ba-68d65e8d8d36 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:55:24.396710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-25d34e26-a1bd-4946-bc2c-a724e3e22113 req-6e781ff3-2701-40d2-993c-f2daea4d6bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c902159b-1429-495e-b8a7-92092a9b748c", "tag": "43484f86-cf5b-4f54-81ae-51af87ee015f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:24.407113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-25d34e26-a1bd-4946-bc2c-a724e3e22113 req-6e781ff3-2701-40d2-993c-f2daea4d6bc4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.407711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-25d34e26-a1bd-4946-bc2c-a724e3e22113 req-6e781ff3-2701-40d2-993c-f2daea4d6bc4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.408215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-25d34e26-a1bd-4946-bc2c-a724e3e22113 req-6e781ff3-2701-40d2-993c-f2daea4d6bc4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.424001 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-25d34e26-a1bd-4946-bc2c-a724e3e22113 req-6e781ff3-2701-40d2-993c-f2daea4d6bc4 service nova] Creating event network-changed:43484f86-cf5b-4f54-81ae-51af87ee015f for instance c902159b-1429-495e-b8a7-92092a9b748c on nch2-master-1 Oct 01 20:55:24.430192 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-25d34e26-a1bd-4946-bc2c-a724e3e22113 req-6e781ff3-2701-40d2-993c-f2daea4d6bc4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037596 Oct 01 20:55:24.434773 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 727/1495] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:24.440626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:24.441419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:24.449619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.450356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.450907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.451853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.452496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.452922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.460073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:24.468630 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bb1fc1ea-4748-48c0-9089-d12d644f8fbf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.402567 Oct 01 20:55:24.470005 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 769/1496] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:24 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:24.474920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ddf63e40-93fc-48e7-bc70-4a2ebb864526 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:24.475531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ddf63e40-93fc-48e7-bc70-4a2ebb864526 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:24.556200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ddf63e40-93fc-48e7-bc70-4a2ebb864526 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:24.564118 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ddf63e40-93fc-48e7-bc70-4a2ebb864526 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1052 microversion: 2.1 time: 0.092692 Oct 01 20:55:24.570698 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 770/1497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:24 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1052 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:24.570698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f100c445-9fd7-430d-99aa-25fe2d4db104 req-0c620d7d-80c1-4012-9db4-6595d52363aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae12c3c-6253-4d5b-8317-6cbb995e1249", "name": "network-vif-plugged", "status": "completed", "tag": "76ff29a6-64b9-4b28-be9e-a4d576ded38c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:24.580331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f100c445-9fd7-430d-99aa-25fe2d4db104 req-0c620d7d-80c1-4012-9db4-6595d52363aa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.580803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f100c445-9fd7-430d-99aa-25fe2d4db104 req-0c620d7d-80c1-4012-9db4-6595d52363aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.581232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f100c445-9fd7-430d-99aa-25fe2d4db104 req-0c620d7d-80c1-4012-9db4-6595d52363aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.591823 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f100c445-9fd7-430d-99aa-25fe2d4db104 req-0c620d7d-80c1-4012-9db4-6595d52363aa service nova] Creating event network-vif-plugged:76ff29a6-64b9-4b28-be9e-a4d576ded38c for instance 2ae12c3c-6253-4d5b-8317-6cbb995e1249 on nch2-master-1 Oct 01 20:55:24.596589 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f100c445-9fd7-430d-99aa-25fe2d4db104 req-0c620d7d-80c1-4012-9db4-6595d52363aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030450 Oct 01 20:55:24.597189 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 771/1498] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:24.602105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4c24d433-ec53-4090-9171-220bd2709ccd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '.version_select at 0x7f41732d7b80>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:24.622037 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4c24d433-ec53-4090-9171-220bd2709ccd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104867800" status: 204 len: 0 microversion: 2.25 time: 0.023682 Oct 01 20:55:24.623187 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 772/1499] 10.222.0.17 () {60 vars in 1259 bytes} [Sat Oct 1 20:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104867800 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:55:24.632777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:24.641312 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-016ed350-b772-4e73-a2c4-255bdcb6def5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.204853 Oct 01 20:55:24.641312 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 728/1500] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:24 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:24.733638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:24.734371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:24.740500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.740988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.741423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.742114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:24.742594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:24.743045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:24.993312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:24.993936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:25.000038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:25.000526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:25.000964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:25.002027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:25.002135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:25.002539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:25.020410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:25.029144 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-74deb36e-da5c-44d8-ad89-97db37ee62cb tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1317 microversion: 2.1 time: 0.299381 Oct 01 20:55:25.030384 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 773/1501] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:24 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:25.291859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:25.300202 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c09b429-7559-445e-81d9-dd237e799a64 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1321 microversion: 2.1 time: 0.310836 Oct 01 20:55:25.300993 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 729/1502] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:24 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:25.329080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:25.329694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:25.335672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:25.336164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:25.336600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:25.337298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:25.337754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:25.338725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:25.494734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:25.495461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:25.501645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:25.502213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:25.502750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:25.504236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:25.504698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:25.505351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:25.839335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:25.857982 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-18697ab7-e3b6-4c8e-8d95-d04f15953ef9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1469 microversion: 2.1 time: 0.532606 Oct 01 20:55:25.863913 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 774/1503] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:25 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1469 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:25.865788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:25.866420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:25.873231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:25.874067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:25.874924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:25.875674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:25.876133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:25.876555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.045794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:26.054307 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aa4e8779-363e-4f8f-8321-caee569707b8 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1150 microversion: 2.1 time: 0.193510 Oct 01 20:55:26.060960 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 775/1504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:25 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1150 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:26.060960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:26.061340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:26.068910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:26.077383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.078198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.079069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.080011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.081042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.081710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.083067 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-530718f5-667a-4fd7-b48b-607bde8a8ef7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.594298 Oct 01 20:55:26.100092 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 730/1505] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:25 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:26.110139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:26.110814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:26.117956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.118667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.119929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.120658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.130069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.130676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.319090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:26.329033 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-068a1fd2-e984-421c-83b7-3b68793c20d3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.272787 Oct 01 20:55:26.342530 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 776/1506] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:26 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:26.342530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ea7f7a97-d9c6-4b22-9b04-d842f6f80c4b req-0f309393-b2c5-4769-8327-a73caae72e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485dd13f-1d60-418b-97bb-d6edfbeeb93a", "tag": "3e0303ab-2873-409d-8e60-eb9015f70e6a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:26.344065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ea7f7a97-d9c6-4b22-9b04-d842f6f80c4b req-0f309393-b2c5-4769-8327-a73caae72e8c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.344927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ea7f7a97-d9c6-4b22-9b04-d842f6f80c4b req-0f309393-b2c5-4769-8327-a73caae72e8c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.345515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ea7f7a97-d9c6-4b22-9b04-d842f6f80c4b req-0f309393-b2c5-4769-8327-a73caae72e8c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.360001 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ea7f7a97-d9c6-4b22-9b04-d842f6f80c4b req-0f309393-b2c5-4769-8327-a73caae72e8c service nova] Creating event network-changed:3e0303ab-2873-409d-8e60-eb9015f70e6a for instance 485dd13f-1d60-418b-97bb-d6edfbeeb93a on nch1-master-1 Oct 01 20:55:26.368739 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ea7f7a97-d9c6-4b22-9b04-d842f6f80c4b req-0f309393-b2c5-4769-8327-a73caae72e8c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037592 Oct 01 20:55:26.369694 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 777/1507] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:26.375096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:26.375415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:26.375991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:26.382225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.382749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.383215 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a19f84e-41d1-4f50-97a6-1f574ca17bee tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1317 microversion: 2.1 time: 0.282000 Oct 01 20:55:26.383566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.383799 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 731/1508] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:26 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:26.385150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.385846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.386273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.389450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:26.390061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:26.395838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.396559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.397172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.398047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.398723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.399488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.420860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:26.440328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:26.519113 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7d16dfbd-dd8d-4e6c-954a-84f4f2926b16 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 204 len: 0 microversion: 2.25 time: 0.147915 Oct 01 20:55:26.520305 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 778/1509] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:55:26 2022] DELETE /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:55:26.529774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:26.530767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:26.539435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.540176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.540830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.541621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.542081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.542525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.548893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:26.557594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4649b1b4-4562-4184-a2f8-27ffa6cffd7b tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1321 microversion: 2.1 time: 0.172503 Oct 01 20:55:26.558264 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 732/1510] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:26 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:26.611946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-45ff62a6-19ed-46e9-a4d9-3810914d7ecf req-95bdd953-6227-4c3c-947b-c4bc824d6b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4330370d-f790-40ef-aee0-b29ac848085e", "name": "network-vif-plugged", "status": "completed", "tag": "4031bbc7-099f-4d64-8e12-e38da43acc75"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:26.622039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-45ff62a6-19ed-46e9-a4d9-3810914d7ecf req-95bdd953-6227-4c3c-947b-c4bc824d6b16 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.622548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-45ff62a6-19ed-46e9-a4d9-3810914d7ecf req-95bdd953-6227-4c3c-947b-c4bc824d6b16 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.623012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-45ff62a6-19ed-46e9-a4d9-3810914d7ecf req-95bdd953-6227-4c3c-947b-c4bc824d6b16 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.634262 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-45ff62a6-19ed-46e9-a4d9-3810914d7ecf req-95bdd953-6227-4c3c-947b-c4bc824d6b16 service nova] Creating event network-vif-plugged:4031bbc7-099f-4d64-8e12-e38da43acc75 for instance 4330370d-f790-40ef-aee0-b29ac848085e on nch1-master-1 Oct 01 20:55:26.640055 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-45ff62a6-19ed-46e9-a4d9-3810914d7ecf req-95bdd953-6227-4c3c-947b-c4bc824d6b16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031801 Oct 01 20:55:26.641181 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 733/1511] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:55:26.680053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:26.689006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:26.690783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:26.691948 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-79a283d8-9706-4475-84f6-7c5034c7ccc5 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1549 microversion: 2.25 time: 0.167572 Oct 01 20:55:26.692519 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 779/1512] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:26 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:55:26.883063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:26.883724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:26.890333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.890861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.891309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:26.892009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:26.892472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:26.892902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:27.035746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:27.046244 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38da332f-5fe3-4340-aa2b-1bbce4b1aab9 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1469 microversion: 2.1 time: 0.167547 Oct 01 20:55:27.046883 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 734/1513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:26 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:27.079150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:27.079882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:27.089204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:27.089922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:27.090722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:27.091602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:27.092500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:27.093089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:27.113656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:27.115294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:27.131206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:27.132105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:27.132410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:27.133499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:27.133892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:27.134317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:27.576134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:27.584672 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d45eb65d-7e0f-48e1-add0-3c03eefa245a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1150 microversion: 2.1 time: 0.509398 Oct 01 20:55:27.585392 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 780/1514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:27 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1150 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:27.591279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:27.591893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:27.598185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:27.598724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:27.599235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:27.600150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:27.600613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:27.601039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:28.042807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:28.054878 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5407ad8e-5306-4b45-9ba9-9b9609717be8 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.945075 Oct 01 20:55:28.056174 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 735/1515] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:27 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:28.073000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:28.073000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:28.078432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:28.079580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:28.080483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:28.081215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:28.081677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:28.082104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:28.281482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:28.290362 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4161901b-11cf-4fcf-ae27-4e85b9c6aa9e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.703683 Oct 01 20:55:28.295619 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 781/1516] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:27 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:28.300712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:28.305759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:28.323669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:28.324153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:28.324601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:28.325904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:28.325904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:28.326212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:28.517928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:28.533257 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0df0e8d0-ec9e-488f-a30c-422d2cbd4f28 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1467 microversion: 2.1 time: 0.473921 Oct 01 20:55:28.533858 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 736/1517] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:28 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1467 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:28.539015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:28.539813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:28.551825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:28.555177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:28.557087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:28.559235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:28.562781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:28.563333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.082689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:29.097868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:29.100031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:29.101445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f541b9c1-6264-438f-bd92-3295d8a806da tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1549 microversion: 2.25 time: 0.566130 Oct 01 20:55:29.102400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:29.106591 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 737/1518] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:28 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1549 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:29.112077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:29.112933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:29.120406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.121142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.121809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.124786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.125555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.126214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.128717 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8032f876-8289-40c5-95a7-e5c35af22594 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1321 microversion: 2.1 time: 0.831664 Oct 01 20:55:29.139205 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 782/1519] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:28 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1321 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:29.152866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e4274c53-bb58-4e38-afe3-218bfa78d500 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:29.153677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e4274c53-bb58-4e38-afe3-218bfa78d500 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:29.168300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4274c53-bb58-4e38-afe3-218bfa78d500 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.168876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4274c53-bb58-4e38-afe3-218bfa78d500 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.169396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4274c53-bb58-4e38-afe3-218bfa78d500 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.170191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4274c53-bb58-4e38-afe3-218bfa78d500 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.170883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4274c53-bb58-4e38-afe3-218bfa78d500 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.171441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4274c53-bb58-4e38-afe3-218bfa78d500 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.551865 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e4274c53-bb58-4e38-afe3-218bfa78d500 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1618 microversion: 2.1 time: 0.410239 Oct 01 20:55:29.561078 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 783/1520] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:29 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1618 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:29.575460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:29.576361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:29.584228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.584986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.586206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.587512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:29.588843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.589470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.590726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.597839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45135c1a-e9f8-4646-86c3-41d895207a6e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1462 microversion: 2.1 time: 0.489591 Oct 01 20:55:29.598430 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 738/1521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:29 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1462 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:29.615132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5b74b87b-6ea1-4b1a-85e5-be5b973cf3c8 req-f3d56367-d751-4f1d-8f6e-a17549ec9e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e", "name": "network-vif-plugged", "status": "completed", "tag": "9b68231b-ea01-4f80-9d40-3d0180818f18"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:29.636532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5b74b87b-6ea1-4b1a-85e5-be5b973cf3c8 req-f3d56367-d751-4f1d-8f6e-a17549ec9e46 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.637144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5b74b87b-6ea1-4b1a-85e5-be5b973cf3c8 req-f3d56367-d751-4f1d-8f6e-a17549ec9e46 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.637689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5b74b87b-6ea1-4b1a-85e5-be5b973cf3c8 req-f3d56367-d751-4f1d-8f6e-a17549ec9e46 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.660725 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5b74b87b-6ea1-4b1a-85e5-be5b973cf3c8 req-f3d56367-d751-4f1d-8f6e-a17549ec9e46 service nova] Creating event network-vif-plugged:9b68231b-ea01-4f80-9d40-3d0180818f18 for instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e on nch1-master-1 Oct 01 20:55:29.669531 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5b74b87b-6ea1-4b1a-85e5-be5b973cf3c8 req-f3d56367-d751-4f1d-8f6e-a17549ec9e46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065679 Oct 01 20:55:29.670393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 739/1522] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:29.678278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:29.679770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:29.688471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.689577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.690902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.691893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.692576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.693232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.720239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:29.899862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:29.909578 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e3aac910-48df-4100-a6a2-91a307795ddf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1198 microversion: 2.1 time: 0.345968 Oct 01 20:55:29.910515 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 784/1523] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:29 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1198 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:29.915081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:29.916838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:29.921918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.922756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.923132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:29.924019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:29.924553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:29.924998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.022352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:30.032939 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f10a47e7-e8fa-415e-a170-0e37ed625aec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.360767 Oct 01 20:55:30.034928 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 740/1524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:29 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:30.040422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ac7a56b9-a833-4fa6-aa9e-62c3f69cf119 req-26ecc35b-7726-482a-9cde-db02d51ded86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1c8b2-7399-45f1-8791-a1f7f3368ab1", "name": "network-vif-deleted", "tag": "07d17637-612c-4ad6-8395-05ff1f3aafa8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:30.054822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ac7a56b9-a833-4fa6-aa9e-62c3f69cf119 req-26ecc35b-7726-482a-9cde-db02d51ded86 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.065220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ac7a56b9-a833-4fa6-aa9e-62c3f69cf119 req-26ecc35b-7726-482a-9cde-db02d51ded86 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.067092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ac7a56b9-a833-4fa6-aa9e-62c3f69cf119 req-26ecc35b-7726-482a-9cde-db02d51ded86 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.089223 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ac7a56b9-a833-4fa6-aa9e-62c3f69cf119 req-26ecc35b-7726-482a-9cde-db02d51ded86 service nova] Creating event network-vif-deleted:07d17637-612c-4ad6-8395-05ff1f3aafa8 for instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 on nch2-master-1 Oct 01 20:55:30.094136 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ac7a56b9-a833-4fa6-aa9e-62c3f69cf119 req-26ecc35b-7726-482a-9cde-db02d51ded86 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057775 Oct 01 20:55:30.095054 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 741/1525] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:30.173811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:30.187879 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b913b08d-9218-4d48-95e8-c975dd287408 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.275766 Oct 01 20:55:30.190133 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 785/1526] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:29 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:30.198405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1991047923", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8c51efc3-f63a-4767-a6b1-ea93db136447"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:30.264202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:30.290766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1a18eff-0ac5-468e-85cf-5c03790b3a20 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:30.291910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1a18eff-0ac5-468e-85cf-5c03790b3a20 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:30.298622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1a18eff-0ac5-468e-85cf-5c03790b3a20 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.299115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1a18eff-0ac5-468e-85cf-5c03790b3a20 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.299553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1a18eff-0ac5-468e-85cf-5c03790b3a20 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.300257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1a18eff-0ac5-468e-85cf-5c03790b3a20 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.300711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1a18eff-0ac5-468e-85cf-5c03790b3a20 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.301133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1a18eff-0ac5-468e-85cf-5c03790b3a20 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.535718 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b1a18eff-0ac5-468e-85cf-5c03790b3a20 tempest-MigrationsAdminTest-251349309 tempest-MigrationsAdminTest-251349309-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1613 microversion: 2.1 time: 0.439253 Oct 01 20:55:30.537807 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 742/1527] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:30 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1613 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:30.563520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-bd4486fb-f29a-487d-b1a2-b165dabd0e9a req-10f992e3-ec1d-4807-a8be-20efe9705399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0f4c70-33b6-4425-9277-2b8b941cd44b", "tag": "36f4cf52-c2dd-417b-801e-0cd9a73b8ac3"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:30.588885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bd4486fb-f29a-487d-b1a2-b165dabd0e9a req-10f992e3-ec1d-4807-a8be-20efe9705399 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.596086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bd4486fb-f29a-487d-b1a2-b165dabd0e9a req-10f992e3-ec1d-4807-a8be-20efe9705399 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.596765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bd4486fb-f29a-487d-b1a2-b165dabd0e9a req-10f992e3-ec1d-4807-a8be-20efe9705399 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.610139 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-bd4486fb-f29a-487d-b1a2-b165dabd0e9a req-10f992e3-ec1d-4807-a8be-20efe9705399 service nova] Creating event network-changed:36f4cf52-c2dd-417b-801e-0cd9a73b8ac3 for instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b on nch2-master-1 Oct 01 20:55:30.615037 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-bd4486fb-f29a-487d-b1a2-b165dabd0e9a req-10f992e3-ec1d-4807-a8be-20efe9705399 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074878 Oct 01 20:55:30.615658 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 743/1528] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:30.621171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:30.622300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:30.629224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.629985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.630681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.631607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.632244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.632852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.654382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:30.655045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:30.655726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:30.656310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:30.656896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:30.677235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.677747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.678195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.678976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.679452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.679889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.705693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.707152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.708578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.709054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lazy-loading 'fault' on Instance uuid e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:30.725900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:30.741032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Getting quotas for user e82ed96a3e794a1b99662cec0969b7ec and project 44683518fe3d46c58b139727cf0c9515. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:30.755375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:55:30.758018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:55:30.802079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:30.805115 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d3df4483-4135-47c1-a049-e550563274b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612367 Oct 01 20:55:30.806189 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 786/1529] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:55:30.811264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:30.811996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:30.819130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:30.819351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.820013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.820645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.821585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.821823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:30.823193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.823731 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7fd075f3-42d5-4586-a061-34e265013b3b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 200 len: 1351 microversion: 2.25 time: 0.206687 Oct 01 20:55:30.824126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.834577 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 744/1530] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:30 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 1351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:30.834577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:30.834577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:30.845694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.845694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.845694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.845694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:30.845694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:30.845694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:30.879584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:31.034080 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-70ceaf9e-f4df-4709-b1f8-495c7b05e03b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 204 len: 0 microversion: 2.1 time: 0.198207 Oct 01 20:55:31.035075 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 745/1531] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:55:30 2022] DELETE /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:55:31.047807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-670c58cc-9c36-4c8c-97be-33b9fc23c9c5 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:31.048837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-670c58cc-9c36-4c8c-97be-33b9fc23c9c5 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:31.134720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-670c58cc-9c36-4c8c-97be-33b9fc23c9c5 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:31.144459 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-670c58cc-9c36-4c8c-97be-33b9fc23c9c5 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1217 microversion: 2.1 time: 0.108130 Oct 01 20:55:31.145695 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 746/1532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:31 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:31.150875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:31.151561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:31.161586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:31.163855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:31.164354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:31.164789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:31.165528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:31.166622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:31.167054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:31.170403 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ab5f7d06-b43c-4343-8361-8b56004185f9 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1321 microversion: 2.1 time: 0.362906 Oct 01 20:55:31.171506 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 787/1533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:30 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:31.177216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:31.178450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:31.184841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:31.185552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:31.186160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:31.187084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:31.187796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:31.188221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:31.435075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:31.443471 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f0c76eff-ffcd-4a88-8530-87c69a655268 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1198 microversion: 2.1 time: 0.297065 Oct 01 20:55:31.444176 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 747/1534] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:31 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1198 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:31.449148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:31.449757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:31.450920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:31.455728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:31.456225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:31.456667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:31.457377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:31.457835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:31.458265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:31.469014 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9642605b-d88c-4cdc-9d86-17172c00a21e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1468 microversion: 2.1 time: 0.296180 Oct 01 20:55:31.469985 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 788/1535] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:31 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1468 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:31.475419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:31.476046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:31.483470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:31.484082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:31.484741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:31.485529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:31.486002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:31.486436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.027565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:32.031087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:32.035949 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7c3fd70b-1239-4620-9769-fe354b82b3b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.564798 Oct 01 20:55:32.046731 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 789/1536] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:31 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:32.046731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d1d91682-ab3b-4cc6-8a27-9f03e9645578 req-e38452e6-c831-477a-b6b2-d6f2911dcbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c902159b-1429-495e-b8a7-92092a9b748c", "name": "network-vif-plugged", "status": "completed", "tag": "43484f86-cf5b-4f54-81ae-51af87ee015f"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:32.051331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d1d91682-ab3b-4cc6-8a27-9f03e9645578 req-e38452e6-c831-477a-b6b2-d6f2911dcbfd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.051510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d1d91682-ab3b-4cc6-8a27-9f03e9645578 req-e38452e6-c831-477a-b6b2-d6f2911dcbfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.052334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d1d91682-ab3b-4cc6-8a27-9f03e9645578 req-e38452e6-c831-477a-b6b2-d6f2911dcbfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.053625 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-017c4ba6-4f6e-49e5-b1e6-ed850628955f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.607921 Oct 01 20:55:32.060572 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 748/1537] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:31 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:32.064670 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d1d91682-ab3b-4cc6-8a27-9f03e9645578 req-e38452e6-c831-477a-b6b2-d6f2911dcbfd service nova] Creating event network-vif-plugged:43484f86-cf5b-4f54-81ae-51af87ee015f for instance c902159b-1429-495e-b8a7-92092a9b748c on nch2-master-1 Oct 01 20:55:32.067427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:32.068058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: e0b1c8b2-7399-45f1-8791-a1f7f3368ab1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:32.069829 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d1d91682-ab3b-4cc6-8a27-9f03e9645578 req-e38452e6-c831-477a-b6b2-d6f2911dcbfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032183 Oct 01 20:55:32.070688 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 790/1538] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:32.075597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.076098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.076544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.077338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.077804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.078237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.093054 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] HTTP exception thrown: Instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 could not be found. Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Request method failure captured: Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 HTTP/1.1 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfsmSqk7h9SKTDD74WbGPmwsUze9ym9OvIHY0vsNq0esXi_yfXtSkRfVgy3wtmKd5FIO3O7fYJJzzurbExhL4y-qoOqVzxsJm8layhI3EK3twBBsEWsg0j8jyZxrRHR4HplNxJTA87TlYmYzV5tT2QwwgzFxUTxT6geIX2juDlhnMc Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.25 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 76e0a9843d9c41f7b2fae591dc09d9d2 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76e0a9843d9c41f7b2fae591dc09d9d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76e0a9843d9c41f7b2fae591dc09d9d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76e0a9843d9c41f7b2fae591dc09d9d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76e0a9843d9c41f7b2fae591dc09d9d2"}]}] Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 76e0a9843d9c41f7b2fae591dc09d9d2 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveAutoBlockMigrationV225Test-121044104-project Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa72870453cd4b958725801b842c7a28 Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-121044104-project Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 could not be found. Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e0b1c8b2-7399-45f1-8791-a1f7f3368ab1'} Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 could not be found. Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 could not be found. Oct 01 20:55:32.095361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 could not be found. Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Returning 404 to user: Instance e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b458d776-c820-4ec4-81d7-47a8500bdefd tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1" status: 404 len: 111 microversion: 2.25 time: 0.034775 Oct 01 20:55:32.100469 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 749/1539] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:32 2022] GET /compute/v2.1/servers/e0b1c8b2-7399-45f1-8791-a1f7f3368ab1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:55:32.107692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:32.108283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:32.115326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.115326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.115736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.116438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.116890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.117308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.144124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:32.171834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:32.171834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:32.176600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.177030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.177615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.178340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.178847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.179281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.226374 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d567761b-5d4d-454a-a46d-8dc84cf4cb2b tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 204 len: 0 microversion: 2.25 time: 0.124176 Oct 01 20:55:32.227157 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 791/1540] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:55:32 2022] DELETE /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:55:32.234529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:32.234529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:32.240062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.240563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.241006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.241726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.242189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.242648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.255254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:32.262967 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f863c3f-b013-4bf7-b14e-d6d16903c34d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1221 microversion: 2.1 time: 0.098732 Oct 01 20:55:32.274766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 750/1541] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:32 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:32.274766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:32.274766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:32.274766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.274766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.275331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.275801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.276256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.276678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.481691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:32.492482 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7411cc4a-4510-45f2-933c-4cd4aa23103e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1321 microversion: 2.1 time: 0.263899 Oct 01 20:55:32.493593 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 792/1542] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:32 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:32.498887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:32.499791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:32.506171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.506956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.507512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.508463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.509154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.509811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.542188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:32.553609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:32.555079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:32.556285 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-81ca3afd-dd04-46df-ba80-adea4b91cc99 tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1565 microversion: 2.25 time: 0.291798 Oct 01 20:55:32.558617 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 751/1543] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:32 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1565 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:32.562440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:32.563610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:32.570104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.570817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.571422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:32.572347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:32.572951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:32.573549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.011908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:33.015822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:33.022796 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9f4e4086-d50c-4800-a1e6-57564d41be70 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1198 microversion: 2.1 time: 0.527732 Oct 01 20:55:33.035428 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 793/1544] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:32 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1198 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:33.061272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:33.061685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:33.068980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:33.082960 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-25c943ff-ac7d-4640-936b-56c286eac692 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1468 microversion: 2.1 time: 0.523352 Oct 01 20:55:33.083575 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 752/1545] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:32 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1468 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:33.089215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.091154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.091611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.092345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.092810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.093079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:33.093237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.094002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:33.102915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.104183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.104815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.105917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.106872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.107475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.511218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:33.519422 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f25cbc05-5a93-4106-a2db-81df317eae48 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.434042 Oct 01 20:55:33.530751 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 753/1546] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:33 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:33.531185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:33.531654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:33.531654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:33.532085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.532258 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-768dddaa-6712-4bbe-904d-30b62de115a3 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.477633 Oct 01 20:55:33.532908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.533511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.534450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.535092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.535749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.537438 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 794/1547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:33 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:33.544141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:33.545070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:33.553447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.554230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.555169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.556084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.558308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.559111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.670962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:33.741843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:33.754007 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-78d36edc-9c42-4c53-ae2b-24a9c67a6f21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1269 microversion: 2.1 time: 0.232936 Oct 01 20:55:33.755078 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 754/1548] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:33 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1269 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:33.760561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:33.761374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:33.767414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.768013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.768802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:33.769775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:33.770337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:33.771029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:34.093786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:34.108883 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0a032782-8887-4f13-8cba-76b3d04f7266 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1321 microversion: 2.1 time: 0.570196 Oct 01 20:55:34.109483 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 795/1549] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:33 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1321 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:34.114061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:34.114709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:34.131904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:34.132388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:34.133014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:34.133900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:34.134589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:34.135200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:34.253096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:34.271174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:34.273100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa72870453cd4b958725801b842c7a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e0a9843d9c41f7b2fae591dc09d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:34.276620 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e1b78963-407f-42b3-ac36-134e36bc9acf tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 200 len: 1565 microversion: 2.25 time: 0.519804 Oct 01 20:55:34.278443 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 755/1550] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:33 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 1565 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:55:34.283542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:34.284982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:34.313054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:34.315809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:34.317279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:34.320361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:34.322203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:34.323212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:34.523592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:34.535764 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a71e9b2-acb0-4bc6-8f53-1bd984fc81a4 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1426 microversion: 2.1 time: 0.253030 Oct 01 20:55:34.546945 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 756/1551] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:34 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1426 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:34.583028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-164c8e90-85a7-4a45-97a0-c5b4a0d05ba9 req-534fd986-8be7-4180-a5ae-199931f8e2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15da01e-ab80-469b-bec2-63336c26cf11", "name": "network-vif-plugged", "status": "completed", "tag": "09809c55-101d-4f60-a1c1-2816a5dd97d8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:34.607677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-164c8e90-85a7-4a45-97a0-c5b4a0d05ba9 req-534fd986-8be7-4180-a5ae-199931f8e2ff service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:34.609523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-164c8e90-85a7-4a45-97a0-c5b4a0d05ba9 req-534fd986-8be7-4180-a5ae-199931f8e2ff service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:34.610577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-164c8e90-85a7-4a45-97a0-c5b4a0d05ba9 req-534fd986-8be7-4180-a5ae-199931f8e2ff service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:34.644396 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-164c8e90-85a7-4a45-97a0-c5b4a0d05ba9 req-534fd986-8be7-4180-a5ae-199931f8e2ff service nova] Creating event network-vif-plugged:09809c55-101d-4f60-a1c1-2816a5dd97d8 for instance e15da01e-ab80-469b-bec2-63336c26cf11 on nch1-master-1 Oct 01 20:55:34.661022 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-164c8e90-85a7-4a45-97a0-c5b4a0d05ba9 req-534fd986-8be7-4180-a5ae-199931f8e2ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098402 Oct 01 20:55:34.666402 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 757/1552] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:34.676172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:34.680218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:34.710010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:34.711933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:34.714143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:34.715610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:34.721450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:34.722871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:34.773638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:35.187634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:35.198029 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9cbe86fd-6d13-405a-9a83-8c4e7da1c61b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1198 microversion: 2.1 time: 1.087490 Oct 01 20:55:35.211847 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 796/1553] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:34 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1198 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:35.219777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:35.220710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:35.227787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:35.228597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:35.229210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:35.230822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:35.231456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:35.232166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:35.707302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:35.721069 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7e75ff9-e68c-4cd5-8ad0-873454b9b0db tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 1.052032 Oct 01 20:55:35.728122 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 758/1554] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:34 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:35.739370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cd7594f3-d036-4af4-9031-621d37019f92 req-6032bf66-957c-4e6b-a80c-bed768f60c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e", "name": "network-vif-deleted", "tag": "9b68231b-ea01-4f80-9d40-3d0180818f18"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:35.756930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cd7594f3-d036-4af4-9031-621d37019f92 req-6032bf66-957c-4e6b-a80c-bed768f60c03 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:35.758954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cd7594f3-d036-4af4-9031-621d37019f92 req-6032bf66-957c-4e6b-a80c-bed768f60c03 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:35.761290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cd7594f3-d036-4af4-9031-621d37019f92 req-6032bf66-957c-4e6b-a80c-bed768f60c03 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:35.799748 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cd7594f3-d036-4af4-9031-621d37019f92 req-6032bf66-957c-4e6b-a80c-bed768f60c03 service nova] Creating event network-vif-deleted:9b68231b-ea01-4f80-9d40-3d0180818f18 for instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e on nch1-master-1 Oct 01 20:55:35.805496 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cd7594f3-d036-4af4-9031-621d37019f92 req-6032bf66-957c-4e6b-a80c-bed768f60c03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075558 Oct 01 20:55:35.806827 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 759/1555] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:35.813541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c552541d-391e-4dd5-95e0-836cc9a8ceb6 req-6b5a9dc1-1dc2-4440-8518-1992471638fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a6997f-d4d8-405f-9d73-c2ff5d089bde", "name": "network-vif-deleted", "tag": "c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:35.834936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c552541d-391e-4dd5-95e0-836cc9a8ceb6 req-6b5a9dc1-1dc2-4440-8518-1992471638fc service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:35.835629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c552541d-391e-4dd5-95e0-836cc9a8ceb6 req-6b5a9dc1-1dc2-4440-8518-1992471638fc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:35.836264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c552541d-391e-4dd5-95e0-836cc9a8ceb6 req-6b5a9dc1-1dc2-4440-8518-1992471638fc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:35.855700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:35.867079 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1a01c644-d298-45d5-913b-57dc2789505c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.652908 Oct 01 20:55:35.876711 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 797/1556] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:35 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:35.885254 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c552541d-391e-4dd5-95e0-836cc9a8ceb6 req-6b5a9dc1-1dc2-4440-8518-1992471638fc service nova] Creating event network-vif-deleted:c0c0ecd0-a5ea-4323-9eef-b4a20f3212ba for instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde on nch2-master-1 Oct 01 20:55:35.890935 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c552541d-391e-4dd5-95e0-836cc9a8ceb6 req-6b5a9dc1-1dc2-4440-8518-1992471638fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082374 Oct 01 20:55:35.891857 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 760/1557] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:35.898409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:35.899388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:35.904708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:35.905449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:35.906279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:35.908663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:35.909991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:35.911192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:35.912141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:35.913091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:35.914095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:35.954862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:35.955408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:35.955847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:35.961248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:35.962287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:35.962787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.224562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:36.237609 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49c041f5-42d0-436e-893d-1389794ed55d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1511 microversion: 2.1 time: 0.343498 Oct 01 20:55:36.238205 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 761/1558] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:35 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:36.246689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:36.247572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] [instance: 57a6997f-d4d8-405f-9d73-c2ff5d089bde] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:36.255506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:36.267939 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ff2d9422-7ee5-4e23-8af8-5cfa747d67b2 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1317 microversion: 2.1 time: 0.389783 Oct 01 20:55:36.268735 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 798/1559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:35 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:36.284567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.285560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.286701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.287494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.288348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.291804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.294142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:36.294811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:36.304016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.304814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.305493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.306991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.307619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.308248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.324152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] HTTP exception thrown: Instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde could not be found. Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Request method failure captured: Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde HTTP/1.1 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKfsmSqk7h9SKTDD74WbGPmwsUze9ym9OvIHY0vsNq0esXi_yfXtSkRfVgy3wtmKd5FIO3O7fYJJzzurbExhL4y-qoOqVzxsJm8layhI3EK3twBBsEWsg0j8jyZxrRHR4HplNxJTA87TlYmYzV5tT2QwwgzFxUTxT6geIX2juDlhnMc Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.25 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 76e0a9843d9c41f7b2fae591dc09d9d2 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76e0a9843d9c41f7b2fae591dc09d9d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76e0a9843d9c41f7b2fae591dc09d9d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76e0a9843d9c41f7b2fae591dc09d9d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76e0a9843d9c41f7b2fae591dc09d9d2"}]}] Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 76e0a9843d9c41f7b2fae591dc09d9d2 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-121044104 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveAutoBlockMigrationV225Test-121044104-project Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa72870453cd4b958725801b842c7a28 Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-121044104-project Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde could not be found. Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '57a6997f-d4d8-405f-9d73-c2ff5d089bde'} Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde could not be found. Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde could not be found. Oct 01 20:55:36.326725 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:36.331858 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:36.331858 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:36.331858 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:36.331858 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:36.331858 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:36.331858 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:36.331858 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:36.331858 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde could not be found. Oct 01 20:55:36.331858 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:36.332746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] Returning 404 to user: Instance 57a6997f-d4d8-405f-9d73-c2ff5d089bde could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:36.335058 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b4a3f9b-d0fb-4b89-b2c3-31b9f730d8ea tempest-LiveAutoBlockMigrationV225Test-121044104 tempest-LiveAutoBlockMigrationV225Test-121044104-project] 10.222.0.17 "GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde" status: 404 len: 111 microversion: 2.25 time: 0.094333 Oct 01 20:55:36.335720 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 762/1560] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:55:36 2022] GET /compute/v2.1/servers/57a6997f-d4d8-405f-9d73-c2ff5d089bde => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:55:36.343815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:36.344686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:36.351325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.354155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.354842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.356460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.358783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.359602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.359726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.360825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.361353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.362713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lazy-loading 'fault' on Instance uuid 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:36.511786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:36.528346 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2ebf280b-cfcc-4635-b5e6-b314020cf9fc tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 200 len: 1302 microversion: 2.1 time: 0.247145 Oct 01 20:55:36.528939 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 799/1561] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:36 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:36.533753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:36.535100 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:36.542892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.543613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.544287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.545578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.546049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.546717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.776842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:36.784634 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ff4f612-b599-45d5-aa8c-121ec84bfb4a tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1198 microversion: 2.1 time: 0.444994 Oct 01 20:55:36.785239 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 763/1562] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:36 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1198 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:36.790187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:36.790368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:36.796588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.797080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.797521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.798220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.798893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.799498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.949301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:36.957322 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1b713836-99a2-4eda-ad3f-2390dcba9c97 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1319 microversion: 2.1 time: 0.427263 Oct 01 20:55:36.957915 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 800/1563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:36 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:36.963149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:36.963769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:36.969736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.970234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.970779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:36.971508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:36.972121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:36.972575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.199344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:37.215848 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-63f75ea0-3b9e-4f34-9f64-5cfe3442a8f6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.429542 Oct 01 20:55:37.216438 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 764/1564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:36 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:37.291762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:37.292891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:37.299692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.300531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.301175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.302111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.302827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.303318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.392749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:37.403002 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1016d962-5fbb-4cb0-87ed-00c3f675b538 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1312 microversion: 2.1 time: 0.443771 Oct 01 20:55:37.403830 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 801/1565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:36 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1312 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:37.409476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-358fa4bc-7e79-4bc5-beaa-039f3ae27f92 req-7b17aa73-dff6-4352-aa3a-11d849b3a94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0f4c70-33b6-4425-9277-2b8b941cd44b", "name": "network-vif-plugged", "status": "completed", "tag": "36f4cf52-c2dd-417b-801e-0cd9a73b8ac3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:37.424128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-358fa4bc-7e79-4bc5-beaa-039f3ae27f92 req-7b17aa73-dff6-4352-aa3a-11d849b3a94e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.424690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-358fa4bc-7e79-4bc5-beaa-039f3ae27f92 req-7b17aa73-dff6-4352-aa3a-11d849b3a94e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.425272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-358fa4bc-7e79-4bc5-beaa-039f3ae27f92 req-7b17aa73-dff6-4352-aa3a-11d849b3a94e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.438558 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-358fa4bc-7e79-4bc5-beaa-039f3ae27f92 req-7b17aa73-dff6-4352-aa3a-11d849b3a94e service nova] Creating event network-vif-plugged:36f4cf52-c2dd-417b-801e-0cd9a73b8ac3 for instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b on nch2-master-1 Oct 01 20:55:37.450704 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-358fa4bc-7e79-4bc5-beaa-039f3ae27f92 req-7b17aa73-dff6-4352-aa3a-11d849b3a94e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039823 Oct 01 20:55:37.451584 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 802/1566] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:37.553203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:37.555112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:37.567354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:37.572797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.574561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.575176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.575926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.576532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.577193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.648939 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] HTTP exception thrown: Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e could not be found. Oct 01 20:55:37.650325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Request method failure captured: Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e HTTP/1.1 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKffgIiQdX31xItDFcMq_OOdolJPqS-Tu1wVFZQyzbKLzg86oAmVRI3klx1wTM8HzGMvEtt5jH61gNgJMzCqzwh4QPrEktqh3BJS9UDy1bVbEuTr-npWRCsDoWIZRJXtkiZOw2EJuozmKBs_K6mtrnDKYVwIr4TWbQYb_8p6gWyHDEA Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 08fae3c0a9324c68b16dd495478a89e3 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08fae3c0a9324c68b16dd495478a89e3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08fae3c0a9324c68b16dd495478a89e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08fae3c0a9324c68b16dd495478a89e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08fae3c0a9324c68b16dd495478a89e3"}]}] Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 08fae3c0a9324c68b16dd495478a89e3 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-MigrationsAdminTest-1058261082-project Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: e5bfbc1e512a445ca7527f3d79e40d16 Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-MigrationsAdminTest-1058261082-project Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e could not be found. Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e'} Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e could not be found. Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e could not be found. Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:37.652082 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:37.658231 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:37.658231 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:37.658231 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:37.658231 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:37.658231 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:37.658231 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e could not be found. Oct 01 20:55:37.658231 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:37.662754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Returning 404 to user: Instance 5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:37.664012 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c40da42e-3267-424e-9fc4-0d81b21c0fd1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e" status: 404 len: 111 microversion: 2.1 time: 0.115699 Oct 01 20:55:37.665081 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 803/1567] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:37 2022] GET /compute/v2.1/servers/5c0f3974-8ab3-4ae3-9e93-f4aab2f8db2e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:55:37.668825 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb2c79ec-7188-4a00-843f-279a0b4ca610 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1317 microversion: 2.1 time: 0.380855 Oct 01 20:55:37.669426 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 765/1568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:37 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:37.695807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:37.699502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:37.735969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.736991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.737752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.738978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.739729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.740396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.808556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:37.809124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:37.809735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:37.820294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.821511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.822176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.823172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.824897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.825588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.938144 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-99572b35-5800-4731-9f64-9d801fbb94fd tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 204 len: 0 microversion: 2.1 time: 0.255645 Oct 01 20:55:37.941923 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 804/1569] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:55:37 2022] DELETE /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:55:37.948136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-be126284-1e5a-493c-9c64-c3e06774d20e req-3a0cf2c7-59ac-4a3a-9f03-029058343dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9fa0c5-c93b-49cb-aa35-a7ff814837e0", "tag": "bc1a697c-1c1c-4c73-b57e-65e6cd768d9a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:37.958076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-be126284-1e5a-493c-9c64-c3e06774d20e req-3a0cf2c7-59ac-4a3a-9f03-029058343dd0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.958594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-be126284-1e5a-493c-9c64-c3e06774d20e req-3a0cf2c7-59ac-4a3a-9f03-029058343dd0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.959027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-be126284-1e5a-493c-9c64-c3e06774d20e req-3a0cf2c7-59ac-4a3a-9f03-029058343dd0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.970906 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-be126284-1e5a-493c-9c64-c3e06774d20e req-3a0cf2c7-59ac-4a3a-9f03-029058343dd0 service nova] Creating event network-changed:bc1a697c-1c1c-4c73-b57e-65e6cd768d9a for instance 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 on nch1-master-1 Oct 01 20:55:37.975615 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-be126284-1e5a-493c-9c64-c3e06774d20e req-3a0cf2c7-59ac-4a3a-9f03-029058343dd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032316 Oct 01 20:55:37.976504 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 805/1570] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:37.982794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:37.983497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:37.989737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.990431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.991056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:37.991757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:37.992213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:37.992633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:38.562780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:38.570677 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7b0f4977-8da5-4c98-84c5-a18e6f75de29 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1198 microversion: 2.1 time: 0.765896 Oct 01 20:55:38.571246 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 766/1571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:37 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1198 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:38.575959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:38.576561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:38.582218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:38.582740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:38.583181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:38.583979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:38.584439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:38.584877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:38.634949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:38.643485 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ac8f0b31-e63b-4a40-9bb6-a018f82c693f tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1535 microversion: 2.1 time: 0.665627 Oct 01 20:55:38.644068 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 806/1572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:37 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1535 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:38.648466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:38.649114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:38.655439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:38.655622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:38.656327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:38.657048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:38.657512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:38.657945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:38.911210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:38.922231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-55ca79e5-1136-460f-863d-24988a6926ee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1319 microversion: 2.1 time: 0.349499 Oct 01 20:55:38.922985 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 767/1573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:38 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:38.927685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:38.928599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:38.934516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:38.935370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:38.936016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:38.936950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:38.937814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:38.938430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.015303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:39.025207 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e2bb18ec-bab9-457a-95f2-6a10dca91b22 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.379603 Oct 01 20:55:39.026138 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 807/1574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:38 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:39.031217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:39.032098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:39.038763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.039565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.040984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.042223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.042963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.043625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.257640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:39.268259 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-91e6ed08-36a5-4a64-908f-af7801da54bc tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1498 microversion: 2.1 time: 0.343916 Oct 01 20:55:39.269521 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 768/1575] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:38 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1498 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:39.297849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:39.305334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:39.312601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.313343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.313963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.314887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.315548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.316627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.342703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lazy-loading 'flavor' on Instance uuid e15da01e-ab80-469b-bec2-63336c26cf11 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:39.401073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:39.409786 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e85f3a71-9724-46b2-b1ab-b92f7c907233 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1317 microversion: 2.1 time: 0.382266 Oct 01 20:55:39.410789 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 808/1576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:39 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:39.431185 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd942a57-beb9-4254-8c66-c84089b49a26 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "POST /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11/action" status: 200 len: 32 microversion: 2.1 time: 0.138974 Oct 01 20:55:39.431917 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 769/1577] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:55:39 2022] POST /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11/action => generated 32 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 01 20:55:39.441709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:39.442760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:39.449592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.450224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.450703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.451420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.451886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.452514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.594316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:39.595174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:39.602101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.602647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.603278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.604178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.604663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.605107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.778971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:39.787673 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b5193de3-8d98-4335-8f6e-a5c6c2ee3ce7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.349760 Oct 01 20:55:39.788255 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 809/1578] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:39 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:39.793751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-bd7811ab-76fc-49c7-b872-2cb2b8606b90 req-9207980f-3d45-410c-ba84-e296fa1fa66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485dd13f-1d60-418b-97bb-d6edfbeeb93a", "name": "network-vif-plugged", "status": "completed", "tag": "3e0303ab-2873-409d-8e60-eb9015f70e6a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:39.803217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bd7811ab-76fc-49c7-b872-2cb2b8606b90 req-9207980f-3d45-410c-ba84-e296fa1fa66f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.803903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bd7811ab-76fc-49c7-b872-2cb2b8606b90 req-9207980f-3d45-410c-ba84-e296fa1fa66f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.804537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bd7811ab-76fc-49c7-b872-2cb2b8606b90 req-9207980f-3d45-410c-ba84-e296fa1fa66f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.817923 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-bd7811ab-76fc-49c7-b872-2cb2b8606b90 req-9207980f-3d45-410c-ba84-e296fa1fa66f service nova] Creating event network-vif-plugged:3e0303ab-2873-409d-8e60-eb9015f70e6a for instance 485dd13f-1d60-418b-97bb-d6edfbeeb93a on nch1-master-1 Oct 01 20:55:39.823416 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-bd7811ab-76fc-49c7-b872-2cb2b8606b90 req-9207980f-3d45-410c-ba84-e296fa1fa66f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033243 Oct 01 20:55:39.824045 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 810/1579] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:39.829209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:39.829918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:39.835910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.836400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.836841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.837592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.838055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.838498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.842703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:39.902211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:39.911042 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d70d8d78-b0df-4631-8149-fbdadceac885 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1382 microversion: 2.1 time: 0.320886 Oct 01 20:55:39.911816 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 770/1580] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:39 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1382 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:39.933476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef5c7317-2bd6-4c85-b898-726584db4a31 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:39.934219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef5c7317-2bd6-4c85-b898-726584db4a31 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:39.940834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5c7317-2bd6-4c85-b898-726584db4a31 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.941320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5c7317-2bd6-4c85-b898-726584db4a31 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.942010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5c7317-2bd6-4c85-b898-726584db4a31 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:39.942914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5c7317-2bd6-4c85-b898-726584db4a31 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:39.943373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5c7317-2bd6-4c85-b898-726584db4a31 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:39.943800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5c7317-2bd6-4c85-b898-726584db4a31 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.088139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:40.096800 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3114e572-d05e-49fe-8556-4de2e1b8b196 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1535 microversion: 2.1 time: 0.271410 Oct 01 20:55:40.097698 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 811/1581] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:39 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1535 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:40.102629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:40.103740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:40.109597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.110087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.110749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.111460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.111916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.112368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.235548 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef5c7317-2bd6-4c85-b898-726584db4a31 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1533 microversion: 2.1 time: 0.306098 Oct 01 20:55:40.236513 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 771/1582] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:39 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1533 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:40.247316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:40.248146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:40.261865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.265376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.266123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.267687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.269673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.270161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.285356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:40.295537 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-639b0873-59b5-489b-967a-a6aaef0cc8bb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1319 microversion: 2.1 time: 0.196454 Oct 01 20:55:40.296680 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 812/1583] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:40 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:40.301402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-22e5740c-d59b-43ad-9afd-d64155373c15 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:40.302433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-22e5740c-d59b-43ad-9afd-d64155373c15 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:40.320056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22e5740c-d59b-43ad-9afd-d64155373c15 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.320555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22e5740c-d59b-43ad-9afd-d64155373c15 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.320989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22e5740c-d59b-43ad-9afd-d64155373c15 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.321755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22e5740c-d59b-43ad-9afd-d64155373c15 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.328241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22e5740c-d59b-43ad-9afd-d64155373c15 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.328981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22e5740c-d59b-43ad-9afd-d64155373c15 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.552079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:40.564510 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5dbddfe6-f6f4-4ae4-80d9-e1c42d9054af tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.326272 Oct 01 20:55:40.566150 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 772/1584] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:40 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:40.581120 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-22e5740c-d59b-43ad-9afd-d64155373c15 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1533 microversion: 2.1 time: 0.283159 Oct 01 20:55:40.581719 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 813/1585] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:40 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1533 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:40.585320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:40.585945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:40.592792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.593203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.593646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.594370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.594857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.595284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.609571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1a7f4acc-c870-4a4e-b6eb-d435620864fc tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:40.615019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a7f4acc-c870-4a4e-b6eb-d435620864fc tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.615771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a7f4acc-c870-4a4e-b6eb-d435620864fc tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.616603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a7f4acc-c870-4a4e-b6eb-d435620864fc tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.617718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a7f4acc-c870-4a4e-b6eb-d435620864fc tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.618946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a7f4acc-c870-4a4e-b6eb-d435620864fc tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.619923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a7f4acc-c870-4a4e-b6eb-d435620864fc tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.674857 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1a7f4acc-c870-4a4e-b6eb-d435620864fc tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.069728 Oct 01 20:55:40.675957 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 814/1586] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Oct 1 20:55:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:40.690017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:40.694152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:40.702908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.703617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.704246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.705158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.705882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.706644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.750082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:40.753076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lazy-loading 'flavor' on Instance uuid 3f0f4c70-33b6-4425-9277-2b8b941cd44b {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:40.768760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Going to try to live migrate instance to nch1-master-1 {{(pid=140437) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 20:55:40.810369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:40.819084 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dca401ce-4ada-46a6-89f8-33923760df66 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1317 microversion: 2.1 time: 0.243849 Oct 01 20:55:40.820022 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 773/1587] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:40 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:40.830746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:40.831696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:40.844488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.845655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.846335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:40.847300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:40.848097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:40.848758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:41.139320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=25 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:41.373113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:41.386683 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2371ac20-1a0c-4448-a0bd-19fb1e8bd5be tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.565185 Oct 01 20:55:41.388019 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 774/1588] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:40 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:41.410107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:41.411554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:41.419575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:41.420676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:41.421491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:41.422461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:41.423342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:41.424645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:41.472950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:41.768619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:41.781465 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae7849eb-8137-4ecf-9c1d-4c0e98297861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1535 microversion: 2.1 time: 0.391969 Oct 01 20:55:41.782430 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 775/1589] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:41 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1535 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:41.787620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:41.788621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:41.801242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:41.801734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:41.802169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:41.802943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:41.803401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:41.803825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:42.067937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:42.075834 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1d6c581-33f5-42f4-bfbb-4aee92ce31e3 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1319 microversion: 2.1 time: 0.292179 Oct 01 20:55:42.076385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 776/1590] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:41 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:42.081236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:42.082023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:42.088953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:42.092369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:42.093032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:42.093766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:42.094220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:42.095650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:42.253855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:42.264672 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c60efbf6-7320-4225-9bce-04d432341e19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.187081 Oct 01 20:55:42.265259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 777/1591] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:42 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:42.270966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:42.271805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:42.279464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:42.281610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:42.282271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:42.283319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:42.284158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:42.284830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:42.764830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:42.808459 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-09b2c47f-9cbe-4717-b301-1f1d1036b4b0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1317 microversion: 2.1 time: 0.541807 Oct 01 20:55:42.824424 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 778/1592] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:42 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:42.839713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-01af8935-9462-4b1d-af5a-4877403722dd req-94ef8e30-1a03-463e-9e68-7029f59ab568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1818557f-9772-403d-bfa8-d226f1063f2f", "name": "network-vif-deleted", "tag": "1dee487a-adae-475f-aff1-35bf8657a7f3"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:42.855041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-01af8935-9462-4b1d-af5a-4877403722dd req-94ef8e30-1a03-463e-9e68-7029f59ab568 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:42.855568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-01af8935-9462-4b1d-af5a-4877403722dd req-94ef8e30-1a03-463e-9e68-7029f59ab568 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:42.856200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-01af8935-9462-4b1d-af5a-4877403722dd req-94ef8e30-1a03-463e-9e68-7029f59ab568 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:42.869141 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-01af8935-9462-4b1d-af5a-4877403722dd req-94ef8e30-1a03-463e-9e68-7029f59ab568 service nova] Creating event network-vif-deleted:1dee487a-adae-475f-aff1-35bf8657a7f3 for instance 1818557f-9772-403d-bfa8-d226f1063f2f on nch1-master-1 Oct 01 20:55:42.874516 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-01af8935-9462-4b1d-af5a-4877403722dd req-94ef8e30-1a03-463e-9e68-7029f59ab568 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038953 Oct 01 20:55:42.875453 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 779/1593] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:42.880550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:42.881254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:42.887630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:42.888117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:42.888557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:42.889264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:42.890881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:42.891492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.322189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:43.335774 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5ed6064e-4c1c-41be-93b6-6bd5c4b9384b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.457914 Oct 01 20:55:43.336683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 780/1594] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:42 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:43.348166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:43.349012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:43.357299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.358469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.358998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.359724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.360183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.361788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.413804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.414244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.414909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.415933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lazy-loading 'fault' on Instance uuid 1818557f-9772-403d-bfa8-d226f1063f2f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:43.482782 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-20c55b8f-fef4-4f08-b9d4-d5c210c94ff5 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b/action" status: 202 len: 0 microversion: 2.1 time: 2.797020 Oct 01 20:55:43.488926 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 815/1595] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:55:40 2022] POST /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b/action => generated 0 bytes in 2804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 20:55:43.497124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:43.497486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:43.501128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:43.511567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.512438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.513065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.514017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.514871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.515510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.517897 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd1f2661-51de-47bf-94dd-0a601c989339 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 200 len: 1369 microversion: 2.1 time: 0.177957 Oct 01 20:55:43.518587 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 781/1596] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:43 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:43.524578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:43.525478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:43.544813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.547937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.548656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.550859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.551625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.552535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.766309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:43.772634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:43.774317 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6e6588dc-760e-4353-bfd2-0d13542e6da8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1509 microversion: 2.1 time: 0.283954 Oct 01 20:55:43.785118 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0c69b0d8-1602-4b37-ac91-82282c244fe1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.264775 Oct 01 20:55:43.787144 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 816/1598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:43 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:43.787626 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 782/1598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:43 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:43.794419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:43.795341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:43.801401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:43.802110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:43.805862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.806988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.807525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.808482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.808810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.809402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.809648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.809776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.810308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:43.810525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:43.811659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:43.812362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.438706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:44.451244 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cea5e90f-16d3-4357-b3af-fc29bfe4a929 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.662943 Oct 01 20:55:44.451841 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 817/1599] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:43 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:44.457785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:44.471258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:44.471885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:44.476522 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4c126785-6b47-4f5d-89ea-0d7a1fdfea13 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e" status: 200 len: 1511 microversion: 2.1 time: 0.679051 Oct 01 20:55:44.477328 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 783/1600] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:43 2022] GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e => generated 1511 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:44.483634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:44.484469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:44.487536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.488098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.488899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.489829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.490482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.491142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.492109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.492931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.494760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.495930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.496477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.497069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.781804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:44.797690 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8d0c81dd-e26b-4a38-9a19-ad60fbae3521 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1317 microversion: 2.1 time: 0.344478 Oct 01 20:55:44.798700 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 818/1601] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:44 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:44.804590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:44.811230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:44.813092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:44.826404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:44.840553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.841439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.841571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.842234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.842717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.843146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.844876 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f6e152d-986a-406b-b1df-5a1d25b95d73 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.366268 Oct 01 20:55:44.846284 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 784/1602] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:44 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:44.854300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:44.855285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 1818557f-9772-403d-bfa8-d226f1063f2f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:44.862654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.863612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.864631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.865599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.866289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.867441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.891327 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] HTTP exception thrown: Instance 1818557f-9772-403d-bfa8-d226f1063f2f could not be found. Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Request method failure captured: Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f HTTP/1.1 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKffgIiQdX31xItDFcMq_OOdolJPqS-Tu1wVFZQyzbKLzg86oAmVRI3klx1wTM8HzGMvEtt5jH61gNgJMzCqzwh4QPrEktqh3BJS9UDy1bVbEuTr-npWRCsDoWIZRJXtkiZOw2EJuozmKBs_K6mtrnDKYVwIr4TWbQYb_8p6gWyHDEA Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 08fae3c0a9324c68b16dd495478a89e3 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08fae3c0a9324c68b16dd495478a89e3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08fae3c0a9324c68b16dd495478a89e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08fae3c0a9324c68b16dd495478a89e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08fae3c0a9324c68b16dd495478a89e3"}]}] Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 08fae3c0a9324c68b16dd495478a89e3 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-MigrationsAdminTest-1058261082-project Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e5bfbc1e512a445ca7527f3d79e40d16 Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-MigrationsAdminTest-1058261082-project Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 1818557f-9772-403d-bfa8-d226f1063f2f could not be found. Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1818557f-9772-403d-bfa8-d226f1063f2f'} Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1818557f-9772-403d-bfa8-d226f1063f2f could not be found. Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1818557f-9772-403d-bfa8-d226f1063f2f could not be found. Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:44.894463 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:44.899360 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:44.899360 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:44.899360 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:44.899360 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:44.899360 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:44.899360 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1818557f-9772-403d-bfa8-d226f1063f2f could not be found. Oct 01 20:55:44.899360 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:44.902337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Returning 404 to user: Instance 1818557f-9772-403d-bfa8-d226f1063f2f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:44.904306 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4693650-e4ef-47cf-aa34-5e0539a3b391 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f" status: 404 len: 111 microversion: 2.1 time: 0.056693 Oct 01 20:55:44.909775 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 785/1603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:44 2022] GET /compute/v2.1/servers/1818557f-9772-403d-bfa8-d226f1063f2f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:55:44.916301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:44.917401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:44.926690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.927763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.928824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.929855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:44.931196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:44.932985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:44.980211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:55:45.059932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:45.067262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:45.068028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:45.068681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:45.241540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:45.274470 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1ef27a2d-8863-431a-bf2c-ad09338726f1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.474366 Oct 01 20:55:45.275962 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 819/1604] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Oct 1 20:55:44 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:45.281342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ba4cb6e4-c0cf-4a02-ad2c-534b2da4946b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '.version_select at 0x7f4173fd1ca0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:45.282758 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc1c7057-a66a-48f9-8b38-c58dcda5e089 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.371508 Oct 01 20:55:45.300881 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 786/1605] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:44 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:45.311507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:45.316187 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ba4cb6e4-c0cf-4a02-ad2c-534b2da4946b tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194715992" status: 202 len: 0 microversion: 2.1 time: 0.038877 Oct 01 20:55:45.317585 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 820/1606] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 20:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194715992 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:55:45.326928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:45.332986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-60364902', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:45.347572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:45.348066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:45.351072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:45.351874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:45.352347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:45.352831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:45.476051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:45.476950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:45.492414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:45.493853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:45.496104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:45.498600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:45.499408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:45.501366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:45.522892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:55:45.636254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:45.643935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:45.644437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:45.644887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.104931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:46.112809 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a1f404ab-52fb-46e7-89c5-be3a17721d58 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.640896 Oct 01 20:55:46.113954 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 821/1607] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:45 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:46.119180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:46.119984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:46.126126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.126897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.127615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.128573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.129261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.130564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.138202 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48fc2915-6a6b-4a8f-b6f7-7c966751d55c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-60364902" status: 200 len: 1512 microversion: 2.1 time: 0.834737 Oct 01 20:55:46.139185 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 787/1608] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Oct 1 20:55:45 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-60364902 => generated 1512 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:46.144065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:46.144874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:46.163915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.164728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.165704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.166431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.166971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.167397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.401639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:46.410224 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c58f1502-00f2-40ad-b196-f0780add99df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1317 microversion: 2.1 time: 0.295041 Oct 01 20:55:46.419629 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 822/1609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:46 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:46.424923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-6a3849e0-8639-44f0-9139-6cb29eaba85a req-dccd7b8a-157f-499b-b482-45709b10ba44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9fa0c5-c93b-49cb-aa35-a7ff814837e0", "name": "network-vif-plugged", "status": "completed", "tag": "bc1a697c-1c1c-4c73-b57e-65e6cd768d9a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:46.444691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6a3849e0-8639-44f0-9139-6cb29eaba85a req-dccd7b8a-157f-499b-b482-45709b10ba44 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.445463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6a3849e0-8639-44f0-9139-6cb29eaba85a req-dccd7b8a-157f-499b-b482-45709b10ba44 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.446074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6a3849e0-8639-44f0-9139-6cb29eaba85a req-dccd7b8a-157f-499b-b482-45709b10ba44 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.470023 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-6a3849e0-8639-44f0-9139-6cb29eaba85a req-dccd7b8a-157f-499b-b482-45709b10ba44 service nova] Creating event network-vif-plugged:bc1a697c-1c1c-4c73-b57e-65e6cd768d9a for instance 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 on nch1-master-1 Oct 01 20:55:46.487653 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-6a3849e0-8639-44f0-9139-6cb29eaba85a req-dccd7b8a-157f-499b-b482-45709b10ba44 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065793 Oct 01 20:55:46.488859 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 823/1610] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:46.500354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:46.512400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:46.515311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:46.529827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.531351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.532022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.533110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.533896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.534912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.545928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:46.559116 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6203b95a-b0f5-4928-a23f-a3975c59ec81 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.418530 Oct 01 20:55:46.559713 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 788/1611] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:46 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:46.573785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:46.576709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:46.593647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.594222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.594716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.598513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.601856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.603094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:46.670150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:55:46.791968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:46.801973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:46.802864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:46.803763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.008179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:47.021211 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a8210fe-202d-4da0-9ea9-1a5bb823db6d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.456949 Oct 01 20:55:47.022002 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 789/1612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:46 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:47.038642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:47.039439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:47.046091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.046871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.047463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.048005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.048648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.049242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.082469 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-394a11b2-be16-4eee-ac48-57cce9c1aecf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.592063 Oct 01 20:55:47.083109 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 824/1613] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Oct 1 20:55:46 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:47.084058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:47.116106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:47.121448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:47.122481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.compute.servers [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Removing options 'limit' from query {{(pid=140437) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 01 20:55:47.123632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:47.129463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.129960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.130400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.131170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.131636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.132070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.162634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:47.218802 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-731bb628-7161-4a3b-a05a-d2cd9e753427 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 204 len: 0 microversion: 2.1 time: 0.193121 Oct 01 20:55:47.220303 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 790/1614] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:55:47 2022] DELETE /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:55:47.226180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:47.227198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:47.233562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.234373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.235772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.236732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.238270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.239932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.246019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:47.252428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.252810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.253394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.501287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:47.505118 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7c953752-523c-432c-9ce8-90d93634290a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.393292 Oct 01 20:55:47.505716 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 825/1615] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 20:55:47 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:47.510801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:47.511531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:47.519563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.520773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.521481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.522818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.528671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.529252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-943e993b-ef9b-4b7a-b638-4e6152c37572 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.307434 Oct 01 20:55:47.529576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.529853 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 791/1616] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:47 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:47.550791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:47.551621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:47.558389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.559217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.559728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.560626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.561091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.561710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.744567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:47.748524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:47.753989 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b6cba396-1931-4cd4-a7a3-0b249621dac1 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1468 microversion: 2.1 time: 0.247249 Oct 01 20:55:47.754594 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 826/1617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:47 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1468 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:47.759883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:47.763579 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd925c58-6efb-4b3b-9ea7-27ed7180d23a tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1317 microversion: 2.1 time: 0.223729 Oct 01 20:55:47.764785 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 792/1618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:47 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:47.769490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:47.770391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:47.772700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:47.773813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:47.778608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.779414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.780048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.780830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.781290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.781713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.784327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.785042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.785561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.787827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.788385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.789120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.867146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:47.891836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:55:47.951938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:47.960326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-46ae6082-d08f-4fda-ae8e-c7be49baa136 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.194277 Oct 01 20:55:47.961077 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 793/1619] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:47 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:47.961229 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dfd9e8c1-59d3-41d7-a7f6-dac48a4179e1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.205315 Oct 01 20:55:47.961858 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 827/1620] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:55:47 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:47.976083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:47.982069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:47.982580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.servers [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Removing options 'limit' from query {{(pid=140438) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 01 20:55:47.983419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:47.988751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.989235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.989673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:47.990406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:47.990898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:47.991484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.020169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:55:48.045366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:48.045986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:48.050587 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-be4c56f8-f7a6-435f-be76-305a451c41a1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.079581 Oct 01 20:55:48.051916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.052403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.052667 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 794/1621] 10.222.0.17 () {58 vars in 1150 bytes} [Sat Oct 1 20:55:47 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:48.052841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.053743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.054197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.054786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.065688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:48.070751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:48.071977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:48.077158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.077652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.078094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.078848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.079304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.079920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.106738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:55:48.136294 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-694927ca-5202-42b5-aeb7-203ec12ca070 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.074572 Oct 01 20:55:48.146848 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 795/1622] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 20:55:48 2022] GET /compute/v2.1/servers => generated 1009 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:48.152812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:48.159077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:48.159895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:48.172559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.172946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.173380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.174133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.174745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.175342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.210511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:48.218521 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ce9e2893-2b10-41b2-946e-c1770f5dadf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.176922 Oct 01 20:55:48.219225 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 828/1623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:48 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:48.263504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:55:48.336406 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9f592bdb-d661-4517-a1c1-000b642d6b77 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.187271 Oct 01 20:55:48.337047 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 796/1624] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:55:48 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:55:48.350746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:48.356486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:48.356939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.compute.servers [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Removing options 'limit' from query {{(pid=140437) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 01 20:55:48.357599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:48.362814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.363299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.363737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.364472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.364933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.365361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.558446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:48.559108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:48.566948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.567338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.567782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.568499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.569090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.569525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.680141 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-166bbe71-46d1-4a54-8dd7-389d19ef72a6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.330739 Oct 01 20:55:48.680141 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 829/1625] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Oct 1 20:55:48 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:48.691774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:48.697675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:48.698358 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-60364902', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:55:48.703848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.704342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.704785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.705531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.705989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.706418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.723665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:48.736154 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ffff534-1492-4485-90d5-a26c2917704d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.181875 Oct 01 20:55:48.736346 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 797/1626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:48 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:48.778123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:48.779304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:48.786468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.787074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.787584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.788359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.788893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.789389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.794749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:55:48.862721 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9a743166-6078-4771-9761-058023e452fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-60364902" status: 200 len: 344 microversion: 2.1 time: 0.175282 Oct 01 20:55:48.863644 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 830/1627] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Oct 1 20:55:48 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-60364902 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:48.868928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:48.869536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:48.878432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.878432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.878432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.878432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.878432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.879172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:48.962010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:48.970664 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2d7b5fd-ed5c-45e7-a97c-9e6ae6e02f44 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1468 microversion: 2.1 time: 0.197278 Oct 01 20:55:48.972063 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 798/1628] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:48 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1468 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:48.978053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-53701521-ab5a-4944-a557-ed75eb31b6fa tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:48.987340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53701521-ab5a-4944-a557-ed75eb31b6fa tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:48.988728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53701521-ab5a-4944-a557-ed75eb31b6fa tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:48.989181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53701521-ab5a-4944-a557-ed75eb31b6fa tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:49.029723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:49.040651 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-121c14a5-749b-4e81-8025-72b579f78a11 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1317 microversion: 2.1 time: 0.175343 Oct 01 20:55:49.041240 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 831/1629] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:48 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:49.046147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:49.046994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:49.053220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:49.053709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:49.054145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:49.054947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:49.055259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-53701521-ab5a-4944-a557-ed75eb31b6fa tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Going to try to stop instance {{(pid=140438) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 20:55:49.056444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:49.057045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:49.103256 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-53701521-ab5a-4944-a557-ed75eb31b6fa tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "POST /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a/action" status: 202 len: 0 microversion: 2.1 time: 0.128714 Oct 01 20:55:49.103942 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 799/1630] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:55:48 2022] POST /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:55:49.113131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:49.113847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:49.120763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:49.121257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:49.121693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:49.123159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:49.123653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:49.124093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:49.246009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:49.255515 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4593b135-0996-4e31-9251-6fc502a5c0f1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.213216 Oct 01 20:55:49.270940 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 832/1631] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:49 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:49.276093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:49.276718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:49.283880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:49.284376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:49.284909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:49.286174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:49.286691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:49.287129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:49.306148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:49.317291 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d80497ef-aa75-420a-ba09-10aa2fab7db1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.208941 Oct 01 20:55:49.318300 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 800/1632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:49 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:49.431263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:49.440553 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b8e857cd-0ae0-4ba2-bf28-4882bf987d51 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.168207 Oct 01 20:55:49.441131 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 833/1633] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:49 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:49.761297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:49.762803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:49.769820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:49.770572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:49.771357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:49.774779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:49.774779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:49.774779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:49.928812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:49.937830 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9377b7c1-4f47-40c3-bcd5-88b37768c1cd tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.182419 Oct 01 20:55:49.938405 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 801/1634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:49 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:49.994656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:49.995273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:50.001487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.002086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.002661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.003453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.003984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.004491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.004930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b9fb9294-53e4-4719-a0cf-3b81a6b475ff tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Action: 'update', calling method: .version_select at 0x7f41732d7310>, body: {"quota_set": {"ram": "5120"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:50.067485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9fb9294-53e4-4719-a0cf-3b81a6b475ff tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.067978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9fb9294-53e4-4719-a0cf-3b81a6b475ff tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.068422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9fb9294-53e4-4719-a0cf-3b81a6b475ff tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.069164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9fb9294-53e4-4719-a0cf-3b81a6b475ff tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.069628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9fb9294-53e4-4719-a0cf-3b81a6b475ff tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.070059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9fb9294-53e4-4719-a0cf-3b81a6b475ff tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.124171 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b9fb9294-53e4-4719-a0cf-3b81a6b475ff tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/51030f254d594921b621dc3651ea9173" status: 200 len: 148 microversion: 2.57 time: 0.244518 Oct 01 20:55:50.125018 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 834/1635] 10.222.0.17 () {62 vars in 1303 bytes} [Sat Oct 1 20:55:49 2022] PUT /compute/v2.1/os-quota-sets/51030f254d594921b621dc3651ea9173 => generated 148 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:55:50.129292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:50.129903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:50.135934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.136423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.136869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.137558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.138010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.138432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.147498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:50.155970 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2becebb3-a1ba-4855-936f-9d410007d521 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1468 microversion: 2.1 time: 0.165831 Oct 01 20:55:50.156626 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 802/1636] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:49 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1468 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:50.169970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6b6513c-5611-4348-a006-86b0ec45ecc3 tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Calling method '.version_select at 0x7f417c28d4c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:50.245318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6b6513c-5611-4348-a006-86b0ec45ecc3 tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.245817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6b6513c-5611-4348-a006-86b0ec45ecc3 tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.246294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6b6513c-5611-4348-a006-86b0ec45ecc3 tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.254338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6b6513c-5611-4348-a006-86b0ec45ecc3 tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.254883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6b6513c-5611-4348-a006-86b0ec45ecc3 tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.255330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6b6513c-5611-4348-a006-86b0ec45ecc3 tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.273094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:50.278736 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a6b6513c-5611-4348-a006-86b0ec45ecc3 tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/51030f254d594921b621dc3651ea9173/detail" status: 200 len: 463 microversion: 2.57 time: 0.120816 Oct 01 20:55:50.286927 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 803/1637] 10.222.0.17 () {60 vars in 1304 bytes} [Sat Oct 1 20:55:50 2022] GET /compute/v2.1/os-quota-sets/51030f254d594921b621dc3651ea9173/detail => generated 463 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:55:50.286927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:50.286927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:50.292443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.292932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.293372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.294076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.294770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.295195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.388882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:50.398220 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f9b4081b-71a7-4e67-b788-ce6885a29739 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1467 microversion: 2.1 time: 0.272269 Oct 01 20:55:50.398873 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 835/1638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:50 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1467 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:50.404165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:50.404782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:50.411356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.412035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.412642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.413517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.414143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.414789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.580943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:50.589791 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bbce2562-18c4-4b3b-907f-0795ce1aa64a tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.309309 Oct 01 20:55:50.590377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 804/1639] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:50 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:50.598887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd07805a-0e22-40f4-a3c3-84fdddf3a511 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:50.598887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bd07805a-0e22-40f4-a3c3-84fdddf3a511 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:50.602295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd07805a-0e22-40f4-a3c3-84fdddf3a511 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.603148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd07805a-0e22-40f4-a3c3-84fdddf3a511 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.603297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd07805a-0e22-40f4-a3c3-84fdddf3a511 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.603983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd07805a-0e22-40f4-a3c3-84fdddf3a511 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.604681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd07805a-0e22-40f4-a3c3-84fdddf3a511 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.605116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd07805a-0e22-40f4-a3c3-84fdddf3a511 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.705032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:50.713406 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fc9cad3b-83c2-4ee6-b8c9-af166595f28d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.312897 Oct 01 20:55:50.713985 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 836/1640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:50 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:50.733665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Action: 'update', calling method: .version_select at 0x7f417354de50>, body: {"quota_set": {"ram": "2048"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:50.789952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:50.800667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.801157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.801594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.802445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.802924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.803350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.817560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:50.827088 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd07805a-0e22-40f4-a3c3-84fdddf3a511 tempest-ServersOnMultiNodesTest-62598029 tempest-ServersOnMultiNodesTest-62598029-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1618 microversion: 2.1 time: 0.235355 Oct 01 20:55:50.827900 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 805/1641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:50 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1618 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:50.844089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.844580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.845021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.845825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.855431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:50.856056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:50.859161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.860038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.865207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.866003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.866767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.867823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.869015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.869681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.962442 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c53ca2df-d7ad-4234-bd41-180109c1998c tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/51030f254d594921b621dc3651ea9173?user_id=dabd0acd01284edc8077eb8311a790d4" status: 200 len: 148 microversion: 2.57 time: 0.231654 Oct 01 20:55:50.967015 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 837/1642] 10.222.0.17 () {62 vars in 1384 bytes} [Sat Oct 1 20:55:50 2022] PUT /compute/v2.1/os-quota-sets/51030f254d594921b621dc3651ea9173?user_id=dabd0acd01284edc8077eb8311a790d4 => generated 148 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:55:50.977446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:50.979053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:50.987740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.988476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.988916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:50.989661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:50.990295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:50.990751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.020441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:51.069453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:51.078978 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ed5ca1b-7f3e-4219-bb65-c7909c7b467c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.238504 Oct 01 20:55:51.079913 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 806/1643] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:50 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:51.086190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:51.087579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:51.095228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.096133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.096682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.097526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.098223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.098806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.165933 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d6024d02-1276-4803-b060-de441d8d29d0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 204 len: 0 microversion: 2.1 time: 0.197194 Oct 01 20:55:51.167459 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 838/1644] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:55:50 2022] DELETE /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:55:51.177269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-eb085ab0-0220-42e5-a0bc-7ddf7643b093 req-3e5c3327-3d68-450a-8ca2-8c396c7432ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2c58aa-4921-414b-95d6-d976a10c336b", "name": "network-vif-deleted", "tag": "91d3a9b8-4d83-45ba-9fcf-e81641ef7683"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:51.189050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-eb085ab0-0220-42e5-a0bc-7ddf7643b093 req-3e5c3327-3d68-450a-8ca2-8c396c7432ad service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.189450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-eb085ab0-0220-42e5-a0bc-7ddf7643b093 req-3e5c3327-3d68-450a-8ca2-8c396c7432ad service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.190090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-eb085ab0-0220-42e5-a0bc-7ddf7643b093 req-3e5c3327-3d68-450a-8ca2-8c396c7432ad service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.202598 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-eb085ab0-0220-42e5-a0bc-7ddf7643b093 req-3e5c3327-3d68-450a-8ca2-8c396c7432ad service nova] Creating event network-vif-deleted:91d3a9b8-4d83-45ba-9fcf-e81641ef7683 for instance bd2c58aa-4921-414b-95d6-d976a10c336b on nch1-master-1 Oct 01 20:55:51.207625 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-eb085ab0-0220-42e5-a0bc-7ddf7643b093 req-3e5c3327-3d68-450a-8ca2-8c396c7432ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038204 Oct 01 20:55:51.208248 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 839/1645] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:51.213277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-97e10c9e-cd62-42be-a3e9-d53a44105efb tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] Calling method '.version_select at 0x7f41732f78b0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:51.254100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:51.263083 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ae52a8b-4b19-4b36-9fc8-ecc14039c54d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.181936 Oct 01 20:55:51.275055 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 807/1646] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:51 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:51.275055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:51.275055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:51.276295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.277042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.277703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.278841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.279511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.280154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.319968 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-97e10c9e-cd62-42be-a3e9-d53a44105efb tempest-QuotasAdminTestV257-1281127633 tempest-QuotasAdminTestV257-1281127633-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/51030f254d594921b621dc3651ea9173?user_id=dabd0acd01284edc8077eb8311a790d4" status: 200 len: 190 microversion: 2.57 time: 0.110391 Oct 01 20:55:51.320786 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 840/1647] 10.222.0.17 () {60 vars in 1364 bytes} [Sat Oct 1 20:55:51 2022] GET /compute/v2.1/os-quota-sets/51030f254d594921b621dc3651ea9173?user_id=dabd0acd01284edc8077eb8311a790d4 => generated 190 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:55:51.343375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:51.347434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:51.361067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.365859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.366436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.367305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.368618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.372591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.422707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.423469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.424217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.424877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lazy-loading 'fault' on Instance uuid bd2c58aa-4921-414b-95d6-d976a10c336b {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:51.488157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:51.498182 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0e07f2dd-6e66-42fb-8af2-ac47df53ab18 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1302 microversion: 2.1 time: 0.162822 Oct 01 20:55:51.498902 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 841/1648] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:51 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1302 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:51.524940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:51.532650 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-90861118-bc4c-448b-8db1-5e6e14de4460 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1473 microversion: 2.1 time: 0.267863 Oct 01 20:55:51.533629 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 808/1649] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:51 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1473 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:51.612679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:51.613530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:51.620528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.621018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.621458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.622172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.622638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.623092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.737141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:51.737971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:51.745943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.746711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.747152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.747862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:51.748438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:51.749064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:51.763830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:51.776995 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9964241c-c6c0-4953-8621-ff3feeb03698 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.168348 Oct 01 20:55:51.778083 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 842/1650] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:51 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:51.893501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:51.902896 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a51d05f-c543-470e-b74d-744caa4d283c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.169771 Oct 01 20:55:51.903463 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 809/1651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:51 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:52.167986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:52.168634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:52.176369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.176885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.177313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.178107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.178598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.179033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.288151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:52.288767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:52.295904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.296497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.297198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.297856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.298440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.299058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.419300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:52.427578 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-db984920-b1ca-4dd8-a536-a54cbde2fc68 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.263601 Oct 01 20:55:52.428163 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 843/1652] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:52 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:52.503606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:52.512529 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c8cc8e8-a9c2-403a-a7f3-7a905cfed84e tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.228515 Oct 01 20:55:52.513099 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 810/1653] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:52 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:52.526816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:52.527687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:52.534844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.535356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.535807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.536714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.537246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.537733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.557664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:52.558767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:52.565865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.566066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:52.566364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.567251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.568162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.568728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.569551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.583318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.583848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.584299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.584766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lazy-loading 'fault' on Instance uuid bd2c58aa-4921-414b-95d6-d976a10c336b {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:52.639752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:52.647830 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2fbdd41d-0f19-4745-867d-fbc02598baf0 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 200 len: 1302 microversion: 2.1 time: 0.126421 Oct 01 20:55:52.648414 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 844/1654] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:52 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 1302 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:52.737295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:52.746327 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a5bc98b7-bd7f-469f-bfb3-2ff9158d3d41 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1473 microversion: 2.1 time: 0.193962 Oct 01 20:55:52.746951 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 811/1655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:52 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1473 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:52.803095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:52.804138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:52.813707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.814667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.815415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.816416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.817032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.817778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.934402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:52.937265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:52.954310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.956700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.957641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:52.958968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:52.962272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:52.964012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:53.144192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:53.154815 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4055c1c9-e024-4dd0-8749-fcaaf99defc1 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.356429 Oct 01 20:55:53.155555 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 845/1656] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:52 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:53.250190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:53.260525 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9b039f42-9b2c-495a-9e09-a967c87db155 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.335448 Oct 01 20:55:53.266560 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 812/1657] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:52 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:53.313716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-4767e09b-97ca-4072-acba-9816f09dc542 req-d2d21961-df9b-460c-81f1-598feee13fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0f4c70-33b6-4425-9277-2b8b941cd44b", "name": "network-vif-unplugged", "status": "completed", "tag": "36f4cf52-c2dd-417b-801e-0cd9a73b8ac3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:53.336357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4767e09b-97ca-4072-acba-9816f09dc542 req-d2d21961-df9b-460c-81f1-598feee13fce service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:53.337370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4767e09b-97ca-4072-acba-9816f09dc542 req-d2d21961-df9b-460c-81f1-598feee13fce service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:53.337842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4767e09b-97ca-4072-acba-9816f09dc542 req-d2d21961-df9b-460c-81f1-598feee13fce service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:53.362116 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-4767e09b-97ca-4072-acba-9816f09dc542 req-d2d21961-df9b-460c-81f1-598feee13fce service nova] Creating event network-vif-unplugged:36f4cf52-c2dd-417b-801e-0cd9a73b8ac3 for instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b on nch2-master-1 Oct 01 20:55:53.367215 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-4767e09b-97ca-4072-acba-9816f09dc542 req-d2d21961-df9b-460c-81f1-598feee13fce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058640 Oct 01 20:55:53.368219 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 846/1658] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:53.452614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:53.453660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:53.462407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:53.462942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:53.463493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:53.464458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:53.465120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:53.465718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:53.549616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:53.552541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:53.568474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:53.569365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:53.570021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:53.571481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:53.574568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:53.575323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.258991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:54.272236 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab1eeb5b-bfa6-4e15-84e6-16dfc120828c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.821512 Oct 01 20:55:54.297941 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 813/1659] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:53 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:54.305193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:54.307197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: bd2c58aa-4921-414b-95d6-d976a10c336b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:54.317797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.318598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.319234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.320215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.320885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.321493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.326670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:54.340172 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-42f30f7d-2216-47df-973b-b9e4390123b9 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.804444 Oct 01 20:55:54.342107 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 847/1660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:53 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:54.355597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:54.357737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:54.365419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] HTTP exception thrown: Instance bd2c58aa-4921-414b-95d6-d976a10c336b could not be found. Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Request method failure captured: Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b HTTP/1.1 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKffgIiQdX31xItDFcMq_OOdolJPqS-Tu1wVFZQyzbKLzg86oAmVRI3klx1wTM8HzGMvEtt5jH61gNgJMzCqzwh4QPrEktqh3BJS9UDy1bVbEuTr-npWRCsDoWIZRJXtkiZOw2EJuozmKBs_K6mtrnDKYVwIr4TWbQYb_8p6gWyHDEA Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 08fae3c0a9324c68b16dd495478a89e3 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08fae3c0a9324c68b16dd495478a89e3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08fae3c0a9324c68b16dd495478a89e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08fae3c0a9324c68b16dd495478a89e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08fae3c0a9324c68b16dd495478a89e3"}]}] Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 08fae3c0a9324c68b16dd495478a89e3 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-MigrationsAdminTest-1058261082-project Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e5bfbc1e512a445ca7527f3d79e40d16 Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-MigrationsAdminTest-1058261082-project Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance bd2c58aa-4921-414b-95d6-d976a10c336b could not be found. Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'bd2c58aa-4921-414b-95d6-d976a10c336b'} Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2c58aa-4921-414b-95d6-d976a10c336b could not be found. Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2c58aa-4921-414b-95d6-d976a10c336b could not be found. Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:54.367459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:54.372549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:54.372549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:54.372549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:54.372549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:54.372549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:54.372549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2c58aa-4921-414b-95d6-d976a10c336b could not be found. Oct 01 20:55:54.372549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:54.375332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Returning 404 to user: Instance bd2c58aa-4921-414b-95d6-d976a10c336b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:54.376578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-254f02ac-8fa0-48f8-a73f-3c271facfe3e tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b" status: 404 len: 111 microversion: 2.1 time: 0.077274 Oct 01 20:55:54.376749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.377469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.378367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.378634 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 814/1661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:54 2022] GET /compute/v2.1/servers/bd2c58aa-4921-414b-95d6-d976a10c336b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:55:54.379831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.381604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.382376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.391407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:54.395214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:54.408893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.410243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.410749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.414790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.415335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.415922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.509638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:54.520571 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e8a2022-cf53-4149-a28b-dda1ef306a12 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1302 microversion: 2.1 time: 0.173615 Oct 01 20:55:54.534996 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 848/1662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:54 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1302 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:54.546316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-96cd1889-b186-4b31-8051-7d4bb15c8be9 req-4b358597-12d1-4851-b456-e5b2c878ffb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9fa0c5-c93b-49cb-aa35-a7ff814837e0", "name": "network-vif-deleted", "tag": "bc1a697c-1c1c-4c73-b57e-65e6cd768d9a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:54.567621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-96cd1889-b186-4b31-8051-7d4bb15c8be9 req-4b358597-12d1-4851-b456-e5b2c878ffb3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.568385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-96cd1889-b186-4b31-8051-7d4bb15c8be9 req-4b358597-12d1-4851-b456-e5b2c878ffb3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.569947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-96cd1889-b186-4b31-8051-7d4bb15c8be9 req-4b358597-12d1-4851-b456-e5b2c878ffb3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.590890 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-96cd1889-b186-4b31-8051-7d4bb15c8be9 req-4b358597-12d1-4851-b456-e5b2c878ffb3 service nova] Creating event network-vif-deleted:bc1a697c-1c1c-4c73-b57e-65e6cd768d9a for instance 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 on nch1-master-1 Oct 01 20:55:54.597400 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-96cd1889-b186-4b31-8051-7d4bb15c8be9 req-4b358597-12d1-4851-b456-e5b2c878ffb3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060627 Oct 01 20:55:54.598514 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 849/1663] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:54.608980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:54.610143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:54.617595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.618941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.619776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.620659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.621331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.621942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.686563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:54.697500 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-70b06d40-d80e-4d89-af21-de72ffef5fcb tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.316689 Oct 01 20:55:54.698434 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 815/1664] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:54 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:54.704763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:54.705353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:54.713754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.714470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.715046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.715831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.716503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.717003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.755405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:54.895601 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec8ef015-c9d2-42c7-b385-e14865273b49 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 204 len: 0 microversion: 2.1 time: 0.193683 Oct 01 20:55:54.903349 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 816/1665] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:55:54 2022] DELETE /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:55:54.911568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:54.912275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:54.920393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.920899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.921341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.922056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:54.922537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:54.922969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:54.924270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:54.938920 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-71c36a55-871b-48e2-9fcf-cc7aa3c4b64a tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.332810 Oct 01 20:55:54.939911 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 850/1666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:54 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:55.148422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:55.162309 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9946a008-68e1-403a-81bf-a929ef453861 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1469 microversion: 2.1 time: 0.255143 Oct 01 20:55:55.165779 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 817/1667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:54 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1469 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:55.303304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:55.304077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:55.310112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.310638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.311081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.312037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.312499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.312927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.445402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-40749e59-8058-4035-8eee-8195b798c095 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Calling method '.version_select at 0x7f417c12e280>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:55.463426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:55.471172 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d9ce0c5f-d63e-4fe9-9fb1-27189db23268 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.172015 Oct 01 20:55:55.471751 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 851/1668] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:55 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:55.476185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:55.476799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:55.483450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.484198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.485059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.485983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.486691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.487128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.512231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-40749e59-8058-4035-8eee-8195b798c095 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 200 len: 371 microversion: 2.1 time: 0.189699 Oct 01 20:55:55.512823 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 818/1669] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Oct 1 20:55:55 2022] GET /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:55:55.517656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-f245ebd7-4ce4-4c93-bec7-87d9758eaca6 req-c6680405-8fd8-4d89-91bb-d487ece93780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0f4c70-33b6-4425-9277-2b8b941cd44b", "tag": "36f4cf52-c2dd-417b-801e-0cd9a73b8ac3"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:55.527885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f245ebd7-4ce4-4c93-bec7-87d9758eaca6 req-c6680405-8fd8-4d89-91bb-d487ece93780 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.528512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f245ebd7-4ce4-4c93-bec7-87d9758eaca6 req-c6680405-8fd8-4d89-91bb-d487ece93780 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.528954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f245ebd7-4ce4-4c93-bec7-87d9758eaca6 req-c6680405-8fd8-4d89-91bb-d487ece93780 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.540705 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-f245ebd7-4ce4-4c93-bec7-87d9758eaca6 req-c6680405-8fd8-4d89-91bb-d487ece93780 service nova] Creating event network-changed:36f4cf52-c2dd-417b-801e-0cd9a73b8ac3 for instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b on nch2-master-1 Oct 01 20:55:55.545738 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-f245ebd7-4ce4-4c93-bec7-87d9758eaca6 req-c6680405-8fd8-4d89-91bb-d487ece93780 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031440 Oct 01 20:55:55.546508 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 819/1670] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:55.551387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68b80ebe-c553-4216-a122-866405a890fb tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Action: 'update', calling method: .version_select at 0x7f4173b06700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:55.619826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68b80ebe-c553-4216-a122-866405a890fb tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.620875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68b80ebe-c553-4216-a122-866405a890fb tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.621319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68b80ebe-c553-4216-a122-866405a890fb tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.622060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68b80ebe-c553-4216-a122-866405a890fb tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.622537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68b80ebe-c553-4216-a122-866405a890fb tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.622965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68b80ebe-c553-4216-a122-866405a890fb tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.673674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68b80ebe-c553-4216-a122-866405a890fb tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 200 len: 328 microversion: 2.1 time: 0.125906 Oct 01 20:55:55.674991 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 820/1671] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:55:55 2022] PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:55.680082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:55.680859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:55.687497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.687987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.689123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.689268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.689689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.690122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.704266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:55.725947 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-afef6961-e577-4a79-99be-f31e099f26bf tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.253120 Oct 01 20:55:55.728751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.730867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.731508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.732137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lazy-loading 'fault' on Instance uuid 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:55.744041 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 852/1672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:55 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:55.763505 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:55.764132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:55.785272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.785778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.786219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.788826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:55.789311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:55.789779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:55.794791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:55.808372 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80585eee-54fc-4998-b2ee-d3a2eb8b4487 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 200 len: 1307 microversion: 2.1 time: 0.131917 Oct 01 20:55:55.810611 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 821/1673] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:55 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 1307 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:55.925684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1421626943", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:55.994245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:56.074870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:56.083435 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1148da97-55c0-496f-b12d-340ce852940b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.334971 Oct 01 20:55:56.084112 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 853/1674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:55 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:56.089807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:56.090660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:56.097030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.097516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.098142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.098884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.099343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.099767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.474701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:56.485643 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-19e67a5a-1358-44ea-bfe8-fbf9e5c03ebf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.400465 Oct 01 20:55:56.486136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:56.486626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:56.487146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:56.488600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:56.489601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:56.500841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.501773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.502686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.502870 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 854/1675] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:56 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:56.504420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.505466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.505943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.509217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:56.509656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:56.522769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.523273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.523717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.524524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.524931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.525362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.527886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Getting quotas for project 29a8000bfb634471b905328904f6bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:56.533151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Getting quotas for user 1b9aed06520543b5bad8fb49d9e0cfb6 and project 29a8000bfb634471b905328904f6bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:56.546615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.utils [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] cores quota exceeded for 29a8000bfb634471b905328904f6bb07, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140438) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 01 20:55:56.547541 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Request method failure captured: Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 145 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKlaJW4zHl_QDX_iX04luMPSd7DrdSBHgDAFb-Ay2RV0py7lXBH8S07yv6bCBkremcEYyYJGX_4-bQbnm5xnBRl5FZAUHDgbRVyCYBxlRnSQBy-hT8Uy2fEgzKNQPMXlxKZqfrf5ntcZiHm_JsUKX03eNsfAccQamYVli5HmIcugJbY Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 29a8000bfb634471b905328904f6bb07 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_29a8000bfb634471b905328904f6bb07", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29a8000bfb634471b905328904f6bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/29a8000bfb634471b905328904f6bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29a8000bfb634471b905328904f6bb07"}]}] Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 29a8000bfb634471b905328904f6bb07 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-QuotasAdminNegativeTest-36815941-project Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1b9aed06520543b5bad8fb49d9e0cfb6 Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-QuotasAdminNegativeTest-36815941-project Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1421626943", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1421626943', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452'}}} Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 20:55:56.551361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-39f459f7-8b65-4f82-9496-7ab1f5756fa9 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.694816 Oct 01 20:55:56.558276 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 822/1676] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:55 2022] POST /compute/v2.1/servers => generated 111 bytes in 696 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:55:56.563140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:56.563826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:56.572189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.572801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.573310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.574106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.574665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.575160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.828157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:56.836373 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3cbaa7a2-49e2-49b5-84bb-ca1c04632bfe tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1469 microversion: 2.1 time: 0.332460 Oct 01 20:55:56.836957 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 855/1677] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:56 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:56.856079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8edc7c77-9317-44d3-b6f4-ea964879ee68 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Action: 'update', calling method: .version_select at 0x7f41732d79d0>, body: {"quota_set": {"cores": 20}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:56.862756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:56.875208 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85b01a08-867d-4fa0-b8a5-90f1541d21d2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.319861 Oct 01 20:55:56.886709 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 823/1678] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:56 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:56.886709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:56.886709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:56.892134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.892727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.893245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.894208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.894935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.895425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.900722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:56.940655 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8edc7c77-9317-44d3-b6f4-ea964879ee68 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.941125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8edc7c77-9317-44d3-b6f4-ea964879ee68 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.941783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8edc7c77-9317-44d3-b6f4-ea964879ee68 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.942558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8edc7c77-9317-44d3-b6f4-ea964879ee68 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:56.943079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8edc7c77-9317-44d3-b6f4-ea964879ee68 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:56.943515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8edc7c77-9317-44d3-b6f4-ea964879ee68 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:56.951724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=24 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:57.005575 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8edc7c77-9317-44d3-b6f4-ea964879ee68 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 200 len: 329 microversion: 2.1 time: 0.153571 Oct 01 20:55:57.006361 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 856/1679] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:55:56 2022] PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 329 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:57.011065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:57.011679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:57.018684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.019250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.019824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.020579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.021045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.021481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.043434 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] HTTP exception thrown: Instance 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 could not be found. Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Request method failure captured: Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 HTTP/1.1 Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKi4hneyV0UmMyeEvxPvki8R_BaiMwZO97vr8doDlv5bt_m4zcidHAO2rMbLQLo5XufeJzCNqaQJgqbxlBI7erezeGG3CP5Ypm3KXxKIZiGIp8xqkmPMfLUCm1WFlGy0ybNN5EV4fBmpGyJFj_BHTiUeMt0TdrHml-jGdV2K6QFsrAQ Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_44683518fe3d46c58b139727cf0c9515", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}] Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: e82ed96a3e794a1b99662cec0969b7ec Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 could not be found. Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '6d9fa0c5-c93b-49cb-aa35-a7ff814837e0'} Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 could not be found. Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 could not be found. Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:57.045255 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 could not be found. Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Returning 404 to user: Instance 6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4f17de11-7788-47eb-a501-dbeec4e5d3e0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0" status: 404 len: 111 microversion: 2.1 time: 0.039963 Oct 01 20:55:57.051269 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 857/1680] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:57 2022] GET /compute/v2.1/servers/6d9fa0c5-c93b-49cb-aa35-a7ff814837e0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:55:57.052374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fde86bc2-5059-405c-98d1-b9292ca366ce tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Calling method '.version_select at 0x7f4173dc7790>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:57.111817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:57.121914 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fde86bc2-5059-405c-98d1-b9292ca366ce tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 200 len: 371 microversion: 2.1 time: 0.072876 Oct 01 20:55:57.122038 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-04076232-879e-4ff8-af4c-87e3d797879b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.244708 Oct 01 20:55:57.122136 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 824/1681] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:56 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:57.134892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:57.135389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:57.138958 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 858/1682] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Oct 1 20:55:57 2022] GET /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:57.142850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.143639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.143748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.143996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:57.144461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.144624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:57.144919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.145347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.153236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.153941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.154764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.155745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.156375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.156974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.173129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:55:57.265089 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0fd49307-2e8b-46a7-8d60-da676d3ce8bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 204 len: 0 microversion: 2.1 time: 0.134227 Oct 01 20:55:57.265879 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 825/1683] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:55:57 2022] DELETE /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:55:57.271231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c00f294-cdd6-4ba9-b4f3-9db18949db73 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Action: 'update', calling method: .version_select at 0x7f417c1eb550>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:57.341775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c00f294-cdd6-4ba9-b4f3-9db18949db73 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.342271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c00f294-cdd6-4ba9-b4f3-9db18949db73 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.342773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c00f294-cdd6-4ba9-b4f3-9db18949db73 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.343504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c00f294-cdd6-4ba9-b4f3-9db18949db73 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.343960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c00f294-cdd6-4ba9-b4f3-9db18949db73 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.344388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c00f294-cdd6-4ba9-b4f3-9db18949db73 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.357236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:57.366915 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-90147551-13d1-4be9-94c5-5191672689b5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.226685 Oct 01 20:55:57.369009 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 859/1684] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:57 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:57.375048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:57.375722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:57.382361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.390031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.390839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.391320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.391804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.394574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.404156 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8c00f294-cdd6-4ba9-b4f3-9db18949db73 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 200 len: 328 microversion: 2.1 time: 0.136986 Oct 01 20:55:57.405010 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 826/1685] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:55:57 2022] PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 328 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:57.459050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-460271108", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:57.534878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:57.566082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:57.577735 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f717da67-5e80-4f95-a44f-58a95c002329 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1473 microversion: 2.1 time: 0.207504 Oct 01 20:55:57.579371 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 860/1686] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:57 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1473 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:57.584909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:57.585929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:57.590459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:57.594742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.601094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.602100 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.603046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.603639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.604464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.819045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:57.827258 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9effcf18-ef91-432d-936c-2c50b1593bea tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.246569 Oct 01 20:55:57.838728 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 861/1687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:57 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:57.845378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-aa1abc0e-724a-4945-8dbe-5a9169130163 req-6bd806c2-cd55-40d2-a877-053710d638e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718605d6-75e8-4b45-8db7-cd48626c0ce3", "name": "network-vif-deleted", "tag": "0293e38a-8ed1-4661-add8-6b614f7f55b2"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:57.858640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:57.858814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-aa1abc0e-724a-4945-8dbe-5a9169130163 req-6bd806c2-cd55-40d2-a877-053710d638e2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.859192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-aa1abc0e-724a-4945-8dbe-5a9169130163 req-6bd806c2-cd55-40d2-a877-053710d638e2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.859627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-aa1abc0e-724a-4945-8dbe-5a9169130163 req-6bd806c2-cd55-40d2-a877-053710d638e2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.859767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:57.860256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:57.860839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:57.861531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:57.866816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:57.873972 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-aa1abc0e-724a-4945-8dbe-5a9169130163 req-6bd806c2-cd55-40d2-a877-053710d638e2 service nova] Creating event network-vif-deleted:0293e38a-8ed1-4661-add8-6b614f7f55b2 for instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 on nch1-master-1 Oct 01 20:55:57.874400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.874913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.875355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.876086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.876714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.877323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.879736 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-aa1abc0e-724a-4945-8dbe-5a9169130163 req-6bd806c2-cd55-40d2-a877-053710d638e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039516 Oct 01 20:55:57.880348 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 862/1688] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:57.886922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:57.887665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:57.894484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.895057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.895502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.896218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.896672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.897281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.899789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Getting quotas for project 29a8000bfb634471b905328904f6bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:57.905333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Getting quotas for user 1b9aed06520543b5bad8fb49d9e0cfb6 and project 29a8000bfb634471b905328904f6bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:57.919026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.utils [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] instances quota exceeded for 29a8000bfb634471b905328904f6bb07, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140438) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 01 20:55:57.919578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Request method failure captured: Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 144 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKlaJW4zHl_QDX_iX04luMPSd7DrdSBHgDAFb-Ay2RV0py7lXBH8S07yv6bCBkremcEYyYJGX_4-bQbnm5xnBRl5FZAUHDgbRVyCYBxlRnSQBy-hT8Uy2fEgzKNQPMXlxKZqfrf5ntcZiHm_JsUKX03eNsfAccQamYVli5HmIcugJbY Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 29a8000bfb634471b905328904f6bb07 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_29a8000bfb634471b905328904f6bb07", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29a8000bfb634471b905328904f6bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/29a8000bfb634471b905328904f6bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29a8000bfb634471b905328904f6bb07"}]}] Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 29a8000bfb634471b905328904f6bb07 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-QuotasAdminNegativeTest-36815941-project Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1b9aed06520543b5bad8fb49d9e0cfb6 Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-QuotasAdminNegativeTest-36815941-project Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-460271108", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-460271108', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452'}}} Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 20:55:57.922137 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 01 20:55:57.927164 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:57.931206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:57.932088 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b08d4f70-27dd-4673-8510-9f58589f2cd8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.477004 Oct 01 20:55:57.933037 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 827/1689] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:57 2022] POST /compute/v2.1/servers => generated 119 bytes in 478 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:55:57.936588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.937684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.938235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.938880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lazy-loading 'fault' on Instance uuid 718605d6-75e8-4b45-8db7-cd48626c0ce3 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:57.939214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:57.940731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:57.949174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.949666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.950228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.950965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:57.951445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:57.951874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:57.985298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bfbc1e512a445ca7527f3d79e40d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fae3c0a9324c68b16dd495478a89e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:57.993446 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-116fc227-003a-4cf3-b3e3-a34c692d5080 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 200 len: 1303 microversion: 2.1 time: 0.111797 Oct 01 20:55:57.994023 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 863/1690] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:57 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:57.998538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-79415aa0-06f5-4761-b79f-90f3cdef3a3e tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Action: 'update', calling method: .version_select at 0x7f417354d280>, body: {"quota_set": {"instances": 10}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:58.069735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79415aa0-06f5-4761-b79f-90f3cdef3a3e tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.070227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79415aa0-06f5-4761-b79f-90f3cdef3a3e tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.071248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79415aa0-06f5-4761-b79f-90f3cdef3a3e tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.071992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79415aa0-06f5-4761-b79f-90f3cdef3a3e tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.072455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79415aa0-06f5-4761-b79f-90f3cdef3a3e tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.072898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79415aa0-06f5-4761-b79f-90f3cdef3a3e tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.085796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:58.094163 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1dd1c04b-16ff-481f-986a-bd3a3ae82fe0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.160067 Oct 01 20:55:58.094774 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 828/1691] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:57 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:58.130279 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-79415aa0-06f5-4761-b79f-90f3cdef3a3e tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 200 len: 329 microversion: 2.1 time: 0.135170 Oct 01 20:55:58.130973 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 864/1692] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:55:57 2022] PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 329 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:58.144769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23807b4e-134d-4cf2-a0c6-b2de753dcf2c tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Calling method '.version_select at 0x7f4173043430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:58.144943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:58.145448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:58.152925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.153415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.153857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.154585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.155046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.155469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.160266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:55:58.221980 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23807b4e-134d-4cf2-a0c6-b2de753dcf2c tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 200 len: 371 microversion: 2.1 time: 0.080799 Oct 01 20:55:58.222689 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 829/1693] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Oct 1 20:55:58 2022] GET /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:55:58.234519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19b5d1d4-b3e6-4430-a7e3-71bcd628402f tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Action: 'update', calling method: .version_select at 0x7f4172ff2280>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:58.303534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19b5d1d4-b3e6-4430-a7e3-71bcd628402f tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.304073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19b5d1d4-b3e6-4430-a7e3-71bcd628402f tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.304695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19b5d1d4-b3e6-4430-a7e3-71bcd628402f tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.305700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19b5d1d4-b3e6-4430-a7e3-71bcd628402f tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.306231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19b5d1d4-b3e6-4430-a7e3-71bcd628402f tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.306703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19b5d1d4-b3e6-4430-a7e3-71bcd628402f tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.317093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:58.328341 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e132355a-7a32-4644-a8d0-ad029d62568f tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.187177 Oct 01 20:55:58.329281 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 865/1694] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:58 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:58.380906 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19b5d1d4-b3e6-4430-a7e3-71bcd628402f tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 200 len: 325 microversion: 2.1 time: 0.150027 Oct 01 20:55:58.381696 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 830/1695] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:55:58 2022] PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 325 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:55:58.390447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:58.391497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:58.397907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.398409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.398928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.399637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.400103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.400534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.433376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1891926728", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:58.485752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:55:58.584394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:58.592902 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e6b4614b-8605-44c4-a9a8-81ef1e6226e4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.206339 Oct 01 20:55:58.593493 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 866/1696] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:58 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:58.606105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:58.606920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:58.612798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.613315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.613757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.614466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.614946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.615376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.739803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:55:58.740304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:55:58.740698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:55:58.741112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:55:58.741529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:55:58.751114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.751599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.752033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.752762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.753215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.753721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.771963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Getting quotas for project 29a8000bfb634471b905328904f6bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:55:58.777173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Getting quotas for user 1b9aed06520543b5bad8fb49d9e0cfb6 and project 29a8000bfb634471b905328904f6bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:55:58.780084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:58.787963 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2ce03acd-292e-46b0-b7e0-ae1f462ac5cd tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1473 microversion: 2.1 time: 0.185609 Oct 01 20:55:58.788725 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 867/1697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:58 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:58.790162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.utils [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] ram quota exceeded for 29a8000bfb634471b905328904f6bb07, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140438) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 01 20:55:58.790746 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Request method failure captured: Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 145 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKlaJW4zHl_QDX_iX04luMPSd7DrdSBHgDAFb-Ay2RV0py7lXBH8S07yv6bCBkremcEYyYJGX_4-bQbnm5xnBRl5FZAUHDgbRVyCYBxlRnSQBy-hT8Uy2fEgzKNQPMXlxKZqfrf5ntcZiHm_JsUKX03eNsfAccQamYVli5HmIcugJbY Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 29a8000bfb634471b905328904f6bb07 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_29a8000bfb634471b905328904f6bb07", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29a8000bfb634471b905328904f6bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/29a8000bfb634471b905328904f6bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29a8000bfb634471b905328904f6bb07"}]}] Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 29a8000bfb634471b905328904f6bb07 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-QuotasAdminNegativeTest-36815941-project Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1b9aed06520543b5bad8fb49d9e0cfb6 Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-QuotasAdminNegativeTest-36815941-project Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1891926728", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1891926728', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452'}}} Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 20:55:58.792696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19a88fe7-74e1-49a5-86b0-9b6063352f9b tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.365349 Oct 01 20:55:58.797452 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 831/1698] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:55:58 2022] POST /compute/v2.1/servers => generated 110 bytes in 367 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:55:58.802657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4eb3f82f-113a-45ce-ba98-81e2dfac0408 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Action: 'update', calling method: .version_select at 0x7f41732d79d0>, body: {"quota_set": {"ram": 51200}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:58.852962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:58.853579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:58.859610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.860088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.860521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.861229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.861692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.862110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.864675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb3f82f-113a-45ce-ba98-81e2dfac0408 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.865164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb3f82f-113a-45ce-ba98-81e2dfac0408 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.865610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb3f82f-113a-45ce-ba98-81e2dfac0408 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.867161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb3f82f-113a-45ce-ba98-81e2dfac0408 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:58.867161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb3f82f-113a-45ce-ba98-81e2dfac0408 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:58.867421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4eb3f82f-113a-45ce-ba98-81e2dfac0408 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:58.927956 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4eb3f82f-113a-45ce-ba98-81e2dfac0408 tempest-QuotasAdminNegativeTest-148632111 tempest-QuotasAdminNegativeTest-148632111-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 200 len: 329 microversion: 2.1 time: 0.128631 Oct 01 20:55:58.928640 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 868/1699] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:55:58 2022] PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 329 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:55:58.941898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f425be37-8dfb-4f61-b992-20e16de345c8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Action: 'update', calling method: .version_select at 0x7f41781b8940>, body: {"quota_set": {"ram": 0}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:58.947453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f425be37-8dfb-4f61-b992-20e16de345c8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '1b9aed06520543b5bad8fb49d9e0cfb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a8000bfb634471b905328904f6bb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f425be37-8dfb-4f61-b992-20e16de345c8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Request method failure captured: Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 HTTP/1.1 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 25 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKlaJW4zHl_QDX_iX04luMPSd7DrdSBHgDAFb-Ay2RV0py7lXBH8S07yv6bCBkremcEYyYJGX_4-bQbnm5xnBRl5FZAUHDgbRVyCYBxlRnSQBy-hT8Uy2fEgzKNQPMXlxKZqfrf5ntcZiHm_JsUKX03eNsfAccQamYVli5HmIcugJbY Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 29a8000bfb634471b905328904f6bb07 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_29a8000bfb634471b905328904f6bb07", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29a8000bfb634471b905328904f6bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/29a8000bfb634471b905328904f6bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29a8000bfb634471b905328904f6bb07"}]}] Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 29a8000bfb634471b905328904f6bb07 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-36815941 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-QuotasAdminNegativeTest-36815941-project Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1b9aed06520543b5bad8fb49d9e0cfb6 Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-QuotasAdminNegativeTest-36815941-project Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: {"quota_set": {"ram": 0}} Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '29a8000bfb634471b905328904f6bb07', 'body': {'quota_set': {'ram': 0}}} Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:55:58.949552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f425be37-8dfb-4f61-b992-20e16de345c8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:58.956182 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f425be37-8dfb-4f61-b992-20e16de345c8 tempest-QuotasAdminNegativeTest-36815941 tempest-QuotasAdminNegativeTest-36815941-project] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07" status: 403 len: 116 microversion: 2.1 time: 0.012999 Oct 01 20:55:58.958884 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 869/1700] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:55:58 2022] PUT /compute/v2.1/os-quota-sets/29a8000bfb634471b905328904f6bb07 => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:55:59.018987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:59.019712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] [instance: 718605d6-75e8-4b45-8db7-cd48626c0ce3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:59.032908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.033959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.035025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.035716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.036273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.036847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.053052 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] HTTP exception thrown: Instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 could not be found. Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Request method failure captured: Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 HTTP/1.1 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKffgIiQdX31xItDFcMq_OOdolJPqS-Tu1wVFZQyzbKLzg86oAmVRI3klx1wTM8HzGMvEtt5jH61gNgJMzCqzwh4QPrEktqh3BJS9UDy1bVbEuTr-npWRCsDoWIZRJXtkiZOw2EJuozmKBs_K6mtrnDKYVwIr4TWbQYb_8p6gWyHDEA Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 08fae3c0a9324c68b16dd495478a89e3 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08fae3c0a9324c68b16dd495478a89e3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08fae3c0a9324c68b16dd495478a89e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08fae3c0a9324c68b16dd495478a89e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08fae3c0a9324c68b16dd495478a89e3"}]}] Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 08fae3c0a9324c68b16dd495478a89e3 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-MigrationsAdminTest-1058261082 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-MigrationsAdminTest-1058261082-project Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: e5bfbc1e512a445ca7527f3d79e40d16 Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-MigrationsAdminTest-1058261082-project Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 could not be found. Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '718605d6-75e8-4b45-8db7-cd48626c0ce3'} Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 could not be found. Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 could not be found. Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:55:59.054953 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:59.060437 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:55:59.060437 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:55:59.060437 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:55:59.060437 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:55:59.060437 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:55:59.060437 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 could not be found. Oct 01 20:55:59.060437 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:55:59.062760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] Returning 404 to user: Instance 718605d6-75e8-4b45-8db7-cd48626c0ce3 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:55:59.064164 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e545d2e2-e778-4f59-83a1-bf42104fec75 tempest-MigrationsAdminTest-1058261082 tempest-MigrationsAdminTest-1058261082-project] 10.222.0.17 "GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3" status: 404 len: 111 microversion: 2.1 time: 0.048772 Oct 01 20:55:59.065280 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 870/1701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:59 2022] GET /compute/v2.1/servers/718605d6-75e8-4b45-8db7-cd48626c0ce3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:55:59.094377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:59.104830 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-261dd4b5-5d4c-45f3-96ef-bef86fd21afd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.256957 Oct 01 20:55:59.105752 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 832/1702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:58 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:59.122406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:59.123908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:59.133583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.136033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.137088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.138683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.139528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.140135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.359957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:59.360847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:59.368401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.368915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.369930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.370346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.370845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.371275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.372054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:59.385414 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e12c9f8c-abd7-4f8a-9647-09988ad7a404 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.272674 Oct 01 20:55:59.386017 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 871/1703] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:59 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:59.622603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:59.624009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:59.656006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.656770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.658390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.661159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.661944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.662803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.677460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:59.695485 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-91712c31-ce3f-4c9d-8d12-d1ad91bfd55c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.345538 Oct 01 20:55:59.696872 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 833/1704] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:59 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:55:59.814203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:55:59.816320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:55:59.828693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.829737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.830182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.830962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.831496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:55:59.839833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.840346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.845634 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1c05820d-1808-4072-ad0c-a4cce50c8c42 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.233105 Oct 01 20:55:59.846478 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 872/1705] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:59 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:55:59.904462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-8c0467de-875e-4a63-8ddc-19267882a1ee req-cf4799c2-f1f1-410c-a5fb-fb7debf9d4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae12c3c-6253-4d5b-8317-6cbb995e1249", "name": "network-vif-deleted", "tag": "76ff29a6-64b9-4b28-be9e-a4d576ded38c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:55:59.926851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8c0467de-875e-4a63-8ddc-19267882a1ee req-cf4799c2-f1f1-410c-a5fb-fb7debf9d4a2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.927661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8c0467de-875e-4a63-8ddc-19267882a1ee req-cf4799c2-f1f1-410c-a5fb-fb7debf9d4a2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.938669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8c0467de-875e-4a63-8ddc-19267882a1ee req-cf4799c2-f1f1-410c-a5fb-fb7debf9d4a2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.940555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:55:59.941528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:55:59.942035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:55:59.942605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lazy-loading 'fault' on Instance uuid 2ae12c3c-6253-4d5b-8317-6cbb995e1249 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:55:59.958982 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-8c0467de-875e-4a63-8ddc-19267882a1ee req-cf4799c2-f1f1-410c-a5fb-fb7debf9d4a2 service nova] Creating event network-vif-deleted:76ff29a6-64b9-4b28-be9e-a4d576ded38c for instance 2ae12c3c-6253-4d5b-8317-6cbb995e1249 on nch2-master-1 Oct 01 20:55:59.967408 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-8c0467de-875e-4a63-8ddc-19267882a1ee req-cf4799c2-f1f1-410c-a5fb-fb7debf9d4a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066303 Oct 01 20:55:59.970619 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 873/1706] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:00.020374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:00.032388 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dbfce731-1ae2-4a3c-9815-1e2fc9e9a758 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 200 len: 1307 microversion: 2.1 time: 0.223882 Oct 01 20:56:00.033726 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 834/1707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:55:59 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 1307 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:00.132636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:00.134114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:00.145074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:00.145868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:00.147429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:00.151952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:00.152533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:00.152986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:00.390638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:00.401442 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b6c80a37-857e-4c4b-ab6e-35f6180b5e62 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.274212 Oct 01 20:56:00.404238 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 874/1708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:00 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:00.424797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:00.425425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:00.436573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:00.437323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:00.437905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:00.440109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:00.442678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:00.443073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:00.649530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:00.659023 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-25911c69-8734-476a-b979-79b43dceabea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.254043 Oct 01 20:56:00.659867 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 835/1709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:00 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:00.722121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:00.723505 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:00.729806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:00.730558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:00.731194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:00.732535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:00.733183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:00.733831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:00.871264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:00.871952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:00.886326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:00.887396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:00.888118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:00.891743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:00.892333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:00.894072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.428753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:01.442931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:01.446176 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cac62dcd-222b-484d-9668-f8350f689743 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.729350 Oct 01 20:56:01.446856 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 875/1710] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:00 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:01.455654 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2bcabfb9-e25c-48c4-aa08-27f8d85d293e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.589627 Oct 01 20:56:01.461885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:01.464076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ae12c3c-6253-4d5b-8317-6cbb995e1249] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:01.467584 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 836/1711] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:00 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:01.472838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:01.474425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:01.479354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.480090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.481125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.483318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.485231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.485377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.485781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.486409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.487436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.488004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.488321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.488667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.523174 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] HTTP exception thrown: Instance 2ae12c3c-6253-4d5b-8317-6cbb995e1249 could not be found. Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Request method failure captured: Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 HTTP/1.1 Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKi4hneyV0UmMyeEvxPvki8R_BaiMwZO97vr8doDlv5bt_m4zcidHAO2rMbLQLo5XufeJzCNqaQJgqbxlBI7erezeGG3CP5Ypm3KXxKIZiGIp8xqkmPMfLUCm1WFlGy0ybNN5EV4fBmpGyJFj_BHTiUeMt0TdrHml-jGdV2K6QFsrAQ Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_44683518fe3d46c58b139727cf0c9515", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}] Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: e82ed96a3e794a1b99662cec0969b7ec Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 2ae12c3c-6253-4d5b-8317-6cbb995e1249 could not be found. Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '2ae12c3c-6253-4d5b-8317-6cbb995e1249'} Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae12c3c-6253-4d5b-8317-6cbb995e1249 could not be found. Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae12c3c-6253-4d5b-8317-6cbb995e1249 could not be found. Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:01.525441 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae12c3c-6253-4d5b-8317-6cbb995e1249 could not be found. Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Returning 404 to user: Instance 2ae12c3c-6253-4d5b-8317-6cbb995e1249 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-86fe4b62-751a-443a-b061-ded2a637ac82 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249" status: 404 len: 111 microversion: 2.1 time: 0.078374 Oct 01 20:56:01.533018 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 876/1712] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:01 2022] GET /compute/v2.1/servers/2ae12c3c-6253-4d5b-8317-6cbb995e1249 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:01.545839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:01.546636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:01.554611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.555148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.555728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.556452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.557100 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.557647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.597637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:01.754522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:01.763005 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e07e9b2b-54ef-4c24-bd66-e5055c32dd37 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.294174 Oct 01 20:56:01.766928 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 837/1713] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:01 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:01.779252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:01.779907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:01.791436 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a67b3bdd-532f-47e9-9573-79b93ad31b51 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 204 len: 0 microversion: 2.1 time: 0.255698 Oct 01 20:56:01.793265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.793782 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 877/1714] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:01 2022] DELETE /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:01.799730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.800435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.801376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.803142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:01.803833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.803988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:01.804788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.810818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.811667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.812825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:01.813796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:01.814629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:01.815270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:02.140264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:02.147026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:02.152110 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b1f9e631-e0d2-446c-bd60-26ab7bbd9b93 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1471 microversion: 2.1 time: 0.353420 Oct 01 20:56:02.156051 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 878/1715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:01 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:02.171925 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df58939a-dd7a-4641-b42e-eeafd70feab1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.402542 Oct 01 20:56:02.172683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 838/1716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:01 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:02.472965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:02.473584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:02.480783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:02.481257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:02.481926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:02.487271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:02.487977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:02.491815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:02.492229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:02.492906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:02.500338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:02.501104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:02.501545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:02.502451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:02.503115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:02.503557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:02.730762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:02.751983 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4ced5f64-1f17-404c-a927-a68dcfb2c540 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.282625 Oct 01 20:56:02.758668 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 879/1717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:02 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:02.773677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:02.782173 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3c8dbe93-88df-451c-bfe3-5ec5b14f7f40 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.298741 Oct 01 20:56:02.782989 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 839/1718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:02 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:02.793323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:02.793938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:02.802206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:02.802826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:02.803337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:02.804115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:02.804642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:02.805184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:02.964074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:02.972042 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a0e13a09-364f-4f80-86a6-815bd30526fd tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.182591 Oct 01 20:56:02.992258 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 880/1719] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:02 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:03.177096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:03.177714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:03.184204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.184952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.185391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:03.186267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.187174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.187787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:03.222651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1813403864", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": "none"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:03.289843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:56:03.290277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:56:03.291114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:56:03.295092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:56:03.295674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:56:03.309475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.310237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.310876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:03.312124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.313891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.313891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:03.337783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Getting quotas for project 6f9e92bfb756442983da09a9adfe2e88. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:03.346710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Getting quotas for user da040526fe7b490784ea27f2572f0b7b and project 6f9e92bfb756442983da09a9adfe2e88. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:03.364929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:56:03.367869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:56:03.421823 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19f7850b-6edc-44af-b481-90279b5c77d3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.510681 Oct 01 20:56:03.422989 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 840/1720] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:56:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 01 20:56:03.428070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:03.429241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:03.435913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.436498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.437270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:03.438062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.438640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.439198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:03.621740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:03.639459 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0d3e5022-b4f3-4b31-a9b1-3e9024f4d737 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1471 microversion: 2.1 time: 0.466097 Oct 01 20:56:03.655454 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 881/1721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:03 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1471 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:03.662683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9475b20c-1fb8-412c-be2b-5ecf37b470fd tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:03.666781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9475b20c-1fb8-412c-be2b-5ecf37b470fd tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:03.805991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9475b20c-1fb8-412c-be2b-5ecf37b470fd tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:03.822912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9475b20c-1fb8-412c-be2b-5ecf37b470fd tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:03.824622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9475b20c-1fb8-412c-be2b-5ecf37b470fd tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:03.834678 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9475b20c-1fb8-412c-be2b-5ecf37b470fd tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "PUT /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1359 microversion: 2.75 time: 0.177642 Oct 01 20:56:03.835342 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 882/1722] 10.222.0.17 () {62 vars in 1297 bytes} [Sat Oct 1 20:56:03 2022] PUT /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:03.840207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:03.840830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:03.847131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.847633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.848083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:03.848798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.849272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.849707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:03.943023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:03.951756 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-91be6ac3-5ed1-4a44-ac81-ab48d562e255 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1496 microversion: 2.1 time: 0.527467 Oct 01 20:56:03.952421 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 841/1723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:03 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1496 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:03.967148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:03.967148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:03.980883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.981414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.982036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:03.982647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:03.983111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:03.983790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:04.372825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:04.383275 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b2237ff3-c08c-421e-95df-4eb791ff4e88 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1392 microversion: 2.1 time: 0.546758 Oct 01 20:56:04.384489 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 883/1724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:03 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1392 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:04.390793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:04.391675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:04.399250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:04.400034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:04.400722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:04.401812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:04.402587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:04.403297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:04.403653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:04.442102 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-11f277d8-2916-4aa7-a01f-b60f478be3c7 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.485465 Oct 01 20:56:04.445162 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 842/1725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:03 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:04.454525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:04.455627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:04.469811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:04.470657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:04.471445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:04.472340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:04.473250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:04.474002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:04.480705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:04.589405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:04.592678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:04.603198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:04.605225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:04.615720 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8006665d-042e-4f57-9bc2-b19bbd053ff1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1355 microversion: 2.75 time: 0.229697 Oct 01 20:56:04.629072 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 884/1726] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:04 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1355 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:04.670792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:04.672536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:04.688305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:04.689950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:04.693040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:04.694205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:04.699326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:04.699790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:04.874641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:04.903538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:04.913807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02b2d44a-33e1-4124-b81c-d53d0d4833e8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.466388 Oct 01 20:56:04.915861 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 843/1727] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:04 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:04.920659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-834bc191-e4f8-4315-83a8-7b8bf3140a52 req-8b4c92dc-fddc-4f78-9b01-8544853898f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f8e63c-9de6-41e3-83b4-bb0715083b05", "name": "network-vif-deleted", "tag": "3bdc2e6e-032a-4305-bd86-e5a991fd2084"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:04.932074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-834bc191-e4f8-4315-83a8-7b8bf3140a52 req-8b4c92dc-fddc-4f78-9b01-8544853898f7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:04.932836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-834bc191-e4f8-4315-83a8-7b8bf3140a52 req-8b4c92dc-fddc-4f78-9b01-8544853898f7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:04.933460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-834bc191-e4f8-4315-83a8-7b8bf3140a52 req-8b4c92dc-fddc-4f78-9b01-8544853898f7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:04.947444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-834bc191-e4f8-4315-83a8-7b8bf3140a52 req-8b4c92dc-fddc-4f78-9b01-8544853898f7 service nova] Creating event network-vif-deleted:3bdc2e6e-032a-4305-bd86-e5a991fd2084 for instance 93f8e63c-9de6-41e3-83b4-bb0715083b05 on nch2-master-1 Oct 01 20:56:04.954324 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-834bc191-e4f8-4315-83a8-7b8bf3140a52 req-8b4c92dc-fddc-4f78-9b01-8544853898f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037084 Oct 01 20:56:04.956192 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe9a86ab-7580-48a0-ac04-b21b9641e701 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1429 microversion: 2.1 time: 0.290458 Oct 01 20:56:04.959115 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 885/1729] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:04 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1429 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:04.959276 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 844/1729] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:04.988219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:04.993866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:05.017104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.018428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.018954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.019981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.020703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.021304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.395492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:05.404675 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92a4cca0-6a25-484a-849d-8d11331aeb3a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 200 len: 1473 microversion: 2.1 time: 0.424793 Oct 01 20:56:05.415674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:05.418876 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 845/1730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:04 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 1473 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:05.418990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:05.421201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.421697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.422138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.422892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.423326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.431973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3fbcde67-55ec-4c4f-9d54-a055bff28a89 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-920448100"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:05.435396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3fbcde67-55ec-4c4f-9d54-a055bff28a89 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:05.443012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.452551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fbcde67-55ec-4c4f-9d54-a055bff28a89 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.453203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fbcde67-55ec-4c4f-9d54-a055bff28a89 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.453748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fbcde67-55ec-4c4f-9d54-a055bff28a89 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.456575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fbcde67-55ec-4c4f-9d54-a055bff28a89 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.457209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fbcde67-55ec-4c4f-9d54-a055bff28a89 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.458551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fbcde67-55ec-4c4f-9d54-a055bff28a89 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.759378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:05.784050 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aca2f71b-162f-4668-8083-0c30ddd9fbb6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1382 microversion: 2.1 time: 0.376104 Oct 01 20:56:05.786692 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 886/1731] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:05 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1382 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:05.794392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:05.795398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:05.806219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.806913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.807635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.808693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.809791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.810758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.949125 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3fbcde67-55ec-4c4f-9d54-a055bff28a89 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463/action" status: 202 len: 0 microversion: 2.1 time: 0.521096 Oct 01 20:56:05.949947 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 846/1732] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:56:05 2022] POST /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 20:56:05.963392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:05.966925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:05.986896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.987590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.988683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.989420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:05.990048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:05.990772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:05.998732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:06.016101 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e827a5b-83bd-487c-8554-22fdc45f8e1d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.227968 Oct 01 20:56:06.017661 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 887/1733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:05 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:06.039588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4a2c0162-93c5-4db4-ab03-8dcaae9d582a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '.version_select at 0x7f41784403a0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:06.050590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a2c0162-93c5-4db4-ab03-8dcaae9d582a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.051346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a2c0162-93c5-4db4-ab03-8dcaae9d582a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.051908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a2c0162-93c5-4db4-ab03-8dcaae9d582a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.064513 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4a2c0162-93c5-4db4-ab03-8dcaae9d582a tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.036673 Oct 01 20:56:06.067057 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 888/1734] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 20:56:06 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:06.074025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:06.074680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:06.083130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.083762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.085207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.087431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.088000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.088395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.096721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:06.106723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:06.108281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:06.114071 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a082c51-814d-4cd1-8df1-7c9888f0334f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1417 microversion: 2.75 time: 0.162556 Oct 01 20:56:06.114696 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 847/1735] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:05 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1417 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:06.120307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3c8493f-dd20-43c9-be8c-cff46a15d8f3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173022040>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:06.166534 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3c8493f-dd20-43c9-be8c-cff46a15d8f3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.050630 Oct 01 20:56:06.167156 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 848/1736] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:06 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:06.177761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:06.179284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:06.189965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.190925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.191379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.192099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.192625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.193202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.248876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.249841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.250789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.251478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lazy-loading 'fault' on Instance uuid 93f8e63c-9de6-41e3-83b4-bb0715083b05 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:06.295808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:06.309843 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e786c101-aa6c-45dd-859c-7ddbbcc8d6fc tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.241134 Oct 01 20:56:06.314432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:06.317802 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 889/1737] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:06 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:06.326422 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-730e07d3-1b19-45d7-bde6-90e11132fa24 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1306 microversion: 2.1 time: 0.158304 Oct 01 20:56:06.329341 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 849/1738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:06 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:06.330601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e7a00bf2-0915-4075-afb6-7a5c83dcd3f2 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:06.331629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e7a00bf2-0915-4075-afb6-7a5c83dcd3f2 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:06.335231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:06.341012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7a00bf2-0915-4075-afb6-7a5c83dcd3f2 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.341665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7a00bf2-0915-4075-afb6-7a5c83dcd3f2 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.342254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7a00bf2-0915-4075-afb6-7a5c83dcd3f2 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.343154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7a00bf2-0915-4075-afb6-7a5c83dcd3f2 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.343689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7a00bf2-0915-4075-afb6-7a5c83dcd3f2 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.344212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7a00bf2-0915-4075-afb6-7a5c83dcd3f2 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.483256 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e7a00bf2-0915-4075-afb6-7a5c83dcd3f2 tempest-LiveMigrationTest-894622269 tempest-LiveMigrationTest-894622269-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1533 microversion: 2.1 time: 0.161749 Oct 01 20:56:06.483837 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 890/1739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:06 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1533 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:06.514021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:06.516339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:06.525893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.526653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.527186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.528048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.528631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.529131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.568019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:06.645484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:06.661616 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3e7afda6-c071-4ef2-b8f2-624955d1ea62 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 204 len: 0 microversion: 2.1 time: 0.151943 Oct 01 20:56:06.663190 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 850/1740] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:06 2022] DELETE /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:06.673633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:06.674853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:06.685352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.685814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.686901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.687705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:06.688232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:06.688816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:06.826895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:06.834897 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-213f7fcc-09c3-4b73-bae4-45a9562eacd2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1388 microversion: 2.1 time: 0.167283 Oct 01 20:56:06.835468 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 891/1741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:06 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1388 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:07.043894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:07.044925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:07.057233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.058054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.058925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.059955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.060404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.061014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.144811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:07.145511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:07.153334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.153890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.154334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.155066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.156345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.156780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.242021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:07.251787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:07.253623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:07.258964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:07.260089 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-081d049d-5c1b-4fb6-9562-7f4f0292f6fb tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1417 microversion: 2.75 time: 0.119229 Oct 01 20:56:07.260724 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 892/1742] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:07 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1417 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:56:07.265186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e185d833-855f-402c-8286-c618021702f2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417386d280>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:07.266779 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7932886e-5a77-418c-90ac-5a12984b6ee2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.229022 Oct 01 20:56:07.267730 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 851/1743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:07 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:07.311014 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e185d833-855f-402c-8286-c618021702f2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.049228 Oct 01 20:56:07.311844 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 893/1744] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:07 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:07.333397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:07.334104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:07.340074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.340557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.340989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.341754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.342287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.342665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.355000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:07.355625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:07.362911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.363666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.364320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.365079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.365706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.366217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.406549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.407040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.407746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.408321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lazy-loading 'fault' on Instance uuid 93f8e63c-9de6-41e3-83b4-bb0715083b05 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:07.464431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:07.473636 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ca2f6e71-3f2a-44ee-a523-bdcf687a031f tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 200 len: 1306 microversion: 2.1 time: 0.123734 Oct 01 20:56:07.478997 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 894/1745] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:07 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:07.568885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:07.578801 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f08b5fe2-72b0-4837-b636-49e88ff36f94 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.249176 Oct 01 20:56:07.579790 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 852/1746] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:07 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:07.707815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3f406c11-d11d-41eb-8666-098855b8a505 tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] Action: 'create', calling method: .version_select at 0x7f417386d310>, body: {"security_group": {"name": "tempest-securitygroup-808234782", "description": "tempest-description-1716814298"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:07.859393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:07.860867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:07.869915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.871237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.871895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:07.872738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:07.873258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:07.873698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:08.199816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:08.211601 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1329b7b3-ff70-47b7-84bc-775a1cdee3c7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 200 len: 1388 microversion: 2.1 time: 0.355993 Oct 01 20:56:08.223789 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 853/1747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:07 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 1388 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:08.250667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-bf925476-dcc2-49a9-9b0b-e30b518f47a2 req-f8d4fd28-3d0a-45b8-b6bc-edfb2f752cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0f4c70-33b6-4425-9277-2b8b941cd44b", "name": "network-vif-deleted", "tag": "36f4cf52-c2dd-417b-801e-0cd9a73b8ac3"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:08.261803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bf925476-dcc2-49a9-9b0b-e30b518f47a2 req-f8d4fd28-3d0a-45b8-b6bc-edfb2f752cf4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:08.262506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bf925476-dcc2-49a9-9b0b-e30b518f47a2 req-f8d4fd28-3d0a-45b8-b6bc-edfb2f752cf4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:08.263323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bf925476-dcc2-49a9-9b0b-e30b518f47a2 req-f8d4fd28-3d0a-45b8-b6bc-edfb2f752cf4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:08.281917 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-bf925476-dcc2-49a9-9b0b-e30b518f47a2 req-f8d4fd28-3d0a-45b8-b6bc-edfb2f752cf4 service nova] Creating event network-vif-deleted:36f4cf52-c2dd-417b-801e-0cd9a73b8ac3 for instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b on nch1-master-1 Oct 01 20:56:08.294724 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-bf925476-dcc2-49a9-9b0b-e30b518f47a2 req-f8d4fd28-3d0a-45b8-b6bc-edfb2f752cf4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042923 Oct 01 20:56:08.296977 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 854/1748] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:56:08.303298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:08.304482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:08.330765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:08.332885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:08.335014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:08.339621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:08.340359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:08.342271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:08.364457 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3f406c11-d11d-41eb-8666-098855b8a505 tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.884166 Oct 01 20:56:08.365063 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 895/1749] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 20:56:07 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:08.378026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:08.381116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:08.401948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:08.402901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:08.403517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:08.404624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:08.405695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:08.406411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:08.579162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:08.598297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:08.608280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:08.617347 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3a48de23-2f66-4339-88f9-4d4c8fc0bc48 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1417 microversion: 2.75 time: 0.248978 Oct 01 20:56:08.620329 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 896/1750] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:08 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1417 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:08.643017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8324883c-1cb0-4281-81c3-7d2fff480858 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41739bb550>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:08.716518 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8324883c-1cb0-4281-81c3-7d2fff480858 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.094232 Oct 01 20:56:08.717114 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 897/1751] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:08 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:08.727972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-745b68bc-b8c4-411a-891e-acce1e4a7995 tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] Action: 'create', calling method: .version_select at 0x7f41732233a0>, body: {"security_group": {"name": "tempest-securitygroup-1143414990", "description": "tempest-description-108431952"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:08.762315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:08.773438 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0a2f05a-3f75-42bc-bbb7-68a54e4de043 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.472260 Oct 01 20:56:08.783435 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 855/1752] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:08 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:08.793969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:08.794654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 93f8e63c-9de6-41e3-83b4-bb0715083b05] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:08.807468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:08.808279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:08.809235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:08.810195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:08.810957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:08.812004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:08.833791 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] HTTP exception thrown: Instance 93f8e63c-9de6-41e3-83b4-bb0715083b05 could not be found. Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Request method failure captured: Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 HTTP/1.1 Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKi4hneyV0UmMyeEvxPvki8R_BaiMwZO97vr8doDlv5bt_m4zcidHAO2rMbLQLo5XufeJzCNqaQJgqbxlBI7erezeGG3CP5Ypm3KXxKIZiGIp8xqkmPMfLUCm1WFlGy0ybNN5EV4fBmpGyJFj_BHTiUeMt0TdrHml-jGdV2K6QFsrAQ Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_44683518fe3d46c58b139727cf0c9515", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}] Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e82ed96a3e794a1b99662cec0969b7ec Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 93f8e63c-9de6-41e3-83b4-bb0715083b05 could not be found. Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '93f8e63c-9de6-41e3-83b4-bb0715083b05'} Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f8e63c-9de6-41e3-83b4-bb0715083b05 could not be found. Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f8e63c-9de6-41e3-83b4-bb0715083b05 could not be found. Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:08.836093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f8e63c-9de6-41e3-83b4-bb0715083b05 could not be found. Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Returning 404 to user: Instance 93f8e63c-9de6-41e3-83b4-bb0715083b05 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e55ac302-2e5b-495e-ba2c-ed0620915310 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05" status: 404 len: 111 microversion: 2.1 time: 0.053703 Oct 01 20:56:08.847966 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 856/1753] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:08 2022] GET /compute/v2.1/servers/93f8e63c-9de6-41e3-83b4-bb0715083b05 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:08.861553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:08.862068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:08.879886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=5 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:08.880102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:08.880487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:08.881132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:08.882022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:08.885632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:08.886085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:09.078182 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-745b68bc-b8c4-411a-891e-acce1e4a7995 tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.359759 Oct 01 20:56:09.079152 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 898/1754] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 20:56:08 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:09.085399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:09.086713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 3d5200d5-8702-4469-a18f-480ef4f6210c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:09.104637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:09.106755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:09.108196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:09.109565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:09.111666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:09.112430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:09.157725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 3d5200d5-8702-4469-a18f-480ef4f6210c] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:09.165231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:09.176702 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60398fde-8964-48e7-a814-ae2c1d72461d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.322800 Oct 01 20:56:09.177265 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 857/1755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:08 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:09.262403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae90559f-f7df-4ab5-b7f4-0a033e590f30 tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] Action: 'create', calling method: .version_select at 0x7f4173022a60>, body: {"security_group": {"name": "tempest-securitygroup-44612502", "description": "tempest-description-974326265"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:09.265427 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d45b87cd-47d5-4ccb-9e79-58765e22c7c0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c" status: 204 len: 0 microversion: 2.1 time: 0.184519 Oct 01 20:56:09.266145 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 899/1756] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:09 2022] DELETE /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:09.274931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:09.275592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 3f0f4c70-33b6-4425-9277-2b8b941cd44b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:09.282000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:09.282573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:09.283137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:09.283918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:09.284439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:09.285110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:09.301052 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] HTTP exception thrown: Instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b could not be found. Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Request method failure captured: Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b HTTP/1.1 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKhKftXhcj6-26HIOzPPLrtrm6c-qGdlf8tOhsZ2CBA0Jh8ZpiON8CGL9Z06ab_GihOYHLrCcDD0sIfdEY65fD1F-czmuBp0n64ZhdKcdFxcQ1vmtZR3NMXdaH34cYRvFs3PNbKI-ah6-A1r4K0kFpqUajSnzIDkHSVBwrKdTVasbsw Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 237c6bad691343e7a7e64304f55e01e9 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_237c6bad691343e7a7e64304f55e01e9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/237c6bad691343e7a7e64304f55e01e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/237c6bad691343e7a7e64304f55e01e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/237c6bad691343e7a7e64304f55e01e9"}]}] Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 237c6bad691343e7a7e64304f55e01e9 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-LiveMigrationTest-1978574502-project Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a749a74841e840e2b8de67fb9562bf51 Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-LiveMigrationTest-1978574502-project Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b could not be found. Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '3f0f4c70-33b6-4425-9277-2b8b941cd44b'} Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b could not be found. Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b could not be found. Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:09.303256 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b could not be found. Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Returning 404 to user: Instance 3f0f4c70-33b6-4425-9277-2b8b941cd44b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-360d974b-09ef-45e7-b176-4b9099fd4508 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b" status: 404 len: 111 microversion: 2.1 time: 0.034448 Oct 01 20:56:09.309658 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 900/1757] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:09 2022] GET /compute/v2.1/servers/3f0f4c70-33b6-4425-9277-2b8b941cd44b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:09.313171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:09.313733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:09.320485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:09.322520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:09.322980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:09.323717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:09.324298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:09.324618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:09.356721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:09.455557 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c730310d-1f9c-438b-af41-3b13a9dbe3fc tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 204 len: 0 microversion: 2.1 time: 0.148227 Oct 01 20:56:09.456857 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 901/1758] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:09 2022] DELETE /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:09.467198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:09.467925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 3d5200d5-8702-4469-a18f-480ef4f6210c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:09.474845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:09.475396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:09.475859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:09.476542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:09.477060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:09.477488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:09.568547 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae90559f-f7df-4ab5-b7f4-0a033e590f30 tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.376435 Oct 01 20:56:09.569588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 858/1759] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 20:56:09 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:09.582933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7f2155c-db35-4c85-85bb-9e71e3d98596 tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] Action: 'create', calling method: .version_select at 0x7f41730228b0>, body: {"security_group": {"name": "tempest-securitygroup-2122215998", "description": "tempest-description-113015921"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:09.949514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:09.962135 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ac530390-b02a-49e5-96dc-703f1a17b0db tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c" status: 200 len: 1475 microversion: 2.1 time: 0.499747 Oct 01 20:56:09.973734 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 902/1760] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:09 2022] GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c => generated 1475 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:09.987649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:09.988953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:10.000003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.000692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.001312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:10.002351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.002853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.003534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:10.012628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:10.102136 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d7f2155c-db35-4c85-85bb-9e71e3d98596 tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.523079 Oct 01 20:56:10.110458 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 859/1761] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 20:56:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:56:10.125056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ae2a4f4-9991-40aa-aa1f-b319a50bb727 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4172f76ca0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:10.140246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:10.150265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:10.151819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:10.157966 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ab233666-d019-41f6-8345-eaaa9f244a4c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1438 microversion: 2.75 time: 0.182846 Oct 01 20:56:10.158583 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 903/1762] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:09 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1438 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:10.164368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:10.164944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:10.171253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.171979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.172608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:10.173666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.174553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.175176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:10.199617 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ae2a4f4-9991-40aa-aa1f-b319a50bb727 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.095482 Oct 01 20:56:10.200336 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 860/1763] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:10 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:10.204838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2c9ff09-8d9e-4cf2-b3a8-244a96abc614 tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] Calling method '.version_select at 0x7f4173022040>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:10.413519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:10.423262 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-db18a7ae-db46-4a6c-b144-3a2d46818eab tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.263445 Oct 01 20:56:10.424171 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 904/1764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:10 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:10.430964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:10.434003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:10.444872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.445710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.446214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:10.448016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.448542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.449544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:10.555367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:56:10.556049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:56:10.556430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:56:10.556913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:56:10.557332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:56:10.622237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:10.628062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.628553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.628993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:10.629702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.630165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.630617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:10.714633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:10.727821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:10.729521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:10.735213 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-16242c5b-5e7c-4a7c-9dd4-7697ceff09c4 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "POST /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5/action" status: 202 len: 1495 microversion: 2.75 time: 0.309845 Oct 01 20:56:10.735836 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 905/1765] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:56:10 2022] POST /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5/action => generated 1495 bytes in 311 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 01 20:56:10.740436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:10.741060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:10.748188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.748757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.749313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:10.750115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:10.750820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:10.751257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:11.002670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:11.010865 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7b7614b4-c9f9-48eb-b469-74d8498f4967 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.273907 Oct 01 20:56:11.011533 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 906/1766] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:10 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:11.015914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a1f7f8c2-53f0-41ba-89db-7b52189486a5 req-57ef0dd1-caa6-451f-8d7b-f2bec8ed8f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bb9a33-87d3-4429-93d5-2f740d08b463", "name": "network-vif-plugged", "status": "completed", "tag": "203f0093-826e-4ebf-8795-aeac2a7fda5f"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:11.029738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a1f7f8c2-53f0-41ba-89db-7b52189486a5 req-57ef0dd1-caa6-451f-8d7b-f2bec8ed8f76 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:11.029738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a1f7f8c2-53f0-41ba-89db-7b52189486a5 req-57ef0dd1-caa6-451f-8d7b-f2bec8ed8f76 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:11.029738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a1f7f8c2-53f0-41ba-89db-7b52189486a5 req-57ef0dd1-caa6-451f-8d7b-f2bec8ed8f76 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:11.046665 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a1f7f8c2-53f0-41ba-89db-7b52189486a5 req-57ef0dd1-caa6-451f-8d7b-f2bec8ed8f76 service nova] Creating event network-vif-plugged:203f0093-826e-4ebf-8795-aeac2a7fda5f for instance 12bb9a33-87d3-4429-93d5-2f740d08b463 on nch1-master-1 Oct 01 20:56:11.051776 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a1f7f8c2-53f0-41ba-89db-7b52189486a5 req-57ef0dd1-caa6-451f-8d7b-f2bec8ed8f76 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039133 Oct 01 20:56:11.052394 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 907/1767] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:11.058108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:11.058720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:11.065122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:11.065597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:11.066036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:11.066764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:11.067225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:11.067652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:11.093187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:11.180807 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a9d5478e-ff6f-49c7-8a42-44429f0aacbc tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 204 len: 0 microversion: 2.1 time: 0.127018 Oct 01 20:56:11.181793 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 908/1768] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:11 2022] DELETE /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:11.187178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:11.188037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:11.193918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:11.194410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:11.195020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:11.195725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:11.196187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:11.196620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:11.313641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:11.322544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:11.324014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:11.328985 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8b3bd4f6-7fed-48c8-a3a3-18db801e5aa3 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.146277 Oct 01 20:56:11.338254 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 909/1769] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:11 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:11.338254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:11.338254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 3d5200d5-8702-4469-a18f-480ef4f6210c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:11.345175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:11.346026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:11.348958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:11.349881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:11.350857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:11.351296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:11.738859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:11.756823 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9236ea82-6e64-4589-ac47-598b03cecc02 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c" status: 200 len: 1475 microversion: 2.1 time: 0.426139 Oct 01 20:56:11.772397 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 910/1770] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:11 2022] GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c => generated 1475 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:11.776024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:11.776624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:11.785865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:11.786480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:11.787008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:11.787830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:11.788299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:11.788758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:12.259896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:12.283442 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ac35dc63-9755-4c6c-8d21-e420ced38f11 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1668 microversion: 2.1 time: 0.524929 Oct 01 20:56:12.302403 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 911/1771] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:11 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1668 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:12.313961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4be2279e-5864-4ab8-97f1-ef77612ab440 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173223700>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:12.409815 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4be2279e-5864-4ab8-97f1-ef77612ab440 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.101753 Oct 01 20:56:12.414305 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 912/1772] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:12 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:12.425549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:12.428324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:12.435498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:12.436239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:12.437113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:12.438068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:12.438778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:12.439431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:12.663004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:12.688858 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f4f9e8af-87de-43c6-9a45-94290158da74 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.273101 Oct 01 20:56:12.689473 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 913/1773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:12 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:12.710569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-0ce4b9db-e27c-4f9e-bc1c-5ac78d442434 req-192f2ad1-03ca-4a5b-88a3-60321ebd37a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5200d5-8702-4469-a18f-480ef4f6210c", "name": "network-vif-deleted", "tag": "fe73a873-9bad-492e-9df0-e646f2d24659"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:12.722042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0ce4b9db-e27c-4f9e-bc1c-5ac78d442434 req-192f2ad1-03ca-4a5b-88a3-60321ebd37a4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:12.722549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0ce4b9db-e27c-4f9e-bc1c-5ac78d442434 req-192f2ad1-03ca-4a5b-88a3-60321ebd37a4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:12.723104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0ce4b9db-e27c-4f9e-bc1c-5ac78d442434 req-192f2ad1-03ca-4a5b-88a3-60321ebd37a4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:12.748875 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-0ce4b9db-e27c-4f9e-bc1c-5ac78d442434 req-192f2ad1-03ca-4a5b-88a3-60321ebd37a4 service nova] Creating event network-vif-deleted:fe73a873-9bad-492e-9df0-e646f2d24659 for instance 3d5200d5-8702-4469-a18f-480ef4f6210c on nch2-master-1 Oct 01 20:56:12.754656 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-0ce4b9db-e27c-4f9e-bc1c-5ac78d442434 req-192f2ad1-03ca-4a5b-88a3-60321ebd37a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047426 Oct 01 20:56:12.755792 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 914/1774] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:12.761610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:12.762453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:12.771906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:12.772516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:12.775127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:12.775929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:12.776413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:12.776927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.114250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:13.126019 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-45e5c78e-6e18-43bf-8f36-dd4a72d10517 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.366615 Oct 01 20:56:13.126881 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 915/1775] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:12 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:13.156673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:13.157432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:13.174428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.176889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.177722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.178636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.179133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.182758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.330609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=24 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:13.337257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:13.357035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=56 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:13.357983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:13.360546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:13.374854 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f5c355d8-0573-4d59-9a02-f60151db6562 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.227994 Oct 01 20:56:13.392954 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 916/1776] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:13 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:13.404761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:13.406185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 3d5200d5-8702-4469-a18f-480ef4f6210c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:13.437037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.460214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.460835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.461622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.462113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.462673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.547185 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] HTTP exception thrown: Instance 3d5200d5-8702-4469-a18f-480ef4f6210c could not be found. Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Request method failure captured: Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c HTTP/1.1 Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKi4hneyV0UmMyeEvxPvki8R_BaiMwZO97vr8doDlv5bt_m4zcidHAO2rMbLQLo5XufeJzCNqaQJgqbxlBI7erezeGG3CP5Ypm3KXxKIZiGIp8xqkmPMfLUCm1WFlGy0ybNN5EV4fBmpGyJFj_BHTiUeMt0TdrHml-jGdV2K6QFsrAQ Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_44683518fe3d46c58b139727cf0c9515", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}] Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: e82ed96a3e794a1b99662cec0969b7ec Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 3d5200d5-8702-4469-a18f-480ef4f6210c could not be found. Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '3d5200d5-8702-4469-a18f-480ef4f6210c'} Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5200d5-8702-4469-a18f-480ef4f6210c could not be found. Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5200d5-8702-4469-a18f-480ef4f6210c could not be found. Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:13.552150 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:13.561149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:13.561149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:13.561149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:13.561149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:13.561149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:13.561149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5200d5-8702-4469-a18f-480ef4f6210c could not be found. Oct 01 20:56:13.561149 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:13.561149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Returning 404 to user: Instance 3d5200d5-8702-4469-a18f-480ef4f6210c could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:13.562686 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b814416c-0020-4b93-a0f5-28480d9b1148 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c" status: 404 len: 111 microversion: 2.1 time: 0.158909 Oct 01 20:56:13.564753 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 917/1777] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:13 2022] GET /compute/v2.1/servers/3d5200d5-8702-4469-a18f-480ef4f6210c => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:13.579923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-49472d66-65e1-416e-892a-f0ff853a7685 req-2b3250d4-9afc-4903-ae50-d9b21365f293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5", "name": "network-vif-deleted", "tag": "809f3c73-a9c0-49e1-aa63-ab6c8475dc33"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:13.606920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-49472d66-65e1-416e-892a-f0ff853a7685 req-2b3250d4-9afc-4903-ae50-d9b21365f293 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.607315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-49472d66-65e1-416e-892a-f0ff853a7685 req-2b3250d4-9afc-4903-ae50-d9b21365f293 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.607760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-49472d66-65e1-416e-892a-f0ff853a7685 req-2b3250d4-9afc-4903-ae50-d9b21365f293 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.624690 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-49472d66-65e1-416e-892a-f0ff853a7685 req-2b3250d4-9afc-4903-ae50-d9b21365f293 service nova] Creating event network-vif-deleted:809f3c73-a9c0-49e1-aa63-ab6c8475dc33 for instance 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 on nch1-master-1 Oct 01 20:56:13.630547 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-49472d66-65e1-416e-892a-f0ff853a7685 req-2b3250d4-9afc-4903-ae50-d9b21365f293 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063143 Oct 01 20:56:13.631880 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 918/1778] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:13.643584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:13.644508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:13.651860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.652447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.652809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.653640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.653970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.654400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.679951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:13.701426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2c9ff09-8d9e-4cf2-b3a8-244a96abc614 tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] 10.222.0.17 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11671 microversion: 2.1 time: 3.499825 Oct 01 20:56:13.703335 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 861/1779] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Oct 1 20:56:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11671 bytes in 3502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:56:13.714343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa728196-f710-42b9-8948-32b6d2e9eb78 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4172f769d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:13.760058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:13.768238 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6f3ab6c0-11b1-43bf-a4de-5ee691f7e48c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1601 microversion: 2.1 time: 0.133362 Oct 01 20:56:13.769026 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 919/1780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:13 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1601 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:13.790413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:13.791122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:13.797893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.797893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.798668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.799081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.799456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.799822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.803419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aa728196-f710-42b9-8948-32b6d2e9eb78 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.098949 Oct 01 20:56:13.815826 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 862/1781] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:13 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:13.817275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:13.817899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:13.818138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=58 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:13.831269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.831835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.832564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.833810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.846092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.846580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.877763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:13.878183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:13.878663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:13.879125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lazy-loading 'fault' on Instance uuid 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:13.987655 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:13.999391 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-65e4545c-0cea-4d87-92c5-fe8913926932 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 200 len: 1309 microversion: 2.1 time: 0.215299 Oct 01 20:56:14.018740 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 920/1782] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:13 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 1309 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:14.024579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7865aaef-00b5-4310-8a3b-b8095493281a tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] Calling method '.version_select at 0x7f4173849550>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:14.213185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:14.232944 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc5092bf-737d-4a34-827a-2247603782e5 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1484 microversion: 2.1 time: 0.411124 Oct 01 20:56:14.233852 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 863/1783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:13 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1484 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:14.239217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:14.240164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:14.246856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:14.247352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:14.247993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:14.248729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:14.249855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:14.250298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:14.266950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:14.506727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:14.521780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9aef4936-7ca6-47da-8093-17b9c621b754 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.285515 Oct 01 20:56:14.522384 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 864/1784] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:14 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:14.527234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45ddd861-e7af-4daf-a07f-f2ffdafc40b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:14.528225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45ddd861-e7af-4daf-a07f-f2ffdafc40b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:14.535653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ddd861-e7af-4daf-a07f-f2ffdafc40b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:14.536340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ddd861-e7af-4daf-a07f-f2ffdafc40b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:14.537282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ddd861-e7af-4daf-a07f-f2ffdafc40b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:14.539626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ddd861-e7af-4daf-a07f-f2ffdafc40b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:14.540273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ddd861-e7af-4daf-a07f-f2ffdafc40b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:14.540703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ddd861-e7af-4daf-a07f-f2ffdafc40b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:14.558520 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7865aaef-00b5-4310-8a3b-b8095493281a tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.538276 Oct 01 20:56:14.559592 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 921/1785] 10.222.0.17 () {58 vars in 1191 bytes} [Sat Oct 1 20:56:14 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:14.566661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:14.567574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:14.576365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:14.577136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:14.577818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:14.578834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:14.579577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:14.580237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:14.658717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:14.671282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:14.673862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:14.681924 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-49220435-b340-4191-a451-59807159c38b tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.120935 Oct 01 20:56:14.682560 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 922/1786] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:14 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:14.688300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9e75e6ca-d40f-403b-be5b-7f3c61e1583e tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] Calling method '.version_select at 0x7f41738498b0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:14.696956 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45ddd861-e7af-4daf-a07f-f2ffdafc40b8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "POST /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11/action" status: 202 len: 0 microversion: 2.1 time: 0.173027 Oct 01 20:56:14.704728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 865/1787] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:56:14 2022] POST /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:14.721170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:14.722288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:14.738963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:14.739473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:14.739967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:14.740752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:14.741372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:14.742569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.020609 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9e75e6ca-d40f-403b-be5b-7f3c61e1583e tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/50655461-5b9b-4c95-95e2-d16b43688bbd" status: 202 len: 0 microversion: 2.1 time: 0.335608 Oct 01 20:56:15.022225 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 923/1788] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 20:56:14 2022] DELETE /compute/v2.1/os-security-groups/50655461-5b9b-4c95-95e2-d16b43688bbd => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:15.047574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:15.048464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:15.058628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.059558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.060922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.062381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.063602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.064785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.134522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.135371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.136042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.136813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lazy-loading 'fault' on Instance uuid bed59d2f-d270-4882-b32b-89be0dedc71f {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:15.215490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:15.226832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f1cb492-2a70-468e-9d3e-48627dfa0ee4 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1492 microversion: 2.1 time: 0.509411 Oct 01 20:56:15.246900 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 866/1789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:14 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1492 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:15.251902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b4343fe-e952-4cea-9aba-abfaac99224a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4172ff2040>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:15.278709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:15.286982 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-89bb22d3-376a-4095-9678-c74f01f22ce6 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 200 len: 1325 microversion: 2.1 time: 0.261101 Oct 01 20:56:15.294821 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 924/1790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:15 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 1325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:15.309809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:15.316039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:15.326847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.327352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.328011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.329015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.329652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.330246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.340743 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b4343fe-e952-4cea-9aba-abfaac99224a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.087733 Oct 01 20:56:15.346081 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 867/1791] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:15 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:15.346619 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] HTTP exception thrown: Instance 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 could not be found. Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Request method failure captured: Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 HTTP/1.1 Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKi4hneyV0UmMyeEvxPvki8R_BaiMwZO97vr8doDlv5bt_m4zcidHAO2rMbLQLo5XufeJzCNqaQJgqbxlBI7erezeGG3CP5Ypm3KXxKIZiGIp8xqkmPMfLUCm1WFlGy0ybNN5EV4fBmpGyJFj_BHTiUeMt0TdrHml-jGdV2K6QFsrAQ Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_44683518fe3d46c58b139727cf0c9515", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}] Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: e82ed96a3e794a1b99662cec0969b7ec Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 could not be found. Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5'} Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 could not be found. Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 could not be found. Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:15.348562 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:15.357552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:15.357552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:15.357552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:15.357552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:15.357552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:15.357552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 could not be found. Oct 01 20:56:15.357552 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:15.359211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Returning 404 to user: Instance 2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:15.360450 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1d84ba6c-e00c-41e7-a15e-82eae846f7a0 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5" status: 404 len: 111 microversion: 2.1 time: 0.064243 Oct 01 20:56:15.361041 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 925/1792] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:15 2022] GET /compute/v2.1/servers/2c7ad9bc-e3fa-4dbf-ba09-ee316fa0cbc5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:15.364086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-143d65f8-096d-48c0-8da2-41becf154855 tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] Calling method '.version_select at 0x7f417302c670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:15.475409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-658062d3-8a9a-46f2-a733-3ab4035d31f8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:15.484614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:15.569782 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-658062d3-8a9a-46f2-a733-3ab4035d31f8 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/feda80dc-d885-4f9c-897d-e6bd50684bcb" status: 204 len: 0 microversion: 2.1 time: 0.122084 Oct 01 20:56:15.578307 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 926/1793] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 20:56:15 2022] DELETE /compute/v2.1/os-server-groups/feda80dc-d885-4f9c-897d-e6bd50684bcb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:15.588724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:15.589933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:15.600064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.600803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.602188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.603882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.604565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.605307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.805155 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-143d65f8-096d-48c0-8da2-41becf154855 tempest-SecurityGroupsTestAdminJSON-406211969 tempest-SecurityGroupsTestAdminJSON-406211969-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5df8ddf1-8db8-47bf-b087-c06e45c8b2c0" status: 202 len: 0 microversion: 2.1 time: 0.456932 Oct 01 20:56:15.809915 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 868/1794] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 20:56:15 2022] DELETE /compute/v2.1/os-security-groups/5df8ddf1-8db8-47bf-b087-c06e45c8b2c0 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:15.816304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:15.817173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:15.829243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.830053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.830739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.831658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.832289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.832904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.894812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:15.915361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:15.925351 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-44ff1521-95e5-4db1-9b4a-8cf097ebbbcf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.343099 Oct 01 20:56:15.940060 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 927/1795] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:15 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:15.945270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c1b1f1a6-5298-45ec-8098-6157ba086177 req-ae6f8230-12ba-4463-8863-00332a5427df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed59d2f-d270-4882-b32b-89be0dedc71f", "name": "network-vif-deleted", "tag": "66d65798-4e84-432e-b05a-65e6432c780b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:15.959016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c1b1f1a6-5298-45ec-8098-6157ba086177 req-ae6f8230-12ba-4463-8863-00332a5427df service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.959666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c1b1f1a6-5298-45ec-8098-6157ba086177 req-ae6f8230-12ba-4463-8863-00332a5427df service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.960380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c1b1f1a6-5298-45ec-8098-6157ba086177 req-ae6f8230-12ba-4463-8863-00332a5427df service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.976555 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c1b1f1a6-5298-45ec-8098-6157ba086177 req-ae6f8230-12ba-4463-8863-00332a5427df service nova] Creating event network-vif-deleted:66d65798-4e84-432e-b05a-65e6432c780b for instance bed59d2f-d270-4882-b32b-89be0dedc71f on nch2-master-1 Oct 01 20:56:15.982055 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c1b1f1a6-5298-45ec-8098-6157ba086177 req-ae6f8230-12ba-4463-8863-00332a5427df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040478 Oct 01 20:56:15.984038 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 928/1796] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:15.988992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:15.990175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:15.997833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:15.998506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:15.999074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:15.999905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.000479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.001152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.131007 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2a5d765-024d-458a-b167-28574228d560 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df" status: 204 len: 0 microversion: 2.1 time: 0.319043 Oct 01 20:56:16.140220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 869/1797] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:15 2022] DELETE /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:16.146738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-959d8a78-a94c-4d8f-aff0-4f2ae11671a4 tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] Calling method '.version_select at 0x7f41730a74c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:16.160879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:16.172403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:16.174244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:16.181199 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4a64c04a-30f4-42c6-91ca-33eda2567d5d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.196718 Oct 01 20:56:16.181800 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 929/1798] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:15 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:16.207267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:16.207778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:16.215447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.215953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.216405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.217145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.217610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.218049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.247684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:16.351955 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7cc59bb7-49d6-4929-a56e-786bf8d14983 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 204 len: 0 microversion: 2.1 time: 0.148115 Oct 01 20:56:16.353010 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 930/1799] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:16 2022] DELETE /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:16.362320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:16.363482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:16.374552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.375685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.376623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.377990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.386901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.389988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.403143 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-959d8a78-a94c-4d8f-aff0-4f2ae11671a4 tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/3bf3f092-a1c3-4ca2-82e5-f5d5d61c3abd" status: 202 len: 0 microversion: 2.1 time: 0.260730 Oct 01 20:56:16.404064 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 870/1800] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 20:56:16 2022] DELETE /compute/v2.1/os-security-groups/3bf3f092-a1c3-4ca2-82e5-f5d5d61c3abd => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:16.410179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:16.411524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: bed59d2f-d270-4882-b32b-89be0dedc71f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:16.424775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.425579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.426309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.427581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.428272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.428885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.451027 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] HTTP exception thrown: Instance bed59d2f-d270-4882-b32b-89be0dedc71f could not be found. Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Request method failure captured: Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f HTTP/1.1 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKhKftXhcj6-26HIOzPPLrtrm6c-qGdlf8tOhsZ2CBA0Jh8ZpiON8CGL9Z06ab_GihOYHLrCcDD0sIfdEY65fD1F-czmuBp0n64ZhdKcdFxcQ1vmtZR3NMXdaH34cYRvFs3PNbKI-ah6-A1r4K0kFpqUajSnzIDkHSVBwrKdTVasbsw Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 237c6bad691343e7a7e64304f55e01e9 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_237c6bad691343e7a7e64304f55e01e9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/237c6bad691343e7a7e64304f55e01e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/237c6bad691343e7a7e64304f55e01e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/237c6bad691343e7a7e64304f55e01e9"}]}] Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 237c6bad691343e7a7e64304f55e01e9 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveMigrationTest-1978574502-project Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a749a74841e840e2b8de67fb9562bf51 Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveMigrationTest-1978574502-project Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance bed59d2f-d270-4882-b32b-89be0dedc71f could not be found. Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'bed59d2f-d270-4882-b32b-89be0dedc71f'} Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed59d2f-d270-4882-b32b-89be0dedc71f could not be found. Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed59d2f-d270-4882-b32b-89be0dedc71f could not be found. Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:16.453109 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:16.459459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:16.459459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:16.459459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:16.459459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:16.459459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:16.459459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed59d2f-d270-4882-b32b-89be0dedc71f could not be found. Oct 01 20:56:16.459459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:16.459459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Returning 404 to user: Instance bed59d2f-d270-4882-b32b-89be0dedc71f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:16.463057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-889d084f-b3da-4be5-bbe3-7cab5ec2759d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f" status: 404 len: 111 microversion: 2.1 time: 0.054610 Oct 01 20:56:16.465127 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 871/1801] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:16 2022] GET /compute/v2.1/servers/bed59d2f-d270-4882-b32b-89be0dedc71f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:16.471840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0263461a-50e3-4f0d-bd5d-4eb86c8f8945 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417302c160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:16.523994 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0263461a-50e3-4f0d-bd5d-4eb86c8f8945 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.056703 Oct 01 20:56:16.524994 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 872/1802] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:16 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:16.529786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:16.530565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:16.538393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.539058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.539577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.540498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.541042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.542068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.629349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:16.641421 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ed8487d6-c95c-45b4-95c1-0011f621a3d6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1492 microversion: 2.1 time: 0.286633 Oct 01 20:56:16.642416 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 931/1803] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:16 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1492 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:16.647906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6547ff02-430d-4ef3-ba3e-a97d7a7a5d71 tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] Calling method '.version_select at 0x7f4173754160>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:16.738265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:16.747408 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-96f1729d-eb0f-4296-b8fc-098a31052a67 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df" status: 200 len: 1472 microversion: 2.1 time: 0.221324 Oct 01 20:56:16.764840 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 873/1804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:16 2022] GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:16.769725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1f36435c-e113-4d5c-a5b2-d680533f2c05 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '.version_select at 0x7f417302c550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:16.795487 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1f36435c-e113-4d5c-a5b2-d680533f2c05 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509059810" status: 202 len: 0 microversion: 2.1 time: 0.029444 Oct 01 20:56:16.803362 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 874/1805] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 20:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509059810 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:16.939833 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6547ff02-430d-4ef3-ba3e-a97d7a7a5d71 tempest-SecurityGroupsTestAdminJSON-1838053573 tempest-SecurityGroupsTestAdminJSON-1838053573-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/f2bfb35c-26a9-4564-a233-98d1a7938df3" status: 202 len: 0 microversion: 2.1 time: 0.294925 Oct 01 20:56:16.940526 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 932/1806] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 20:56:16 2022] DELETE /compute/v2.1/os-security-groups/f2bfb35c-26a9-4564-a233-98d1a7938df3 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:16.956790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:16.957900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:16.969512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.970370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.971073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:16.972138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:16.976861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:16.977657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.208907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:17.213648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:17.218463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:17.233164 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-90bb3959-f1d2-4920-981b-476e4bad1935 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.280881 Oct 01 20:56:17.236547 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 875/1807] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:16 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:17.253608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.254546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.255965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.257201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.258475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.259272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.344940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:17.354718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:17.356171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:17.362753 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c80db9a4-8222-40ca-b3f0-fa1976d41ded tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.156731 Oct 01 20:56:17.363346 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 933/1808] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:17 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:17.540625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2f26b64-fc69-4c7f-bb46-5820a271985e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41730288b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:17.608045 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2f26b64-fc69-4c7f-bb46-5820a271985e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.069833 Oct 01 20:56:17.608045 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 876/1809] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:17 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:17.667212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:17.667837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:17.676392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.677146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.677768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.682199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.682981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.683753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.755715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:17.758290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:17.774326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.779142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.779820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.780699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.781262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.781860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.824008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:17.950746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:17.951573 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b8f4df8-12e6-44fc-90d1-ec8e2a4fc51c tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 204 len: 0 microversion: 2.1 time: 0.216411 Oct 01 20:56:17.952473 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 877/1810] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:17 2022] DELETE /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:17.958086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:17.958908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:17.963523 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4a10f73f-9913-4c1c-bda8-241df072ab7e tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1492 microversion: 2.1 time: 0.303267 Oct 01 20:56:17.965019 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 934/1811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:17 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1492 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:17.965861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.966363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.966999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.967729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.968194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.968625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.975883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:17.976843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:17.983408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.984187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.984834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:17.985856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:17.987130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:17.987791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:18.254234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:18.262504 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-288da460-b169-4200-9cca-fd8dcd8514ca tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df" status: 200 len: 1472 microversion: 2.1 time: 0.308791 Oct 01 20:56:18.266343 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 878/1812] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:17 2022] GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:18.295122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:18.295730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:18.302235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:18.302687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:18.303312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:18.304836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:18.305759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:18.306528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:18.321460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:18.334059 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2c845fcb-6636-49ff-ba21-3c0298cafbf2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1486 microversion: 2.1 time: 0.365681 Oct 01 20:56:18.335166 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 935/1813] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:17 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1486 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:18.389932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:18.390589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:18.397252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:18.398849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:18.399484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:18.401455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:18.402104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:18.402735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:18.536980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:18.540821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:18.547322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:18.548832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a4436a9-a506-476f-a6d9-74968240ffbb tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.266233 Oct 01 20:56:18.549769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:18.550340 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 879/1814] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:18 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:18.555501 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ad8655fd-22be-4e35-be56-1ddd131fb4c1 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.169506 Oct 01 20:56:18.566565 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 936/1815] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:18 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:18.621685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b9494ef3-59ee-441e-a831-a3571b85ea76 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4172f3ee50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:18.675687 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b9494ef3-59ee-441e-a831-a3571b85ea76 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.057794 Oct 01 20:56:18.687076 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 880/1816] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:18 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:18.988749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:18.989739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:19.003659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:19.004164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:19.007056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:19.008595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:19.009075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:19.009514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:19.294557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:19.295987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:19.313829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:19.315250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:19.315710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:19.316106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:19.322770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:19.323278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:19.323741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:19.332933 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3d2cf9c5-fba7-4492-80c2-cc3aa109ed06 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1498 microversion: 2.1 time: 0.348089 Oct 01 20:56:19.334743 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 937/1817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:18 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1498 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:19.370400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:19.373013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:19.392688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:19.394664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:19.395447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:19.396564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:19.397204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:19.399028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:19.918105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:19.929456 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c23990ce-a0ce-400c-afe3-261a567536ea tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df" status: 200 len: 1472 microversion: 2.1 time: 0.637972 Oct 01 20:56:19.941872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:19.942485 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 881/1818] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:19 2022] GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df => generated 1472 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:19.953005 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bc184d07-7ba1-4054-a814-5bd692432b47 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1486 microversion: 2.1 time: 0.596163 Oct 01 20:56:19.953610 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 938/1819] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:19 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1486 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:19.970221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:19.973606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:19.984406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:19.985159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:19.985832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:19.986423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:19.987167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:19.987290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:19.987916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:19.988706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.021821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:20.024407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:20.026781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.031522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:20.034290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:20.034952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.052852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:20.056447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:20.212840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:20.377506 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-13f7f522-f472-4922-90b7-aeca94d72fb8 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 204 len: 0 microversion: 2.1 time: 0.433270 Oct 01 20:56:20.381951 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 882/1820] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:19 2022] DELETE /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:20.425667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:20.426557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:20.441942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:20.442735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:20.446260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.449627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:20.452374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:20.453774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.529947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:20.546265 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6acd0e39-2955-4d87-b4cb-679417ac8799 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.580516 Oct 01 20:56:20.547545 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 939/1821] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:19 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:20.553502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a443681e-4f9a-437d-b31d-c1c955218365 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41736ba160>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:20.566599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:20.588208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:20.592405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:20.607421 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5243933e-4a82-4eca-bfda-86a29d1d6f89 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.223974 Oct 01 20:56:20.609316 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 883/1822] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:20 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:20.627495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8fe4b2fd-1bb6-491c-a515-9a3c43d9c79c req-62d3fba5-d156-4388-aba5-21e754209328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a4e4e5-a2d3-4ef7-a9fc-5905102864df", "name": "network-vif-deleted", "tag": "6ec345d7-85eb-444e-9419-7bdc55b67d3a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:20.644362 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a443681e-4f9a-437d-b31d-c1c955218365 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.095486 Oct 01 20:56:20.654748 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 940/1823] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:20 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:20.660700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-817b4075-66cb-4074-8b58-a7771aebdb30 req-e03b8f69-164c-454c-ae11-09ae0c3334c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec44930-5588-48ae-8253-56af3ab60310", "name": "network-vif-deleted", "tag": "ecbb28ab-d141-46cd-9031-9cb3e8005cd8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:20.664934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8fe4b2fd-1bb6-491c-a515-9a3c43d9c79c req-62d3fba5-d156-4388-aba5-21e754209328 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:20.667765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8fe4b2fd-1bb6-491c-a515-9a3c43d9c79c req-62d3fba5-d156-4388-aba5-21e754209328 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:20.669162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8fe4b2fd-1bb6-491c-a515-9a3c43d9c79c req-62d3fba5-d156-4388-aba5-21e754209328 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.683168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-817b4075-66cb-4074-8b58-a7771aebdb30 req-e03b8f69-164c-454c-ae11-09ae0c3334c8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:20.683666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-817b4075-66cb-4074-8b58-a7771aebdb30 req-e03b8f69-164c-454c-ae11-09ae0c3334c8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:20.684099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-817b4075-66cb-4074-8b58-a7771aebdb30 req-e03b8f69-164c-454c-ae11-09ae0c3334c8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.693271 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8fe4b2fd-1bb6-491c-a515-9a3c43d9c79c req-62d3fba5-d156-4388-aba5-21e754209328 service nova] Creating event network-vif-deleted:6ec345d7-85eb-444e-9419-7bdc55b67d3a for instance 77a4e4e5-a2d3-4ef7-a9fc-5905102864df on nch2-master-1 Oct 01 20:56:20.708941 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-817b4075-66cb-4074-8b58-a7771aebdb30 req-e03b8f69-164c-454c-ae11-09ae0c3334c8 service nova] Creating event network-vif-deleted:ecbb28ab-d141-46cd-9031-9cb3e8005cd8 for instance 2ec44930-5588-48ae-8253-56af3ab60310 on nch2-master-1 Oct 01 20:56:20.710403 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8fe4b2fd-1bb6-491c-a515-9a3c43d9c79c req-62d3fba5-d156-4388-aba5-21e754209328 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095269 Oct 01 20:56:20.715169 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 884/1824] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:20.721214 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-817b4075-66cb-4074-8b58-a7771aebdb30 req-e03b8f69-164c-454c-ae11-09ae0c3334c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065064 Oct 01 20:56:20.724362 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 941/1825] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:20.729542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:20.730606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:20.752889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:20.753537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:20.754063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.754909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:20.758641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:20.759210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.964513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:20.966802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:20.988077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:20.991401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:20.994777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:20.997735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:21.001192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:21.003133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:21.018202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:21.026301 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2405c409-b1b3-45d6-bc9f-04ce3354435f tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.309735 Oct 01 20:56:21.028093 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 885/1826] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:20 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:21.033630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:21.035112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:21.053030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:21.059816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:21.060456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:21.061875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:21.063415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:21.063953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:21.114427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:21.115156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:21.115689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:21.116401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lazy-loading 'fault' on Instance uuid 77a4e4e5-a2d3-4ef7-a9fc-5905102864df {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:21.137638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:21.138442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:21.141945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:21.153238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lazy-loading 'fault' on Instance uuid fc3d670b-2ef6-4707-86ae-f91be8167888 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:21.206388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:21.219225 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-af867396-8aaf-4415-a60f-d3b14e2e7312 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df" status: 200 len: 1308 microversion: 2.1 time: 0.266264 Oct 01 20:56:21.220800 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 942/1827] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:20 2022] GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:21.235741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:21.250082 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca7bc3d9-d671-479d-9218-193504aa4fa7 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 200 len: 1301 microversion: 2.1 time: 0.220611 Oct 01 20:56:21.267022 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 886/1828] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:21 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 1301 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:21.579338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:21.580734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:21.590332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:21.591173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:21.592670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:21.593643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:21.594327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:21.595077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:21.642882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:21.644968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:21.658238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:21.659396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:21.660114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:21.662109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:21.663522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:21.665361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:21.767466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:21.780548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:21.782319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:21.790111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34235c14-0dbd-4274-99f5-7e0e102be20d tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.153574 Oct 01 20:56:21.791295 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 887/1829] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:21 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:21.799217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebb29b1b-3111-4389-98dc-c7837ce4b44e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4172ed04c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:21.816076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:21.833495 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f2b9b27d-dbaf-48bd-9930-165812afd42d tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.267877 Oct 01 20:56:21.836088 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 943/1830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:21 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:21.877159 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebb29b1b-3111-4389-98dc-c7837ce4b44e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.084156 Oct 01 20:56:21.878019 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 888/1831] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:21 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:21.993187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-367299699", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:22.052652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:22.053590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:22.060731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.061254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.061949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.066043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.067081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.067627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.079084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:56:22.329008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:22.339427 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3895e9a-12d4-4dc2-b8dd-f8d8a7c3ab5d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.290598 Oct 01 20:56:22.340843 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 889/1832] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:22 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:22.345561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:22.347056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 77a4e4e5-a2d3-4ef7-a9fc-5905102864df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:22.355081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.355860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.356501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.357395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.358034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.358663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.375284 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] HTTP exception thrown: Instance 77a4e4e5-a2d3-4ef7-a9fc-5905102864df could not be found. Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Request method failure captured: Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df HTTP/1.1 Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKi4hneyV0UmMyeEvxPvki8R_BaiMwZO97vr8doDlv5bt_m4zcidHAO2rMbLQLo5XufeJzCNqaQJgqbxlBI7erezeGG3CP5Ypm3KXxKIZiGIp8xqkmPMfLUCm1WFlGy0ybNN5EV4fBmpGyJFj_BHTiUeMt0TdrHml-jGdV2K6QFsrAQ Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_44683518fe3d46c58b139727cf0c9515", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}] Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e82ed96a3e794a1b99662cec0969b7ec Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 77a4e4e5-a2d3-4ef7-a9fc-5905102864df could not be found. Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '77a4e4e5-a2d3-4ef7-a9fc-5905102864df'} Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77a4e4e5-a2d3-4ef7-a9fc-5905102864df could not be found. Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77a4e4e5-a2d3-4ef7-a9fc-5905102864df could not be found. Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:22.377887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.383376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:22.383376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:22.383376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:22.383376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:22.383376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:22.383376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77a4e4e5-a2d3-4ef7-a9fc-5905102864df could not be found. Oct 01 20:56:22.383376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.384859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Returning 404 to user: Instance 77a4e4e5-a2d3-4ef7-a9fc-5905102864df could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:22.386190 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1bb9ac34-aea2-4cb2-8091-e558a080ee50 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df" status: 404 len: 111 microversion: 2.1 time: 0.044563 Oct 01 20:56:22.386967 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 890/1833] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:22 2022] GET /compute/v2.1/servers/77a4e4e5-a2d3-4ef7-a9fc-5905102864df => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:22.391740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:22.392562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: fc3d670b-2ef6-4707-86ae-f91be8167888] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:22.396709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:56:22.397136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:56:22.397614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:56:22.398588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:56:22.399003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:56:22.400792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.401309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.401760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.402629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.403083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.403892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.410964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.411643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.412085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.412819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.413276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.414334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.426677 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] HTTP exception thrown: Instance fc3d670b-2ef6-4707-86ae-f91be8167888 could not be found. Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Request method failure captured: Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 HTTP/1.1 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKhKftXhcj6-26HIOzPPLrtrm6c-qGdlf8tOhsZ2CBA0Jh8ZpiON8CGL9Z06ab_GihOYHLrCcDD0sIfdEY65fD1F-czmuBp0n64ZhdKcdFxcQ1vmtZR3NMXdaH34cYRvFs3PNbKI-ah6-A1r4K0kFpqUajSnzIDkHSVBwrKdTVasbsw Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 237c6bad691343e7a7e64304f55e01e9 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_237c6bad691343e7a7e64304f55e01e9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/237c6bad691343e7a7e64304f55e01e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/237c6bad691343e7a7e64304f55e01e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/237c6bad691343e7a7e64304f55e01e9"}]}] Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 237c6bad691343e7a7e64304f55e01e9 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveMigrationTest-1978574502-project Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a749a74841e840e2b8de67fb9562bf51 Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveMigrationTest-1978574502-project Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance fc3d670b-2ef6-4707-86ae-f91be8167888 could not be found. Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'fc3d670b-2ef6-4707-86ae-f91be8167888'} Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc3d670b-2ef6-4707-86ae-f91be8167888 could not be found. Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc3d670b-2ef6-4707-86ae-f91be8167888 could not be found. Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:22.429319 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.435245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:22.435245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:22.435245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:22.435245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:22.435245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:22.435245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc3d670b-2ef6-4707-86ae-f91be8167888 could not be found. Oct 01 20:56:22.435245 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.437529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Getting quotas for project a6bdd72ba854403e8fef7f651a3ef106. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:22.438904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Returning 404 to user: Instance fc3d670b-2ef6-4707-86ae-f91be8167888 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:22.439780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-abf451a6-1681-436b-a7f4-91146050ffcb tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888" status: 404 len: 111 microversion: 2.1 time: 0.051708 Oct 01 20:56:22.440705 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 891/1834] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:22 2022] GET /compute/v2.1/servers/fc3d670b-2ef6-4707-86ae-f91be8167888 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:22.445304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:22.445915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 2ec44930-5588-48ae-8253-56af3ab60310] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:22.446436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Getting quotas for user 123a8a1d0b65407098b5a8e91091b9ca and project a6bdd72ba854403e8fef7f651a3ef106. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:22.453136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.453793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.454141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.455489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.456353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.457031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.462216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:56:22.465840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:56:22.472967 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] HTTP exception thrown: Instance 2ec44930-5588-48ae-8253-56af3ab60310 could not be found. Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Request method failure captured: Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 HTTP/1.1 Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKi4hneyV0UmMyeEvxPvki8R_BaiMwZO97vr8doDlv5bt_m4zcidHAO2rMbLQLo5XufeJzCNqaQJgqbxlBI7erezeGG3CP5Ypm3KXxKIZiGIp8xqkmPMfLUCm1WFlGy0ybNN5EV4fBmpGyJFj_BHTiUeMt0TdrHml-jGdV2K6QFsrAQ Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_44683518fe3d46c58b139727cf0c9515", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}] Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e82ed96a3e794a1b99662cec0969b7ec Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 2ec44930-5588-48ae-8253-56af3ab60310 could not be found. Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2ec44930-5588-48ae-8253-56af3ab60310'} Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec44930-5588-48ae-8253-56af3ab60310 could not be found. Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec44930-5588-48ae-8253-56af3ab60310 could not be found. Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:22.474612 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.481883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:22.481883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:22.481883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:22.481883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:22.481883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:22.481883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec44930-5588-48ae-8253-56af3ab60310 could not be found. Oct 01 20:56:22.481883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:22.484623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Returning 404 to user: Instance 2ec44930-5588-48ae-8253-56af3ab60310 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:22.484623 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3048094f-2262-4b56-b411-d91998a00114 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310" status: 404 len: 111 microversion: 2.1 time: 0.042733 Oct 01 20:56:22.485230 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 892/1835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:22 2022] GET /compute/v2.1/servers/2ec44930-5588-48ae-8253-56af3ab60310 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:22.490556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:22.491373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:22.498004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.498674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.499323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.500067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.500524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.501007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.520728 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6d2253ce-2bb9-4913-868e-93be8a20157f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683292 Oct 01 20:56:22.521918 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 944/1836] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:56:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:56:22.528416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-294cd187-5fa0-443f-b6d8-7b575584169d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:22.530907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:22.594737 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-294cd187-5fa0-443f-b6d8-7b575584169d tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/fdce9808-1c48-473e-b790-269b25808432" status: 204 len: 0 microversion: 2.1 time: 0.070255 Oct 01 20:56:22.599053 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 945/1837] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 20:56:22 2022] DELETE /compute/v2.1/os-server-groups/fdce9808-1c48-473e-b790-269b25808432 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:22.610215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:22.610757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:22.626185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.626185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.626185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.626654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.627055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.627708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.659082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:22.701567 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-10c57371-70fd-4a51-a928-f34a607fc80d tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "DELETE /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 204 len: 0 microversion: 2.1 time: 0.214672 Oct 01 20:56:22.702238 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 893/1838] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:22 2022] DELETE /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:22.716465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-196375865", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:22.806279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:56:22.876145 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bb25282b-71f4-4171-99a8-a98989b94c94 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 204 len: 0 microversion: 2.1 time: 0.272113 Oct 01 20:56:22.876845 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 946/1839] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:22 2022] DELETE /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:22.885875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:22.886992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:22.894368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.902177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.903190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:22.904134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:22.904777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:22.905414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.146378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:23.163983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:56:23.164418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:56:23.165030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:56:23.165687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:56:23.166307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:56:23.168633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:23.169565 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f18a7bc5-3f06-437b-a925-c30f1f419681 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1499 microversion: 2.1 time: 0.287786 Oct 01 20:56:23.181548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.182309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.183364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.184295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.184993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.185640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.187126 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 947/1840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:22 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1499 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:23.192468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-125b6c4d-b3ae-4dcc-869d-4742efddd5d0 req-59b37126-d36c-429b-9868-3e0bdecfd08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3d670b-2ef6-4707-86ae-f91be8167888", "name": "network-vif-deleted", "tag": "93297d56-6416-43dd-8e55-db06d23206f3"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:23.206070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-125b6c4d-b3ae-4dcc-869d-4742efddd5d0 req-59b37126-d36c-429b-9868-3e0bdecfd08b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.208953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Getting quotas for project a6bdd72ba854403e8fef7f651a3ef106. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:23.212275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-125b6c4d-b3ae-4dcc-869d-4742efddd5d0 req-59b37126-d36c-429b-9868-3e0bdecfd08b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.213106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-125b6c4d-b3ae-4dcc-869d-4742efddd5d0 req-59b37126-d36c-429b-9868-3e0bdecfd08b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.214864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Getting quotas for user 123a8a1d0b65407098b5a8e91091b9ca and project a6bdd72ba854403e8fef7f651a3ef106. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:23.228392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:56:23.230951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:56:23.232656 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-125b6c4d-b3ae-4dcc-869d-4742efddd5d0 req-59b37126-d36c-429b-9868-3e0bdecfd08b service nova] Creating event network-vif-deleted:93297d56-6416-43dd-8e55-db06d23206f3 for instance fc3d670b-2ef6-4707-86ae-f91be8167888 on nch2-master-1 Oct 01 20:56:23.238732 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-125b6c4d-b3ae-4dcc-869d-4742efddd5d0 req-59b37126-d36c-429b-9868-3e0bdecfd08b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050136 Oct 01 20:56:23.244166 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 948/1841] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:23.252434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:23.254856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:23.269657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.270817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.271587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.272559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.273639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.274476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.314090 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4e3a3d2d-12f3-44ed-9910-a86d8e438749 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610359 Oct 01 20:56:23.314683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 894/1842] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:56:23.326012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:23.326648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:23.335998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.336386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.337030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.338473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.339273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.339861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.361370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:23.371461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:23.373422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:23.393571 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-da5ce193-afda-4ed6-a2b5-f6c40c4f6fbf tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.144806 Oct 01 20:56:23.408014 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 949/1843] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:23 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:23.438597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:23.439676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:23.456483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.456984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.457428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.458140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.458631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.463117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.736961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:23.745895 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6b52836e-da5e-4046-8fc3-3e707bf6c5bf tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1472 microversion: 2.1 time: 0.336116 Oct 01 20:56:23.769009 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 950/1844] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:23 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:23.773979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5150c6a5-851b-45d9-811d-3d3e4228265d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173223670>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:23.775197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:23.812455 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-663c6f6e-0b2e-41bb-920a-845d608a75e6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.496620 Oct 01 20:56:23.824559 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 895/1845] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:23 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:23.853703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a052b97-727e-47b6-b67e-bf22d726ae1e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:23.854970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a052b97-727e-47b6-b67e-bf22d726ae1e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:23.857357 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5150c6a5-851b-45d9-811d-3d3e4228265d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.087055 Oct 01 20:56:23.858439 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 951/1846] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:23 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:23.872850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:23.874867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:23.891131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.892279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.893585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.894739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:23.897028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:23.898241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:23.986032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a052b97-727e-47b6-b67e-bf22d726ae1e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:23.993987 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a052b97-727e-47b6-b67e-bf22d726ae1e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1213 microversion: 2.1 time: 0.166745 Oct 01 20:56:23.996584 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 896/1847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:23 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:24.138997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:24.148502 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e1109e5c-073b-400f-b3fe-6b4beda482ad tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 0.286186 Oct 01 20:56:24.163371 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 952/1848] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:23 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:24.194517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:24.195210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:24.202006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:24.202627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:24.203311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:24.204234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:24.204766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:24.205398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:24.392870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:24.404573 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4464d5a0-36ff-40ff-8db3-60d11c1f5c42 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1499 microversion: 2.1 time: 0.213952 Oct 01 20:56:24.408208 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 897/1849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:24 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1499 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:24.432363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:24.433624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:24.446665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:24.447347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:24.447897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:24.448738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:24.449535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:24.450081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:24.581510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:24.593685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:24.595666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:24.604813 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3432fa49-fa30-45dc-96b2-09ff05797241 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.177920 Oct 01 20:56:24.607193 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 953/1850] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:24 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:24.777813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:24.779142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:24.789708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:24.790222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:24.790689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:24.791408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:24.791887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:24.792314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:24.853987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:24.854831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:24.860282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:24.870145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:24.870682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:24.871122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:24.873361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:24.873361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:24.873361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:25.486177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:25.495890 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4bbd8060-954a-4a72-b1c7-73b5548ec12e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1472 microversion: 2.1 time: 0.722008 Oct 01 20:56:25.502654 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 898/1851] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:24 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1472 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:25.511181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec7649de-0cba-48ac-9da9-4755a35cbc0b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173022f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:25.581903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec7649de-0cba-48ac-9da9-4755a35cbc0b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.077864 Oct 01 20:56:25.582997 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 899/1852] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:25 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:25.588226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:25.589023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:25.601629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:25.603778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:25.604249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:25.605007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:25.605484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:25.607429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:25.654507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:25.665595 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2434bbcf-00ff-4b5a-ad44-0ea7f3b7c541 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.817266 Oct 01 20:56:25.685868 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 954/1853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:24 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:25.691488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:25.692392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:25.698737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:25.699513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:25.700174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:25.701296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:25.702019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:25.702707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:26.002269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:26.015968 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea3a1b78-ee4d-44f0-8730-61758597d9ab tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1271 microversion: 2.1 time: 0.431668 Oct 01 20:56:26.032889 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 900/1854] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:25 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1271 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:26.051363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:26.052033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:26.064730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:26.066387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:26.066872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:26.067607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:26.068097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:26.068532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:26.840582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:26.860283 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d612fa89-93a5-445d-a5b1-5b30c64a3b6b tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 200 len: 1504 microversion: 2.1 time: 1.172542 Oct 01 20:56:26.863949 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 955/1855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:25 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 1504 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:26.878674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:26.879910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:26.889201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:26.890096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:26.890820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:26.892000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:26.892837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:26.893486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:27.082937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:27.093265 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4e345bd-9384-4036-aead-bcae53478cab tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1499 microversion: 2.1 time: 1.058802 Oct 01 20:56:27.103521 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 901/1856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:26 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1499 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:27.109741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:27.110716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:27.124992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:27.126903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:27.131649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:27.133345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:27.134064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:27.135051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:27.341952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:27.352676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:27.354797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:27.363692 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ed5d1551-21f7-4db9-ada7-dfa94151bcb8 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.496780 Oct 01 20:56:27.365211 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 956/1857] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:26 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:27.371759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ba1da51b-8caa-4b22-a516-0f0204a7bf6d req-4c2cee39-f4ce-42a9-afec-04529c85eb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15da01e-ab80-469b-bec2-63336c26cf11", "name": "network-vif-deleted", "tag": "09809c55-101d-4f60-a1c1-2816a5dd97d8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:27.415503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ba1da51b-8caa-4b22-a516-0f0204a7bf6d req-4c2cee39-f4ce-42a9-afec-04529c85eb61 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:27.416561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ba1da51b-8caa-4b22-a516-0f0204a7bf6d req-4c2cee39-f4ce-42a9-afec-04529c85eb61 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:27.419006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ba1da51b-8caa-4b22-a516-0f0204a7bf6d req-4c2cee39-f4ce-42a9-afec-04529c85eb61 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:27.440627 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ba1da51b-8caa-4b22-a516-0f0204a7bf6d req-4c2cee39-f4ce-42a9-afec-04529c85eb61 service nova] Creating event network-vif-deleted:09809c55-101d-4f60-a1c1-2816a5dd97d8 for instance e15da01e-ab80-469b-bec2-63336c26cf11 on nch1-master-1 Oct 01 20:56:27.446150 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ba1da51b-8caa-4b22-a516-0f0204a7bf6d req-4c2cee39-f4ce-42a9-afec-04529c85eb61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079489 Oct 01 20:56:27.447019 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 957/1858] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:27.452794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cdbb8d25-e9bb-41c1-a58f-fd17950422c5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417369dee0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:27.514693 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cdbb8d25-e9bb-41c1-a58f-fd17950422c5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1411 microversion: 2.1 time: 0.056967 Oct 01 20:56:27.515937 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 958/1859] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:27 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:27.527132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:27.527974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:27.540175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:27.540547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:27.541050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:27.541679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:27.542135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:27.542669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:27.854257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:27.863601 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7c93517-3273-4d28-9b39-86ff078f8a21 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1472 microversion: 2.1 time: 0.758552 Oct 01 20:56:27.867753 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 902/1860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:27 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1472 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:27.890074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-71a88d74-fd4c-4192-b2f9-eba1ce4dade5 req-60c1bae7-46dc-4130-b90e-6d7a8a0b6392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c51efc3-f63a-4767-a6b1-ea93db136447", "name": "network-vif-unplugged", "status": "completed", "tag": "da9dc053-8628-4335-88b6-12d5540ec545"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:27.934595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:27.948841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-71a88d74-fd4c-4192-b2f9-eba1ce4dade5 req-60c1bae7-46dc-4130-b90e-6d7a8a0b6392 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:27.949441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-71a88d74-fd4c-4192-b2f9-eba1ce4dade5 req-60c1bae7-46dc-4130-b90e-6d7a8a0b6392 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:27.949954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-71a88d74-fd4c-4192-b2f9-eba1ce4dade5 req-60c1bae7-46dc-4130-b90e-6d7a8a0b6392 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:27.956112 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0f9908dc-62a0-42a3-b6de-3f93d2442ea8 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.438912 Oct 01 20:56:27.963922 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 959/1861] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:27 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:27.971585 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-71a88d74-fd4c-4192-b2f9-eba1ce4dade5 req-60c1bae7-46dc-4130-b90e-6d7a8a0b6392 service nova] Creating event network-vif-unplugged:da9dc053-8628-4335-88b6-12d5540ec545 for instance 8c51efc3-f63a-4767-a6b1-ea93db136447 on nch1-master-1 Oct 01 20:56:27.974005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-09f32b58-a06e-4e8d-891a-c4d26b63bfe3 req-c9f4d0ef-2e5d-49da-87d8-97213315442b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ddcd83-e345-4846-9f2e-2808c079168f", "name": "network-vif-deleted", "tag": "f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:27.988374 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-71a88d74-fd4c-4192-b2f9-eba1ce4dade5 req-60c1bae7-46dc-4130-b90e-6d7a8a0b6392 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105540 Oct 01 20:56:27.992334 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 903/1862] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:27.999372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-09f32b58-a06e-4e8d-891a-c4d26b63bfe3 req-c9f4d0ef-2e5d-49da-87d8-97213315442b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.000985 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-09f32b58-a06e-4e8d-891a-c4d26b63bfe3 req-c9f4d0ef-2e5d-49da-87d8-97213315442b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.003131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-09f32b58-a06e-4e8d-891a-c4d26b63bfe3 req-c9f4d0ef-2e5d-49da-87d8-97213315442b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.020408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:28.021440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:28.039887 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-09f32b58-a06e-4e8d-891a-c4d26b63bfe3 req-c9f4d0ef-2e5d-49da-87d8-97213315442b service nova] Creating event network-vif-deleted:f44f4370-8a04-4dd1-ac56-f00d5b4f3fe9 for instance 28ddcd83-e345-4846-9f2e-2808c079168f on nch1-master-1 Oct 01 20:56:28.045645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.048029 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-09f32b58-a06e-4e8d-891a-c4d26b63bfe3 req-c9f4d0ef-2e5d-49da-87d8-97213315442b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080582 Oct 01 20:56:28.049757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.049987 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 960/1863] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:28.052403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.056457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:28.057527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: e15da01e-ab80-469b-bec2-63336c26cf11] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:28.057814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.058386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.058872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.078865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.083031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.083988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.087060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.087782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.088473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.093627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:28.125267 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] HTTP exception thrown: Instance e15da01e-ab80-469b-bec2-63336c26cf11 could not be found. Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Request method failure captured: Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 HTTP/1.1 Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjs9WU-kFW1dQRrr64MDO6sMqh0xezf1tqugf-walt3J9-MkXRSg8VCGJn7Xk6ygRHUEJPLXDvbpQ4XL4Rcw4xrft5XWTjnz-UJG1v821TqJDVpBM0rP8_IooDNRRofFYwT96EyfCZhZOIRLX_WAMIssBwFKOIIeWIO86IOm0asQlQ Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: bcaab3f0817043c682737e94bb1dd1ac Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerRescueTestJSON-1402920430 Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcaab3f0817043c682737e94bb1dd1ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcaab3f0817043c682737e94bb1dd1ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcaab3f0817043c682737e94bb1dd1ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcaab3f0817043c682737e94bb1dd1ac"}]}] Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerRescueTestJSON-1402920430 Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: bcaab3f0817043c682737e94bb1dd1ac Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerRescueTestJSON-1402920430 Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerRescueTestJSON-1402920430-project Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 725f68beba264c2eafc951f8300eba32 Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerRescueTestJSON-1402920430-project Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e15da01e-ab80-469b-bec2-63336c26cf11 could not be found. Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e15da01e-ab80-469b-bec2-63336c26cf11'} Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e15da01e-ab80-469b-bec2-63336c26cf11 could not be found. Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15da01e-ab80-469b-bec2-63336c26cf11 could not be found. Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:28.127693 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:28.133537 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:28.133537 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:28.133537 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:28.133537 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:28.133537 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:28.133537 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15da01e-ab80-469b-bec2-63336c26cf11 could not be found. Oct 01 20:56:28.133537 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:28.136184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Returning 404 to user: Instance e15da01e-ab80-469b-bec2-63336c26cf11 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:28.137044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:28.138335 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-74511f22-1afe-422d-85b1-282951aca3c6 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11" status: 404 len: 111 microversion: 2.1 time: 0.086408 Oct 01 20:56:28.142678 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 961/1864] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:28 2022] GET /compute/v2.1/servers/e15da01e-ab80-469b-bec2-63336c26cf11 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:28.181920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:28.182642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:28.189556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.190051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.190513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.191230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.191687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.192177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.234246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.234840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.235282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.235772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lazy-loading 'fault' on Instance uuid 28ddcd83-e345-4846-9f2e-2808c079168f {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:28.311630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:28.323877 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06823af4-5944-4d11-8cba-452f5882db20 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1271 microversion: 2.1 time: 0.324800 Oct 01 20:56:28.326869 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 904/1865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:27 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1271 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:28.337143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:28.348433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:28.359068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.359568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.371133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.372178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.372826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.373316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.387570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a749a74841e840e2b8de67fb9562bf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237c6bad691343e7a7e64304f55e01e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:28.402040 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5a654ba0-cea9-4a1e-ae0b-4615cc888fc2 tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 200 len: 1300 microversion: 2.1 time: 0.259610 Oct 01 20:56:28.411456 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 962/1866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:28 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:28.422939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:28.431612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:28.444401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.447931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.448604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.450305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.452409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.457511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:28.471611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.683723 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d23bd778-6438-4d76-9354-f6c5d9b3ee47 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "DELETE /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 204 len: 0 microversion: 2.1 time: 0.355107 Oct 01 20:56:28.690469 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 905/1867] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:28 2022] DELETE /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:28.702713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0d7ddb8-9ce5-4b72-aa64-b2297688ab71 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4172f3c8b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:28.785794 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0d7ddb8-9ce5-4b72-aa64-b2297688ab71 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1420 microversion: 2.1 time: 0.089245 Oct 01 20:56:28.786193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:28.786776 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 906/1868] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:28 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:28.804650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:28.805124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:28.806093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:28.810987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:28.812124 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9ce7f202-b631-4337-b099-a649c4e2ac57 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.399194 Oct 01 20:56:28.814619 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 963/1869] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:28 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:28.838807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.839340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.839504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0676550f-38a3-4f6c-8f26-d5401bc54a82 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41735ef3a0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:28.839802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.840599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.841159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.841818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.911143 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0676550f-38a3-4f6c-8f26-d5401bc54a82 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 200 len: 1420 microversion: 2.1 time: 0.095383 Oct 01 20:56:28.911929 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 964/1870] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:28 2022] GET /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:28.916856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:28.917468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:28.927529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.928147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.928689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.931462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.932062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.933381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.976784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:28.977467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:28.977870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:28.978399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lazy-loading 'fault' on Instance uuid 8c51efc3-f63a-4767-a6b1-ea93db136447 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:29.033090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:29.037034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:29.043566 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c582df17-aa39-4842-9f29-c73230980905 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1306 microversion: 2.1 time: 0.130781 Oct 01 20:56:29.044417 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 965/1871] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:28 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1306 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:29.049582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f68c4994-80ba-44e3-bee7-14f1c95d8cde tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173635e50>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:29.054927 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e6708e59-8d24-41c1-a40c-8c44dee71012 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1493 microversion: 2.1 time: 0.254821 Oct 01 20:56:29.063060 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 907/1872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:28 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1493 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:29.068717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:29.069576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:29.077514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.078152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.078446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.079193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.079683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.080121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.216000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:29.224149 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94fc88a1-d973-4f41-bc2e-0d0bb3ce2770 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.160039 Oct 01 20:56:29.224731 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 908/1873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:29 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:29.347921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:29.348427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:29.355476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.356031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.356478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.357249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.357717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.358154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.505279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:29.514629 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-481f16d0-50c0-48d1-807f-da3a038fdd38 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1313 microversion: 2.1 time: 0.170695 Oct 01 20:56:29.515297 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 909/1874] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:29 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:29.521980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:29.523217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] [instance: 28ddcd83-e345-4846-9f2e-2808c079168f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:29.533859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.534693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.535241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.535956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.536413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.536846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.551251 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] HTTP exception thrown: Instance 28ddcd83-e345-4846-9f2e-2808c079168f could not be found. Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Request method failure captured: Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f HTTP/1.1 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKhKftXhcj6-26HIOzPPLrtrm6c-qGdlf8tOhsZ2CBA0Jh8ZpiON8CGL9Z06ab_GihOYHLrCcDD0sIfdEY65fD1F-czmuBp0n64ZhdKcdFxcQ1vmtZR3NMXdaH34cYRvFs3PNbKI-ah6-A1r4K0kFpqUajSnzIDkHSVBwrKdTVasbsw Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 237c6bad691343e7a7e64304f55e01e9 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_237c6bad691343e7a7e64304f55e01e9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/237c6bad691343e7a7e64304f55e01e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/237c6bad691343e7a7e64304f55e01e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/237c6bad691343e7a7e64304f55e01e9"}]}] Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 237c6bad691343e7a7e64304f55e01e9 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-LiveMigrationTest-1978574502 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-LiveMigrationTest-1978574502-project Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a749a74841e840e2b8de67fb9562bf51 Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-LiveMigrationTest-1978574502-project Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 28ddcd83-e345-4846-9f2e-2808c079168f could not be found. Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '28ddcd83-e345-4846-9f2e-2808c079168f'} Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28ddcd83-e345-4846-9f2e-2808c079168f could not be found. Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28ddcd83-e345-4846-9f2e-2808c079168f could not be found. Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:29.552995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28ddcd83-e345-4846-9f2e-2808c079168f could not be found. Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] Returning 404 to user: Instance 28ddcd83-e345-4846-9f2e-2808c079168f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05566ff4-d5de-4edf-9706-7eea50a01c3b tempest-LiveMigrationTest-1978574502 tempest-LiveMigrationTest-1978574502-project] 10.222.0.17 "GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f" status: 404 len: 111 microversion: 2.1 time: 0.039506 Oct 01 20:56:29.559152 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 910/1875] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:29 2022] GET /compute/v2.1/servers/28ddcd83-e345-4846-9f2e-2808c079168f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:29.561862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e749072c-8c15-452f-b14c-097822165327 req-d1a1bcfe-7c33-4708-9ade-b6e59b890bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b9ddc4-96e9-4c59-b07f-e785f2179e8c", "tag": "edbfb05d-0450-4747-beea-2150a81bba2f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:29.571302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e749072c-8c15-452f-b14c-097822165327 req-d1a1bcfe-7c33-4708-9ade-b6e59b890bd9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.571721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e749072c-8c15-452f-b14c-097822165327 req-d1a1bcfe-7c33-4708-9ade-b6e59b890bd9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.572153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e749072c-8c15-452f-b14c-097822165327 req-d1a1bcfe-7c33-4708-9ade-b6e59b890bd9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.583989 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e749072c-8c15-452f-b14c-097822165327 req-d1a1bcfe-7c33-4708-9ade-b6e59b890bd9 service nova] Creating event network-changed:edbfb05d-0450-4747-beea-2150a81bba2f for instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c on nch2-master-1 Oct 01 20:56:29.589183 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e749072c-8c15-452f-b14c-097822165327 req-d1a1bcfe-7c33-4708-9ade-b6e59b890bd9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031042 Oct 01 20:56:29.590110 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 911/1876] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:29.668096 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f68c4994-80ba-44e3-bee7-14f1c95d8cde tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 204 len: 0 microversion: 2.1 time: 0.622400 Oct 01 20:56:29.668681 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 966/1877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:29 2022] DELETE /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:29.677303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:29.677898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:29.685250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.685745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.686179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.687233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.687706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.688729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.740098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:29.846271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:29.847273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:29.848092 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba2ac8b2-56dc-41df-8715-37501268419e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 204 len: 0 microversion: 2.1 time: 0.174206 Oct 01 20:56:29.855798 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 912/1878] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:29 2022] DELETE /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:29.859245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.862131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.863012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:29.863834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:29.864342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:29.864776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:30.004255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:30.019304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:30.021723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:30.030029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1504129712", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "00c1b669-0633-4d9a-bca2-2a3af62ab8df"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:30.037186 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3a2ff534-5ec0-4cd1-89c6-957d9786bc94 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.195741 Oct 01 20:56:30.038754 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 967/1879] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:29 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:30.078697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:30.080135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:30.090559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:30.092055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:30.092883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:30.093901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:30.094871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:30.095577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:30.118744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] validate_networks() for [('00c1b669-0633-4d9a-bca2-2a3af62ab8df', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:56:30.153794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:30.154578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:30.155172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:30.155780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lazy-loading 'fault' on Instance uuid 8c51efc3-f63a-4767-a6b1-ea93db136447 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:30.270320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:30.287463 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aa20164e-84e0-4188-8821-2abaaea90726 tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1306 microversion: 2.1 time: 0.218568 Oct 01 20:56:30.289403 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 968/1880] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:30 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1306 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:30.300162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:30.301347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:30.310134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:30.311251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:30.312184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:30.314246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:30.315456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:30.317152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:30.696451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:30.706664 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5836cb8e-112e-48b3-8491-52f9c7d3d170 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1493 microversion: 2.1 time: 0.415997 Oct 01 20:56:30.707958 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 969/1881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:30 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1493 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:30.714664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-8ff772f7-814c-4824-81bc-76a5de548768 req-03fd5819-4bb1-426a-b790-3faa5f7661be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c51efc3-f63a-4767-a6b1-ea93db136447", "name": "network-vif-deleted", "tag": "da9dc053-8628-4335-88b6-12d5540ec545"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:30.724404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8ff772f7-814c-4824-81bc-76a5de548768 req-03fd5819-4bb1-426a-b790-3faa5f7661be service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:30.725177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8ff772f7-814c-4824-81bc-76a5de548768 req-03fd5819-4bb1-426a-b790-3faa5f7661be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:30.726415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8ff772f7-814c-4824-81bc-76a5de548768 req-03fd5819-4bb1-426a-b790-3faa5f7661be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:30.738806 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-8ff772f7-814c-4824-81bc-76a5de548768 req-03fd5819-4bb1-426a-b790-3faa5f7661be service nova] Creating event network-vif-deleted:da9dc053-8628-4335-88b6-12d5540ec545 for instance 8c51efc3-f63a-4767-a6b1-ea93db136447 on nch1-master-1 Oct 01 20:56:30.748183 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-8ff772f7-814c-4824-81bc-76a5de548768 req-03fd5819-4bb1-426a-b790-3faa5f7661be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038702 Oct 01 20:56:30.748967 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 970/1882] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:30.754642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:30.755923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:30.762833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:30.763865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:30.764330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:30.765471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:30.765471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:30.765932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.343464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:56:31.344069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:56:31.344373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:56:31.344797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:56:31.345223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:56:31.355190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:31.355806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:31.356438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.357455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:31.358012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:31.358561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.378921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Getting quotas for project 9c0b38cea2c345c68c51c4d8cb9c07e7. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:31.386342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Getting quotas for user 1d180849a694494e89843c0c315acd6d and project 9c0b38cea2c345c68c51c4d8cb9c07e7. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:31.400000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:31.401298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:56:31.404314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:56:31.440837 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-88a3041d-9bb0-4577-85b7-80925efb9e36 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1519 microversion: 2.1 time: 0.689352 Oct 01 20:56:31.463332 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 971/1883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:30 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1519 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:31.475357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:31.476380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:31.489532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:31.490042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:31.490507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.493396 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3fd32ce6-7292-49d4-bfef-df7dac135c19 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467557 Oct 01 20:56:31.501004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:31.501542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:31.502604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.508801 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 913/1884] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 20:56:31.517881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:31.518534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:31.537002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:31.537767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:31.538418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.539350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:31.539986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:31.540439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.753099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:31.769261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:31.771811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:31.786752 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bac2bbc0-eae4-428d-85e6-d84febb869cc tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.276118 Oct 01 20:56:31.803458 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 914/1885] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:31 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:31.812993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:31.813953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:31.822839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:31.823962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:31.824886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.825793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:31.826263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:31.826734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.866233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:31.866850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:31.867291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:31.867420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:31.867755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lazy-loading 'fault' on Instance uuid 8c51efc3-f63a-4767-a6b1-ea93db136447 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:31.876280 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c7f56457-67e6-4d8b-9f04-b26e94f15b92 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1313 microversion: 2.1 time: 0.411175 Oct 01 20:56:31.889683 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 972/1886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:31 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:31.893371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-71002961-f229-46b7-94e6-e707375f834e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:31.893371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-71002961-f229-46b7-94e6-e707375f834e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:31.965889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ed96a3e794a1b99662cec0969b7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44683518fe3d46c58b139727cf0c9515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:31.975641 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-86d79815-bcaf-4fa3-adcc-cd31c6810a6e tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 200 len: 1306 microversion: 2.1 time: 0.170914 Oct 01 20:56:31.993996 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 915/1887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:31 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 1306 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:32.000355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:32.001104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:32.009338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:32.009987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:32.010535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:32.011363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:32.011918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:32.012524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:32.032554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-71002961-f229-46b7-94e6-e707375f834e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:32.050044 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-71002961-f229-46b7-94e6-e707375f834e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1208 microversion: 2.1 time: 0.171832 Oct 01 20:56:32.051378 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 973/1888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:31 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1208 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:32.371322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:32.379715 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a977d7da-f9b5-4f2b-bd77-feea702479a2 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1493 microversion: 2.1 time: 0.384028 Oct 01 20:56:32.380544 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 916/1889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:31 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1493 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:32.473145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:32.474139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:32.483483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:32.486005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:32.486782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:32.487758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:32.488829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:32.489588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:32.490349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:32.789556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9ab829f9-bd6b-4635-b62d-4aea2b8b6dc3 req-ae7fc68d-0b20-4130-b480-5a108655baca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f88d037c-9adb-4bbc-9431-52326a81f876", "tag": "8e4735ae-fb8d-40df-a185-339aa25f7014"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:32.826427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9ab829f9-bd6b-4635-b62d-4aea2b8b6dc3 req-ae7fc68d-0b20-4130-b480-5a108655baca service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:32.827587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9ab829f9-bd6b-4635-b62d-4aea2b8b6dc3 req-ae7fc68d-0b20-4130-b480-5a108655baca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:32.829437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9ab829f9-bd6b-4635-b62d-4aea2b8b6dc3 req-ae7fc68d-0b20-4130-b480-5a108655baca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:32.861049 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9ab829f9-bd6b-4635-b62d-4aea2b8b6dc3 req-ae7fc68d-0b20-4130-b480-5a108655baca service nova] Creating event network-changed:8e4735ae-fb8d-40df-a185-339aa25f7014 for instance f88d037c-9adb-4bbc-9431-52326a81f876 on nch2-master-1 Oct 01 20:56:32.870104 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9ab829f9-bd6b-4635-b62d-4aea2b8b6dc3 req-ae7fc68d-0b20-4130-b480-5a108655baca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084746 Oct 01 20:56:32.871660 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 917/1890] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:56:32.878944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:32.880219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:32.889625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:32.890873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:32.891375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:32.893060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:32.893859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:32.897156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:32.952223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:32.964450 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-027f050f-48f4-4af7-9699-60e957b17fce tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1496 microversion: 2.1 time: 0.498460 Oct 01 20:56:32.988384 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 974/1891] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:32 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1496 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:33.003817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:33.007253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:33.028777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:33.046230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:33.047860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:33.050819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:33.054753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:33.057438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:33.110898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:33.127495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:33.129943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:33.137723 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d9a2281-447a-4901-843f-5d673613dd2c tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.264149 Oct 01 20:56:33.141435 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 918/1892] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:32 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:33.150849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:33.156544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:33.157848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:33.183159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:33.184462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:33.184923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:33.185904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:33.188897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:33.189568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:33.406070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:56:33.938572 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82692972-ff66-44ae-bc81-322b34246dc5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 344 microversion: 2.1 time: 0.795346 Oct 01 20:56:33.939551 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 919/1893] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Oct 1 20:56:33 2022] GET /compute/v2.1/servers?status=shutoff => generated 344 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:33.945263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:33.945863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] [instance: 8c51efc3-f63a-4767-a6b1-ea93db136447] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:33.952002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:33.953031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:33.953714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:33.955958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:33.957221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:33.957832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:33.976839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] HTTP exception thrown: Instance 8c51efc3-f63a-4767-a6b1-ea93db136447 could not be found. Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Request method failure captured: Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 HTTP/1.1 Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKi4hneyV0UmMyeEvxPvki8R_BaiMwZO97vr8doDlv5bt_m4zcidHAO2rMbLQLo5XufeJzCNqaQJgqbxlBI7erezeGG3CP5Ypm3KXxKIZiGIp8xqkmPMfLUCm1WFlGy0ybNN5EV4fBmpGyJFj_BHTiUeMt0TdrHml-jGdV2K6QFsrAQ Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_44683518fe3d46c58b139727cf0c9515", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/44683518fe3d46c58b139727cf0c9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/44683518fe3d46c58b139727cf0c9515"}]}] Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 44683518fe3d46c58b139727cf0c9515 Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-22243837 Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e82ed96a3e794a1b99662cec0969b7ec Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersOnMultiNodesTest-22243837-project Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 8c51efc3-f63a-4767-a6b1-ea93db136447 could not be found. Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '8c51efc3-f63a-4767-a6b1-ea93db136447'} Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c51efc3-f63a-4767-a6b1-ea93db136447 could not be found. Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c51efc3-f63a-4767-a6b1-ea93db136447 could not be found. Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:33.979766 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:33.985897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:33.985897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:33.985897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:33.985897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:33.985897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:33.985897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c51efc3-f63a-4767-a6b1-ea93db136447 could not be found. Oct 01 20:56:33.985897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:33.987746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] Returning 404 to user: Instance 8c51efc3-f63a-4767-a6b1-ea93db136447 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:33.988813 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6217d71d-63fc-4abc-9d84-8d10409e54df tempest-ServersOnMultiNodesTest-22243837 tempest-ServersOnMultiNodesTest-22243837-project] 10.222.0.17 "GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447" status: 404 len: 111 microversion: 2.1 time: 0.048607 Oct 01 20:56:33.994991 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 920/1894] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:33 2022] GET /compute/v2.1/servers/8c51efc3-f63a-4767-a6b1-ea93db136447 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:34.000139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:34.000763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:34.009280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.010099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.010809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:34.011687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.012309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.012949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:34.046814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:34.403328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:34.426619 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-51b188d5-c801-4248-8b8a-416c7a0acaf3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1278 microversion: 2.1 time: 0.428570 Oct 01 20:56:34.440564 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 921/1895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:33 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1278 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:34.459243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-79e8a2b6-14c0-4a79-85a0-d8508847f6ae req-32bade95-0b5f-4ba1-ae8c-b199d592a3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b9ddc4-96e9-4c59-b07f-e785f2179e8c", "name": "network-vif-plugged", "status": "completed", "tag": "edbfb05d-0450-4747-beea-2150a81bba2f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:34.485481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:34.489827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-79e8a2b6-14c0-4a79-85a0-d8508847f6ae req-32bade95-0b5f-4ba1-ae8c-b199d592a3b4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.492422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-79e8a2b6-14c0-4a79-85a0-d8508847f6ae req-32bade95-0b5f-4ba1-ae8c-b199d592a3b4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.494293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-79e8a2b6-14c0-4a79-85a0-d8508847f6ae req-32bade95-0b5f-4ba1-ae8c-b199d592a3b4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:34.494463 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0ed90c35-fbdc-49ef-9b4c-e38ad8ee69f4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1313 microversion: 2.1 time: 1.503393 Oct 01 20:56:34.494947 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 975/1896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:32 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1313 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:34.529794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:34.530274 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-79e8a2b6-14c0-4a79-85a0-d8508847f6ae req-32bade95-0b5f-4ba1-ae8c-b199d592a3b4 service nova] Creating event network-vif-plugged:edbfb05d-0450-4747-beea-2150a81bba2f for instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c on nch2-master-1 Oct 01 20:56:34.530550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:34.546772 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-79e8a2b6-14c0-4a79-85a0-d8508847f6ae req-32bade95-0b5f-4ba1-ae8c-b199d592a3b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102494 Oct 01 20:56:34.550035 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 922/1897] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:34.555990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.556780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.557467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:34.558426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.559156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.559812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:34.560048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45babc61-6b93-48ea-9c91-ffceda1027d4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:34.567385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:34.580784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45babc61-6b93-48ea-9c91-ffceda1027d4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.586337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45babc61-6b93-48ea-9c91-ffceda1027d4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.587124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45babc61-6b93-48ea-9c91-ffceda1027d4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:34.642031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45babc61-6b93-48ea-9c91-ffceda1027d4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Going to try to start instance {{(pid=140438) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 01 20:56:34.732262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:34.743762 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45babc61-6b93-48ea-9c91-ffceda1027d4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "POST /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a/action" status: 202 len: 0 microversion: 2.1 time: 0.189007 Oct 01 20:56:34.746075 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 923/1898] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:56:34 2022] POST /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:34.753440 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-35ec244e-4110-42fc-a670-6af881a0092c tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1451 microversion: 2.1 time: 0.233603 Oct 01 20:56:34.755332 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 976/1899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:34 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1451 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:34.762820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:34.764006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:34.764630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:34.765028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:34.785418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.790674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.792774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:34.795544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.798561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.799419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:34.813126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.813638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.819652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:34.823166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:34.823853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:34.826388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:35.110813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:35.122109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:35.124234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:35.132749 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-78693f19-e9b5-4c56-ab54-c70f55e3d8db tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.383603 Oct 01 20:56:35.134619 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 924/1900] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:34 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:35.155682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-91d21f6b-596e-4540-92e0-ad5e4f83e1d9 req-4b1496bd-4003-4512-b790-a6ddd6e16429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bb9a33-87d3-4429-93d5-2f740d08b463", "name": "network-vif-deleted", "tag": "203f0093-826e-4ebf-8795-aeac2a7fda5f"}, {"server_uuid": "19fe3865-129e-47db-a49c-cae3dded681f", "name": "network-vif-deleted", "tag": "dc4e575f-951d-4f79-be51-61c297320479"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:35.181664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-91d21f6b-596e-4540-92e0-ad5e4f83e1d9 req-4b1496bd-4003-4512-b790-a6ddd6e16429 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:35.182951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-91d21f6b-596e-4540-92e0-ad5e4f83e1d9 req-4b1496bd-4003-4512-b790-a6ddd6e16429 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:35.183433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-91d21f6b-596e-4540-92e0-ad5e4f83e1d9 req-4b1496bd-4003-4512-b790-a6ddd6e16429 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:35.225304 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-91d21f6b-596e-4540-92e0-ad5e4f83e1d9 req-4b1496bd-4003-4512-b790-a6ddd6e16429 service nova] Creating event network-vif-deleted:203f0093-826e-4ebf-8795-aeac2a7fda5f for instance 12bb9a33-87d3-4429-93d5-2f740d08b463 on nch1-master-1 Oct 01 20:56:35.226468 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-91d21f6b-596e-4540-92e0-ad5e4f83e1d9 req-4b1496bd-4003-4512-b790-a6ddd6e16429 service nova] Creating event network-vif-deleted:dc4e575f-951d-4f79-be51-61c297320479 for instance 19fe3865-129e-47db-a49c-cae3dded681f on nch1-master-1 Oct 01 20:56:35.245606 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-91d21f6b-596e-4540-92e0-ad5e4f83e1d9 req-4b1496bd-4003-4512-b790-a6ddd6e16429 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.108794 Oct 01 20:56:35.246384 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 925/1901] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:35.474161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:35.479163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:35.494892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:35.495741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:35.496905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:35.498036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:35.502931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:35.504119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:35.712571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:35.732271 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-30c7f447-06c2-40ba-b674-b787f313ca09 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1505 microversion: 2.1 time: 0.968176 Oct 01 20:56:35.734898 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 977/1902] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:34 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1505 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:35.767493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:35.768829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:35.792904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:35.793646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:35.794281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:35.795211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:35.795991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:35.797082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:36.002946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:36.018208 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-281f0313-dead-4250-9ac3-d041566b4062 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1266 microversion: 2.1 time: 0.568222 Oct 01 20:56:36.019058 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 926/1903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:35 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1266 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:36.035668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:36.036683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:36.053226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:36.053934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:36.054463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:36.055225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:36.055851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:36.056866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:36.104001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:36.104937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:36.106833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:36.107575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lazy-loading 'fault' on Instance uuid 19fe3865-129e-47db-a49c-cae3dded681f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:36.188778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f68beba264c2eafc951f8300eba32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaab3f0817043c682737e94bb1dd1ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:36.194577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:36.205039 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dce589de-3543-4b70-9b0d-f15c9f69dd23 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1313 microversion: 2.1 time: 0.468241 Oct 01 20:56:36.206602 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 978/1904] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:35 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:36.213266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:36.214155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:36.221368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:36.222167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:36.222805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:36.223689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:36.224348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:36.225024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:36.240547 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e450ce0b-5a00-470c-b757-affe88a3c281 tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 200 len: 1304 microversion: 2.1 time: 0.220173 Oct 01 20:56:36.252224 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 927/1905] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:36 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 1304 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:36.374525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:36.384237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:36.386106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:36.392151 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-272ef388-9124-4644-9083-0b51523f83d5 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1447 microversion: 2.75 time: 0.184354 Oct 01 20:56:36.392750 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 979/1906] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:36 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:36.761314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:36.762065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:36.778303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:36.780604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:36.781713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:36.782934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:36.785474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:36.787415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:37.051090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:37.052520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:37.060130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:37.061059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:37.061839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:37.062894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:37.063437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:37.063948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:37.704593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:37.712578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2a61fcf4-5986-4e41-b32d-822281cf63b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1505 microversion: 2.1 time: 0.959430 Oct 01 20:56:37.728151 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 928/1907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:36 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1505 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:37.732335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:37.733454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:37.734086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:37.743476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:37.743993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:37.744446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:37.745175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:37.745650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:37.746092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:37.746738 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d8228288-3213-4c1c-83eb-657f5d9c5542 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1308 microversion: 2.1 time: 0.705621 Oct 01 20:56:37.747500 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 980/1908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:37 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1308 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:37.758765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:37.761281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] [instance: 19fe3865-129e-47db-a49c-cae3dded681f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:37.775563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:37.776379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:37.780163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:37.781170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:37.781816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:37.783609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:37.791708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:37.813536 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] HTTP exception thrown: Instance 19fe3865-129e-47db-a49c-cae3dded681f could not be found. Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Request method failure captured: Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f HTTP/1.1 Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjs9WU-kFW1dQRrr64MDO6sMqh0xezf1tqugf-walt3J9-MkXRSg8VCGJn7Xk6ygRHUEJPLXDvbpQ4XL4Rcw4xrft5XWTjnz-UJG1v821TqJDVpBM0rP8_IooDNRRofFYwT96EyfCZhZOIRLX_WAMIssBwFKOIIeWIO86IOm0asQlQ Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: bcaab3f0817043c682737e94bb1dd1ac Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerRescueTestJSON-1402920430 Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcaab3f0817043c682737e94bb1dd1ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcaab3f0817043c682737e94bb1dd1ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcaab3f0817043c682737e94bb1dd1ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcaab3f0817043c682737e94bb1dd1ac"}]}] Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerRescueTestJSON-1402920430 Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: bcaab3f0817043c682737e94bb1dd1ac Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerRescueTestJSON-1402920430 Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerRescueTestJSON-1402920430-project Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 725f68beba264c2eafc951f8300eba32 Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerRescueTestJSON-1402920430-project Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 19fe3865-129e-47db-a49c-cae3dded681f could not be found. Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '19fe3865-129e-47db-a49c-cae3dded681f'} Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19fe3865-129e-47db-a49c-cae3dded681f could not be found. Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19fe3865-129e-47db-a49c-cae3dded681f could not be found. Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:37.816488 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19fe3865-129e-47db-a49c-cae3dded681f could not be found. Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] Returning 404 to user: Instance 19fe3865-129e-47db-a49c-cae3dded681f could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c27fb623-cc77-448e-9445-0306ff81929d tempest-ServerRescueTestJSON-1402920430 tempest-ServerRescueTestJSON-1402920430-project] 10.222.0.17 "GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f" status: 404 len: 111 microversion: 2.1 time: 0.068059 Oct 01 20:56:37.821501 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 981/1909] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:37 2022] GET /compute/v2.1/servers/19fe3865-129e-47db-a49c-cae3dded681f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:37.831552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:37.832756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:37.841706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:37.842942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:37.843647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:37.844393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:37.844854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:37.845295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:37.976276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:37.984703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:37.986203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:37.993691 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-27e0ed38-a516-4a9c-8f31-5c5717312020 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1453 microversion: 2.75 time: 0.171141 Oct 01 20:56:38.010907 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 982/1910] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:37 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:38.014532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-828a598c-e395-4a52-8e54-30c4887e5c4c req-910c2f3f-86b1-4f61-a743-1b7b0decb30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88d037c-9adb-4bbc-9431-52326a81f876", "name": "network-vif-plugged", "status": "completed", "tag": "8e4735ae-fb8d-40df-a185-339aa25f7014"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:38.027827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-828a598c-e395-4a52-8e54-30c4887e5c4c req-910c2f3f-86b1-4f61-a743-1b7b0decb30b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:38.028459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-828a598c-e395-4a52-8e54-30c4887e5c4c req-910c2f3f-86b1-4f61-a743-1b7b0decb30b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:38.028913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-828a598c-e395-4a52-8e54-30c4887e5c4c req-910c2f3f-86b1-4f61-a743-1b7b0decb30b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:38.049864 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-828a598c-e395-4a52-8e54-30c4887e5c4c req-910c2f3f-86b1-4f61-a743-1b7b0decb30b service nova] Creating event network-vif-plugged:8e4735ae-fb8d-40df-a185-339aa25f7014 for instance f88d037c-9adb-4bbc-9431-52326a81f876 on nch2-master-1 Oct 01 20:56:38.058680 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-828a598c-e395-4a52-8e54-30c4887e5c4c req-910c2f3f-86b1-4f61-a743-1b7b0decb30b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056499 Oct 01 20:56:38.060483 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 983/1911] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:38.068030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-1b8bf8cc-a2c7-46b7-90c3-f19dd5764c6b req-c7174c8f-7910-4e30-a5d8-b615ade50d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a034bac-1433-439f-8bd0-f22a00cb0e32", "tag": "13fbc280-9adc-4f57-960d-1b77f52e9e08"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:38.080681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b8bf8cc-a2c7-46b7-90c3-f19dd5764c6b req-c7174c8f-7910-4e30-a5d8-b615ade50d69 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:38.081162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b8bf8cc-a2c7-46b7-90c3-f19dd5764c6b req-c7174c8f-7910-4e30-a5d8-b615ade50d69 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:38.081950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b8bf8cc-a2c7-46b7-90c3-f19dd5764c6b req-c7174c8f-7910-4e30-a5d8-b615ade50d69 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:38.096686 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-1b8bf8cc-a2c7-46b7-90c3-f19dd5764c6b req-c7174c8f-7910-4e30-a5d8-b615ade50d69 service nova] Creating event network-changed:13fbc280-9adc-4f57-960d-1b77f52e9e08 for instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 on nch1-master-1 Oct 01 20:56:38.107867 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-1b8bf8cc-a2c7-46b7-90c3-f19dd5764c6b req-c7174c8f-7910-4e30-a5d8-b615ade50d69 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045463 Oct 01 20:56:38.109538 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 984/1912] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:38.179318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:38.202377 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e0efd337-36e6-4912-8c59-3bf01f7c03c3 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1313 microversion: 2.1 time: 0.472598 Oct 01 20:56:38.207968 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 929/1913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:37 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:38.748819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:38.749892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:38.758093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:38.759039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:38.759858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:38.760969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:38.761644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:38.762332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:38.776665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:38.777394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:38.784131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:38.787895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:38.790130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:38.792136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:38.792692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:38.793215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.218806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:39.227935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:39.230197 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-825e21c5-f06d-4ff5-b608-cc1079110ff6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1509 microversion: 2.1 time: 0.485309 Oct 01 20:56:39.234117 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 985/1914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:38 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1509 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:39.240571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:39.242685 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9d6be113-0a63-4215-83e6-6740c597ef2a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1308 microversion: 2.1 time: 0.470547 Oct 01 20:56:39.243895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:39.244579 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 930/1915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:38 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1308 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:39.250646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.251658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.252256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.253390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.253992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.254567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.353676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:39.362815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:39.364521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:39.371356 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-10b265ee-0e2a-427d-a614-4241f0ba7bda tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1453 microversion: 2.75 time: 0.135833 Oct 01 20:56:39.372146 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 986/1916] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:39 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:39.377519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:39.378330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:39.384350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.385180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.385800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.386721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.387343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.387933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.417285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a0d49342-4d8b-4fa4-a3e9-facfcf6c1e5f tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:39.421275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0d49342-4d8b-4fa4-a3e9-facfcf6c1e5f tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.422427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0d49342-4d8b-4fa4-a3e9-facfcf6c1e5f tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.422974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0d49342-4d8b-4fa4-a3e9-facfcf6c1e5f tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.423806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0d49342-4d8b-4fa4-a3e9-facfcf6c1e5f tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.424349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0d49342-4d8b-4fa4-a3e9-facfcf6c1e5f tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.424852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0d49342-4d8b-4fa4-a3e9-facfcf6c1e5f tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.462255 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a0d49342-4d8b-4fa4-a3e9-facfcf6c1e5f tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.216311 Oct 01 20:56:39.463475 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 931/1917] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:56:39 2022] GET /compute/v2.1/os-services => generated 947 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:39.469133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:39.474693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:39.475775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.servers [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Removing options 'limit' from query {{(pid=140438) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 01 20:56:39.476638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:39.477824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.478607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.479124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.479877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.480398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.480835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.483168 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1bf6b118-95ce-4332-b3b5-54ae8c17b5bf tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018511 Oct 01 20:56:39.484105 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 932/1918] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Oct 1 20:56:39 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:56:39.488641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6cfce2d-3da5-4bf8-bc24-cd5e8dbc8a2c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:39.494846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6cfce2d-3da5-4bf8-bc24-cd5e8dbc8a2c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.495343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6cfce2d-3da5-4bf8-bc24-cd5e8dbc8a2c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.495790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6cfce2d-3da5-4bf8-bc24-cd5e8dbc8a2c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.496592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6cfce2d-3da5-4bf8-bc24-cd5e8dbc8a2c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.497257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6cfce2d-3da5-4bf8-bc24-cd5e8dbc8a2c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.497868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6cfce2d-3da5-4bf8-bc24-cd5e8dbc8a2c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.523703 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6cfce2d-3da5-4bf8-bc24-cd5e8dbc8a2c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.038389 Oct 01 20:56:39.524904 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 933/1919] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Oct 1 20:56:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:39.529780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:39.530625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:39.539857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.540364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.540816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:39.541538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:39.542003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:39.542445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.165083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:40.172815 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ccb7dae6-0c95-46be-a74c-db386340b39a tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1313 microversion: 2.1 time: 0.799531 Oct 01 20:56:40.173382 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 987/1920] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:39 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1313 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:40.177619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3c60b0da-6a6c-4741-8a72-4404c5b2c4c8 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:40.182531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c60b0da-6a6c-4741-8a72-4404c5b2c4c8 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.182531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c60b0da-6a6c-4741-8a72-4404c5b2c4c8 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.182821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c60b0da-6a6c-4741-8a72-4404c5b2c4c8 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.183519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c60b0da-6a6c-4741-8a72-4404c5b2c4c8 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.183982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c60b0da-6a6c-4741-8a72-4404c5b2c4c8 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.184404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c60b0da-6a6c-4741-8a72-4404c5b2c4c8 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.190321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:40.200736 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b98675a7-ce1f-4490-9de0-b5888e3eb256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1509 microversion: 2.1 time: 0.674604 Oct 01 20:56:40.201501 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 934/1921] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:39 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1509 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:40.209337 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3c60b0da-6a6c-4741-8a72-4404c5b2c4c8 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.034931 Oct 01 20:56:40.209948 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 988/1922] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:56:40 2022] GET /compute/v2.1/os-services => generated 947 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:40.222205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-576c832d-c28d-41a3-96e7-3c3047a28934 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:40.222916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:40.222916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:40.227090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-576c832d-c28d-41a3-96e7-3c3047a28934 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.227649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-576c832d-c28d-41a3-96e7-3c3047a28934 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.228323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-576c832d-c28d-41a3-96e7-3c3047a28934 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.229051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-576c832d-c28d-41a3-96e7-3c3047a28934 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.229456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.229890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-576c832d-c28d-41a3-96e7-3c3047a28934 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.230110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-576c832d-c28d-41a3-96e7-3c3047a28934 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.230243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.230592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.231489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.231952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.232546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.254122 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-576c832d-c28d-41a3-96e7-3c3047a28934 tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.035495 Oct 01 20:56:40.254756 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 989/1923] 10.222.0.17 () {58 vars in 1196 bytes} [Sat Oct 1 20:56:40 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 01 20:56:40.268757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ca2a7b19-e32d-495a-a463-250f9ae2383c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:40.272395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2a7b19-e32d-495a-a463-250f9ae2383c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.272961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2a7b19-e32d-495a-a463-250f9ae2383c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.273403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2a7b19-e32d-495a-a463-250f9ae2383c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.274146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2a7b19-e32d-495a-a463-250f9ae2383c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.274640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2a7b19-e32d-495a-a463-250f9ae2383c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.275095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca2a7b19-e32d-495a-a463-250f9ae2383c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.299784 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ca2a7b19-e32d-495a-a463-250f9ae2383c tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.035213 Oct 01 20:56:40.300571 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 990/1924] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:56:40 2022] GET /compute/v2.1/os-services => generated 947 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:40.305895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:40.306737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:40.314176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.314969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.315596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.316584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.317767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.318407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.626258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:40.652770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b04715bb-fd46-4fa7-82cf-81539269b971 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e" status: 200 len: 1511 microversion: 2.1 time: 0.433748 Oct 01 20:56:40.655671 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 935/1925] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:40 2022] GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:40.666961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9feb6a02-e82f-45b5-90d1-9d9f8cf90e6e tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:40.675159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9feb6a02-e82f-45b5-90d1-9d9f8cf90e6e tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.676493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9feb6a02-e82f-45b5-90d1-9d9f8cf90e6e tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.676948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9feb6a02-e82f-45b5-90d1-9d9f8cf90e6e tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.677706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9feb6a02-e82f-45b5-90d1-9d9f8cf90e6e tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.687372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9feb6a02-e82f-45b5-90d1-9d9f8cf90e6e tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.688244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9feb6a02-e82f-45b5-90d1-9d9f8cf90e6e tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.729715 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9feb6a02-e82f-45b5-90d1-9d9f8cf90e6e tempest-ServicesAdminNegativeTestJSON-143433033 tempest-ServicesAdminNegativeTestJSON-143433033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.072623 Oct 01 20:56:40.737999 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 936/1926] 10.222.0.17 () {58 vars in 1198 bytes} [Sat Oct 1 20:56:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:56:40.737999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:40.737999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:40.742902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.742902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.743111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.743835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.744290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.744953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.748712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:40.760215 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b3d5a887-5be2-443d-8de1-fc90b3e6f9d7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1308 microversion: 2.1 time: 0.458303 Oct 01 20:56:40.762293 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 991/1927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:40 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:40.767079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:40.768913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:40.778152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.778698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.779190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.780059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:40.780522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:40.780957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:40.887522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:40.895931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:40.898113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:40.904371 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c5d33aaa-9806-4349-969c-8ded55e5a20f tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1438 microversion: 2.75 time: 0.172482 Oct 01 20:56:40.918668 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 937/1928] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:40 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1438 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:41.023233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff921f6e-bd93-4cdf-938d-78859a5c06af tempest-ServicesAdminNegativeTestJSON-720659149 tempest-ServicesAdminNegativeTestJSON-720659149-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:41.027386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ff921f6e-bd93-4cdf-938d-78859a5c06af tempest-ServicesAdminNegativeTestJSON-720659149 tempest-ServicesAdminNegativeTestJSON-720659149-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7e48c730d06a4cc8b1c55c1290d02437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a666f410e6146daa5b86d414a196cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff921f6e-bd93-4cdf-938d-78859a5c06af tempest-ServicesAdminNegativeTestJSON-720659149 tempest-ServicesAdminNegativeTestJSON-720659149-project] Request method failure captured: Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmGkQcoOePROZLaKnnDsrepZRngwumh2CnyHYS6pYkQTOd6ZJP1UCUaLsZFF2DC93F4IURa7-rqEjU12kfafxoVGJVTLQ7pBg0fXa1qTNLtnz_tXg3X-F3VmT0ZG4vEePU67aUhXiNDd3V_3EFzFui1qG_pf8WJclWfiF1_gpAB_oU Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8a666f410e6146daa5b86d414a196cd8 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-720659149 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8a666f410e6146daa5b86d414a196cd8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a666f410e6146daa5b86d414a196cd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8a666f410e6146daa5b86d414a196cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a666f410e6146daa5b86d414a196cd8"}]}] Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-720659149 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8a666f410e6146daa5b86d414a196cd8 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-720659149 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServicesAdminNegativeTestJSON-720659149-project Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7e48c730d06a4cc8b1c55c1290d02437 Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-720659149-project Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: action_args: {} Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 01 20:56:41.029052 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff921f6e-bd93-4cdf-938d-78859a5c06af tempest-ServicesAdminNegativeTestJSON-720659149 tempest-ServicesAdminNegativeTestJSON-720659149-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff921f6e-bd93-4cdf-938d-78859a5c06af tempest-ServicesAdminNegativeTestJSON-720659149 tempest-ServicesAdminNegativeTestJSON-720659149-project] 10.222.0.17 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.110648 Oct 01 20:56:41.034094 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 938/1929] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:56:40 2022] GET /compute/v2.1/os-services => generated 112 bytes in 112 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:41.083166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:41.095040 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-70f4089a-5caa-4e0b-b152-85d4b9d7bfc6 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1511 microversion: 2.1 time: 0.331317 Oct 01 20:56:41.095774 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 992/1930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:40 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:41.121900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:41.127613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:41.128478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:41.207133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:41.210987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:41.224426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.225284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.226701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:41.227817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.228771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.229500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:41.336810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:56:41.337810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:56:41.338690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:56:41.339336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:56:41.340444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:56:41.401981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=14 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:41.402162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.402946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.403585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:41.405803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.406776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.407467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:41.453553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:41.461886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.462756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.463526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:41.464490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.465669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.466619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:41.547557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:56:41.647527 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4268c3e1-16de-44ce-b754-20ad9c252778 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.530212 Oct 01 20:56:41.663403 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 993/1931] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Oct 1 20:56:41 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:41.675849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:41.676886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:41.692817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.694939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.696111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:41.698037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.701312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.702180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:41.710126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:41.727395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:41.781551 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1bb6b7f-41c5-4621-9cac-b35090da612e tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5/action" status: 202 len: 1942 microversion: 2.75 time: 0.749058 Oct 01 20:56:41.782233 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 939/1932] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 20:56:41 2022] POST /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5/action => generated 1942 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 01 20:56:41.793016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:41.799292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:41.812970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.813779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.814565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:41.815587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:41.816216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:41.816977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:42.051308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:42.204701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:42.207538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:42.215980 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2b22c792-0eaf-4d89-a091-aff0dbd1fe47 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1463 microversion: 2.1 time: 0.550971 Oct 01 20:56:42.217414 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 994/1933] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:41 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1463 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:42.233852 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02aac105-b285-4119-baa6-0107a3eabd01 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1509 microversion: 2.1 time: 0.450297 Oct 01 20:56:42.235532 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 940/1934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:41 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1509 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:42.236577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:42.237516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:42.242297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:42.243180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:42.249285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:42.257125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:42.259382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:42.264823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:42.265323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:42.265765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:42.266151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:42.266485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:42.266963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:42.267418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:42.267616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:42.268274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:42.268889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:42.502019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:42.601901 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4d8bb5a8-d421-4473-aa60-b4fc45b1805b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.358232 Oct 01 20:56:42.604664 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 941/1935] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:42 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:42.611342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:42.617932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:42.624747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:42.635074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:42.635855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:42.637240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:42.637657 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e59a23b4-24ea-4a58-a63c-e30010d81484 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1308 microversion: 2.1 time: 0.418875 Oct 01 20:56:42.638844 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 995/1936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:42 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:42.649433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:42.649869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:42.650545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:42.659226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:42.659936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:42.660677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:42.661184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:42.661625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:42.662340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:42.665339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:42.665790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:43.149003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:43.160410 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1197e8e0-a105-4754-9745-eb7d8034749c tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e" status: 200 len: 1511 microversion: 2.1 time: 0.520410 Oct 01 20:56:43.170959 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 996/1937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:42 2022] GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:43.180079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ce6202d4-16f3-4da6-aac7-e2a658a8a6e7 req-26bf7201-9b6f-4866-b3d4-9f5f20c9eab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a034bac-1433-439f-8bd0-f22a00cb0e32", "name": "network-vif-plugged", "status": "completed", "tag": "13fbc280-9adc-4f57-960d-1b77f52e9e08"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:43.193518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ce6202d4-16f3-4da6-aac7-e2a658a8a6e7 req-26bf7201-9b6f-4866-b3d4-9f5f20c9eab4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:43.194592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ce6202d4-16f3-4da6-aac7-e2a658a8a6e7 req-26bf7201-9b6f-4866-b3d4-9f5f20c9eab4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:43.195097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ce6202d4-16f3-4da6-aac7-e2a658a8a6e7 req-26bf7201-9b6f-4866-b3d4-9f5f20c9eab4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:43.208630 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ce6202d4-16f3-4da6-aac7-e2a658a8a6e7 req-26bf7201-9b6f-4866-b3d4-9f5f20c9eab4 service nova] Creating event network-vif-plugged:13fbc280-9adc-4f57-960d-1b77f52e9e08 for instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 on nch1-master-1 Oct 01 20:56:43.215114 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ce6202d4-16f3-4da6-aac7-e2a658a8a6e7 req-26bf7201-9b6f-4866-b3d4-9f5f20c9eab4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048120 Oct 01 20:56:43.216129 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 997/1938] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:43.222991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:43.224503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:43.233936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:43.234595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:43.235046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:43.235882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:43.236450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:43.236872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:43.696161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:43.708041 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1ecab2c6-b6ed-4ca0-8a0e-d05bed2b0e82 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1463 microversion: 2.1 time: 1.101620 Oct 01 20:56:43.708963 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 942/1939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:42 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1463 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:43.714767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:43.715731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:43.722633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:43.723745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:43.724444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:43.725989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:43.726720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:43.727371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:43.883548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:43.907907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:43.918322 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d8ae6f63-dc50-4dfe-91f7-9cbe82497474 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.207504 Oct 01 20:56:43.919041 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 943/1940] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:43 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:43.926153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:43.926811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:43.930458 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2db7f739-d2f2-4c9d-b7ca-75730cd76a29 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1511 microversion: 2.1 time: 0.710199 Oct 01 20:56:43.931393 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 998/1941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:43 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1511 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:43.949596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-295384307", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "41b9ddc4-96e9-4c59-b07f-e785f2179e8c"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:43.951080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:43.951600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:43.952063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:43.952783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:43.953248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:43.953684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:44.046143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:56:44.527714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:44.535985 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85b3b415-975f-43bd-8110-39c3591c8520 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1308 microversion: 2.1 time: 0.615645 Oct 01 20:56:44.552690 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 944/1942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:43 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1308 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:44.563809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:44.575007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:44.575984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:44.581335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:44.581840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:44.582284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:44.583252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:44.583896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:44.584383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:44.637473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=13 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:44.720235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:56:44.748124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:56:44.751717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:56:44.753672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:56:44.755169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:56:44.758807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:56:44.784828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:44.785465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:44.785979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:44.787052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:44.787746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:44.788361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:44.796790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:44.805065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:44.805873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:44.806608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:44.824355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Getting quotas for project a6bdd72ba854403e8fef7f651a3ef106. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:44.830614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Getting quotas for user 123a8a1d0b65407098b5a8e91091b9ca and project a6bdd72ba854403e8fef7f651a3ef106. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:44.845777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:56:44.848642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:56:44.940185 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-44d56e07-c136-492d-a4e4-e5891b87ae59 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002328 Oct 01 20:56:44.942770 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 999/1943] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:56:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:56:44.955323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:44.957333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:44.966194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:44.967061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:44.967640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:44.968672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:44.969356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:44.969931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.107525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:45.142252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87598190-69c9-4a0a-9567-ad7ac9ba8aee tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.587259 Oct 01 20:56:45.142813 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 945/1944] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:56:44 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:45.144215 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7972e5cb-0837-4aed-871d-846af89af17c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.199092 Oct 01 20:56:45.148015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-712d856b-3ca2-4dea-9ff9-3ae7dade6157 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:45.148643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-712d856b-3ca2-4dea-9ff9-3ae7dade6157 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:45.163027 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1000/1945] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:44 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:45.174818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:45.178259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:45.179236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:45.235137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-712d856b-3ca2-4dea-9ff9-3ae7dade6157 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:45.247709 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-712d856b-3ca2-4dea-9ff9-3ae7dade6157 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1213 microversion: 2.1 time: 0.103750 Oct 01 20:56:45.251769 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 946/1946] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:45 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:45.326047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.327006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.327862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.328808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.329506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.330191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.398013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:56:45.455066 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-afa291ee-07aa-4f9e-b05b-8bc6f43d0482 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.288029 Oct 01 20:56:45.455668 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1001/1947] 10.222.0.17 () {58 vars in 1150 bytes} [Sat Oct 1 20:56:45 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:45.473311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:45.479492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:45.480598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:45.486418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.487185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.487791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.488713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.489331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.489943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.548355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fa23673-2a4a-4e26-a949-0dc54618b466 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Action: 'create', calling method: .version_select at 0x7f417c1db8b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1G8EoMiaaXx5nUgFby1WdgcWmyRx2gPVv4X7nJj06dOTNlfcCAySU7osZ992PYyvbHxWVB3DEcxN0rRc+2ZubNi7qxClBIgqNdQ4OCYJyWGeY3wx2o35JSMzx/TW1x+A=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fa23673-2a4a-4e26-a949-0dc54618b466 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Request method failure captured: Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 257 Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmN4XD3jhN6_VAqVW9TMOAJHo6SkFa1N97HvDt28AuQQuSERAE1yJqOMBpTIHKGjqUsrHlX5nr0oV797mB8yyFdCCr9p95gsMlUBH8n-SAeuUI9VgxkpPWL1mEnwG3HWqEDU1zKm6gZm8pGaCR-5M2o8s0kfdiL5FzsvjvSWmtYg_g Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90234df69d5e4546983a5d3f14143a7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}] Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1G8EoMiaaXx5nUgFby1WdgcWmyRx2gPVv4X7nJj06dOTNlfcCAySU7osZ992PYyvbHxWVB3DEcxN0rRc+2ZubNi7qxClBIgqNdQ4OCYJyWGeY3wx2o35JSMzx/TW1x+A=="}} Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1G8EoMiaaXx5nUgFby1WdgcWmyRx2gPVv4X7nJj06dOTNlfcCAySU7osZ992PYyvbHxWVB3DEcxN0rRc+2ZubNi7qxClBIgqNdQ4OCYJyWGeY3wx2o35JSMzx/TW1x+A=='}}} Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 01 20:56:45.555519 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 01 20:56:45.560706 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.563595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fa23673-2a4a-4e26-a949-0dc54618b466 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:45.564051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fa23673-2a4a-4e26-a949-0dc54618b466 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.200321 Oct 01 20:56:45.567260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:45.569116 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 947/1948] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:56:45 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 01 20:56:45.584901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:45.586585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:45.600568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:56:45.605182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.605761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.606225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.607013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.609611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.612295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.698396 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ae55df9c-0faf-4afc-a5b2-744ae190e256 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.228864 Oct 01 20:56:45.700182 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1002/1949] 10.222.0.17 () {58 vars in 1212 bytes} [Sat Oct 1 20:56:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:45.705680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a57c610b-5977-4ff1-afb0-3649ed2ac1bc tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Action: 'create', calling method: .version_select at 0x7f4173635dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-407903218", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:45.731846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a57c610b-5977-4ff1-afb0-3649ed2ac1bc tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:45.738225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a57c610b-5977-4ff1-afb0-3649ed2ac1bc tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for user 1f9c07411c404bc3bc680e597f6c2e00 and project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:45.766461 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-a57c610b-5977-4ff1-afb0-3649ed2ac1bc tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a57c610b-5977-4ff1-afb0-3649ed2ac1bc tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Request method failure captured: Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 2166 Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKmN4XD3jhN6_VAqVW9TMOAJHo6SkFa1N97HvDt28AuQQuSERAE1yJqOMBpTIHKGjqUsrHlX5nr0oV797mB8yyFdCCr9p95gsMlUBH8n-SAeuUI9VgxkpPWL1mEnwG3HWqEDU1zKm6gZm8pGaCR-5M2o8s0kfdiL5FzsvjvSWmtYg_g Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90234df69d5e4546983a5d3f14143a7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}] Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-407903218", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:56:45.782112 ncdv-master-1 devstack@n-api.service[140437]: exception: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-407903218', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:45.785211 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a57c610b-5977-4ff1-afb0-3649ed2ac1bc tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a57c610b-5977-4ff1-afb0-3649ed2ac1bc tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.082345 Oct 01 20:56:45.788478 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1003/1950] 10.222.0.17 () {60 vars in 1160 bytes} [Sat Oct 1 20:56:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:56:45.797573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:45.813122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:45.813935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:45.822348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.823351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.824382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.825414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.826048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.826612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.844235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:45.853327 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8b46ff51-2d02-4d6c-96aa-142a69cee999 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1486 microversion: 2.1 time: 0.279811 Oct 01 20:56:45.865043 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 948/1951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:45 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1486 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:45.875674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f92a3f9-03d4-466a-a1fd-094005b55419 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Action: 'create', calling method: .version_select at 0x7f417c1db4c0>, body: {"keypair": {"name": "tempest-keypair-629981469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcWpWGYX0o1IT9MI5x1lfi2etXmBg1PHFCuyrBLgrLRXwDJ2HukhRHzE9Z1Tdqw7USU8SC6gibzahTEKoaxFK7zvlPHozijXc8IjR5AL7dDmp/dc6lA7BqUJiaSO4nlkg=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:45.898932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6f92a3f9-03d4-466a-a1fd-094005b55419 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:45.908354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6f92a3f9-03d4-466a-a1fd-094005b55419 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for user 1f9c07411c404bc3bc680e597f6c2e00 and project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:45.951039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:56:45.959648 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f92a3f9-03d4-466a-a1fd-094005b55419 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092970 Oct 01 20:56:45.961116 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 949/1952] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:56:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:45.966360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:45.968427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:45.976625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.977459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.978201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:45.980332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:45.981153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:45.981952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.018445 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-674460fc-6a8f-448e-9bda-6ff3cd3d5f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.230353 Oct 01 20:56:46.019497 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1004/1953] 10.222.0.17 () {58 vars in 1196 bytes} [Sat Oct 1 20:56:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:46.024018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lazy-loading 'flavor' on Instance uuid 1a034bac-1433-439f-8bd0-f22a00cb0e32 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:46.024689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a49869e3-99b6-475d-81a6-34f7163f21ca tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Action: 'create', calling method: .version_select at 0x7f41736a9dc0>, body: {"keypair": {"name": "tempest-keypair-629981469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ6N6bXN5Qy4yZtvKL7qqO1P424Alk0qasdebwOG+rfSIDYHGAVPXUtmYqQw5+Rr8oFcPFMOe4FQntjABA9vHC3YEyEk8b65107QFTR8kKJYFoU1Dunm1EJDSzxUBZVoQ=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:46.047982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a49869e3-99b6-475d-81a6-34f7163f21ca tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:46.057038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a49869e3-99b6-475d-81a6-34f7163f21ca tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for user 1f9c07411c404bc3bc680e597f6c2e00 and project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:46.091591 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-a49869e3-99b6-475d-81a6-34f7163f21ca tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] HTTP exception thrown: Key pair 'tempest-keypair-629981469' already exists. Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a49869e3-99b6-475d-81a6-34f7163f21ca tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Request method failure captured: Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 272 Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKmN4XD3jhN6_VAqVW9TMOAJHo6SkFa1N97HvDt28AuQQuSERAE1yJqOMBpTIHKGjqUsrHlX5nr0oV797mB8yyFdCCr9p95gsMlUBH8n-SAeuUI9VgxkpPWL1mEnwG3HWqEDU1zKm6gZm8pGaCR-5M2o8s0kfdiL5FzsvjvSWmtYg_g Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90234df69d5e4546983a5d3f14143a7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}] Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: {"keypair": {"name": "tempest-keypair-629981469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ6N6bXN5Qy4yZtvKL7qqO1P424Alk0qasdebwOG+rfSIDYHGAVPXUtmYqQw5+Rr8oFcPFMOe4FQntjABA9vHC3YEyEk8b65107QFTR8kKJYFoU1Dunm1EJDSzxUBZVoQ=="}} Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: exception: Key pair 'tempest-keypair-629981469' already exists. Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-629981469', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ6N6bXN5Qy4yZtvKL7qqO1P424Alk0qasdebwOG+rfSIDYHGAVPXUtmYqQw5+Rr8oFcPFMOe4FQntjABA9vHC3YEyEk8b65107QFTR8kKJYFoU1Dunm1EJDSzxUBZVoQ=='}}} Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result.read() Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '1f9c07411c404bc3bc680e597f6c2e00-tempest-keypair-629981469' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 01 20:56:46.095239 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi session.flush() Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result.read() Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 01 20:56:46.099664 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '1f9c07411c404bc3bc680e597f6c2e00-tempest-keypair-629981469' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 1, 20, 56, 46, 82797), 'updated_at': None, 'name': 'tempest-keypair-629981469', 'user_id': '1f9c07411c404bc3bc680e597f6c2e00', 'fingerprint': 'e1:97:ea:53:89:ed:15:d2:0e:79:63:86:c2:33:5f:fa', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ6N6bXN5Qy4yZtvKL7qqO1P424Alk0qasdebwOG+rfSIDYHGAVPXUtmYqQw5+Rr8oFcPFMOe4FQntjABA9vHC3YEyEk8b65107QFTR8kKJYFoU1Dunm1EJDSzxUBZVoQ==', 'type': 'ssh'}] Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi keypair.create() Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._create() Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-629981469' already exists. Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 01 20:56:46.107336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-629981469' already exists. Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-629981469' already exists. Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a49869e3-99b6-475d-81a6-34f7163f21ca tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Returning 409 to user: Key pair 'tempest-keypair-629981469' already exists. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a49869e3-99b6-475d-81a6-34f7163f21ca tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.076152 Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1005/1954] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:56:46 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:46.116799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:46.119663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'name': 'e-60364902', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:46.126645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.127140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.127932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.129549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.130464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.131546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.173012 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-03af03e7-492a-47a7-93f6-8ca4274900e1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32/action" status: 202 len: 0 microversion: 2.1 time: 0.210188 Oct 01 20:56:46.173724 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 950/1955] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:56:45 2022] POST /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:46.181964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa300ea8-bcc5-4d0b-b06b-3699c05b3d8f tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Calling method '.version_select at 0x7f4173028790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:46.204873 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa300ea8-bcc5-4d0b-b06b-3699c05b3d8f tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-629981469" status: 202 len: 0 microversion: 2.1 time: 0.029614 Oct 01 20:56:46.206388 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 951/1956] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 20:56:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-629981469 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:46.213582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:46.214337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:46.223205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.224306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.225848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.226860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.227648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.228560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.334341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:56:46.414867 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-390d55a3-b88f-4cc6-9757-3d16bf8fde10 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?name=e-60364902" status: 200 len: 344 microversion: 2.1 time: 0.315481 Oct 01 20:56:46.415850 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1006/1957] 10.222.0.17 () {58 vars in 1156 bytes} [Sat Oct 1 20:56:46 2022] GET /compute/v2.1/servers?name=e-60364902 => generated 344 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:46.421084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:46.423825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:46.431668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.432757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.433695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.434957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.435652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.436980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.479686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:46.488437 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6be245ad-8826-48fa-82e1-dea8f454b1b7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1494 microversion: 2.1 time: 0.280576 Oct 01 20:56:46.489063 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 952/1958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:46 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1494 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:46.507264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-899222ce-a74f-4ec7-8c40-a155d1563581 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Action: 'create', calling method: .version_select at 0x7f4172fef0d0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFPafMYLcFBMrHwT5hYwwGCGRRB5gXczSfzSbYS9clepv/ZeaEqO2sh/9yymlUEpx98d62HtfI78HhOSystgRH+PFTYWVb9zdINIRZyaydHDRrsqTss18ucCHs06ifckQ=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-899222ce-a74f-4ec7-8c40-a155d1563581 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Request method failure captured: Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 247 Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmN4XD3jhN6_VAqVW9TMOAJHo6SkFa1N97HvDt28AuQQuSERAE1yJqOMBpTIHKGjqUsrHlX5nr0oV797mB8yyFdCCr9p95gsMlUBH8n-SAeuUI9VgxkpPWL1mEnwG3HWqEDU1zKm6gZm8pGaCR-5M2o8s0kfdiL5FzsvjvSWmtYg_g Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90234df69d5e4546983a5d3f14143a7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}] Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFPafMYLcFBMrHwT5hYwwGCGRRB5gXczSfzSbYS9clepv/ZeaEqO2sh/9yymlUEpx98d62HtfI78HhOSystgRH+PFTYWVb9zdINIRZyaydHDRrsqTss18ucCHs06ifckQ=="}} Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFPafMYLcFBMrHwT5hYwwGCGRRB5gXczSfzSbYS9clepv/ZeaEqO2sh/9yymlUEpx98d62HtfI78HhOSystgRH+PFTYWVb9zdINIRZyaydHDRrsqTss18ucCHs06ifckQ=='}}} Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '' Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:56:46.512047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-899222ce-a74f-4ec7-8c40-a155d1563581 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-899222ce-a74f-4ec7-8c40-a155d1563581 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.023900 Oct 01 20:56:46.518625 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 953/1959] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:56:46 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:56:46.521460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:46.521460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:46.530230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.530784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.531278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.532004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.532468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.533673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.535753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:46.559497 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f1007a3e-6ede-44ec-aa87-538f430ad954 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.141967 Oct 01 20:56:46.562281 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1007/1960] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:46 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:46.565745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:46.571882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:46.572646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:46.578306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.578816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.579357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.580091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.580548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.581058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.621923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:46.632482 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98643980-bb83-4ee4-aa4e-d58090d5f4d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1265 microversion: 2.1 time: 0.116993 Oct 01 20:56:46.633062 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 954/1961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:46 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:46.654342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20f2a03a-1bea-4283-8e25-634a0c2605da tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Action: 'create', calling method: .version_select at 0x7f417c1db4c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-432859683", "public_key": " "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:46.670834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-20f2a03a-1bea-4283-8e25-634a0c2605da tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:46.682303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:56:46.683247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-20f2a03a-1bea-4283-8e25-634a0c2605da tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for user 1f9c07411c404bc3bc680e597f6c2e00 and project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:46.685429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:46.707591 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-20f2a03a-1bea-4283-8e25-634a0c2605da tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20f2a03a-1bea-4283-8e25-634a0c2605da tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Request method failure captured: Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 94 Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmN4XD3jhN6_VAqVW9TMOAJHo6SkFa1N97HvDt28AuQQuSERAE1yJqOMBpTIHKGjqUsrHlX5nr0oV797mB8yyFdCCr9p95gsMlUBH8n-SAeuUI9VgxkpPWL1mEnwG3HWqEDU1zKm6gZm8pGaCR-5M2o8s0kfdiL5FzsvjvSWmtYg_g Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90234df69d5e4546983a5d3f14143a7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}] Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-432859683", "public_key": " "}} Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: exception: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-432859683', 'public_key': ' '}}} Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.712054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.718198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.721520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20f2a03a-1bea-4283-8e25-634a0c2605da tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:46.722674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20f2a03a-1bea-4283-8e25-634a0c2605da tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.072337 Oct 01 20:56:46.731313 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 955/1962] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Oct 1 20:56:46 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:56:46.739948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae063366-2ad6-4af9-a8ea-9f3192a2beb8 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Action: 'create', calling method: .version_select at 0x7f417c2893a0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPGZvNlZ4v83+IKPaZh0KFXKMf0K/h6bsan2Sj7q/sElJKapEfyNH+aSyR4yvz+q8TTp3CkhNPj1pkthQjoo8VhsrtNn+ub2vMDbX90Kw3veMefsAOnUhyWvGD+mmtAhw=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae063366-2ad6-4af9-a8ea-9f3192a2beb8 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Request method failure captured: Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 507 Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmN4XD3jhN6_VAqVW9TMOAJHo6SkFa1N97HvDt28AuQQuSERAE1yJqOMBpTIHKGjqUsrHlX5nr0oV797mB8yyFdCCr9p95gsMlUBH8n-SAeuUI9VgxkpPWL1mEnwG3HWqEDU1zKm6gZm8pGaCR-5M2o8s0kfdiL5FzsvjvSWmtYg_g Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90234df69d5e4546983a5d3f14143a7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}] Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPGZvNlZ4v83+IKPaZh0KFXKMf0K/h6bsan2Sj7q/sElJKapEfyNH+aSyR4yvz+q8TTp3CkhNPj1pkthQjoo8VhsrtNn+ub2vMDbX90Kw3veMefsAOnUhyWvGD+mmtAhw=="}} Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPGZvNlZ4v83+IKPaZh0KFXKMf0K/h6bsan2Sj7q/sElJKapEfyNH+aSyR4yvz+q8TTp3CkhNPj1pkthQjoo8VhsrtNn+ub2vMDbX90Kw3veMefsAOnUhyWvGD+mmtAhw=='}}} Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 01 20:56:46.747067 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae063366-2ad6-4af9-a8ea-9f3192a2beb8 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:46.753433 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae063366-2ad6-4af9-a8ea-9f3192a2beb8 tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.015090 Oct 01 20:56:46.756848 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 956/1963] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:56:46 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:56:46.762093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38607d74-8674-4b03-a48c-2c83b0585d7a tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Action: 'create', calling method: .version_select at 0x7f417c18d5e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1422307923", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:46.771801 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4c278f1f-cca6-473d-b89a-6e216c159ec5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.209959 Oct 01 20:56:46.772522 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1008/1964] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Oct 1 20:56:46 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:46.785537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:46.792311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:46.793005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-6036490', 'deleted': False, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:56:46.798783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.799278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.799723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.800718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:46.801184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:46.801618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:46.808884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-38607d74-8674-4b03-a48c-2c83b0585d7a tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:46.828826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-38607d74-8674-4b03-a48c-2c83b0585d7a tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Getting quotas for user 1f9c07411c404bc3bc680e597f6c2e00 and project 90234df69d5e4546983a5d3f14143a7e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:46.855698 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-38607d74-8674-4b03-a48c-2c83b0585d7a tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38607d74-8674-4b03-a48c-2c83b0585d7a tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Request method failure captured: Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 118 Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmN4XD3jhN6_VAqVW9TMOAJHo6SkFa1N97HvDt28AuQQuSERAE1yJqOMBpTIHKGjqUsrHlX5nr0oV797mB8yyFdCCr9p95gsMlUBH8n-SAeuUI9VgxkpPWL1mEnwG3HWqEDU1zKm6gZm8pGaCR-5M2o8s0kfdiL5FzsvjvSWmtYg_g Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90234df69d5e4546983a5d3f14143a7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}] Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1422307923", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: exception: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1422307923', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 01 20:56:46.859174 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 01 20:56:46.867529 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.872414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38607d74-8674-4b03-a48c-2c83b0585d7a tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:46.873657 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38607d74-8674-4b03-a48c-2c83b0585d7a tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.118502 Oct 01 20:56:46.878832 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 957/1965] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:56:46 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:56:46.887237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02ba6e07-46ac-403d-8b2e-db997bb7682d tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Calling method '.version_select at 0x7f417c1db4c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:46.904018 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-02ba6e07-46ac-403d-8b2e-db997bb7682d tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1293699104 not found for user 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.905091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02ba6e07-46ac-403d-8b2e-db997bb7682d tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Request method failure captured: Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1293699104 HTTP/1.1 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmN4XD3jhN6_VAqVW9TMOAJHo6SkFa1N97HvDt28AuQQuSERAE1yJqOMBpTIHKGjqUsrHlX5nr0oV797mB8yyFdCCr9p95gsMlUBH8n-SAeuUI9VgxkpPWL1mEnwG3HWqEDU1zKm6gZm8pGaCR-5M2o8s0kfdiL5FzsvjvSWmtYg_g Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90234df69d5e4546983a5d3f14143a7e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90234df69d5e4546983a5d3f14143a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90234df69d5e4546983a5d3f14143a7e"}]}] Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 90234df69d5e4546983a5d3f14143a7e Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-492162797 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-KeyPairsNegativeTestJSON-492162797-project Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: exception: Keypair tempest-keypair-non-existent-1293699104 not found for user 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'tempest-keypair-non-existent-1293699104'} Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1293699104 not found for user 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.906898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1293699104 not found for user 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1293699104 not found for user 1f9c07411c404bc3bc680e597f6c2e00 Oct 01 20:56:46.913189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:46.916150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02ba6e07-46ac-403d-8b2e-db997bb7682d tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1293699104 not found for user 1f9c07411c404bc3bc680e597f6c2e00 {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:46.917369 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02ba6e07-46ac-403d-8b2e-db997bb7682d tempest-KeyPairsNegativeTestJSON-492162797 tempest-KeyPairsNegativeTestJSON-492162797-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1293699104" status: 404 len: 145 microversion: 2.1 time: 0.037380 Oct 01 20:56:46.923291 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 958/1966] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 20:56:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1293699104 => generated 145 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:46.987370 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ee8a17a9-d495-4aac-9b17-08a9fd3186b2 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-6036490" status: 200 len: 344 microversion: 2.1 time: 0.205881 Oct 01 20:56:46.987959 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1009/1967] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Oct 1 20:56:46 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-6036490 => generated 344 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:56:47.004380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:47.004894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:47.014547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.015196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.016549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.018123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.018785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.019638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.053883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:47.167342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0a9db52a-5fe2-4d28-8bd7-aa6e96fb2781 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 204 len: 0 microversion: 2.1 time: 0.169653 Oct 01 20:56:47.170540 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 959/1968] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:46 2022] DELETE /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:47.179410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:47.180641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:47.190926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.191967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.192560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.193660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.194221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.195468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.422418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:47.433722 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-40a7eb05-532d-4f58-b866-81cf8b831068 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1517 microversion: 2.1 time: 0.259545 Oct 01 20:56:47.434730 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1010/1969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:47 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1517 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:47.513813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:47.514826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:47.521024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.522412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.523145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.524114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.524805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.525719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.543775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:47.596966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:47.598378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:47.608271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.609610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.610339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.611346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.612679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.613350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.764542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:47.806180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:47.814230 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d561f43c-78c7-4354-a257-0a0394394d37 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.227214 Oct 01 20:56:47.819717 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe0e5a75-ad80-4db5-8f88-4e921df527ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 200 len: 1477 microversion: 2.1 time: 0.310275 Oct 01 20:56:47.820721 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 960/1970] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:47 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 1477 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:47.823085 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1011/1971] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:47 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:56:47.828698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:47.829393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:47.848700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.850399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.850911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.851953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.852430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.852866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.855973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-51df6bab-fc1a-448d-b5c9-c51915ac651d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1219146765"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:47.867622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-51df6bab-fc1a-448d-b5c9-c51915ac651d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:47.880951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51df6bab-fc1a-448d-b5c9-c51915ac651d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.883859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51df6bab-fc1a-448d-b5c9-c51915ac651d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.884586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51df6bab-fc1a-448d-b5c9-c51915ac651d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:47.887061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51df6bab-fc1a-448d-b5c9-c51915ac651d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:47.887788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51df6bab-fc1a-448d-b5c9-c51915ac651d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:47.889524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51df6bab-fc1a-448d-b5c9-c51915ac651d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:48.002573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:48.020631 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f3ebbdbc-ff26-4767-95b1-270f0508a53c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1271 microversion: 2.1 time: 0.198238 Oct 01 20:56:48.043652 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 961/1972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:47 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:48.310540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1006154721", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": "none"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:48.411667 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-51df6bab-fc1a-448d-b5c9-c51915ac651d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32/action" status: 202 len: 0 microversion: 2.1 time: 0.567499 Oct 01 20:56:48.413104 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1012/1973] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:56:47 2022] POST /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 20:56:48.426062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:56:48.426543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:56:48.430991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:56:48.431505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:56:48.433864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:56:48.442828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-be96efd3-816a-42d6-ac0a-a5ee4d7ef0f1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41727b39d0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:48.480835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:48.482646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:48.483990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:48.488523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:48.493626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:48.497135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:48.530669 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-be96efd3-816a-42d6-ac0a-a5ee4d7ef0f1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.107859 Oct 01 20:56:48.532130 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1013/1974] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:48 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:48.539165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:48.541141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Getting quotas for project 49706c672bdd47d39405f8d7b80636ca. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:48.545470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:48.565740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:48.566755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:48.567354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:48.571217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Getting quotas for user a418c7b850684796bf4022c5b05e936d and project 49706c672bdd47d39405f8d7b80636ca. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:48.573345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:48.575616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:48.576754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:48.628578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:56:48.632932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:56:48.768459 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d9eb27c6-a071-4bf4-891f-5460ba520446 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.723080 Oct 01 20:56:48.778636 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 962/1975] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 20:56:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 20:56:48.783585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e4813b5f-6898-46a6-bbdc-3891894b726d tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:48.784202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e4813b5f-6898-46a6-bbdc-3891894b726d tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:48.911672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:48.923637 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b015398f-fd92-424d-a6ec-d4ff4d5db324 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1517 microversion: 2.1 time: 0.390281 Oct 01 20:56:48.939921 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1014/1976] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:48 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1517 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:48.946932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:48.947813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:48.972983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:48.976232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:48.976850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:48.977706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:48.979137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:48.980564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:49.112082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e4813b5f-6898-46a6-bbdc-3891894b726d tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:49.125620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e4813b5f-6898-46a6-bbdc-3891894b726d tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:49.129837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e4813b5f-6898-46a6-bbdc-3891894b726d tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:49.134135 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e4813b5f-6898-46a6-bbdc-3891894b726d tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1278 microversion: 2.54 time: 0.354410 Oct 01 20:56:49.136385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 963/1977] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:48 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1278 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:49.144162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:49.145224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:49.155947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:49.156847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:49.158685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:49.159431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:49.159996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:49.160636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:49.277364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:49.327308 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a306040b-7307-4fb1-a764-7d3a7dff0c6c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.385536 Oct 01 20:56:49.335629 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1015/1978] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:48 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:49.402674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-adb0ec97-93df-4c98-9dd8-868aa6f2a6ef req-618f56f0-8a11-46bf-b32b-aca9cc6ecb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c902159b-1429-495e-b8a7-92092a9b748c", "name": "network-vif-deleted", "tag": "43484f86-cf5b-4f54-81ae-51af87ee015f"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:49.433879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-adb0ec97-93df-4c98-9dd8-868aa6f2a6ef req-618f56f0-8a11-46bf-b32b-aca9cc6ecb1c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:49.435581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-adb0ec97-93df-4c98-9dd8-868aa6f2a6ef req-618f56f0-8a11-46bf-b32b-aca9cc6ecb1c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:49.438256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-adb0ec97-93df-4c98-9dd8-868aa6f2a6ef req-618f56f0-8a11-46bf-b32b-aca9cc6ecb1c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:49.458274 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-adb0ec97-93df-4c98-9dd8-868aa6f2a6ef req-618f56f0-8a11-46bf-b32b-aca9cc6ecb1c service nova] Creating event network-vif-deleted:43484f86-cf5b-4f54-81ae-51af87ee015f for instance c902159b-1429-495e-b8a7-92092a9b748c on nch2-master-1 Oct 01 20:56:49.466333 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-adb0ec97-93df-4c98-9dd8-868aa6f2a6ef req-618f56f0-8a11-46bf-b32b-aca9cc6ecb1c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069386 Oct 01 20:56:49.470406 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1016/1979] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:56:49.561443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:49.572321 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd50c9d7-fd4a-40c2-8f7a-25c7c45f6b64 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1313 microversion: 2.1 time: 0.433766 Oct 01 20:56:49.575119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6e13465d-7f4c-48b2-9115-9374e732bda6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417278aaf0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:49.597357 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 964/1980] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:49 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:49.702111 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6e13465d-7f4c-48b2-9115-9374e732bda6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.158194 Oct 01 20:56:49.703930 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1017/1981] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:49 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:49.954144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:49.954959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:49.972771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:49.973323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:49.975203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:49.976005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:49.976472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:49.976965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.054916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.055419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.057194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.062387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-af6c5a13-df10-45d2-98cd-0a31d03785ae req-e059a8e0-d342-4ff0-b028-7fdc04722e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f148ce-57dc-4294-bbe5-56948f7f3470", "tag": "bbcf5a9d-7ccf-47c9-a2f0-ed1efe7ff151"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:50.064377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lazy-loading 'fault' on Instance uuid c902159b-1429-495e-b8a7-92092a9b748c {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:50.085638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-af6c5a13-df10-45d2-98cd-0a31d03785ae req-e059a8e0-d342-4ff0-b028-7fdc04722e63 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.092470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-af6c5a13-df10-45d2-98cd-0a31d03785ae req-e059a8e0-d342-4ff0-b028-7fdc04722e63 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.094814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-af6c5a13-df10-45d2-98cd-0a31d03785ae req-e059a8e0-d342-4ff0-b028-7fdc04722e63 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.112522 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-af6c5a13-df10-45d2-98cd-0a31d03785ae req-e059a8e0-d342-4ff0-b028-7fdc04722e63 service nova] Creating event network-changed:bbcf5a9d-7ccf-47c9-a2f0-ed1efe7ff151 for instance 68f148ce-57dc-4294-bbe5-56948f7f3470 on nch2-master-1 Oct 01 20:56:50.119043 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-af6c5a13-df10-45d2-98cd-0a31d03785ae req-e059a8e0-d342-4ff0-b028-7fdc04722e63 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060628 Oct 01 20:56:50.120195 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1018/1982] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:56:50.185448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:50.202022 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba9596cb-7284-460a-925e-4eb9c4347f39 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 200 len: 1311 microversion: 2.1 time: 0.250291 Oct 01 20:56:50.210647 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 965/1983] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:49 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 1311 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:50.220316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:50.220955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:50.230327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.233630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.234097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.234865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.235347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.237230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.294006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a45e6ca6-05e2-4f49-88f7-db57d8b136d8 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Calling method '.version_select at 0x7f41727b3b80>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:50.316675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:50.327067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:50.328648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:50.329769 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ae8a5a7-8e44-4716-b109-d5b6992d866e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1330 microversion: 2.54 time: 0.117157 Oct 01 20:56:50.330387 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 966/1984] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:50 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:50.388322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:50.393504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:50.408598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.413184 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a45e6ca6-05e2-4f49-88f7-db57d8b136d8 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/731dff07d63c4d4286e4cec5f8b7b868" status: 200 len: 371 microversion: 2.1 time: 0.270607 Oct 01 20:56:50.414399 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1019/1985] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Oct 1 20:56:50 2022] GET /compute/v2.1/os-quota-sets/731dff07d63c4d4286e4cec5f8b7b868 => generated 371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:50.415134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.415925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.417586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.418922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.420161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.429092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c3b9d175-fb86-484a-ba3d-98fdd152103e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Action: 'update', calling method: .version_select at 0x7f417276c040>, body: {"quota_set": {"ram": "5120"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:50.545932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:50.558774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3b9d175-fb86-484a-ba3d-98fdd152103e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.559934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3b9d175-fb86-484a-ba3d-98fdd152103e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.560880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3b9d175-fb86-484a-ba3d-98fdd152103e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.562060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3b9d175-fb86-484a-ba3d-98fdd152103e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.563181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3b9d175-fb86-484a-ba3d-98fdd152103e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.563793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3b9d175-fb86-484a-ba3d-98fdd152103e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.578761 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b716a6d-7ab6-4e05-b356-0317bfec2717 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.199875 Oct 01 20:56:50.580054 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 967/1986] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:50 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:50.616368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:50.617269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:50.627017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.627795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.628906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.630897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:50.631773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:50.632387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:50.645130 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c3b9d175-fb86-484a-ba3d-98fdd152103e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/731dff07d63c4d4286e4cec5f8b7b868" status: 200 len: 328 microversion: 2.1 time: 0.222050 Oct 01 20:56:50.654633 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1020/1987] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:56:50 2022] PUT /compute/v2.1/os-quota-sets/731dff07d63c4d4286e4cec5f8b7b868 => generated 328 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:50.671915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-480edc1b-87d2-4053-840a-2a19082b2f38 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:50.685298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:50.696429 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-480edc1b-87d2-4053-840a-2a19082b2f38 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-quota-sets/731dff07d63c4d4286e4cec5f8b7b868" status: 202 len: 0 microversion: 2.1 time: 0.027953 Oct 01 20:56:50.701575 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1021/1988] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 20:56:50 2022] DELETE /compute/v2.1/os-quota-sets/731dff07d63c4d4286e4cec5f8b7b868 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:56:50.708727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-821d98fe-d52a-4174-9b39-595d181d329e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Calling method '.version_select at 0x7f417278ec10>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:50.814814 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-821d98fe-d52a-4174-9b39-595d181d329e tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/731dff07d63c4d4286e4cec5f8b7b868" status: 200 len: 371 microversion: 2.1 time: 0.110131 Oct 01 20:56:50.825150 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1022/1989] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Oct 1 20:56:50 2022] GET /compute/v2.1/os-quota-sets/731dff07d63c4d4286e4cec5f8b7b868 => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:50.835171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f0219d84-0bc8-4330-b46f-99b5cc837aea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41727b38b0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:50.867822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:50.880499 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1bb7a9cb-a7c2-404a-b0af-97e7f053435b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1313 microversion: 2.1 time: 0.270361 Oct 01 20:56:50.883110 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 968/1990] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:50 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:50.930906 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f0219d84-0bc8-4330-b46f-99b5cc837aea tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.103086 Oct 01 20:56:50.932083 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1023/1991] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:50 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:51.077841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b45c54d-a0a8-406f-9a65-2d0c2b8329d6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Calling method '.version_select at 0x7f4173028160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:51.229813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:51.231730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: c902159b-1429-495e-b8a7-92092a9b748c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:51.240449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.241709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.242327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.243729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.244918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.245671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.275744 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] HTTP exception thrown: Instance c902159b-1429-495e-b8a7-92092a9b748c could not be found. Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Request method failure captured: Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c HTTP/1.1 Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKktI785jAu8GTx12ds3W5tdOPo9Q3-Cn7QkqKSPtQ1fyqfBDi7cxgARCB96Evv-_Y1l5_fjAZlVjbjnKtHrcvNfu6DVX8q91Lm8FI6khKOQSBjO3rKCOxaUDttyjZuKLV9MYUnaufJN2MraRy_h4JlOj6gBwCnwyEetbDQ6_dqeZCo Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 0edc386b86af4e77bcc8e6663b966c7c Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ListServerFiltersTestJSON-871933899 Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0edc386b86af4e77bcc8e6663b966c7c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0edc386b86af4e77bcc8e6663b966c7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0edc386b86af4e77bcc8e6663b966c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0edc386b86af4e77bcc8e6663b966c7c"}]}] Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ListServerFiltersTestJSON-871933899 Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 0edc386b86af4e77bcc8e6663b966c7c Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-871933899 Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ListServerFiltersTestJSON-871933899-project Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 7d21433c5d434e6f85d17aad6e21f4f0 Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ListServerFiltersTestJSON-871933899-project Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance c902159b-1429-495e-b8a7-92092a9b748c could not be found. Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'c902159b-1429-495e-b8a7-92092a9b748c'} Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c902159b-1429-495e-b8a7-92092a9b748c could not be found. Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c902159b-1429-495e-b8a7-92092a9b748c could not be found. Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:51.278249 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:51.284863 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:51.284863 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:51.284863 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:51.284863 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:51.284863 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:51.284863 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c902159b-1429-495e-b8a7-92092a9b748c could not be found. Oct 01 20:56:51.284863 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:56:51.287570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Returning 404 to user: Instance c902159b-1429-495e-b8a7-92092a9b748c could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:51.289044 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0ec5f814-9c8f-4797-847f-1932929102b1 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c" status: 404 len: 111 microversion: 2.1 time: 0.067377 Oct 01 20:56:51.290483 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1024/1992] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:51 2022] GET /compute/v2.1/servers/c902159b-1429-495e-b8a7-92092a9b748c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:51.305959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:51.306471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:51.317859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b45c54d-a0a8-406f-9a65-2d0c2b8329d6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/9777f22c6fa9415292d22267bc555cc5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.243854 Oct 01 20:56:51.320286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.320914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.321465 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 969/1993] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 20:56:51 2022] GET /compute/v2.1/os-quota-sets/9777f22c6fa9415292d22267bc555cc5/defaults => generated 371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:51.321597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.322511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.323155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.323658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.358471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:51.359324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:51.370656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:51.372659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.373247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.373938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.380336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.381438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.383216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.391842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:51.514829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:51.527233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:51.528150 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-46fae050-770a-41c1-a529-e677c2e9457e tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e" status: 204 len: 0 microversion: 2.1 time: 0.227444 Oct 01 20:56:51.529702 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1025/1994] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:51 2022] DELETE /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:51.536264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:51.538298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-42e6a9cd-e42a-4798-a5ae-d895ff6a5728 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1336 microversion: 2.54 time: 0.184660 Oct 01 20:56:51.538882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:51.550581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:51.550738 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 970/1995] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:51 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1336 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:51.565087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.566660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.567372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.568938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.570741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.571374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.607936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:51.608718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:51.619206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.620051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.620438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.621312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.627023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.627642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.739541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:51.758184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:51.765108 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-18acb843-9325-4083-9b29-d7b8f0accd35 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.160803 Oct 01 20:56:51.766418 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 971/1996] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:51 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:51.770026 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-12465700-02e9-48d9-bb17-cae3e333aafe tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e" status: 200 len: 1517 microversion: 2.1 time: 0.236087 Oct 01 20:56:51.782789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a259955-7688-486b-8778-4d28927e598c tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Action: 'update', calling method: .version_select at 0x7f4172ff25e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:51.783729 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1026/1997] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:51 2022] GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:51.905229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:51.911233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:51.916406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a259955-7688-486b-8778-4d28927e598c tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.919042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a259955-7688-486b-8778-4d28927e598c tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.919675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a259955-7688-486b-8778-4d28927e598c tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.920066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.920778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.921392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.921950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a259955-7688-486b-8778-4d28927e598c tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.922484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a259955-7688-486b-8778-4d28927e598c tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.922724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:51.923305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a259955-7688-486b-8778-4d28927e598c tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:51.923497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:51.924089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.012258 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0a259955-7688-486b-8778-4d28927e598c tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/2c5ebc4b698040f6bed9392c55617867" status: 200 len: 328 microversion: 2.1 time: 0.243612 Oct 01 20:56:52.013915 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 972/1998] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:56:51 2022] PUT /compute/v2.1/os-quota-sets/2c5ebc4b698040f6bed9392c55617867 => generated 328 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:52.024688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf70e92e-5159-4c2d-9f68-ed4d3e75c377 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417c25a550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:52.087519 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf70e92e-5159-4c2d-9f68-ed4d3e75c377 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.072208 Oct 01 20:56:52.094588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 973/1999] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:52 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:52.094588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4672a79f-0036-482a-9751-77f457e6f278 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Calling method '.version_select at 0x7f4172fef1f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:52.123049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:52.134968 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bc2a2845-2207-4cba-b637-8724ad4c2f34 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1313 microversion: 2.1 time: 0.233317 Oct 01 20:56:52.137080 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1027/2000] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:51 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:52.183925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4672a79f-0036-482a-9751-77f457e6f278 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.184930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4672a79f-0036-482a-9751-77f457e6f278 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.185896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4672a79f-0036-482a-9751-77f457e6f278 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.187250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4672a79f-0036-482a-9751-77f457e6f278 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.188005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4672a79f-0036-482a-9751-77f457e6f278 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.189419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4672a79f-0036-482a-9751-77f457e6f278 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.215148 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4672a79f-0036-482a-9751-77f457e6f278 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/2c5ebc4b698040f6bed9392c55617867/detail" status: 200 len: 916 microversion: 2.1 time: 0.125508 Oct 01 20:56:52.216203 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 974/2001] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 20:56:52 2022] GET /compute/v2.1/os-quota-sets/2c5ebc4b698040f6bed9392c55617867/detail => generated 916 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:52.433983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Action: 'update', calling method: .version_select at 0x7f4172f431f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:52.568475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:52.570476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:52.578757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.579477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.579880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.580014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.580417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.580587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.581184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.581527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.581665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.582059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.582279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.582849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.667845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.669780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.670610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.672044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.672614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.673296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.704239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:52.714867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:52.716360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:52.721903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c882d295-7b94-437f-ac37-ed115e03f8ad tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1336 microversion: 2.54 time: 0.158129 Oct 01 20:56:52.722536 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 975/2002] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:52 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1336 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:52.768879 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d150ddda-a0b4-44e2-a17a-b246efa002c4 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/2c5ebc4b698040f6bed9392c55617867?user_id=b95f61b5a9c04888b73c7a10a3fbe123" status: 200 len: 328 microversion: 2.1 time: 0.339432 Oct 01 20:56:52.770312 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1028/2003] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Oct 1 20:56:52 2022] PUT /compute/v2.1/os-quota-sets/2c5ebc4b698040f6bed9392c55617867?user_id=b95f61b5a9c04888b73c7a10a3fbe123 => generated 328 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:52.782927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6413af42-3c22-4a90-a891-cd043de2abef tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Calling method '.version_select at 0x7f417c25a0d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:52.796268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:52.796375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:52.809499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.810859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.811751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.813231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.813897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.814519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.904246 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6413af42-3c22-4a90-a891-cd043de2abef tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/2c5ebc4b698040f6bed9392c55617867?user_id=b95f61b5a9c04888b73c7a10a3fbe123" status: 200 len: 370 microversion: 2.1 time: 0.125219 Oct 01 20:56:52.905051 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 976/2004] 10.222.0.17 () {58 vars in 1323 bytes} [Sat Oct 1 20:56:52 2022] GET /compute/v2.1/os-quota-sets/2c5ebc4b698040f6bed9392c55617867?user_id=b95f61b5a9c04888b73c7a10a3fbe123 => generated 370 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:52.912279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:52.913987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:52.926415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.927274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.928163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:52.929203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:52.930056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:52.930939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:53.011399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:53.056874 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a7420064-b984-40f8-ab3e-f0009d10fc65 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.266458 Oct 01 20:56:53.070518 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1029/2005] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:52 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:53.070518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b6e2c9cd-e49e-4097-b29b-51cb80c221b0 req-85799454-cd29-4bf6-b73d-78d7169e7a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a034bac-1433-439f-8bd0-f22a00cb0e32", "name": "network-vif-plugged", "status": "completed", "tag": "13fbc280-9adc-4f57-960d-1b77f52e9e08"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:53.081610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b6e2c9cd-e49e-4097-b29b-51cb80c221b0 req-85799454-cd29-4bf6-b73d-78d7169e7a37 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:53.082359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b6e2c9cd-e49e-4097-b29b-51cb80c221b0 req-85799454-cd29-4bf6-b73d-78d7169e7a37 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:53.082848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b6e2c9cd-e49e-4097-b29b-51cb80c221b0 req-85799454-cd29-4bf6-b73d-78d7169e7a37 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:53.103285 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b6e2c9cd-e49e-4097-b29b-51cb80c221b0 req-85799454-cd29-4bf6-b73d-78d7169e7a37 service nova] Creating event network-vif-plugged:13fbc280-9adc-4f57-960d-1b77f52e9e08 for instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 on nch1-master-1 Oct 01 20:56:53.109764 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b6e2c9cd-e49e-4097-b29b-51cb80c221b0 req-85799454-cd29-4bf6-b73d-78d7169e7a37 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048740 Oct 01 20:56:53.111100 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1030/2006] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:53.118968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c4aa899a-4228-4006-b312-539dde797a3f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41727b3700>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:53.182885 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c4aa899a-4228-4006-b312-539dde797a3f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.070313 Oct 01 20:56:53.184210 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1031/2007] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:53 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:53.198793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:53.199793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:53.204044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:53.207835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:53.208788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:53.209495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:53.210290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:53.210828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:53.211208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:53.220231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8acc377a-2470-4215-93e3-70b07c73de75 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e" status: 200 len: 1517 microversion: 2.1 time: 0.313035 Oct 01 20:56:53.221631 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 977/2008] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:52 2022] GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e => generated 1517 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:53.416913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:53.434373 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f2fa3bc3-9c9b-4a5d-9fdb-d4089339a21b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1313 microversion: 2.1 time: 0.233106 Oct 01 20:56:53.435492 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1032/2009] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:53 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:53.537719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2da5734a-a1cd-4619-94f7-005c728518af tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Calling method '.version_select at 0x7f417c289b80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:53.750120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:53.750767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:53.757541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:53.758037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:53.758482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:53.759220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:53.759699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:53.760129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:53.829269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:53.837604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:53.838827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:53.840588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:53.842283 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f4c482d0-4845-4f54-88b3-dcefd3c302f9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1336 microversion: 2.54 time: 0.096963 Oct 01 20:56:53.847193 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2da5734a-a1cd-4619-94f7-005c728518af tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/9777f22c6fa9415292d22267bc555cc5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.312663 Oct 01 20:56:53.861508 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 978/2010] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 20:56:53 2022] GET /compute/v2.1/os-quota-sets/9777f22c6fa9415292d22267bc555cc5/defaults => generated 371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:53.873107 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1033/2011] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:53 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1336 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:56:53.877142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30c0f1e0-21f3-49bd-8a52-90c6ab49a9f6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Action: 'update', calling method: .version_select at 0x7f4172fdee50>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:53.970300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30c0f1e0-21f3-49bd-8a52-90c6ab49a9f6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:53.970721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30c0f1e0-21f3-49bd-8a52-90c6ab49a9f6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:53.971691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30c0f1e0-21f3-49bd-8a52-90c6ab49a9f6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:53.972503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30c0f1e0-21f3-49bd-8a52-90c6ab49a9f6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:53.972973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30c0f1e0-21f3-49bd-8a52-90c6ab49a9f6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:53.973484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30c0f1e0-21f3-49bd-8a52-90c6ab49a9f6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:54.095327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:54.096166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:54.112142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:54.113698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:54.116377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:54.119352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:54.121795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:54.124269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:54.328121 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-30c0f1e0-21f3-49bd-8a52-90c6ab49a9f6 tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/9777f22c6fa9415292d22267bc555cc5" status: 200 len: 329 microversion: 2.1 time: 0.454673 Oct 01 20:56:54.329249 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 979/2012] 10.222.0.17 () {60 vars in 1263 bytes} [Sat Oct 1 20:56:53 2022] PUT /compute/v2.1/os-quota-sets/9777f22c6fa9415292d22267bc555cc5 => generated 329 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:54.336363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a87a2c5f-5303-44de-a56e-2fb58bd4e027 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417c29aee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:54.437256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:54.444553 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a87a2c5f-5303-44de-a56e-2fb58bd4e027 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.113763 Oct 01 20:56:54.445155 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 980/2013] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:54 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:54.458361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:54.459619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:54.498259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:54.498860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:54.499318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:54.500056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:54.509210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:54.509855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:54.549623 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0ee3c2e8-c8d0-49c7-bd59-7f7dfbd585db tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.459271 Oct 01 20:56:54.550237 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1034/2014] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:54 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:54.582445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e5914a72-d600-4bcc-8334-17f0b2ce32ac tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Action: 'update', calling method: .version_select at 0x7f417279c940>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:54.816946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5914a72-d600-4bcc-8334-17f0b2ce32ac tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:54.818970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5914a72-d600-4bcc-8334-17f0b2ce32ac tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:54.820401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5914a72-d600-4bcc-8334-17f0b2ce32ac tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:54.823266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5914a72-d600-4bcc-8334-17f0b2ce32ac tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:54.824685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5914a72-d600-4bcc-8334-17f0b2ce32ac tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:54.826192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5914a72-d600-4bcc-8334-17f0b2ce32ac tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:54.869527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:54.892681 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5636c102-e319-4af4-8c42-455934090a61 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e" status: 200 len: 1475 microversion: 2.1 time: 0.444983 Oct 01 20:56:54.895768 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 981/2015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:54 2022] GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e => generated 1475 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:54.917259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:54.918501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:54.937497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:54.938043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:54.938522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:54.939495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:54.942726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:54.944039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:55.276829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=79,nova_api:UPDATE=10,nova_api:INSERT=10 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:55.575106 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e5914a72-d600-4bcc-8334-17f0b2ce32ac tempest-QuotasAdminTestJSON-1447010991 tempest-QuotasAdminTestJSON-1447010991-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/9777f22c6fa9415292d22267bc555cc5" status: 200 len: 329 microversion: 2.1 time: 1.002508 Oct 01 20:56:55.575868 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1035/2016] 10.222.0.17 () {60 vars in 1263 bytes} [Sat Oct 1 20:56:54 2022] PUT /compute/v2.1/os-quota-sets/9777f22c6fa9415292d22267bc555cc5 => generated 329 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:55.590273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:55.592664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:55.610227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:55.611915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:55.612380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:55.617573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:55.621512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:55.621512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:55.807140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:55.845283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:55.849138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:55.855326 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c3d8b11b-b7f0-46a7-9799-20488c8f99b1 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1357 microversion: 2.54 time: 0.272968 Oct 01 20:56:55.857847 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1036/2017] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:55 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:55.880180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ec5dd143-464a-4ceb-bc93-ae3f81151ad1 req-991a2f53-ef08-4bce-8b89-a0121fa9e565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4330370d-f790-40ef-aee0-b29ac848085e", "name": "network-vif-deleted", "tag": "4031bbc7-099f-4d64-8e12-e38da43acc75"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:55.910151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ec5dd143-464a-4ceb-bc93-ae3f81151ad1 req-991a2f53-ef08-4bce-8b89-a0121fa9e565 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:55.914882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ec5dd143-464a-4ceb-bc93-ae3f81151ad1 req-991a2f53-ef08-4bce-8b89-a0121fa9e565 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:55.917008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ec5dd143-464a-4ceb-bc93-ae3f81151ad1 req-991a2f53-ef08-4bce-8b89-a0121fa9e565 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:55.950017 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ec5dd143-464a-4ceb-bc93-ae3f81151ad1 req-991a2f53-ef08-4bce-8b89-a0121fa9e565 service nova] Creating event network-vif-deleted:4031bbc7-099f-4d64-8e12-e38da43acc75 for instance 4330370d-f790-40ef-aee0-b29ac848085e on nch1-master-1 Oct 01 20:56:55.964559 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ec5dd143-464a-4ceb-bc93-ae3f81151ad1 req-991a2f53-ef08-4bce-8b89-a0121fa9e565 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102314 Oct 01 20:56:55.966353 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1037/2018] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:55.980517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2cdeb435-9e10-457f-802e-38a91b1b8c60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417276c790>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:56.087192 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2cdeb435-9e10-457f-802e-38a91b1b8c60 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.118591 Oct 01 20:56:56.087953 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1038/2019] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:55 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:56.103656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:56.104932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:56.123536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.124280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.124922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.125931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.126702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.128407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.184574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:56.200750 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c086c4b5-9847-41d1-aa75-9d25ca09d0e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1313 microversion: 2.1 time: 1.299303 Oct 01 20:56:56.204882 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 982/2020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:54 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1313 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:56.220364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07a6d061-94d0-4eda-ab35-550cd8163d2b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Action: 'create', calling method: .version_select at 0x7f4173028940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1573935692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnvYi5w7AjNyDobfIT9E/mFwzgCkOQ3h+wn49j8BbtKDnBQSNmCJvhrDNeXo4KRhMiOdJOs4QtFp6nm67LrVD5oGLus0nJMvIsE+c2OD5QLHOPsS8WYAalNStcvBCGCWg=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:56.276069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-07a6d061-94d0-4eda-ab35-550cd8163d2b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Getting quotas for project 49706c672bdd47d39405f8d7b80636ca. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:56:56.289218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-07a6d061-94d0-4eda-ab35-550cd8163d2b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Getting quotas for user a418c7b850684796bf4022c5b05e936d and project 49706c672bdd47d39405f8d7b80636ca. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:56:56.356923 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07a6d061-94d0-4eda-ab35-550cd8163d2b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.149675 Oct 01 20:56:56.364786 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 983/2021] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Oct 1 20:56:56 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 01 20:56:56.378960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:56.382797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 4330370d-f790-40ef-aee0-b29ac848085e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:56.405816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.407547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.413188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.414290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.414981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.415890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.439936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:56.453831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] HTTP exception thrown: Instance 4330370d-f790-40ef-aee0-b29ac848085e could not be found. Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Request method failure captured: Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e HTTP/1.1 Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKktI785jAu8GTx12ds3W5tdOPo9Q3-Cn7QkqKSPtQ1fyqfBDi7cxgARCB96Evv-_Y1l5_fjAZlVjbjnKtHrcvNfu6DVX8q91Lm8FI6khKOQSBjO3rKCOxaUDttyjZuKLV9MYUnaufJN2MraRy_h4JlOj6gBwCnwyEetbDQ6_dqeZCo Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0edc386b86af4e77bcc8e6663b966c7c Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListServerFiltersTestJSON-871933899 Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0edc386b86af4e77bcc8e6663b966c7c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0edc386b86af4e77bcc8e6663b966c7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0edc386b86af4e77bcc8e6663b966c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0edc386b86af4e77bcc8e6663b966c7c"}]}] Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListServerFiltersTestJSON-871933899 Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0edc386b86af4e77bcc8e6663b966c7c Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-871933899 Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListServerFiltersTestJSON-871933899-project Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7d21433c5d434e6f85d17aad6e21f4f0 Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListServerFiltersTestJSON-871933899-project Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 4330370d-f790-40ef-aee0-b29ac848085e could not be found. Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '4330370d-f790-40ef-aee0-b29ac848085e'} Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4330370d-f790-40ef-aee0-b29ac848085e could not be found. Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4330370d-f790-40ef-aee0-b29ac848085e could not be found. Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:56:56.459351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:56.464218 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:56:56.464218 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:56:56.464218 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:56:56.464218 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:56:56.464218 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:56:56.464218 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4330370d-f790-40ef-aee0-b29ac848085e could not be found. Oct 01 20:56:56.464218 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:56:56.468178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Returning 404 to user: Instance 4330370d-f790-40ef-aee0-b29ac848085e could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:56:56.473799 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c2004ec6-281d-4b41-89c5-642103a3dda5 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e" status: 404 len: 111 microversion: 2.1 time: 0.107076 Oct 01 20:56:56.475050 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 984/2022] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:56 2022] GET /compute/v2.1/servers/4330370d-f790-40ef-aee0-b29ac848085e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:56:56.481232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cd6e8fdf-acaa-48d4-8c27-1a6c91342969 req-ba661822-94dd-4f33-bd2f-486717dc78e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f148ce-57dc-4294-bbe5-56948f7f3470", "name": "network-vif-plugged", "status": "completed", "tag": "bbcf5a9d-7ccf-47c9-a2f0-ed1efe7ff151"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:56.482391 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cbdaccc4-d9ab-4460-8bcd-ca6da8f137be tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.392794 Oct 01 20:56:56.494700 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1039/2023] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:56 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:56.507323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1573935692", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:56.507323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:56.530226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.530678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.531121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.532129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cd6e8fdf-acaa-48d4-8c27-1a6c91342969 req-ba661822-94dd-4f33-bd2f-486717dc78e6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.532876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cd6e8fdf-acaa-48d4-8c27-1a6c91342969 req-ba661822-94dd-4f33-bd2f-486717dc78e6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.533715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cd6e8fdf-acaa-48d4-8c27-1a6c91342969 req-ba661822-94dd-4f33-bd2f-486717dc78e6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.533853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.534326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.534787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.556679 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cd6e8fdf-acaa-48d4-8c27-1a6c91342969 req-ba661822-94dd-4f33-bd2f-486717dc78e6 service nova] Creating event network-vif-plugged:bbcf5a9d-7ccf-47c9-a2f0-ed1efe7ff151 for instance 68f148ce-57dc-4294-bbe5-56948f7f3470 on nch2-master-1 Oct 01 20:56:56.575456 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cd6e8fdf-acaa-48d4-8c27-1a6c91342969 req-ba661822-94dd-4f33-bd2f-486717dc78e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098222 Oct 01 20:56:56.582527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 985/2024] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:56:56.611671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:56.612604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:56.632764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.635935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.644445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.648236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.652408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.653223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.733582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:56:56.790204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:56:56.790665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:56:56.814910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:56:56.815428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:56:56.815993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:56:56.817821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:56.927726 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5b8c6fdd-a0cb-44fc-9709-01be827052ca tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "DELETE /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 204 len: 0 microversion: 2.1 time: 0.329799 Oct 01 20:56:56.928421 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 986/2025] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:56:56 2022] DELETE /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:56:56.961334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:56.962718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:56.971835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.975215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.976273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:56.978513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:56.979477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:56.980220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:57.007180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:57.019325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:57.022564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:57.024050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:57.025254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:57.025948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:57.026616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:57.074821 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5a6f036f-63ba-4621-99c9-c5ef6672db28 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "POST /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be/action" status: 202 len: 1140 microversion: 2.54 time: 0.585867 Oct 01 20:56:57.076488 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1040/2026] 10.222.0.17 () {62 vars in 1320 bytes} [Sat Oct 1 20:56:56 2022] POST /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be/action => generated 1140 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 01 20:56:57.102210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:57.103338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:57.129049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:57.130259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:57.132687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:57.140418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:57.168232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:57.168989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:57.185223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:56:57.340757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:57.368352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:57.372689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:57.375084 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bc1f9e0c-8d26-4568-9da7-da3229d6346a tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.279226 Oct 01 20:56:57.390605 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1041/2027] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:57 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:56:57.399778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-da2b9446-b4c9-4b9e-86b0-65edf802a2be tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417278a4c0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:57.477773 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-da2b9446-b4c9-4b9e-86b0-65edf802a2be tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.098542 Oct 01 20:56:57.480166 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1042/2028] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:57 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:57.493117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:57.494095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:57.508149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:57.510721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:57.512009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:57.512711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:57.513678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:57.514340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:57.514990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:57.520726 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3734f77d-bc00-447c-9389-6a398af6ba53 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1515 microversion: 2.1 time: 0.586169 Oct 01 20:56:57.540137 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 987/2029] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:56 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1515 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:57.549164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:57.549791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:57.564221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:57.564817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:57.565219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:57.565950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:57.566424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:57.566883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:57.927070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:57.944205 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-419c1e5b-352d-4ccf-84fd-e91ef27e94de tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1313 microversion: 2.1 time: 0.462844 Oct 01 20:56:57.957804 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1043/2030] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:57 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:57.965058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:58.000768 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-619db87f-0a60-4f7c-b3c1-07cb8ef1fc8c tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.459224 Oct 01 20:56:58.003044 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 988/2031] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:57 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:58.408193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:58.410107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:58.451623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:58.452131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:58.452583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:58.453291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:58.455194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:58.455989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:58.499041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb56c160-3027-4428-80ba-abd67b3af0ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417c18db80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:58.584370 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb56c160-3027-4428-80ba-abd67b3af0ac tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.091770 Oct 01 20:56:58.588912 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 989/2032] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:58 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:56:58.620272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:58.627626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:58.651674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:58.655151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:58.660749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:58.661667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:58.662446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:58.667725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:59.097120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:59.116560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:59.118404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:59.120060 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9e6451d3-3227-4a2c-97f8-72eb0b6b3e8f tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.716618 Oct 01 20:56:59.135153 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1044/2033] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:58 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:56:59.144034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:59.145248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:59.162754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:59.166969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:59.169816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:59.171936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:59.172714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:59.180013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:59.422026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21433c5d434e6f85d17aad6e21f4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edc386b86af4e77bcc8e6663b966c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:59.431182 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06c71884-2b42-4b87-8a25-92e7c6fe8ed4 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 200 len: 1515 microversion: 2.1 time: 0.831367 Oct 01 20:56:59.433952 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 990/2034] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:58 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 1515 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:59.439777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:59.451420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:56:59.462601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:59.463540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:59.464294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:59.465584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:59.467990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:59.468636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:59.628691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:56:59.648431 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6954120d-a6d2-46c5-9e5a-ea49bf03fcc6 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.212453 Oct 01 20:56:59.649686 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 991/2035] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:56:59 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:56:59.654981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2b3d5b3-bef4-45da-bcfc-eac0210e749e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417c18d9d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:56:59.747618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:56:59.767645 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-53c3c279-0a3c-4a0c-b88a-6ee73c7980ee tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1463 microversion: 2.1 time: 0.631005 Oct 01 20:56:59.768777 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a2b3d5b3-bef4-45da-bcfc-eac0210e749e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.117740 Oct 01 20:56:59.769398 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 992/2036] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:56:59 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:59.775838 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1045/2037] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:56:59 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1463 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:56:59.782624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b944f448-1fd8-4cbf-96da-2546a9dac78c req-c35a093a-7ead-4178-8dd9-045af7cd3b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485dd13f-1d60-418b-97bb-d6edfbeeb93a", "name": "network-vif-deleted", "tag": "3e0303ab-2873-409d-8e60-eb9015f70e6a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:56:59.823368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b944f448-1fd8-4cbf-96da-2546a9dac78c req-c35a093a-7ead-4178-8dd9-045af7cd3b64 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:56:59.825294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b944f448-1fd8-4cbf-96da-2546a9dac78c req-c35a093a-7ead-4178-8dd9-045af7cd3b64 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:56:59.825776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b944f448-1fd8-4cbf-96da-2546a9dac78c req-c35a093a-7ead-4178-8dd9-045af7cd3b64 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:56:59.864350 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b944f448-1fd8-4cbf-96da-2546a9dac78c req-c35a093a-7ead-4178-8dd9-045af7cd3b64 service nova] Creating event network-vif-deleted:3e0303ab-2873-409d-8e60-eb9015f70e6a for instance 485dd13f-1d60-418b-97bb-d6edfbeeb93a on nch1-master-1 Oct 01 20:56:59.879554 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b944f448-1fd8-4cbf-96da-2546a9dac78c req-c35a093a-7ead-4178-8dd9-045af7cd3b64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108640 Oct 01 20:56:59.880103 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 993/2038] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:00.305478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9c7a216c-75d0-4d07-887f-11c65ba2aa81 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:00.317879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9c7a216c-75d0-4d07-887f-11c65ba2aa81 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Searching by: {'deleted': False, 'project_id': '6e41d13569c94212af2211abe1d8ba99'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:57:00.336386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c7a216c-75d0-4d07-887f-11c65ba2aa81 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.336822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:00.337324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c7a216c-75d0-4d07-887f-11c65ba2aa81 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.337469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:00.338066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c7a216c-75d0-4d07-887f-11c65ba2aa81 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.339789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c7a216c-75d0-4d07-887f-11c65ba2aa81 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.340702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c7a216c-75d0-4d07-887f-11c65ba2aa81 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.341644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c7a216c-75d0-4d07-887f-11c65ba2aa81 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.359402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.359925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.360379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.361117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.361587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.362027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.398810 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9c7a216c-75d0-4d07-887f-11c65ba2aa81 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.590721 Oct 01 20:57:00.414404 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1046/2039] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:56:59 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 01 20:57:00.428819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:57:00.445303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:00.445945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:00.476896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.483279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.483791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.484841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.485306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.485736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.639763 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-66a428aa-0cab-4f19-a7d0-9df77c9a5f15 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 204 len: 0 microversion: 2.42 time: 0.752665 Oct 01 20:57:00.642123 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 994/2040] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:56:59 2022] DELETE /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:57:00.654670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:00.667298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:00.681055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:00.685254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Searching by: {'deleted': False} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:57:00.688827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:00.690198 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c7c5d0ab-41d7-4cdb-b17c-b351796075e5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.274321 Oct 01 20:57:00.698858 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1047/2041] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:00 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:00.720091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:00.721555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.723262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.723498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] [instance: 485dd13f-1d60-418b-97bb-d6edfbeeb93a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:00.723705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.725092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.729013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.729635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.733231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.734130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.735311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.736595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.737195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.737739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.757228 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] HTTP exception thrown: Instance 485dd13f-1d60-418b-97bb-d6edfbeeb93a could not be found. Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Request method failure captured: Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a HTTP/1.1 Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKktI785jAu8GTx12ds3W5tdOPo9Q3-Cn7QkqKSPtQ1fyqfBDi7cxgARCB96Evv-_Y1l5_fjAZlVjbjnKtHrcvNfu6DVX8q91Lm8FI6khKOQSBjO3rKCOxaUDttyjZuKLV9MYUnaufJN2MraRy_h4JlOj6gBwCnwyEetbDQ6_dqeZCo Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 0edc386b86af4e77bcc8e6663b966c7c Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ListServerFiltersTestJSON-871933899 Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0edc386b86af4e77bcc8e6663b966c7c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0edc386b86af4e77bcc8e6663b966c7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0edc386b86af4e77bcc8e6663b966c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0edc386b86af4e77bcc8e6663b966c7c"}]}] Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ListServerFiltersTestJSON-871933899 Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 0edc386b86af4e77bcc8e6663b966c7c Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-871933899 Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ListServerFiltersTestJSON-871933899-project Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 7d21433c5d434e6f85d17aad6e21f4f0 Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ListServerFiltersTestJSON-871933899-project Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 485dd13f-1d60-418b-97bb-d6edfbeeb93a could not be found. Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '485dd13f-1d60-418b-97bb-d6edfbeeb93a'} Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485dd13f-1d60-418b-97bb-d6edfbeeb93a could not be found. Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485dd13f-1d60-418b-97bb-d6edfbeeb93a could not be found. Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:00.760329 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:00.766828 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:00.766828 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:00.766828 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:00.766828 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:00.766828 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:00.766828 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485dd13f-1d60-418b-97bb-d6edfbeeb93a could not be found. Oct 01 20:57:00.766828 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:00.766828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] Returning 404 to user: Instance 485dd13f-1d60-418b-97bb-d6edfbeeb93a could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:00.768577 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fb3b6340-d697-42f0-bd11-dc3876cd8662 tempest-ListServerFiltersTestJSON-871933899 tempest-ListServerFiltersTestJSON-871933899-project] 10.222.0.17 "GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a" status: 404 len: 111 microversion: 2.1 time: 0.067139 Oct 01 20:57:00.773437 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1048/2042] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:00 2022] GET /compute/v2.1/servers/485dd13f-1d60-418b-97bb-d6edfbeeb93a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:57:00.779160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:00.779948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:00.788073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.788967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.789669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:00.790690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:00.791472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:00.792274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:01.090172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:57:01.188685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:01.200477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:01.201885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:01.203249 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-177e9321-e795-4718-b220-83bce0196aaa tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2955 microversion: 2.42 time: 0.429005 Oct 01 20:57:01.203808 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1049/2043] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:00 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2955 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:01.226057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:01.231019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:01.231629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:01.812308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-161104f6-1e71-4241-b1b8-2448c5e75f92 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Action: 'create', calling method: .version_select at 0x7f41726cdd30>, body: {"keypair": {"name": "tempest-keypair-2011407176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9JW8BQJS7LGCQ5QIVoj5BvEF5eupxrhvDZ4hjn064UNlmR0v/5rn/YZNALpKVg635mREeo8+Vf3nthSNysokXC1JpU7XeUT7g2zmc1Vk1Swcx1Kb9+YYhLZbfh80QDUQ=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:01.836439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-161104f6-1e71-4241-b1b8-2448c5e75f92 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Getting quotas for project a4961525068042aba372c046eb589a7a. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:57:01.847349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-161104f6-1e71-4241-b1b8-2448c5e75f92 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Getting quotas for user 56b4d78c7c6c450fb5fc1d3ac587fb26 and project a4961525068042aba372c046eb589a7a. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:57:01.958227 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b31d8bd4-3a59-4667-8aad-09f88f9af359 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12332 microversion: 2.1 time: 1.314624 Oct 01 20:57:02.047686 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 995/2044] 10.222.0.17 () {58 vars in 1171 bytes} [Sat Oct 1 20:57:00 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12332 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 20:57:02.053177 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-161104f6-1e71-4241-b1b8-2448c5e75f92 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.749283 Oct 01 20:57:02.053177 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1050/2045] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:57:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:02.053516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:02.053516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:02.053702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f013f362-c50c-4d94-aff8-734c9bf00f6a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41726e2430>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:02.053797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.053797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.053797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.053797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.053797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.053797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.054288 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f013f362-c50c-4d94-aff8-734c9bf00f6a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.069539 Oct 01 20:57:02.054288 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1051/2046] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:01 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:02.054288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:02.054288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:02.090267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.103080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.110041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.112096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.112381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.113300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.145326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:02.171327 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a2772de-bd0c-487c-9de7-5621c054af24 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.210284 Oct 01 20:57:02.190709 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 996/2047] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:01 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:02.198453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae698c97-750a-437c-8c09-d65a1dc4f073 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:02.203554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae698c97-750a-437c-8c09-d65a1dc4f073 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Searching by: {'deleted': False, 'project_id': '6e41d13569c94212af2211abe1d8ba99'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:57:02.216282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=15,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:02.230305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae698c97-750a-437c-8c09-d65a1dc4f073 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.234067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae698c97-750a-437c-8c09-d65a1dc4f073 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.235301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae698c97-750a-437c-8c09-d65a1dc4f073 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.236149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae698c97-750a-437c-8c09-d65a1dc4f073 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.236621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae698c97-750a-437c-8c09-d65a1dc4f073 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.244332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:02.246001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae698c97-750a-437c-8c09-d65a1dc4f073 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.262989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:02.264315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:02.265610 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-48f5aca1-4290-4597-b517-e952e151e2ec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.227107 Oct 01 20:57:02.266659 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1052/2048] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:02 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:02.273636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:02.278927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:02.290659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.291595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.295403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.296607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.297318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.298433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.306238 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae698c97-750a-437c-8c09-d65a1dc4f073 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?tenant_id=a6bdd72ba854403e8fef7f651a3ef106" status: 200 len: 15 microversion: 2.1 time: 0.111439 Oct 01 20:57:02.310539 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 997/2049] 10.222.0.17 () {58 vars in 1231 bytes} [Sat Oct 1 20:57:02 2022] GET /compute/v2.1/servers/detail?tenant_id=a6bdd72ba854403e8fef7f651a3ef106 => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:57:02.328339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:02.335272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Searching by: {'tenant_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'deleted': False} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:57:02.340971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.341657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.342114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.343913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.344814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.345301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.379912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:57:02.438993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.439867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.440447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.770138 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4bb8648e-093b-4d9d-8f13-1a4ea351a13b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a6bdd72ba854403e8fef7f651a3ef106" status: 200 len: 4825 microversion: 2.1 time: 0.444466 Oct 01 20:57:02.771836 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 998/2050] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Oct 1 20:57:02 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a6bdd72ba854403e8fef7f651a3ef106 => generated 4825 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:02.805742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:02.821323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:02.823801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:02.825546 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c50afa62-e0b2-443a-84c4-8435d5fbd47a tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2955 microversion: 2.42 time: 0.557796 Oct 01 20:57:02.826824 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1053/2051] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:02 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2955 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:02.865733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-73e12be1-d59a-484d-b545-227dbf9885b5 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:02.877351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-73e12be1-d59a-484d-b545-227dbf9885b5 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Searching by: {'tenant_id': '6e41d13569c94212af2211abe1d8ba99', 'deleted': False} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:57:02.917288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73e12be1-d59a-484d-b545-227dbf9885b5 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.918173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73e12be1-d59a-484d-b545-227dbf9885b5 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.918647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73e12be1-d59a-484d-b545-227dbf9885b5 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.922689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73e12be1-d59a-484d-b545-227dbf9885b5 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:02.923975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73e12be1-d59a-484d-b545-227dbf9885b5 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:02.924625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73e12be1-d59a-484d-b545-227dbf9885b5 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:02.956895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=34 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:03.017666 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-73e12be1-d59a-484d-b545-227dbf9885b5 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e41d13569c94212af2211abe1d8ba99" status: 200 len: 15 microversion: 2.1 time: 0.189427 Oct 01 20:57:03.023272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-149473290", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:03.034230 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1054/2052] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Oct 1 20:57:02 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e41d13569c94212af2211abe1d8ba99 => generated 15 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:57:03.044829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-129df703-6011-45a7-ae70-e17e017af58b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:03.050831 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-129df703-6011-45a7-ae70-e17e017af58b tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009989 Oct 01 20:57:03.067616 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1055/2053] 10.222.0.17 () {58 vars in 1189 bytes} [Sat Oct 1 20:57:03 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:57:03.078683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-49f28f8f-16cc-41f2-9ba4-30f4e9658517 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41726e4790>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:03.158256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:57:03.175300 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-49f28f8f-16cc-41f2-9ba4-30f4e9658517 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.105738 Oct 01 20:57:03.176422 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1056/2054] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:03 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:03.190796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ed0831b-b4a9-4b33-a6c8-6e0485c12b9a tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:03.196526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ed0831b-b4a9-4b33-a6c8-6e0485c12b9a tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:03.221006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed0831b-b4a9-4b33-a6c8-6e0485c12b9a tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.221528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed0831b-b4a9-4b33-a6c8-6e0485c12b9a tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.222034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed0831b-b4a9-4b33-a6c8-6e0485c12b9a tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.232272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed0831b-b4a9-4b33-a6c8-6e0485c12b9a tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.232813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed0831b-b4a9-4b33-a6c8-6e0485c12b9a tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.233271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ed0831b-b4a9-4b33-a6c8-6e0485c12b9a tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.507107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:57:03.507976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:57:03.509748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:57:03.510558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:57:03.511699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:57:03.522290 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0ed0831b-b4a9-4b33-a6c8-6e0485c12b9a tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.344525 Oct 01 20:57:03.524244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.524973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.526605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.527817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.528605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.528784 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1057/2055] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:57:03 2022] POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:57:03.529742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.548032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:03.555000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Getting quotas for project ff3a0720d242499694d57ffe3b405f21. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:57:03.555622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:03.563252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Getting quotas for user 00d15c074f9344b2b2b5df4411df66d1 and project ff3a0720d242499694d57ffe3b405f21. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:57:03.572568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.573370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.575894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.577448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.578781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.579729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.596741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:57:03.601916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:57:03.770660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:03.772855 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1b66e72c-172c-4d4b-be5a-6127db666430 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999105 Oct 01 20:57:03.789062 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 999/2056] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:57:03.807863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:03.808674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:03.818727 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b191e0e4-cf9b-4765-9ef4-09fc1e7fe8b8 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.286689 Oct 01 20:57:03.820185 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1058/2057] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:03 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:03.839303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:03.844935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:03.851054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:57:03.858455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.866366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.868260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.868891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.869299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.869979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.871189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.871933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:03.872723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.873496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:03.875596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.877396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:03.952965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:57:04.022194 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4fbf2e5f-4ee7-4bbb-bb12-ce894ab086a1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.195712 Oct 01 20:57:04.024321 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1059/2058] 10.222.0.17 () {58 vars in 1150 bytes} [Sat Oct 1 20:57:03 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:04.051576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60a0dce1-6ab1-40e1-929f-6f64dc5181b1 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:04.052790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-60a0dce1-6ab1-40e1-929f-6f64dc5181b1 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:04.110846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:04.127758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:04.129398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:04.132903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26d69edb-41b7-4564-b587-9b94f60b69ea tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.340448 Oct 01 20:57:04.147006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1000/2059] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:03 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:04.173566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:04.182893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:04.194212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:04.194737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:04.195178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:04.195892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:04.196346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:04.196770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:04.280053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-60a0dce1-6ab1-40e1-929f-6f64dc5181b1 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:04.290850 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-60a0dce1-6ab1-40e1-929f-6f64dc5181b1 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1222 microversion: 2.1 time: 0.265378 Oct 01 20:57:04.312926 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1060/2060] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:04 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1222 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:04.330104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e899999e-74e8-4e14-8b2b-2d5272f638f2 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:04.338598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e899999e-74e8-4e14-8b2b-2d5272f638f2 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:04.353475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e899999e-74e8-4e14-8b2b-2d5272f638f2 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:04.356073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e899999e-74e8-4e14-8b2b-2d5272f638f2 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:04.356537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e899999e-74e8-4e14-8b2b-2d5272f638f2 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:04.357364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e899999e-74e8-4e14-8b2b-2d5272f638f2 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:04.357753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e899999e-74e8-4e14-8b2b-2d5272f638f2 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:04.358308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e899999e-74e8-4e14-8b2b-2d5272f638f2 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:04.533810 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e899999e-74e8-4e14-8b2b-2d5272f638f2 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.219442 Oct 01 20:57:04.534998 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1061/2061] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:57:04 2022] POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:57:04.540468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6aeee63d-6bd7-4641-bcea-36ae6b194564 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173260550>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:04.640491 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6aeee63d-6bd7-4641-bcea-36ae6b194564 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.104395 Oct 01 20:57:04.641195 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1062/2062] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:04 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:04.654797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-28bb8f63-e15d-4c49-8d1a-ee04de74528c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:04.655893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-28bb8f63-e15d-4c49-8d1a-ee04de74528c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:04.671575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28bb8f63-e15d-4c49-8d1a-ee04de74528c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:04.672916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28bb8f63-e15d-4c49-8d1a-ee04de74528c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:04.674277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28bb8f63-e15d-4c49-8d1a-ee04de74528c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:04.675449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28bb8f63-e15d-4c49-8d1a-ee04de74528c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:04.676338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28bb8f63-e15d-4c49-8d1a-ee04de74528c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:04.677010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28bb8f63-e15d-4c49-8d1a-ee04de74528c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:04.685428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:04.870167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:04.885744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:04.889212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:04.892330 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bdf3d0d8-29ac-430a-aadb-8040f2fe6371 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2955 microversion: 2.42 time: 0.739770 Oct 01 20:57:04.895760 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1001/2063] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:04 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2955 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:04.900456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:04.901068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:04.923904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:04.924401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:04.924899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:04.926062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:04.927769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:04.928403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:04.975937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:05.157876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:05.194374 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-559b0607-c305-4b35-8c5c-18904de7a4e1 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.297483 Oct 01 20:57:05.195015 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1002/2064] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:04 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:05.224817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:05.225454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:05.243389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:05.243911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:05.244355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:05.245092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:05.245560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:05.246003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:05.420315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:05.439012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:05.440549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:05.449557 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aceb6b6a-29b7-4bf7-ad6d-aa8b5b258129 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.250660 Oct 01 20:57:05.456386 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1003/2065] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:05 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:05.463449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:05.464088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:05.489002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:05.499471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:05.500958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:05.501741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:05.502226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:05.502720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:05.525315 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-28bb8f63-e15d-4c49-8d1a-ee04de74528c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1614 microversion: 2.1 time: 0.882431 Oct 01 20:57:05.532034 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1063/2066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:04 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1614 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:05.668249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:05.680948 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e75d63d5-9b3b-4d1a-92c2-7f7e7bebd744 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1274 microversion: 2.1 time: 0.219545 Oct 01 20:57:05.684550 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1004/2067] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:05 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1274 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:05.696492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c08960d6-f326-44fb-a59c-5a83a6f7c50f tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:05.697331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c08960d6-f326-44fb-a59c-5a83a6f7c50f tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:05.716933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08960d6-f326-44fb-a59c-5a83a6f7c50f tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:05.719479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08960d6-f326-44fb-a59c-5a83a6f7c50f tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:05.720360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08960d6-f326-44fb-a59c-5a83a6f7c50f tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:05.724399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08960d6-f326-44fb-a59c-5a83a6f7c50f tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:05.726538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08960d6-f326-44fb-a59c-5a83a6f7c50f tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:05.729266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08960d6-f326-44fb-a59c-5a83a6f7c50f tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:05.885847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6cde445e-2a70-43fd-88b9-a184c7407423 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1130892361", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:05.890077 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-6cde445e-2a70-43fd-88b9-a184c7407423 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] HTTP exception thrown: min_count must be <= max_count Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6cde445e-2a70-43fd-88b9-a184c7407423 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Request method failure captured: Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 184 Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKmh3ovGQkrVzt13fFqMGp1Hsfk23Apr-j-buKJoZujyBZl5XEV3yHpoe-BtH5ju3aHvtZsoH1UHSZX19xVf-QOlwZQN8fUgw3u561sxlu1fKNWt1L8yJ7sgazfwRecvePv1yNBFzt9d1UwtI8GQv6NnYiLZreg4UdEPXNGyQT1ESDI Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e112b4debcc94e7791f047e7b9d7f06c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}] Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 21c60b2c9b224f4e9750fa3eb6aa0b47 Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1130892361", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: exception: min_count must be <= max_count Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1130892361', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 01 20:57:05.895531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:05.901698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6cde445e-2a70-43fd-88b9-a184c7407423 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Returning 400 to user: min_count must be <= max_count {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:05.911175 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6cde445e-2a70-43fd-88b9-a184c7407423 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.364421 Oct 01 20:57:05.915366 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1064/2068] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:05 2022] POST /compute/v2.1/servers => generated 74 bytes in 383 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 20:57:05.944732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-73cb1220-978a-4e59-a916-064575bffc54 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417273c700>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:06.025744 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-73cb1220-978a-4e59-a916-064575bffc54 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.105398 Oct 01 20:57:06.026627 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1065/2069] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:05 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:06.042018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:06.043093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:06.065128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:06.066997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:06.069436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:06.070970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:06.073323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:06.073942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:06.237986 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c08960d6-f326-44fb-a59c-5a83a6f7c50f tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1614 microversion: 2.1 time: 0.552102 Oct 01 20:57:06.241244 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1005/2070] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:05 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1614 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:06.259303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48fe88bc-9151-4bd4-8cd3-aae3193f14a8 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1655934951", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "max_count": 0}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48fe88bc-9151-4bd4-8cd3-aae3193f14a8 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Request method failure captured: Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 168 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmh3ovGQkrVzt13fFqMGp1Hsfk23Apr-j-buKJoZujyBZl5XEV3yHpoe-BtH5ju3aHvtZsoH1UHSZX19xVf-QOlwZQN8fUgw3u561sxlu1fKNWt1L8yJ7sgazfwRecvePv1yNBFzt9d1UwtI8GQv6NnYiLZreg4UdEPXNGyQT1ESDI Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e112b4debcc94e7791f047e7b9d7f06c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}] Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 21c60b2c9b224f4e9750fa3eb6aa0b47 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1655934951", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "max_count": 0}} Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1655934951', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'max_count': 0}}} Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 0 Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:57:06.264440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 01 20:57:06.273342 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:06.278903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48fe88bc-9151-4bd4-8cd3-aae3193f14a8 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:06.278903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48fe88bc-9151-4bd4-8cd3-aae3193f14a8 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.033903 Oct 01 20:57:06.278903 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1006/2071] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:06 2022] POST /compute/v2.1/servers => generated 130 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:06.289515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:06.291545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:06.321232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:06.323927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:06.328310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:06.329572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:06.330332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:06.331133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:06.886613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:06.922603 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77dc845c-a4cc-4eb3-8c86-f6421d4a488d tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.644488 Oct 01 20:57:06.925085 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1007/2072] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:06 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:06.945129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:06.959171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:57:06.972912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:06.973760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:06.975445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:06.976378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:06.977489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:06.978101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:07.088059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:57:07.197024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:07.204326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6cceb3e5-6529-4c36-a8a7-24ffcde84b48 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1632 microversion: 2.1 time: 0.269113 Oct 01 20:57:07.207157 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1008/2073] 10.222.0.17 () {58 vars in 1190 bytes} [Sat Oct 1 20:57:06 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1632 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:07.222403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:07.228200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:07.229079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5bee21d9-7aff-4863-9fe6-211793718a6e tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1104267681", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "max_count": 2.5}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:07.229528 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-97ad7032-e9fa-4fd4-81cf-6a366a1699f3 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2955 microversion: 2.42 time: 1.201794 Oct 01 20:57:07.232158 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1066/2074] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:06 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2955 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:07.250387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:07.258820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5bee21d9-7aff-4863-9fe6-211793718a6e tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Request method failure captured: Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 170 Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmh3ovGQkrVzt13fFqMGp1Hsfk23Apr-j-buKJoZujyBZl5XEV3yHpoe-BtH5ju3aHvtZsoH1UHSZX19xVf-QOlwZQN8fUgw3u561sxlu1fKNWt1L8yJ7sgazfwRecvePv1yNBFzt9d1UwtI8GQv6NnYiLZreg4UdEPXNGyQT1ESDI Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e112b4debcc94e7791f047e7b9d7f06c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}] Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 21c60b2c9b224f4e9750fa3eb6aa0b47 Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1104267681", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "max_count": 2.5}} Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1104267681', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'max_count': 2.5}}} Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 2.5 Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:57:07.261988 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5bee21d9-7aff-4863-9fe6-211793718a6e tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:07.270784 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5bee21d9-7aff-4863-9fe6-211793718a6e tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.059806 Oct 01 20:57:07.282348 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1009/2075] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:07 2022] POST /compute/v2.1/servers => generated 139 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:07.291575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:07.292200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:07.296216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:07.297521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:07.299051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:07.300999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:07.303151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:07.303980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:07.308136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:07.308646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:07.309089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:07.311216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:07.311690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:07.312130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:07.742036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:07.751853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:07.762982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:07.764769 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6ba75dd9-6103-4fcc-8b49-272eee456f86 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.531570 Oct 01 20:57:07.767194 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1067/2076] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:07 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:07.779270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3eec49a8-74f9-4fe5-809a-aa5f30d6b9e4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41726e44c0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:07.863334 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3eec49a8-74f9-4fe5-809a-aa5f30d6b9e4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.094286 Oct 01 20:57:07.874074 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1068/2077] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:07 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:07.883108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1b92b78a-51d4-4325-a777-a50ede2bf01c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:07.891291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:07.898368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1b92b78a-51d4-4325-a777-a50ede2bf01c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:57:07.906877 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-58587720-12db-4350-8f0f-e2fe6b43f280 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1322 microversion: 2.1 time: 0.623133 Oct 01 20:57:07.907672 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1010/2078] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:07 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:07.913722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0ab64fc-10d3-4143-9c24-8a158941351c tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1961445122", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 0}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0ab64fc-10d3-4143-9c24-8a158941351c tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Request method failure captured: Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 168 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmh3ovGQkrVzt13fFqMGp1Hsfk23Apr-j-buKJoZujyBZl5XEV3yHpoe-BtH5ju3aHvtZsoH1UHSZX19xVf-QOlwZQN8fUgw3u561sxlu1fKNWt1L8yJ7sgazfwRecvePv1yNBFzt9d1UwtI8GQv6NnYiLZreg4UdEPXNGyQT1ESDI Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e112b4debcc94e7791f047e7b9d7f06c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}] Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 21c60b2c9b224f4e9750fa3eb6aa0b47 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1961445122", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 0}} Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1961445122', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'min_count': 0}}} Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 0 Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:57:07.917667 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 01 20:57:07.922861 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:07.927569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=5 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:07.929653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b92b78a-51d4-4325-a777-a50ede2bf01c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:07.930696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0ab64fc-10d3-4143-9c24-8a158941351c tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:07.933983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b92b78a-51d4-4325-a777-a50ede2bf01c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:07.934606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b92b78a-51d4-4325-a777-a50ede2bf01c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:07.935546 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0ab64fc-10d3-4143-9c24-8a158941351c tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.026792 Oct 01 20:57:07.936574 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1011/2079] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:07 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:07.940613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b92b78a-51d4-4325-a777-a50ede2bf01c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:07.941288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b92b78a-51d4-4325-a777-a50ede2bf01c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:07.941949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b92b78a-51d4-4325-a777-a50ede2bf01c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:07.954146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:07.954898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:07.967520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:07.968415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:07.969192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:07.971878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:07.972661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:07.973414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.137264 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1b92b78a-51d4-4325-a777-a50ede2bf01c tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.259001 Oct 01 20:57:08.138423 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1069/2080] 10.222.0.17 () {58 vars in 1196 bytes} [Sat Oct 1 20:57:07 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:57:08.146952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cb761cb6-3609-432c-892b-a74973c7ecb6 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2074476867", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 2.5}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cb761cb6-3609-432c-892b-a74973c7ecb6 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Request method failure captured: Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 170 Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKmh3ovGQkrVzt13fFqMGp1Hsfk23Apr-j-buKJoZujyBZl5XEV3yHpoe-BtH5ju3aHvtZsoH1UHSZX19xVf-QOlwZQN8fUgw3u561sxlu1fKNWt1L8yJ7sgazfwRecvePv1yNBFzt9d1UwtI8GQv6NnYiLZreg4UdEPXNGyQT1ESDI Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e112b4debcc94e7791f047e7b9d7f06c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e112b4debcc94e7791f047e7b9d7f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e112b4debcc94e7791f047e7b9d7f06c"}]}] Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: e112b4debcc94e7791f047e7b9d7f06c Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-800897440 Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 21c60b2c9b224f4e9750fa3eb6aa0b47 Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-800897440-project Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2074476867", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 2.5}} Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2074476867', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'min_count': 2.5}}} Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi 2.5 Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 20:57:08.155835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 01 20:57:08.162705 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:08.165916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cb761cb6-3609-432c-892b-a74973c7ecb6 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:08.167913 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cb761cb6-3609-432c-892b-a74973c7ecb6 tempest-MultipleCreateNegativeTestJSON-800897440 tempest-MultipleCreateNegativeTestJSON-800897440-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028002 Oct 01 20:57:08.169123 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1070/2081] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:08.181107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-eddd84f2-9092-4f66-a86b-6378382927d3 req-9f66b9a4-e0eb-463d-9442-e3911a8c3264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-unplugged", "status": "completed", "tag": "e3c20a77-5ca5-4d7e-9621-467c8ec0eded"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:08.197170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-eddd84f2-9092-4f66-a86b-6378382927d3 req-9f66b9a4-e0eb-463d-9442-e3911a8c3264 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.198375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-eddd84f2-9092-4f66-a86b-6378382927d3 req-9f66b9a4-e0eb-463d-9442-e3911a8c3264 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.199010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-eddd84f2-9092-4f66-a86b-6378382927d3 req-9f66b9a4-e0eb-463d-9442-e3911a8c3264 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.212574 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-eddd84f2-9092-4f66-a86b-6378382927d3 req-9f66b9a4-e0eb-463d-9442-e3911a8c3264 service nova] Creating event network-vif-unplugged:e3c20a77-5ca5-4d7e-9621-467c8ec0eded for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:08.219864 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-eddd84f2-9092-4f66-a86b-6378382927d3 req-9f66b9a4-e0eb-463d-9442-e3911a8c3264 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049214 Oct 01 20:57:08.221156 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1071/2082] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:08.231388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-029e0fde-e614-4859-8980-241d50d60740 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:08.234098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-029e0fde-e614-4859-8980-241d50d60740 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:08.241927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-029e0fde-e614-4859-8980-241d50d60740 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.242786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-029e0fde-e614-4859-8980-241d50d60740 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.243399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-029e0fde-e614-4859-8980-241d50d60740 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.244390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-029e0fde-e614-4859-8980-241d50d60740 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.245173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-029e0fde-e614-4859-8980-241d50d60740 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.246092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-029e0fde-e614-4859-8980-241d50d60740 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.410916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:08.439792 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-029e0fde-e614-4859-8980-241d50d60740 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.212771 Oct 01 20:57:08.446770 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1072/2083] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:57:08 2022] POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:57:08.451231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1ba8c2f-ca12-4f03-9afe-b10be718b5a3 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.503032 Oct 01 20:57:08.453955 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1012/2084] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:07 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:08.472990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:08.473975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:08.474901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:08.475795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:08.495107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.496806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.497773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.499239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.500080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.500840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.502087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.502698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.503103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.503863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.504335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.504783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.697069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:57:08.706937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:57:08.707631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:57:08.712540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:57:08.713225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:57:08.853223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:08.871546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.871958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.872415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.873161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.873628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.876655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.922843 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d6d665fa-9644-4fc3-bd88-455bb95857ce tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action" status: 202 len: 1067 microversion: 2.1 time: 0.467567 Oct 01 20:57:08.937469 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1013/2085] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:57:08 2022] POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action => generated 1067 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 01 20:57:08.942595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5bffc638-faad-4133-b4e5-3ddf81eb52ca req-7600c0e1-aa55-4cb6-a89e-9ba15aeb6e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f4a750-e707-4f90-b122-d4e1a9167098", "tag": "7fe80183-4a7b-4b15-a597-99ffb47ba445"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:08.953700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5bffc638-faad-4133-b4e5-3ddf81eb52ca req-7600c0e1-aa55-4cb6-a89e-9ba15aeb6e34 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:08.954639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5bffc638-faad-4133-b4e5-3ddf81eb52ca req-7600c0e1-aa55-4cb6-a89e-9ba15aeb6e34 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:08.955313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5bffc638-faad-4133-b4e5-3ddf81eb52ca req-7600c0e1-aa55-4cb6-a89e-9ba15aeb6e34 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:08.971720 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5bffc638-faad-4133-b4e5-3ddf81eb52ca req-7600c0e1-aa55-4cb6-a89e-9ba15aeb6e34 service nova] Creating event network-changed:7fe80183-4a7b-4b15-a597-99ffb47ba445 for instance 46f4a750-e707-4f90-b122-d4e1a9167098 on nch1-master-1 Oct 01 20:57:08.980028 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5bffc638-faad-4133-b4e5-3ddf81eb52ca req-7600c0e1-aa55-4cb6-a89e-9ba15aeb6e34 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040338 Oct 01 20:57:08.981393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1014/2086] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:08.997855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-887311633", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7199ff0b-b623-48c8-88af-f13d6644a4de"}], "security_groups": [{"name": "tempest-securitygroup--250152002"}], "key_name": "tempest-keypair-2011407176", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:09.173507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:09.194708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:09.199845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:09.203034 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-23d85fcc-225d-4da0-ba32-49c2dc3cf314 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2934 microversion: 2.42 time: 0.755038 Oct 01 20:57:09.205548 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1073/2087] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:08 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2934 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:09.211626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:09.215941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:09.232250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:09.234674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:09.236647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:09.237617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:09.238879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:09.240534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:09.326007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] validate_networks() for [('7199ff0b-b623-48c8-88af-f13d6644a4de', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:57:09.474211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:09.484582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:09.490721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:09.496366 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe36d83f-4007-4920-804a-6d48526a8564 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.288796 Oct 01 20:57:09.510549 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1074/2088] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:09 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:09.510549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cf436997-1f1f-4fc8-8bbf-bf114af2aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41726efee0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:09.571212 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cf436997-1f1f-4fc8-8bbf-bf114af2aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.072629 Oct 01 20:57:09.579269 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1075/2089] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:09 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:09.583599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:09.584213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:09.601320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:09.601852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:09.602357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:09.603210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:09.603685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:09.604129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.029178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:10.038563 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fd59daf1-25c5-4297-8b8c-9ebd8c380fbb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1322 microversion: 2.1 time: 0.462970 Oct 01 20:57:10.056397 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1076/2090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:09 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:10.061895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:10.062922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:10.070446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.071308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.071990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.072979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.073709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.074375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.447092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Getting quotas for project a4961525068042aba372c046eb589a7a. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:57:10.461655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Getting quotas for user 56b4d78c7c6c450fb5fc1d3ac587fb26 and project a4961525068042aba372c046eb589a7a. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:57:10.471465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:10.482091 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-55c51ee2-be5f-4162-b3fc-9b9e7f1d825f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1471 microversion: 2.1 time: 0.424264 Oct 01 20:57:10.485521 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1077/2091] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:10 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1471 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:10.502963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:57:10.506205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:10.506981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:10.507244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:57:10.507939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:57:10.508529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:57:10.509221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:57:10.516945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.517555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.519053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.523997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.524642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.525199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.531036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.535582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.536488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.538937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.540766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.542460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.587200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Getting quotas for project a4961525068042aba372c046eb589a7a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:57:10.594916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Getting quotas for user 56b4d78c7c6c450fb5fc1d3ac587fb26 and project a4961525068042aba372c046eb589a7a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:57:10.611051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:57:10.615304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:57:10.696737 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6b483fbd-5b90-4b94-aa9f-11e556fd326a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.713623 Oct 01 20:57:10.697437 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1015/2092] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:57:10.703162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:10.703934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:10.712501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.713010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.713460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.714427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.715011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.715613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.766873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:10.838290 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3fa970c3-7369-400e-ad45-bf97bd2c1f52 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.349761 Oct 01 20:57:10.858046 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1078/2093] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:10 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:10.876753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7028b67e-863c-423d-b03f-c18023035508 req-77be6aeb-5aed-425e-b929-27540c4ac87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-unplugged", "status": "completed", "tag": "8e13aabc-dce0-48f9-99b6-bb6839ff32cf"}, {"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-unplugged", "status": "completed", "tag": "e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:10.901310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7028b67e-863c-423d-b03f-c18023035508 req-77be6aeb-5aed-425e-b929-27540c4ac87a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.902069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7028b67e-863c-423d-b03f-c18023035508 req-77be6aeb-5aed-425e-b929-27540c4ac87a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.902724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7028b67e-863c-423d-b03f-c18023035508 req-77be6aeb-5aed-425e-b929-27540c4ac87a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.930281 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7028b67e-863c-423d-b03f-c18023035508 req-77be6aeb-5aed-425e-b929-27540c4ac87a service nova] Creating event network-vif-unplugged:8e13aabc-dce0-48f9-99b6-bb6839ff32cf for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:10.931027 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7028b67e-863c-423d-b03f-c18023035508 req-77be6aeb-5aed-425e-b929-27540c4ac87a service nova] Creating event network-vif-unplugged:e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:10.946559 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7028b67e-863c-423d-b03f-c18023035508 req-77be6aeb-5aed-425e-b929-27540c4ac87a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.084215 Oct 01 20:57:10.947810 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1079/2094] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:10.962128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:10.963608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:10.976325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.978995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.983080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:10.984066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:10.984715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:10.985318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:11.155535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:11.172264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:11.174076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:11.178534 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cf84491b-e896-41f0-a3a6-ae2f2e031472 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.228978 Oct 01 20:57:11.181883 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1080/2095] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:10 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:11.197563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1149d2c9-afe7-430c-adc2-8204a1545048 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417273c940>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:11.306544 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1149d2c9-afe7-430c-adc2-8204a1545048 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.121681 Oct 01 20:57:11.307630 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1081/2096] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:11 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:11.324727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fb82c3b0-902e-4da5-9a93-3772caf4fd73 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:11.327942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fb82c3b0-902e-4da5-9a93-3772caf4fd73 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:11.540221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fb82c3b0-902e-4da5-9a93-3772caf4fd73 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:11.554554 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fb82c3b0-902e-4da5-9a93-3772caf4fd73 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1277 microversion: 2.1 time: 0.245399 Oct 01 20:57:11.555352 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1082/2097] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:11 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:11.598056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:11.599465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:11.620713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:11.621237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:11.621690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:11.622438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:11.635687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:11.636668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:11.658897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:11.678649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:11.696304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:11.697611 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-116f703c-1a8b-445c-85e3-7574625cb79b tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2913 microversion: 2.42 time: 0.999070 Oct 01 20:57:11.698183 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1016/2098] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:10 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2913 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:11.729263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:11.729886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:11.753530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:11.759901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:11.760403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:11.761250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:11.761831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:11.772990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.184813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:12.195575 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c880535b-49a2-48b7-b340-38cc9ca1fcfb tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1322 microversion: 2.1 time: 0.624810 Oct 01 20:57:12.196809 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1083/2099] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:11 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:12.202749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-40c786df-302a-4b4b-ad67-c01864c5c73d req-46116511-21b2-4b4f-a837-b82c9e831227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-deleted", "tag": "f09e681e-660d-4b59-82a1-b74fb5573e9e"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:12.222312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-40c786df-302a-4b4b-ad67-c01864c5c73d req-46116511-21b2-4b4f-a837-b82c9e831227 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:12.223375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-40c786df-302a-4b4b-ad67-c01864c5c73d req-46116511-21b2-4b4f-a837-b82c9e831227 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:12.226115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-40c786df-302a-4b4b-ad67-c01864c5c73d req-46116511-21b2-4b4f-a837-b82c9e831227 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.243678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:12.244479 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-40c786df-302a-4b4b-ad67-c01864c5c73d req-46116511-21b2-4b4f-a837-b82c9e831227 service nova] Creating event network-vif-deleted:f09e681e-660d-4b59-82a1-b74fb5573e9e for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:12.251914 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-40c786df-302a-4b4b-ad67-c01864c5c73d req-46116511-21b2-4b4f-a837-b82c9e831227 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052871 Oct 01 20:57:12.253283 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1084/2100] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:12.256394 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88dc98bc-a289-4c1a-ab1d-4a05aaaa22bf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1471 microversion: 2.1 time: 0.531182 Oct 01 20:57:12.259894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:12.261245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:12.271807 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1017/2101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:11 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1471 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:12.273816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:12.274801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:12.275729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.276364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:12.277078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:12.277760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.284204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:12.286038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:12.302344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:12.303088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:12.303716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.304615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:12.305249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:12.306210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.463519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:12.535680 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cc8e3ee0-2f4d-4005-8bd9-bce261d5d3bf tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.280888 Oct 01 20:57:12.537714 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1085/2102] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:12 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:12.544517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-69d41da5-ed75-4b47-9778-da5393f13109 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41726e2dc0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:12.547101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:12.574328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:12.575864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:12.579257 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77f82339-a54f-4dd0-bdd3-c663313cd7b8 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.306348 Oct 01 20:57:12.579844 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1018/2103] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:12 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:12.603315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:12.603959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:12.621025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:12.622217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:12.622708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.623425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:12.625471 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-69d41da5-ed75-4b47-9778-da5393f13109 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.086402 Oct 01 20:57:12.626092 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1086/2104] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:12 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:12.627178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:12.629605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.746898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:12.748020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:12.758214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:12.762851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:12.763724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.764742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:12.765457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:12.766142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:12.840181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:12.843874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:12.862014 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-952101a1-3e18-477d-a29a-59bc2f4fece9 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1329 microversion: 2.1 time: 0.273250 Oct 01 20:57:12.867288 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1019/2105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:12 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1329 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:13.018218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-40fff8dd-a6d0-408a-9008-c5c9641b449f req-a88783e5-3333-4db8-9003-7d2fab110ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-unplugged", "status": "completed", "tag": "f09e681e-660d-4b59-82a1-b74fb5573e9e"}, {"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-unplugged", "status": "completed", "tag": "3c68fc4b-2f4b-4e13-93c2-8872ece1ad74"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:13.052883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-40fff8dd-a6d0-408a-9008-c5c9641b449f req-a88783e5-3333-4db8-9003-7d2fab110ddc service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.053483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-40fff8dd-a6d0-408a-9008-c5c9641b449f req-a88783e5-3333-4db8-9003-7d2fab110ddc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.054015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-40fff8dd-a6d0-408a-9008-c5c9641b449f req-a88783e5-3333-4db8-9003-7d2fab110ddc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.084362 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-40fff8dd-a6d0-408a-9008-c5c9641b449f req-a88783e5-3333-4db8-9003-7d2fab110ddc service nova] Creating event network-vif-unplugged:f09e681e-660d-4b59-82a1-b74fb5573e9e for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:13.087804 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-40fff8dd-a6d0-408a-9008-c5c9641b449f req-a88783e5-3333-4db8-9003-7d2fab110ddc service nova] Creating event network-vif-unplugged:3c68fc4b-2f4b-4e13-93c2-8872ece1ad74 for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:13.095056 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-40fff8dd-a6d0-408a-9008-c5c9641b449f req-a88783e5-3333-4db8-9003-7d2fab110ddc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.081137 Oct 01 20:57:13.102555 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1020/2106] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:13.224213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:13.225362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:13.241674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.242652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.243213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.244067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.247034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.248080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.316267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:13.333150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:13.340274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:13.341469 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2f429622-b322-4871-be70-edac40956923 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2707 microversion: 2.42 time: 0.613166 Oct 01 20:57:13.355208 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1087/2107] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:12 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2707 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:13.372299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:13.375149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:13.391089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.393848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.394711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.396374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.397088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.397754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.446176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:13.577966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:13.586532 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2ffaa679-e287-4996-bb1d-c4e944f80f5f tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1322 microversion: 2.1 time: 0.367918 Oct 01 20:57:13.587122 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1021/2108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:13 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:13.596517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:13.597410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:13.606741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.607465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.608073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.609079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.609704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.610308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.780407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:13.788665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:13.791654 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-abfbf356-c57f-4f92-a319-8c34018ce21d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1471 microversion: 2.1 time: 0.435265 Oct 01 20:57:13.802883 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1088/2109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:13 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1471 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:13.807787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:13.808410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:13.822058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.822642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.823091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.824627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.825683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.825844 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e8ba9490-c833-4acd-bd36-12efc4f32a62 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1929 microversion: 2.75 time: 0.233542 Oct 01 20:57:13.827341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.830033 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1022/2110] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:13 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1929 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:13.834897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c3595169-861b-4af9-8265-7cca650b0143 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4173beec10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:13.909556 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c3595169-861b-4af9-8265-7cca650b0143 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.075797 Oct 01 20:57:13.920413 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1023/2111] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:13 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:13.928926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:13.930418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:13.938693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:13.943812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.944640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.945268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:13.946230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:13.946924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:13.947555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:14.006719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:14.015486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:14.016936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:14.018238 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-15272cfd-d88e-48ec-9a8b-d0b09900c923 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.214263 Oct 01 20:57:14.027133 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1089/2112] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:13 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:14.054302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:14.063573 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc12eab5-2fef-4194-af19-0d12464840a1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1335 microversion: 2.1 time: 0.141112 Oct 01 20:57:14.065279 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1024/2113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:13 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1335 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:14.377691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:14.378844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:14.392580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:14.401476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:14.402658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:14.403826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:14.404698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:14.405402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:14.636381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:14.637427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:14.655736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:14.656252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:14.656697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:14.657800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:14.662312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:14.663031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:15.133282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:15.148384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:15.150167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:15.156447 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-070c9866-1a56-4a96-b056-9c61fc56ba0e tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2707 microversion: 2.42 time: 0.784627 Oct 01 20:57:15.157695 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1090/2114] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:14 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2707 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:15.167721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-44219a5f-7521-47c3-8b1b-257aaa96c602 req-bb150ebb-a1d4-4ccb-9b33-ab7100432912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-deleted", "tag": "3c68fc4b-2f4b-4e13-93c2-8872ece1ad74"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:15.191353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-44219a5f-7521-47c3-8b1b-257aaa96c602 req-bb150ebb-a1d4-4ccb-9b33-ab7100432912 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:15.203288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-44219a5f-7521-47c3-8b1b-257aaa96c602 req-bb150ebb-a1d4-4ccb-9b33-ab7100432912 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:15.203789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-44219a5f-7521-47c3-8b1b-257aaa96c602 req-bb150ebb-a1d4-4ccb-9b33-ab7100432912 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:15.227024 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-44219a5f-7521-47c3-8b1b-257aaa96c602 req-bb150ebb-a1d4-4ccb-9b33-ab7100432912 service nova] Creating event network-vif-deleted:3c68fc4b-2f4b-4e13-93c2-8872ece1ad74 for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:15.253732 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-44219a5f-7521-47c3-8b1b-257aaa96c602 req-bb150ebb-a1d4-4ccb-9b33-ab7100432912 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094532 Oct 01 20:57:15.254353 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1091/2115] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:15.269466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:15.270184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:15.289365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:15.294812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:15.296005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:15.297434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:15.298085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:15.298738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:15.540865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:15.563479 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3954c618-c4b2-4366-9fce-7b7342ea4c09 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1322 microversion: 2.1 time: 0.947449 Oct 01 20:57:15.580766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1025/2116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:14 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1322 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:15.590898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:15.591523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:15.611258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:15.611782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:15.612241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:15.613004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:15.613473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:15.618199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:15.942477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:16.000642 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64fdb8a6-4371-4be5-9d54-a81ad6742f5b tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1935 microversion: 2.75 time: 0.418356 Oct 01 20:57:16.001965 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1026/2117] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:15 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1935 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:16.009747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e704d36b-51bf-4d68-9dc8-e4c3d0676f3c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417c1eb700>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:16.117584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e704d36b-51bf-4d68-9dc8-e4c3d0676f3c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1438 microversion: 2.1 time: 0.114161 Oct 01 20:57:16.120793 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1027/2118] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:16 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1438 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:16.132108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:16.133031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:16.142854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:16.143709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:16.144447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:16.147287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:16.150709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:16.151521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:16.298281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:16.304044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:16.324792 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5ded7624-892a-4af5-9957-be69bb895158 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1471 microversion: 2.1 time: 1.067400 Oct 01 20:57:16.328085 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1092/2119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:15 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1471 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:16.329904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:16.334150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:16.338064 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a61fedd4-42e9-4a96-a77b-5653cd6d9172 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.212557 Oct 01 20:57:16.350515 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1028/2120] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:16 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:16.350753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:16.350753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:16.357610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1a2e912f-c961-465d-8797-e96df0559b35 req-84148447-86d6-419b-9b45-516f2c7b51ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f4a750-e707-4f90-b122-d4e1a9167098", "name": "network-vif-plugged", "status": "completed", "tag": "7fe80183-4a7b-4b15-a597-99ffb47ba445"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:16.360484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:16.360999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:16.361719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:16.362649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:16.363236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:16.363550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:16.366262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a2e912f-c961-465d-8797-e96df0559b35 req-84148447-86d6-419b-9b45-516f2c7b51ae service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:16.367231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a2e912f-c961-465d-8797-e96df0559b35 req-84148447-86d6-419b-9b45-516f2c7b51ae service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:16.367979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a2e912f-c961-465d-8797-e96df0559b35 req-84148447-86d6-419b-9b45-516f2c7b51ae service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:16.383138 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1a2e912f-c961-465d-8797-e96df0559b35 req-84148447-86d6-419b-9b45-516f2c7b51ae service nova] Creating event network-vif-plugged:7fe80183-4a7b-4b15-a597-99ffb47ba445 for instance 46f4a750-e707-4f90-b122-d4e1a9167098 on nch1-master-1 Oct 01 20:57:16.388560 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1a2e912f-c961-465d-8797-e96df0559b35 req-84148447-86d6-419b-9b45-516f2c7b51ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041951 Oct 01 20:57:16.389858 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1029/2121] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:16.397521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:16.398417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:16.405045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:16.405640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:16.406162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:16.407013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:16.407620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:16.408127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:16.927856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:16.936796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:16.951478 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fb87ee16-b9dc-48b2-91d4-38d18b85ffe7 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1402 microversion: 2.1 time: 0.621601 Oct 01 20:57:16.952422 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1093/2122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:16 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1402 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:16.956840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:16.957179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a89191e8-9003-4c3c-bcdd-6bf87fb591f2 req-54a34850-36d6-4011-ae06-fa8d9efda42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f5ad45-c060-47b7-9ec8-1c1dd15231b3", "tag": "6d7c99e5-4b66-4d43-879f-9bad18c158fe"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:16.963776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:16.966193 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc7f49e7-05e3-4c2c-a9b3-37f3fb3be555 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2593 microversion: 2.42 time: 0.574781 Oct 01 20:57:16.969097 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1030/2123] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:16 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2593 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:16.986543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a89191e8-9003-4c3c-bcdd-6bf87fb591f2 req-54a34850-36d6-4011-ae06-fa8d9efda42a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:16.987166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:16.987521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a89191e8-9003-4c3c-bcdd-6bf87fb591f2 req-54a34850-36d6-4011-ae06-fa8d9efda42a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:16.987834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:16.988332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a89191e8-9003-4c3c-bcdd-6bf87fb591f2 req-54a34850-36d6-4011-ae06-fa8d9efda42a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.001073 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a89191e8-9003-4c3c-bcdd-6bf87fb591f2 req-54a34850-36d6-4011-ae06-fa8d9efda42a service nova] Creating event network-changed:6d7c99e5-4b66-4d43-879f-9bad18c158fe for instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 on nch1-master-1 Oct 01 20:57:17.001320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:17.001777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:17.002296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.003168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:17.003642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:17.005062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.017259 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a89191e8-9003-4c3c-bcdd-6bf87fb591f2 req-54a34850-36d6-4011-ae06-fa8d9efda42a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063570 Oct 01 20:57:17.020898 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1094/2124] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:17.032408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:17.033467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:17.055001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:17.055856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:17.056526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.057480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:17.058143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:17.058799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.204644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:17.251324 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-63cb6de7-6f40-4c88-ad29-10bbd6bfc4f0 tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1935 microversion: 2.75 time: 0.220736 Oct 01 20:57:17.252268 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1095/2125] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:17 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1935 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:57:17.263170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ec11d29b-8fba-471e-8648-9df78af2e323 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417267db80>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:17.356483 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ec11d29b-8fba-471e-8648-9df78af2e323 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1447 microversion: 2.1 time: 0.099109 Oct 01 20:57:17.357305 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1096/2126] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:17 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:17.367446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-049c114f-7a85-46fa-8960-a5e2b3c22601 req-3bcf742a-7a0b-481d-bb4c-f11ee4f4bd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-deleted", "tag": "8e13aabc-dce0-48f9-99b6-bb6839ff32cf"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:17.389898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-049c114f-7a85-46fa-8960-a5e2b3c22601 req-3bcf742a-7a0b-481d-bb4c-f11ee4f4bd6b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:17.390473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-049c114f-7a85-46fa-8960-a5e2b3c22601 req-3bcf742a-7a0b-481d-bb4c-f11ee4f4bd6b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:17.390933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-049c114f-7a85-46fa-8960-a5e2b3c22601 req-3bcf742a-7a0b-481d-bb4c-f11ee4f4bd6b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.423052 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-049c114f-7a85-46fa-8960-a5e2b3c22601 req-3bcf742a-7a0b-481d-bb4c-f11ee4f4bd6b service nova] Creating event network-vif-deleted:8e13aabc-dce0-48f9-99b6-bb6839ff32cf for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:17.443083 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-049c114f-7a85-46fa-8960-a5e2b3c22601 req-3bcf742a-7a0b-481d-bb4c-f11ee4f4bd6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081851 Oct 01 20:57:17.443717 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1097/2127] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:17.449183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:17.453437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:17.463621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:17.464427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:17.465346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.466330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:17.467052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:17.467701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.513264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:17.528276 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c5a33f8e-b34c-4a6b-b74f-04f2ce01da57 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1322 microversion: 2.1 time: 0.555954 Oct 01 20:57:17.529060 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1031/2128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:16 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:17.533780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8d9ecae0-b031-41ba-84a0-f50e743c8073 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417c29ad30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:17.608150 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8d9ecae0-b031-41ba-84a0-f50e743c8073 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 200 len: 1447 microversion: 2.1 time: 0.078033 Oct 01 20:57:17.609406 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1032/2129] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:17 2022] GET /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 1447 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:17.622781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:17.624027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:17.630333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:17.631027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:17.631545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.632334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:17.632871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:17.633504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:17.759012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:17.768725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:17.771548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:17.772744 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-59ab5cfb-ff9b-4a35-86e2-297eced07bd9 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.162130 Oct 01 20:57:17.773355 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1033/2130] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:17 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:17.778202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fde15e23-fe54-4d06-b605-11112b9ecdc6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417c29ad30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:17.980229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:17.988267 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0871c390-e798-4150-bb0a-b41d3b3b5152 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1471 microversion: 2.1 time: 0.543172 Oct 01 20:57:18.012612 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1098/2131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:17 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1471 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:18.017961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:18.018726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:18.025166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:18.025803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:18.026545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:18.027534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:18.028102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:18.028639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:18.029449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=5 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:18.328574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:18.337437 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0dc70b1d-134e-4a5a-b22e-fe2a5f06e8f4 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1402 microversion: 2.1 time: 0.323537 Oct 01 20:57:18.338516 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1099/2132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:18 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1402 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:18.343557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:18.344311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:18.351178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:18.352026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:18.352709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:18.353659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:18.354348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:18.355092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:18.404754 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fde15e23-fe54-4d06-b605-11112b9ecdc6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 204 len: 0 microversion: 2.1 time: 0.630278 Oct 01 20:57:18.405333 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1034/2133] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:17 2022] DELETE /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:57:18.410359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:18.411569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:18.421702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:18.422679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:18.423410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:18.424379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:18.425043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:18.425729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:18.887032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] Lazy-loading 'services' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:18.923272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82b8fcd0-d911-4c14-9ab0-8336b00191fb tempest-ServersAdmin275Test-99766090 tempest-ServersAdmin275Test-99766090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1920 microversion: 2.75 time: 0.515886 Oct 01 20:57:18.924899 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1035/2134] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:18 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1920 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:18.930816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:18.932249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:18.940081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:18.941018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:18.941676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:18.942685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:18.943337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:18.944073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:19.002003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:57:19.016009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:19.031855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:19.035113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:19.050767 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a87f681a-e92c-4f2c-b972-712bea942362 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2435 microversion: 2.42 time: 0.697078 Oct 01 20:57:19.067559 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1100/2135] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:18 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2435 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:19.085370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:19.086675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:19.094116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:19.094921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:19.095566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:19.096608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:19.097511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:19.098400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:19.151164 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c818b612-ffe1-4129-8cc4-b991f3dd8437 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 204 len: 0 microversion: 2.1 time: 0.224595 Oct 01 20:57:19.155262 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1036/2136] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:57:18 2022] DELETE /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:57:19.169596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:19.170307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:19.176686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:19.177176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:19.177614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:19.178322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:19.178800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:19.179225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:19.325762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:19.336559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:19.340922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:19.343208 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f3b57227-0b44-4fd5-9e19-ea8998e82f76 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.178073 Oct 01 20:57:19.344955 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1037/2137] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:19 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:19.352809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:19.353591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:19.362580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:19.363347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:19.364620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:19.365548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:19.366212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:19.366755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:19.403462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:57:19.445551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:19.456007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:19.469494 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-277fad24-a3a4-41d6-9011-4e74e9b52f40 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1472 microversion: 2.1 time: 0.400043 Oct 01 20:57:19.489544 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1101/2138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:19 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:19.498049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:19.499067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:19.519398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:19.520891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:19.521731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:19.523471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:19.524383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:19.527132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:19.539937 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6b86f7cf-f07f-4dbf-85d0-7d600e6d1989 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 204 len: 0 microversion: 2.75 time: 0.193203 Oct 01 20:57:19.540548 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1038/2139] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:57:19 2022] DELETE /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:57:19.551602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1152504704", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "00c1b669-0633-4d9a-bca2-2a3af62ab8df"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:19.647591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] validate_networks() for [('00c1b669-0633-4d9a-bca2-2a3af62ab8df', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:57:20.131631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:20.143539 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a38d5593-2f64-498f-9fac-b562df303501 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1471 microversion: 2.1 time: 0.652185 Oct 01 20:57:20.144426 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1102/2140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:19 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1471 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:20.155908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:20.157747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:20.168406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.168910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.169358 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.170097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.170597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.171035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.441330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:20.456814 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-72386dfb-86ff-4d5f-8f0e-830fccb361ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1402 microversion: 2.1 time: 0.308982 Oct 01 20:57:20.472635 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1103/2141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:20 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1402 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:20.483123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:20.483778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:20.492484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.493602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.494067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.495541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.496933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.497272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.543227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Request method failure captured: Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098/diagnostics HTTP/1.1 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKmc9iGc6dU9peVUB-omqS8w9IPNSEq82S9XegPM-GQSkFor52sVc7EXUj_O-8B26hm-ZG-m18lPwdzjgOmPpLB0OjUJV7EOpKOoFys5l-PrrFan-YynsLQ8r5UAFZ2bejb-qYs5WGocR3Eyp4puOThF4VpR4GmhamaGqYdLic-wE_o Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ff3a0720d242499694d57ffe3b405f21 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1074239142 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff3a0720d242499694d57ffe3b405f21", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff3a0720d242499694d57ffe3b405f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff3a0720d242499694d57ffe3b405f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff3a0720d242499694d57ffe3b405f21"}]}] Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1074239142 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ff3a0720d242499694d57ffe3b405f21 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1074239142 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerDiagnosticsNegativeTest-1074239142-project Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 00d15c074f9344b2b2b5df4411df66d1 Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1074239142-project Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'server_id': '46f4a750-e707-4f90-b122-d4e1a9167098'} Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:20.546656 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:20.554434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:20.554434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:20.554434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:57:20.554434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:57:20.554434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 01 20:57:20.554434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:20.597945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:20.597945 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-53fc56aa-12bf-4b5e-848d-68dcdc1ee1ed tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.086207 Oct 01 20:57:20.597945 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1104/2142] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 20:57:20 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098/diagnostics => generated 117 bytes in 88 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:57:20.599003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=21 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:20.599925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:20.599925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:20.603728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=96 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:20.618578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.619088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.619531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.620256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.620722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.621151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.736585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:20.747165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:20.748798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:20.763788 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-45414429-946b-4b74-998c-a7543251c7c7 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1444 microversion: 2.75 time: 0.193684 Oct 01 20:57:20.765162 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1105/2143] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:20 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1444 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:20.784010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-fa665ada-414e-402f-8d25-de68b7eb8589 req-998c0f27-0068-4d5f-a9c5-bf0c8928b9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-deleted", "tag": "e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:20.811788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fa665ada-414e-402f-8d25-de68b7eb8589 req-998c0f27-0068-4d5f-a9c5-bf0c8928b9a3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.812474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fa665ada-414e-402f-8d25-de68b7eb8589 req-998c0f27-0068-4d5f-a9c5-bf0c8928b9a3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.813758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fa665ada-414e-402f-8d25-de68b7eb8589 req-998c0f27-0068-4d5f-a9c5-bf0c8928b9a3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.816189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:57:20.817729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:57:20.818285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:57:20.819426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:57:20.820267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:57:20.830321 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-fa665ada-414e-402f-8d25-de68b7eb8589 req-998c0f27-0068-4d5f-a9c5-bf0c8928b9a3 service nova] Creating event network-vif-deleted:e0b5e42d-c300-416c-84c4-9aa1f0f5c8ba for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:20.836914 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-fa665ada-414e-402f-8d25-de68b7eb8589 req-998c0f27-0068-4d5f-a9c5-bf0c8928b9a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067451 Oct 01 20:57:20.838007 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1106/2144] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:20.844200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:20.845028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:20.852107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.852606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.853520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.853756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.854268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.854684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.857259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.860787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.861586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.862455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:20.865622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:20.866085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:20.899652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Getting quotas for project 9c0b38cea2c345c68c51c4d8cb9c07e7. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:57:20.906719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Getting quotas for user 1d180849a694494e89843c0c315acd6d and project 9c0b38cea2c345c68c51c4d8cb9c07e7. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:57:20.925346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:57:20.933079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:57:20.994550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:21.018173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:21.031022 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7cdc5b0-1db0-4357-be1f-a822a42ba19b tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.486238 Oct 01 20:57:21.032718 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1039/2145] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:57:21.042792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:21.043759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:21.061406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:21.063485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.064177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.064767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.065345 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0bf793c6-9672-4062-b478-5ce29342e65c tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 2322 microversion: 2.42 time: 0.225008 Oct 01 20:57:21.065649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.066113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.066413 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1107/2146] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:20 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 2322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:21.066990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.081128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:21.085794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:21.094567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.095127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.095645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.096374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.096832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.097258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.142276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:57:21.147994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:21.248646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:21.267235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:21.274254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:21.275699 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7adbf120-36fd-4a72-b2a9-230ae4d0c11e tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.241874 Oct 01 20:57:21.286585 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1040/2147] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:21 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:21.291710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-81bd655c-90d0-47ea-830d-24b58aad3ce6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:21.292333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-81bd655c-90d0-47ea-830d-24b58aad3ce6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:21.397260 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-98e1e4ef-9077-48ff-875b-faf34b392168 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "DELETE /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 204 len: 0 microversion: 2.1 time: 0.326683 Oct 01 20:57:21.403005 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1108/2148] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:57:21 2022] DELETE /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:57:21.418302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:21.419175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:21.445496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.446012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.446460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.449437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.450101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.450570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.480879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-81bd655c-90d0-47ea-830d-24b58aad3ce6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:21.494875 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-81bd655c-90d0-47ea-830d-24b58aad3ce6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1208 microversion: 2.1 time: 0.202961 Oct 01 20:57:21.496201 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1041/2149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:21 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1208 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:21.501608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-bdcd0e86-2a1a-41ed-b245-9013dbf3aa6c req-a9bbff00-d364-4c24-a00d-1d5a80bd2eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f5ad45-c060-47b7-9ec8-1c1dd15231b3", "name": "network-vif-plugged", "status": "completed", "tag": "6d7c99e5-4b66-4d43-879f-9bad18c158fe"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:21.523113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bdcd0e86-2a1a-41ed-b245-9013dbf3aa6c req-a9bbff00-d364-4c24-a00d-1d5a80bd2eb9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.527812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bdcd0e86-2a1a-41ed-b245-9013dbf3aa6c req-a9bbff00-d364-4c24-a00d-1d5a80bd2eb9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.528489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bdcd0e86-2a1a-41ed-b245-9013dbf3aa6c req-a9bbff00-d364-4c24-a00d-1d5a80bd2eb9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.550531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=80 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:21.578132 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-bdcd0e86-2a1a-41ed-b245-9013dbf3aa6c req-a9bbff00-d364-4c24-a00d-1d5a80bd2eb9 service nova] Creating event network-vif-plugged:6d7c99e5-4b66-4d43-879f-9bad18c158fe for instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 on nch1-master-1 Oct 01 20:57:21.591416 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-bdcd0e86-2a1a-41ed-b245-9013dbf3aa6c req-a9bbff00-d364-4c24-a00d-1d5a80bd2eb9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093643 Oct 01 20:57:21.592677 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1042/2150] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:21.604958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:21.606442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:21.619511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.620341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.623645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.624683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.625364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.626024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.835737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:21.847712 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b5c68623-f4d2-4288-a925-822a4f37bbd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1471 microversion: 2.1 time: 0.444923 Oct 01 20:57:21.849173 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1109/2151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:21 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1471 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:21.855025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:21.856106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:21.862077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.862604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.863342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.864307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:21.865175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:21.865497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:21.946581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:21.961754 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99bd9267-dc24-4db5-83f6-1da9af059700 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1478 microversion: 2.1 time: 0.367641 Oct 01 20:57:21.972135 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1043/2152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:21 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1478 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:21.984470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:21.985455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:22.001837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.003518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.006273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.009015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.011023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.012497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.131597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.132319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.132912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.134575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lazy-loading 'fault' on Instance uuid 5df07dcf-c30a-43cf-9e67-279f8d408ea5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:22.226311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.251271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.252979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da040526fe7b490784ea27f2572f0b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9e92bfb756442983da09a9adfe2e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.267881 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f769d28-9885-404c-ae14-7c6b311b5034 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 200 len: 1449 microversion: 2.75 time: 0.293377 Oct 01 20:57:22.268762 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1044/2153] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:21 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 1449 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:22.293887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.295744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:22.296654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:22.308981 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3e20c173-2437-4c56-bcf8-f340338f0a42 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1402 microversion: 2.1 time: 0.452508 Oct 01 20:57:22.309527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.309705 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1110/2154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:21 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1402 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:22.310863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.311547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.312788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.313478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.314116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.319203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:22.326530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:22.340687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.341183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.341617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.342333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.342817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.343244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.375701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.377994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.378776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.379731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lazy-loading 'fault' on Instance uuid 57e9d6a4-ef78-4649-883a-c2d1869c8131 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:22.562604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.577436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.580496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.581949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa4f468a15546eb9f72cb2b632e67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb36a4c325b54c8a964113ba5e52f47b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.583768 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2461fd91-8dbf-44b7-bf2f-d76c904db591 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 200 len: 1609 microversion: 2.42 time: 0.313008 Oct 01 20:57:22.586886 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1045/2155] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:22 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 1609 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:22.591698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-36a2824f-dd6c-4fa3-a124-8f0212b62132 req-ee1d33f3-dee1-4f6d-99c1-425c69800561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a034bac-1433-439f-8bd0-f22a00cb0e32", "name": "network-vif-deleted", "tag": "13fbc280-9adc-4f57-960d-1b77f52e9e08"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:22.598309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.600409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.601956 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f6891b4b-9f3f-42b6-82f3-d71b3b398d36 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.291312 Oct 01 20:57:22.613948 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1111/2156] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:22 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:22.626721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-36a2824f-dd6c-4fa3-a124-8f0212b62132 req-ee1d33f3-dee1-4f6d-99c1-425c69800561 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.627493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:22.628182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:22.631151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-36a2824f-dd6c-4fa3-a124-8f0212b62132 req-ee1d33f3-dee1-4f6d-99c1-425c69800561 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.631807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-36a2824f-dd6c-4fa3-a124-8f0212b62132 req-ee1d33f3-dee1-4f6d-99c1-425c69800561 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.643363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.643867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.644318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.645581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.649110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.649727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.674219 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-36a2824f-dd6c-4fa3-a124-8f0212b62132 req-ee1d33f3-dee1-4f6d-99c1-425c69800561 service nova] Creating event network-vif-deleted:13fbc280-9adc-4f57-960d-1b77f52e9e08 for instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 on nch1-master-1 Oct 01 20:57:22.703179 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-36a2824f-dd6c-4fa3-a124-8f0212b62132 req-ee1d33f3-dee1-4f6d-99c1-425c69800561 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114424 Oct 01 20:57:22.703927 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1046/2157] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:22.789661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:22.804789 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-751c3d59-463c-45ea-84fd-589ccf49aae7 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1212 microversion: 2.1 time: 0.189494 Oct 01 20:57:22.805765 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1112/2158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:22 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1212 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:22.867180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b66bc715-88e1-4462-976d-c335906c1c08 req-f3882010-8d1e-4a3a-b4a1-871aafba59a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e9d6a4-ef78-4649-883a-c2d1869c8131", "name": "network-vif-deleted", "tag": "e3c20a77-5ca5-4d7e-9621-467c8ec0eded"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:22.885773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:22.887934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:22.909673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.912343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.912580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b66bc715-88e1-4462-976d-c335906c1c08 req-f3882010-8d1e-4a3a-b4a1-871aafba59a2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.912811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.913091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b66bc715-88e1-4462-976d-c335906c1c08 req-f3882010-8d1e-4a3a-b4a1-871aafba59a2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.914689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b66bc715-88e1-4462-976d-c335906c1c08 req-f3882010-8d1e-4a3a-b4a1-871aafba59a2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.914872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:22.916522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:22.917007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:22.956403 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b66bc715-88e1-4462-976d-c335906c1c08 req-f3882010-8d1e-4a3a-b4a1-871aafba59a2 service nova] Creating event network-vif-deleted:e3c20a77-5ca5-4d7e-9621-467c8ec0eded for instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 on nch2-master-1 Oct 01 20:57:22.973748 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b66bc715-88e1-4462-976d-c335906c1c08 req-f3882010-8d1e-4a3a-b4a1-871aafba59a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118576 Oct 01 20:57:22.977271 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1047/2159] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:23.001747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:23.002813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:23.022388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.023393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.023866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.040197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.043592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.044352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.282155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:23.292438 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f01cf800-0fcd-4a01-bc98-a0e68dfcf199 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1471 microversion: 2.1 time: 0.422571 Oct 01 20:57:23.293450 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1113/2160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:22 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:23.311188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:23.312613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] [instance: 5df07dcf-c30a-43cf-9e67-279f8d408ea5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:23.319801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.320447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.320995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.337736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.340598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.347424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.389353 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] HTTP exception thrown: Instance 5df07dcf-c30a-43cf-9e67-279f8d408ea5 could not be found. Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Request method failure captured: Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 HTTP/1.1 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKlimwKIT5DBhjsBOdKtO8gL6JUgKiRh55g4ihLi1CuuAnqxsuNowx4L_DtUm-wYp9tCtOn4MHGsMPlXnDrXynd1QUIsbczyiAHdS84mHCAOYnsK8OES9hcWiTsmFZLedok9tl0Dm3D8n9NMMGQ4vkJcmksNPqxVe3UsBIh2zj0Lyj4 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Openstack-Nova-Api-Version: 2.75 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 6f9e92bfb756442983da09a9adfe2e88 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersAdmin275Test-656635453 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f9e92bfb756442983da09a9adfe2e88", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f9e92bfb756442983da09a9adfe2e88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f9e92bfb756442983da09a9adfe2e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f9e92bfb756442983da09a9adfe2e88"}]}] Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersAdmin275Test-656635453 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 6f9e92bfb756442983da09a9adfe2e88 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersAdmin275Test-656635453 Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersAdmin275Test-656635453-project Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: da040526fe7b490784ea27f2572f0b7b Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersAdmin275Test-656635453-project Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 5df07dcf-c30a-43cf-9e67-279f8d408ea5 could not be found. Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '5df07dcf-c30a-43cf-9e67-279f8d408ea5'} Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5df07dcf-c30a-43cf-9e67-279f8d408ea5 could not be found. Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5df07dcf-c30a-43cf-9e67-279f8d408ea5 could not be found. Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:23.391335 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.394458 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:23.394458 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:23.394458 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:23.394458 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:23.394458 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:23.394458 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5df07dcf-c30a-43cf-9e67-279f8d408ea5 could not be found. Oct 01 20:57:23.394458 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.396908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:23.397857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] Returning 404 to user: Instance 5df07dcf-c30a-43cf-9e67-279f8d408ea5 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:23.403141 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4297241f-0135-481a-bdd6-465b43ffe967 tempest-ServersAdmin275Test-656635453 tempest-ServersAdmin275Test-656635453-project] 10.222.0.17 "GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5" status: 404 len: 111 microversion: 2.75 time: 0.093344 Oct 01 20:57:23.404300 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1114/2161] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:23 2022] GET /compute/v2.1/servers/5df07dcf-c30a-43cf-9e67-279f8d408ea5 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 01 20:57:23.412469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:23.413449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:23.421270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.421652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.422165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.423068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.423645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.424035 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-173fb4e1-75e5-446b-ae4e-0f9e5c736b96 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1478 microversion: 2.1 time: 0.429247 Oct 01 20:57:23.424291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.449807 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1048/2162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:22 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1478 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:23.622110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:23.623023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:23.631919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.634000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.634446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.639605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.640247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.640875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.680676 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] HTTP exception thrown: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Request method failure captured: Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 HTTP/1.1 Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKgpvBvQOIlwZbzzSOJS1819rWMaT9csG6VQ_fO7T7_g2GkdljxCTqAv0VTG8o5zrhkdft-X1f8fjmk2G6mFZIjiKAlJbPsKHiYkn1BF1t6Gov5Ze5mUKbKYQrBZme6mSpW8XZ772aB1c9dtNxaYv5qWdI1qutVXpftlEfF9RGFlBYk Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.42 Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bb36a4c325b54c8a964113ba5e52f47b Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-711726808 Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb36a4c325b54c8a964113ba5e52f47b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb36a4c325b54c8a964113ba5e52f47b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb36a4c325b54c8a964113ba5e52f47b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb36a4c325b54c8a964113ba5e52f47b"}]}] Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TaggedBootDevicesTest_v242-711726808 Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bb36a4c325b54c8a964113ba5e52f47b Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-711726808 Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TaggedBootDevicesTest_v242-711726808-project Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 2aa4f468a15546eb9f72cb2b632e67bb Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TaggedBootDevicesTest_v242-711726808-project Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '57e9d6a4-ef78-4649-883a-c2d1869c8131'} Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.682374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Returning 404 to user: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-46565870-2d59-4020-9ead-a90b935712c4 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 404 len: 111 microversion: 2.42 time: 0.068383 Oct 01 20:57:23.686160 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1049/2163] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:23 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:23.705169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:23.705898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:23.718592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.719101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.719664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.720719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.721180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.722395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.773448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:23.782050 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-34c6d6e9-c2f9-4d7f-9e80-01b9753dcbe1 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1402 microversion: 2.1 time: 0.376372 Oct 01 20:57:23.783090 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1115/2164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:23 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1402 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:23.793364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dcfc0bb7-e28b-4801-b384-fae2b0b2a4d2 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '.version_select at 0x7f41726d6af0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:23.817966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:23.843051 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dcfc0bb7-e28b-4801-b384-fae2b0b2a4d2 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367473008" status: 204 len: 0 microversion: 2.42 time: 0.058390 Oct 01 20:57:23.843604 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1116/2165] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 20:57:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367473008 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:57:23.855959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:23.857001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:23.861123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:23.870318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.870523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:23.873669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.875288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:23.875872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.877996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:23.878896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:23.879964 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f078263-9c67-4016-a149-56131dcc0a00 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.189865 Oct 01 20:57:23.881115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:23.881807 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1050/2166] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:23 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:24.107701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:24.126384 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-68c561eb-3be7-4649-b0f1-67242107a0a2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1260 microversion: 2.1 time: 0.274050 Oct 01 20:57:24.128829 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1117/2167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:23 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:24.317490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1126173828", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "475bb209-9eac-4ec5-b531-e4aad4866b2a"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:24.321355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:24.322299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:24.338930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:24.339547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:24.340010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:24.340865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:24.348763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:24.352000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:24.419233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] validate_networks() for [('475bb209-9eac-4ec5-b531-e4aad4866b2a', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:57:25.448316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:25.462348 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1d014665-05f3-44ad-9267-3a906ba994cc tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1471 microversion: 2.1 time: 1.148082 Oct 01 20:57:25.462969 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1118/2168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:24 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1471 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:25.483103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:25.483893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:25.491000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:25.491789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:25.492463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:25.493334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:25.494002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:25.494599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:25.539783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:25.540546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:25.541280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:25.542001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lazy-loading 'fault' on Instance uuid 46f4a750-e707-4f90-b122-d4e1a9167098 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:25.720975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d15c074f9344b2b2b5df4411df66d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0720d242499694d57ffe3b405f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:25.744049 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b761b0f-6d69-4fe1-8789-93ec7dfbba2e tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 200 len: 1312 microversion: 2.1 time: 0.261198 Oct 01 20:57:25.756747 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1119/2169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:25 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:25.776005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:25.777062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:25.786670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:25.787563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:25.788206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:25.789391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:25.790006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:25.791416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.276923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:26.284942 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-33495b14-b2d3-4186-9387-784f522591e5 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1589 microversion: 2.1 time: 0.519516 Oct 01 20:57:26.286317 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1120/2170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:25 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1589 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:26.292033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:26.293044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:26.300006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.300502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.300937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.301831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.302458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.303047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.419384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:26.432403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:26.434798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:26.436955 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4ce49e18-f0bc-4248-adc8-15e53c6ef5af tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.149451 Oct 01 20:57:26.438534 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1121/2171] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:26 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:26.444748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-5f0f9544-0672-4d9e-a71c-46d92e95b21d req-3bb9a3cc-151b-4604-9e15-3eb40263df9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f4a750-e707-4f90-b122-d4e1a9167098", "name": "network-vif-deleted", "tag": "7fe80183-4a7b-4b15-a597-99ffb47ba445"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:26.458075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5f0f9544-0672-4d9e-a71c-46d92e95b21d req-3bb9a3cc-151b-4604-9e15-3eb40263df9e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.459393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5f0f9544-0672-4d9e-a71c-46d92e95b21d req-3bb9a3cc-151b-4604-9e15-3eb40263df9e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.460091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5f0f9544-0672-4d9e-a71c-46d92e95b21d req-3bb9a3cc-151b-4604-9e15-3eb40263df9e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.480030 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-5f0f9544-0672-4d9e-a71c-46d92e95b21d req-3bb9a3cc-151b-4604-9e15-3eb40263df9e service nova] Creating event network-vif-deleted:7fe80183-4a7b-4b15-a597-99ffb47ba445 for instance 46f4a750-e707-4f90-b122-d4e1a9167098 on nch1-master-1 Oct 01 20:57:26.490505 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-5f0f9544-0672-4d9e-a71c-46d92e95b21d req-3bb9a3cc-151b-4604-9e15-3eb40263df9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049210 Oct 01 20:57:26.493849 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1122/2172] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:26.503029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:26.503953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:26.514059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.515057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.515894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.516960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.517699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.518992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.539585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:57:26.540900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:57:26.542435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:57:26.543972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:57:26.544605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:57:26.557935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.558860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.559505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.561026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.561700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.562619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.588694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Getting quotas for project c007c403f0b8414eb5bb14d11897c71a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:57:26.595713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Getting quotas for user 60d08233105349009c9dcf5f25b82229 and project c007c403f0b8414eb5bb14d11897c71a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:57:26.618561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:57:26.627199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:57:26.664237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:26.682480 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-270d976e-6cfc-4127-9f29-e3a04ade614e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1266 microversion: 2.1 time: 0.183680 Oct 01 20:57:26.686775 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1123/2173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:26 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:26.689777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:26.701133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2f0161e9-fbde-49ee-a443-49a9b11bbe8f tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:26.701817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2f0161e9-fbde-49ee-a443-49a9b11bbe8f tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:26.721494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f0161e9-fbde-49ee-a443-49a9b11bbe8f tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.725729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f0161e9-fbde-49ee-a443-49a9b11bbe8f tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.726956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f0161e9-fbde-49ee-a443-49a9b11bbe8f tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.727715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f0161e9-fbde-49ee-a443-49a9b11bbe8f tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.728208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f0161e9-fbde-49ee-a443-49a9b11bbe8f tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.731207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f0161e9-fbde-49ee-a443-49a9b11bbe8f tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.746470 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2c3079b-28eb-4c61-869f-882aec276d59 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.724410 Oct 01 20:57:26.747820 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1051/2174] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 20:57:26.763723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:26.764380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:26.785366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.788013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.789949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:26.790761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:26.793085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:26.793534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:27.083854 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2f0161e9-fbde-49ee-a443-49a9b11bbe8f tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.392846 Oct 01 20:57:27.084431 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1124/2175] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 20:57:26 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3/os-interface => generated 285 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:27.090720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6b1c3352-5d5b-4a1d-aa68-212c00468ef1 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:27.091273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6b1c3352-5d5b-4a1d-aa68-212c00468ef1 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:27.413638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6b1c3352-5d5b-4a1d-aa68-212c00468ef1 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:27.421608 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6b1c3352-5d5b-4a1d-aa68-212c00468ef1 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1217 microversion: 2.1 time: 0.335954 Oct 01 20:57:27.436177 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1125/2176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:27 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:27.450967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:27.455902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] [instance: 46f4a750-e707-4f90-b122-d4e1a9167098] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:27.467960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:27.477094 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5a376f0e-d48c-431d-b7a3-1737227a574d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1477 microversion: 2.1 time: 0.723840 Oct 01 20:57:27.477942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:27.480312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:27.482331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:27.487322 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1052/2177] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:26 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1477 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:27.487943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:27.491790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:27.494276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:27.501092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:27.505860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:27.517883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:27.518658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:27.519293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:27.520957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:27.521473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:27.522074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:27.558914 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] HTTP exception thrown: Instance 46f4a750-e707-4f90-b122-d4e1a9167098 could not be found. Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Request method failure captured: Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 HTTP/1.1 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKmc9iGc6dU9peVUB-omqS8w9IPNSEq82S9XegPM-GQSkFor52sVc7EXUj_O-8B26hm-ZG-m18lPwdzjgOmPpLB0OjUJV7EOpKOoFys5l-PrrFan-YynsLQ8r5UAFZ2bejb-qYs5WGocR3Eyp4puOThF4VpR4GmhamaGqYdLic-wE_o Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ff3a0720d242499694d57ffe3b405f21 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1074239142 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff3a0720d242499694d57ffe3b405f21", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff3a0720d242499694d57ffe3b405f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff3a0720d242499694d57ffe3b405f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff3a0720d242499694d57ffe3b405f21"}]}] Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1074239142 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ff3a0720d242499694d57ffe3b405f21 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1074239142 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerDiagnosticsNegativeTest-1074239142-project Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 00d15c074f9344b2b2b5df4411df66d1 Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1074239142-project Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 46f4a750-e707-4f90-b122-d4e1a9167098 could not be found. Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '46f4a750-e707-4f90-b122-d4e1a9167098'} Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f4a750-e707-4f90-b122-d4e1a9167098 could not be found. Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f4a750-e707-4f90-b122-d4e1a9167098 could not be found. Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:27.570942 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:27.574952 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:27.574952 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:27.574952 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:27.574952 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:27.574952 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:27.574952 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:27.574952 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f4a750-e707-4f90-b122-d4e1a9167098 could not be found. Oct 01 20:57:27.574952 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:27.577278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] Returning 404 to user: Instance 46f4a750-e707-4f90-b122-d4e1a9167098 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:27.581759 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c35d4f49-c451-456e-b54a-29374410f140 tempest-ServerDiagnosticsNegativeTest-1074239142 tempest-ServerDiagnosticsNegativeTest-1074239142-project] 10.222.0.17 "GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098" status: 404 len: 111 microversion: 2.1 time: 0.144192 Oct 01 20:57:27.582341 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1126/2178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:27 2022] GET /compute/v2.1/servers/46f4a750-e707-4f90-b122-d4e1a9167098 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:57:27.711513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:27.712543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:27.736213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:27.736892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:27.741482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:27.741482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:27.741482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:27.741482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:28.545377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:28.560085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:28.562224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:28.566373 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5370aeaa-2e62-4153-af89-346b92744741 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 1.074644 Oct 01 20:57:28.584727 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1053/2179] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:27 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:28.600554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:28.602085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:28.610217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:28.611101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:28.611895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:28.613284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:28.614842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:28.615628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:28.889757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:28.903366 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-42512a06-18d6-45d0-820c-cd5fffa2cc8f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1269 microversion: 2.1 time: 0.316753 Oct 01 20:57:28.904132 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1054/2180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:28 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1269 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:28.908968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:28.919663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:28.947369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:28.948409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:28.949051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:28.951139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:28.951703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:28.952345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:28.988153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:28.996593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:29.000750 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-50c9ea44-843f-43f9-8cc1-a2b592b2e523 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1308 microversion: 2.1 time: 1.295329 Oct 01 20:57:29.006821 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1127/2181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:27 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1308 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:29.217708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a6a9ac7e-a090-4e0f-a31a-e639234e8479 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:29.222619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6a9ac7e-a090-4e0f-a31a-e639234e8479 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.223683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6a9ac7e-a090-4e0f-a31a-e639234e8479 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.228030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6a9ac7e-a090-4e0f-a31a-e639234e8479 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.228922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6a9ac7e-a090-4e0f-a31a-e639234e8479 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.229421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6a9ac7e-a090-4e0f-a31a-e639234e8479 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.229873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6a9ac7e-a090-4e0f-a31a-e639234e8479 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.279450 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a6a9ac7e-a090-4e0f-a31a-e639234e8479 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.271427 Oct 01 20:57:29.280224 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1128/2182] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:57:29 2022] GET /compute/v2.1/os-services => generated 947 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:29.312006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5f5348c9-0d83-4d48-84a4-80697cd12cbd tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:29.320264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5348c9-0d83-4d48-84a4-80697cd12cbd tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.323017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5348c9-0d83-4d48-84a4-80697cd12cbd tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.323957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5348c9-0d83-4d48-84a4-80697cd12cbd tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.324897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5348c9-0d83-4d48-84a4-80697cd12cbd tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.325670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5348c9-0d83-4d48-84a4-80697cd12cbd tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.326281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5348c9-0d83-4d48-84a4-80697cd12cbd tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.387960 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5f5348c9-0d83-4d48-84a4-80697cd12cbd tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.090488 Oct 01 20:57:29.390180 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1129/2183] 10.222.0.17 () {58 vars in 1174 bytes} [Sat Oct 1 20:57:29 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:29.402523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8a98d88a-e3ba-447f-b6e0-e0f0f3c2de12 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:29.406215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a98d88a-e3ba-447f-b6e0-e0f0f3c2de12 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.412875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a98d88a-e3ba-447f-b6e0-e0f0f3c2de12 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.413487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a98d88a-e3ba-447f-b6e0-e0f0f3c2de12 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.415354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a98d88a-e3ba-447f-b6e0-e0f0f3c2de12 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.417775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a98d88a-e3ba-447f-b6e0-e0f0f3c2de12 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.418347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a98d88a-e3ba-447f-b6e0-e0f0f3c2de12 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.512060 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8a98d88a-e3ba-447f-b6e0-e0f0f3c2de12 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111178 Oct 01 20:57:29.522159 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1130/2184] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Oct 1 20:57:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:57:29.540007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fa9258f2-4c7f-461d-84fb-d76e88792266 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:29.549405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa9258f2-4c7f-461d-84fb-d76e88792266 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.549919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa9258f2-4c7f-461d-84fb-d76e88792266 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.550363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa9258f2-4c7f-461d-84fb-d76e88792266 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.551197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa9258f2-4c7f-461d-84fb-d76e88792266 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.551656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa9258f2-4c7f-461d-84fb-d76e88792266 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.552082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa9258f2-4c7f-461d-84fb-d76e88792266 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.564860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:29.588092 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6c490893-cd59-43fd-ba42-c2fe268aa6b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1477 microversion: 2.1 time: 0.682614 Oct 01 20:57:29.589251 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1055/2185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:28 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1477 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:29.630199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:29.632018 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fa9258f2-4c7f-461d-84fb-d76e88792266 tempest-ServicesAdminTestJSON-1927181911 tempest-ServicesAdminTestJSON-1927181911-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.103465 Oct 01 20:57:29.634283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:29.636117 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1131/2186] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:57:29 2022] GET /compute/v2.1/os-services => generated 947 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:57:29.668536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.669601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.670398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.675558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.678399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.685251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.928867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:29.929736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:29.953180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.965292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.965931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:29.968963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:29.969476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:29.970110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:30.427081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:30.457061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:30.458651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:30.459890 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a2349f05-2c9b-4af7-96b0-e4a2973e2624 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1409 microversion: 2.54 time: 0.862139 Oct 01 20:57:30.460481 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1056/2187] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:29 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1409 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:30.475802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:30.476452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:30.495710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:30.498396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:30.499184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:30.503191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:30.507121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:30.508801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:30.863165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:30.892895 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5f5a04cd-d212-4b9e-a193-c62d70bb2e4b tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1277 microversion: 2.1 time: 0.968078 Oct 01 20:57:30.899132 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1132/2188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:29 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1277 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:30.920519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-9c7d3505-0b7b-4f55-bf95-bcf41b000e90 req-44ad7ed9-34b4-4a52-8bb2-d4db9acd4ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c801254-bf56-4ffe-9124-3d27ac319f92", "tag": "e5468503-c18d-4820-827a-3372343bea82"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:30.950418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9c7d3505-0b7b-4f55-bf95-bcf41b000e90 req-44ad7ed9-34b4-4a52-8bb2-d4db9acd4ee4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:30.951218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9c7d3505-0b7b-4f55-bf95-bcf41b000e90 req-44ad7ed9-34b4-4a52-8bb2-d4db9acd4ee4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:30.953470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9c7d3505-0b7b-4f55-bf95-bcf41b000e90 req-44ad7ed9-34b4-4a52-8bb2-d4db9acd4ee4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:30.976778 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-9c7d3505-0b7b-4f55-bf95-bcf41b000e90 req-44ad7ed9-34b4-4a52-8bb2-d4db9acd4ee4 service nova] Creating event network-changed:e5468503-c18d-4820-827a-3372343bea82 for instance 6c801254-bf56-4ffe-9124-3d27ac319f92 on nch1-master-1 Oct 01 20:57:30.983360 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-9c7d3505-0b7b-4f55-bf95-bcf41b000e90 req-44ad7ed9-34b4-4a52-8bb2-d4db9acd4ee4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082256 Oct 01 20:57:30.990896 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1133/2189] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:30.998481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:31.000571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:31.013646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:31.015030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:31.015949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:31.017047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:31.018061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:31.018739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:31.423472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:31.445757 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e837713c-3d31-4926-8b85-a60244c0fdb1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1308 microversion: 2.1 time: 0.984128 Oct 01 20:57:31.455180 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1057/2190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:30 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1308 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:31.480309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e16a57c1-7cd2-415b-a9ac-96f50430cdc0 req-315a86c8-0a08-42f2-a01c-88739dd9811d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b9ddc4-96e9-4c59-b07f-e785f2179e8c", "name": "network-vif-plugged", "status": "completed", "tag": "edbfb05d-0450-4747-beea-2150a81bba2f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:31.501574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e16a57c1-7cd2-415b-a9ac-96f50430cdc0 req-315a86c8-0a08-42f2-a01c-88739dd9811d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:31.507126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e16a57c1-7cd2-415b-a9ac-96f50430cdc0 req-315a86c8-0a08-42f2-a01c-88739dd9811d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:31.508944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e16a57c1-7cd2-415b-a9ac-96f50430cdc0 req-315a86c8-0a08-42f2-a01c-88739dd9811d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:31.589478 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e16a57c1-7cd2-415b-a9ac-96f50430cdc0 req-315a86c8-0a08-42f2-a01c-88739dd9811d service nova] Creating event network-vif-plugged:edbfb05d-0450-4747-beea-2150a81bba2f for instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c on nch2-master-1 Oct 01 20:57:31.621234 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e16a57c1-7cd2-415b-a9ac-96f50430cdc0 req-315a86c8-0a08-42f2-a01c-88739dd9811d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134454 Oct 01 20:57:31.622256 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1058/2191] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:31.647603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:31.650890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:31.673240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:31.705884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:31.706587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:31.707898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:31.713916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:31.718351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:31.734781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:32.009579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:32.017691 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c0b8a1d2-8c05-4101-97a4-c53890f94a55 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1477 microversion: 2.1 time: 1.024976 Oct 01 20:57:32.021997 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1134/2192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:30 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1477 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:32.031327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:32.032182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:32.047007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:32.049918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:32.051612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:32.052593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:32.054195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:32.054990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:32.204490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:32.217737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:32.224291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:32.226016 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f044aa5d-b9e4-47fc-8d29-9cfb7d258b97 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1415 microversion: 2.54 time: 0.593875 Oct 01 20:57:32.255396 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1059/2193] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:31 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1415 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:32.487305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:32.489249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:32.495302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:32.495793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:32.501162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:32.503544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:32.505097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:32.506029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:32.540081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:32.551832 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1a112ffb-27fd-4608-9665-9b90bff93813 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1317 microversion: 2.1 time: 0.527822 Oct 01 20:57:32.555363 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1135/2194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:32 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:33.023449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:33.036713 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a0a68516-bdd1-41d6-b470-56b9cd5e0839 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1308 microversion: 2.1 time: 0.558229 Oct 01 20:57:33.037586 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1060/2195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:32 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:33.045596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c7ca7759-166a-4d41-aca5-43ffaf77e106 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Calling method '.version_select at 0x7f41726e2ca0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.063658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.064798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:33.080117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.080630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.081246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.081979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.083163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.083687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.096151 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-c7ca7759-166a-4d41-aca5-43ffaf77e106 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] HTTP exception thrown: Image not found. Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c7ca7759-166a-4d41-aca5-43ffaf77e106 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Request method failure captured: Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/images/b03d27c7-3be1-4ab7-9138-f2762c944d34/metadata/os_distro HTTP/1.1 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKm8sXquW1zCiOZz3yKxXCKYd0p-HFdgM3VaI1JC0o9X0k9ZOvC6umlYmNtOpQ3dyaPKGkgLXvsg0_kmSuojZpuD2dC0Y8KBp8gh5Vk8AxynjCdfDNWTp8JcopketJm8ZtEdTvjOHJM9yEuNw8F4oi3abKBJzeKejAnfoRBz5akppy8 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cdcdda9ef3a04b76af2a643c0aa26009", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}] Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a29014c4674d44d5aa2b98c4b3f1730d Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: exception: Image not found. Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'image_id': 'b03d27c7-3be1-4ab7-9138-f2762c944d34', 'id': 'os_distro'} Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b03d27c7-3be1-4ab7-9138-f2762c944d34 Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 20:57:33.124749 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b03d27c7-3be1-4ab7-9138-f2762c944d34 could not be found. Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.127832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c7ca7759-166a-4d41-aca5-43ffaf77e106 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Returning 404 to user: Image not found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:33.137418 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c7ca7759-166a-4d41-aca5-43ffaf77e106 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] 10.222.0.17 "DELETE /compute/v2.1/images/b03d27c7-3be1-4ab7-9138-f2762c944d34/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.339269 Oct 01 20:57:33.137418 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1136/2196] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Oct 1 20:57:32 2022] DELETE /compute/v2.1/images/b03d27c7-3be1-4ab7-9138-f2762c944d34/metadata/os_distro => generated 62 bytes in 341 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:33.151126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.155032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:33.176157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.176840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.177292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.178257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.178850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.179179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.523786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:33.533240 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88eb8968-e7ee-41fc-a6c1-b2ebdae97172 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1477 microversion: 2.1 time: 0.494406 Oct 01 20:57:33.533822 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1061/2197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:33 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1477 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:33.557380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5a2a4a6c-9155-4350-b06d-9837689c81c6 req-65016f75-f937-4e5a-99c8-f9f3b85b222a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f5ad45-c060-47b7-9ec8-1c1dd15231b3", "tag": "6d7c99e5-4b66-4d43-879f-9bad18c158fe"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:33.567580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a2a4a6c-9155-4350-b06d-9837689c81c6 req-65016f75-f937-4e5a-99c8-f9f3b85b222a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.568241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a2a4a6c-9155-4350-b06d-9837689c81c6 req-65016f75-f937-4e5a-99c8-f9f3b85b222a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.568720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a2a4a6c-9155-4350-b06d-9837689c81c6 req-65016f75-f937-4e5a-99c8-f9f3b85b222a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.583099 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5a2a4a6c-9155-4350-b06d-9837689c81c6 req-65016f75-f937-4e5a-99c8-f9f3b85b222a service nova] Creating event network-changed:6d7c99e5-4b66-4d43-879f-9bad18c158fe for instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 on nch1-master-1 Oct 01 20:57:33.589215 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5a2a4a6c-9155-4350-b06d-9837689c81c6 req-65016f75-f937-4e5a-99c8-f9f3b85b222a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053810 Oct 01 20:57:33.590333 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1062/2198] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:33.595650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-499354a4-0537-44c7-b845-c83e7f39e134 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Calling method '.version_select at 0x7f417c289a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.615750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:33.626829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-499354a4-0537-44c7-b845-c83e7f39e134 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] HTTP exception thrown: Image not found. Oct 01 20:57:33.631259 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3288a922-3a31-420e-b8c3-0aeb8de3a93a tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1589 microversion: 2.1 time: 0.500082 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-499354a4-0537-44c7-b845-c83e7f39e134 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Request method failure captured: Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/images/d11aae47-c41b-4804-bcd0-5d4f39246896/metadata/os_version HTTP/1.1 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKm8sXquW1zCiOZz3yKxXCKYd0p-HFdgM3VaI1JC0o9X0k9ZOvC6umlYmNtOpQ3dyaPKGkgLXvsg0_kmSuojZpuD2dC0Y8KBp8gh5Vk8AxynjCdfDNWTp8JcopketJm8ZtEdTvjOHJM9yEuNw8F4oi3abKBJzeKejAnfoRBz5akppy8 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cdcdda9ef3a04b76af2a643c0aa26009", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}] Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a29014c4674d44d5aa2b98c4b3f1730d Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'image_id': 'd11aae47-c41b-4804-bcd0-5d4f39246896', 'id': 'os_version'} Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d11aae47-c41b-4804-bcd0-5d4f39246896 Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 20:57:33.635444 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d11aae47-c41b-4804-bcd0-5d4f39246896 could not be found. Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.638595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-499354a4-0537-44c7-b845-c83e7f39e134 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:33.644076 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1137/2199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:33 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1589 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:33.644184 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-499354a4-0537-44c7-b845-c83e7f39e134 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] 10.222.0.17 "GET /compute/v2.1/images/d11aae47-c41b-4804-bcd0-5d4f39246896/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.047587 Oct 01 20:57:33.644184 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1063/2200] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Oct 1 20:57:33 2022] GET /compute/v2.1/images/d11aae47-c41b-4804-bcd0-5d4f39246896/metadata/os_version => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:33.645395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.646329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:33.650256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.651026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:33.661511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.661662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.662122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.662229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.662701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.662839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.663756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.664419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.665052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.672234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.672771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.673468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.689372 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] HTTP exception thrown: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Request method failure captured: Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 HTTP/1.1 Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKgpvBvQOIlwZbzzSOJS1819rWMaT9csG6VQ_fO7T7_g2GkdljxCTqAv0VTG8o5zrhkdft-X1f8fjmk2G6mFZIjiKAlJbPsKHiYkn1BF1t6Gov5Ze5mUKbKYQrBZme6mSpW8XZ772aB1c9dtNxaYv5qWdI1qutVXpftlEfF9RGFlBYk Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Openstack-Nova-Api-Version: 2.42 Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: bb36a4c325b54c8a964113ba5e52f47b Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-711726808 Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb36a4c325b54c8a964113ba5e52f47b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb36a4c325b54c8a964113ba5e52f47b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb36a4c325b54c8a964113ba5e52f47b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb36a4c325b54c8a964113ba5e52f47b"}]}] Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TaggedBootDevicesTest_v242-711726808 Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: bb36a4c325b54c8a964113ba5e52f47b Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-711726808 Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TaggedBootDevicesTest_v242-711726808-project Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 2aa4f468a15546eb9f72cb2b632e67bb Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TaggedBootDevicesTest_v242-711726808-project Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '57e9d6a4-ef78-4649-883a-c2d1869c8131'} Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:33.691446 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Returning 404 to user: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eeb4689b-cbb0-4614-86c1-ed5a3ba69897 tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 404 len: 111 microversion: 2.42 time: 0.054482 Oct 01 20:57:33.695391 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1138/2201] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:57:33 2022] DELETE /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:33.699995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-9651ae29-07bc-4cff-b541-fe5e4479734a req-2c2c6f53-c984-420b-a235-cf82ca63808d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42b06b0-81ad-4fc3-a82e-790eb097e105", "tag": "45614db4-614d-41b4-b508-a44dd8e41c58"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:33.712877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9651ae29-07bc-4cff-b541-fe5e4479734a req-2c2c6f53-c984-420b-a235-cf82ca63808d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.713715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9651ae29-07bc-4cff-b541-fe5e4479734a req-2c2c6f53-c984-420b-a235-cf82ca63808d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.714444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9651ae29-07bc-4cff-b541-fe5e4479734a req-2c2c6f53-c984-420b-a235-cf82ca63808d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.746675 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-9651ae29-07bc-4cff-b541-fe5e4479734a req-2c2c6f53-c984-420b-a235-cf82ca63808d service nova] Creating event network-changed:45614db4-614d-41b4-b508-a44dd8e41c58 for instance f42b06b0-81ad-4fc3-a82e-790eb097e105 on nch1-master-1 Oct 01 20:57:33.751994 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-9651ae29-07bc-4cff-b541-fe5e4479734a req-2c2c6f53-c984-420b-a235-cf82ca63808d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057053 Oct 01 20:57:33.752677 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1139/2202] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:33.759762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.760485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:33.766882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.767382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.767835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.768557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.769023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.769458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.780867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:33.793773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:33.795552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:33.796924 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-feebff75-5977-4cbe-beea-5e65adcd4aec tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1400 microversion: 2.54 time: 0.155747 Oct 01 20:57:33.797681 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1064/2203] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:33 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1400 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:33.827129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80567bb2-fc3a-4ea5-8cc6-a6f4d51a5da1 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Calling method '.version_select at 0x7f4173ac25e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.852150 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-80567bb2-fc3a-4ea5-8cc6-a6f4d51a5da1 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] HTTP exception thrown: Image not found. Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80567bb2-fc3a-4ea5-8cc6-a6f4d51a5da1 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Request method failure captured: Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/images/a77bb214-93fe-4bc9-83c9-9a3f97be5955/metadata HTTP/1.1 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKm8sXquW1zCiOZz3yKxXCKYd0p-HFdgM3VaI1JC0o9X0k9ZOvC6umlYmNtOpQ3dyaPKGkgLXvsg0_kmSuojZpuD2dC0Y8KBp8gh5Vk8AxynjCdfDNWTp8JcopketJm8ZtEdTvjOHJM9yEuNw8F4oi3abKBJzeKejAnfoRBz5akppy8 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cdcdda9ef3a04b76af2a643c0aa26009", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}] Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a29014c4674d44d5aa2b98c4b3f1730d Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'image_id': 'a77bb214-93fe-4bc9-83c9-9a3f97be5955'} Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a77bb214-93fe-4bc9-83c9-9a3f97be5955 Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 20:57:33.854301 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a77bb214-93fe-4bc9-83c9-9a3f97be5955 could not be found. Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.858151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80567bb2-fc3a-4ea5-8cc6-a6f4d51a5da1 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:33.862860 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80567bb2-fc3a-4ea5-8cc6-a6f4d51a5da1 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] 10.222.0.17 "GET /compute/v2.1/images/a77bb214-93fe-4bc9-83c9-9a3f97be5955/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046185 Oct 01 20:57:33.862860 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1065/2204] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 20:57:33 2022] GET /compute/v2.1/images/a77bb214-93fe-4bc9-83c9-9a3f97be5955/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:33.869663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.871749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] [instance: 57e9d6a4-ef78-4649-883a-c2d1869c8131] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:33.883847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.884761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.885954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.887083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:33.888878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:33.889337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:33.919601 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] HTTP exception thrown: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Request method failure captured: Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 HTTP/1.1 Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKgpvBvQOIlwZbzzSOJS1819rWMaT9csG6VQ_fO7T7_g2GkdljxCTqAv0VTG8o5zrhkdft-X1f8fjmk2G6mFZIjiKAlJbPsKHiYkn1BF1t6Gov5Ze5mUKbKYQrBZme6mSpW8XZ772aB1c9dtNxaYv5qWdI1qutVXpftlEfF9RGFlBYk Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.42 Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bb36a4c325b54c8a964113ba5e52f47b Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-711726808 Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb36a4c325b54c8a964113ba5e52f47b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb36a4c325b54c8a964113ba5e52f47b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb36a4c325b54c8a964113ba5e52f47b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb36a4c325b54c8a964113ba5e52f47b"}]}] Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TaggedBootDevicesTest_v242-711726808 Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bb36a4c325b54c8a964113ba5e52f47b Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-711726808 Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TaggedBootDevicesTest_v242-711726808-project Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 2aa4f468a15546eb9f72cb2b632e67bb Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TaggedBootDevicesTest_v242-711726808-project Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '57e9d6a4-ef78-4649-883a-c2d1869c8131'} Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.922143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:33.925571 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.925571 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:33.925571 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:33.925571 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:33.925571 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:33.925571 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:33.925571 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. Oct 01 20:57:33.925571 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:33.927963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] Returning 404 to user: Instance 57e9d6a4-ef78-4649-883a-c2d1869c8131 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:33.933955 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c32341d4-d6e4-4bf1-bc6a-df4725f3e3ee tempest-TaggedBootDevicesTest_v242-711726808 tempest-TaggedBootDevicesTest_v242-711726808-project] 10.222.0.17 "GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131" status: 404 len: 111 microversion: 2.42 time: 0.064013 Oct 01 20:57:33.934891 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1066/2205] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:33 2022] GET /compute/v2.1/servers/57e9d6a4-ef78-4649-883a-c2d1869c8131 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:33.961925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7deb67a-8b6d-4bfc-9373-b33714db2d7c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '.version_select at 0x7f4173ac25e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:33.992904 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7deb67a-8b6d-4bfc-9373-b33714db2d7c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1573935692" status: 204 len: 0 microversion: 2.54 time: 0.041338 Oct 01 20:57:33.995757 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1067/2206] 10.222.0.17 () {60 vars in 1319 bytes} [Sat Oct 1 20:57:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1573935692 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:57:34.014353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aed7a1a6-494e-414d-a132-1e83905a1245 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Action: 'update_all', calling method: .version_select at 0x7f41739c1b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:34.052458 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-aed7a1a6-494e-414d-a132-1e83905a1245 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] HTTP exception thrown: Image not found. Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aed7a1a6-494e-414d-a132-1e83905a1245 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Request method failure captured: Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/images/a3f476b1-8d53-4bc0-a153-c8b4fca9d72a/metadata HTTP/1.1 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 57 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKm8sXquW1zCiOZz3yKxXCKYd0p-HFdgM3VaI1JC0o9X0k9ZOvC6umlYmNtOpQ3dyaPKGkgLXvsg0_kmSuojZpuD2dC0Y8KBp8gh5Vk8AxynjCdfDNWTp8JcopketJm8ZtEdTvjOHJM9yEuNw8F4oi3abKBJzeKejAnfoRBz5akppy8 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cdcdda9ef3a04b76af2a643c0aa26009", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}] Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a29014c4674d44d5aa2b98c4b3f1730d Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'image_id': 'a3f476b1-8d53-4bc0-a153-c8b4fca9d72a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a3f476b1-8d53-4bc0-a153-c8b4fca9d72a Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 20:57:34.056842 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3f476b1-8d53-4bc0-a153-c8b4fca9d72a could not be found. Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:34.060730 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.068718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aed7a1a6-494e-414d-a132-1e83905a1245 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:34.069605 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aed7a1a6-494e-414d-a132-1e83905a1245 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] 10.222.0.17 "PUT /compute/v2.1/images/a3f476b1-8d53-4bc0-a153-c8b4fca9d72a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069504 Oct 01 20:57:34.075447 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1068/2207] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:57:33 2022] PUT /compute/v2.1/images/a3f476b1-8d53-4bc0-a153-c8b4fca9d72a/metadata => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:34.083130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:34.085669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:34.092562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:34.093292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:34.093871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:34.094147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:34.095275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:34.095883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:34.096474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:34.107738 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-66e58c0e-71cd-47ee-8749-84c02e341f5a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1317 microversion: 2.1 time: 0.353546 Oct 01 20:57:34.108803 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1140/2208] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:33 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:34.122256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:34.124610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:34.148748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:34.149264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:34.151215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:34.152536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:34.154884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:34.155517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:34.173512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:57:34.368193 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c209bfc-cd55-4a2a-9b71-a27a241fc9be tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 204 len: 0 microversion: 2.54 time: 0.292229 Oct 01 20:57:34.369510 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1069/2209] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 20:57:34 2022] DELETE /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 20:57:34.376972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6972f412-a0a4-466d-a7db-396a391987e4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Action: 'update', calling method: .version_select at 0x7f4173c3d310>, body: {"meta": {"os_distro": "alt"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:34.407795 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-6972f412-a0a4-466d-a7db-396a391987e4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] HTTP exception thrown: Image not found. Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6972f412-a0a4-466d-a7db-396a391987e4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Request method failure captured: Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/images/9a45b8cd-6e4b-474a-b8a7-8b4671342b95/metadata/os_distro HTTP/1.1 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 30 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKm8sXquW1zCiOZz3yKxXCKYd0p-HFdgM3VaI1JC0o9X0k9ZOvC6umlYmNtOpQ3dyaPKGkgLXvsg0_kmSuojZpuD2dC0Y8KBp8gh5Vk8AxynjCdfDNWTp8JcopketJm8ZtEdTvjOHJM9yEuNw8F4oi3abKBJzeKejAnfoRBz5akppy8 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cdcdda9ef3a04b76af2a643c0aa26009", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}] Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a29014c4674d44d5aa2b98c4b3f1730d Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: {"meta": {"os_distro": "alt"}} Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'image_id': '9a45b8cd-6e4b-474a-b8a7-8b4671342b95', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9a45b8cd-6e4b-474a-b8a7-8b4671342b95 Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 20:57:34.417311 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a45b8cd-6e4b-474a-b8a7-8b4671342b95 could not be found. Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6972f412-a0a4-466d-a7db-396a391987e4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:34.421944 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6972f412-a0a4-466d-a7db-396a391987e4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] 10.222.0.17 "PUT /compute/v2.1/images/9a45b8cd-6e4b-474a-b8a7-8b4671342b95/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.047941 Oct 01 20:57:34.426013 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1070/2210] 10.222.0.17 () {60 vars in 1310 bytes} [Sat Oct 1 20:57:34 2022] PUT /compute/v2.1/images/9a45b8cd-6e4b-474a-b8a7-8b4671342b95/metadata/os_distro => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:34.436234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:34.437007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:34.448538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:34.449058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:34.449508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:34.450234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:34.451016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:34.451730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:35.129128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:35.138481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:35.140823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:35.141973 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2f37ebe2-1878-48f4-abce-23e8492f3a3b tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1406 microversion: 2.54 time: 0.714538 Oct 01 20:57:35.142821 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1071/2211] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:34 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1406 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:35.147755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-befe7b63-f462-44d7-96a1-5b3ebc8a1de4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Action: 'create', calling method: .version_select at 0x7f4172ed0f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:35.172069 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-befe7b63-f462-44d7-96a1-5b3ebc8a1de4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] HTTP exception thrown: Image not found. Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-befe7b63-f462-44d7-96a1-5b3ebc8a1de4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Request method failure captured: Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/images/1576c65a-4f11-47db-91fc-87ec3ba70e55/metadata HTTP/1.1 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 57 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKm8sXquW1zCiOZz3yKxXCKYd0p-HFdgM3VaI1JC0o9X0k9ZOvC6umlYmNtOpQ3dyaPKGkgLXvsg0_kmSuojZpuD2dC0Y8KBp8gh5Vk8AxynjCdfDNWTp8JcopketJm8ZtEdTvjOHJM9yEuNw8F4oi3abKBJzeKejAnfoRBz5akppy8 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cdcdda9ef3a04b76af2a643c0aa26009", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cdcdda9ef3a04b76af2a643c0aa26009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cdcdda9ef3a04b76af2a643c0aa26009"}]}] Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: cdcdda9ef3a04b76af2a643c0aa26009 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a29014c4674d44d5aa2b98c4b3f1730d Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2102962632-project Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'image_id': '1576c65a-4f11-47db-91fc-87ec3ba70e55', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1576c65a-4f11-47db-91fc-87ec3ba70e55 Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 20:57:35.174222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1576c65a-4f11-47db-91fc-87ec3ba70e55 could not be found. Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:35.178101 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:35.181274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:35.182453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-befe7b63-f462-44d7-96a1-5b3ebc8a1de4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:35.183691 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-befe7b63-f462-44d7-96a1-5b3ebc8a1de4 tempest-ImagesMetadataNegativeTestJSON-2102962632 tempest-ImagesMetadataNegativeTestJSON-2102962632-project] 10.222.0.17 "POST /compute/v2.1/images/1576c65a-4f11-47db-91fc-87ec3ba70e55/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039859 Oct 01 20:57:35.184431 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1072/2212] 10.222.0.17 () {60 vars in 1281 bytes} [Sat Oct 1 20:57:35 2022] POST /compute/v2.1/images/1576c65a-4f11-47db-91fc-87ec3ba70e55/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:35.193314 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fd11a6b8-8cf6-4ef9-9e6b-8277f862fbad tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1308 microversion: 2.1 time: 1.083151 Oct 01 20:57:35.194096 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1141/2213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:34 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1308 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:35.207465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:35.207465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:35.216096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:35.216933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:35.222512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:35.223672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:35.224041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:35.224207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:35.224540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:35.224906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:35.225007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:35.225264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:35.225718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:35.225895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:35.226180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:35.226648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:35.827491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:35.851887 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-69d01d3f-307b-45f2-8e1f-a23563f43f42 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1463 microversion: 2.1 time: 0.657247 Oct 01 20:57:35.851887 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1073/2214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:35 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1463 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:35.874119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:35.883751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:35.885152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:35.897924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:35.898799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:35.899661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:35.901253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:35.902475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:35.902615 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-56c9d125-068d-49de-90c5-7560a47c2225 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1317 microversion: 2.1 time: 0.692111 Oct 01 20:57:35.903711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:35.906574 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1142/2215] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:35 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:36.097812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:36.108117 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c2b1d3c3-6d76-44af-becb-43b89e4e773d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1463 microversion: 2.1 time: 0.233282 Oct 01 20:57:36.122336 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1074/2216] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:35 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1463 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:36.122447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Action: 'update', calling method: .version_select at 0x7f417292aa60>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:36.122447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.122615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.123693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.135760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:36.140271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:36.144930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.146971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.147894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.148236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.161575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.162031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.163092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.163774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.164375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.165217 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] HTTP exception thrown: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Request method failure captured: Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/os-services/bbe30e71-5268-47d9-be46-d646954983cd HTTP/1.1 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 56 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKm_cnDByKuo_IjZz7pKmR7QKyW_ZB7TL4r9oCMLtrK1iWiIv67MPxjZtDRAsXjPJM698cGrXhbgg4KO8gMIq9gH5_f6CkOS4asEJJsetm_TcfesSnGX19_5y7K8RCOG5aukwzcNOBOG6GOgPFRBA3syMGgeBc_buehFQx8JpXMVeLU Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Openstack-Nova-Api-Version: 2.53 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 3f9cbc3e76fc414fa7e6b3aa869668d5 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1342090583 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3f9cbc3e76fc414fa7e6b3aa869668d5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f9cbc3e76fc414fa7e6b3aa869668d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3f9cbc3e76fc414fa7e6b3aa869668d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f9cbc3e76fc414fa7e6b3aa869668d5"}]}] Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1342090583 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 3f9cbc3e76fc414fa7e6b3aa869668d5 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1342090583 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: dc06764d7ab8496e8cd24290f70f6fd1 Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: exception: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'bbe30e71-5268-47d9-be46-d646954983cd', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:36.167589 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.171263 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.173657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Returning 404 to user: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:36.174660 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a1d9a2e1-41d3-4759-adc1-136c0ca1e93d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/bbe30e71-5268-47d9-be46-d646954983cd" status: 404 len: 110 microversion: 2.53 time: 0.225166 Oct 01 20:57:36.176297 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1143/2217] 10.222.0.17 () {62 vars in 1309 bytes} [Sat Oct 1 20:57:35 2022] PUT /compute/v2.1/os-services/bbe30e71-5268-47d9-be46-d646954983cd => generated 110 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:36.181601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:36.182987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:36.189401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.190130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.190697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.192199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.192737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.193244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.248742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:57:36.249172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:57:36.249651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:57:36.250070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:57:36.250515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:57:36.292211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:36.301662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:36.303302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:36.304736 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4dc37d78-d7b7-4d9d-abdb-13ca0afa7454 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1406 microversion: 2.54 time: 0.127242 Oct 01 20:57:36.307424 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1144/2218] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1406 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:36.318993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:36.324576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Action: 'update', calling method: .version_select at 0x7f417272d1f0>, body: {"status": "disabled"} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:36.327826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.329012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.329534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.331648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.332095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.332705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.332810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.333398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.333550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.341011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.342174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.342879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.354592 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] HTTP exception thrown: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Request method failure captured: Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: request: PUT /compute/v2.1/os-services/bbe30e71-5268-47d9-be46-d646954983cd HTTP/1.1 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 22 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKm_cnDByKuo_IjZz7pKmR7QKyW_ZB7TL4r9oCMLtrK1iWiIv67MPxjZtDRAsXjPJM698cGrXhbgg4KO8gMIq9gH5_f6CkOS4asEJJsetm_TcfesSnGX19_5y7K8RCOG5aukwzcNOBOG6GOgPFRBA3syMGgeBc_buehFQx8JpXMVeLU Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Openstack-Nova-Api-Version: 2.53 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 3f9cbc3e76fc414fa7e6b3aa869668d5 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1342090583 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3f9cbc3e76fc414fa7e6b3aa869668d5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f9cbc3e76fc414fa7e6b3aa869668d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3f9cbc3e76fc414fa7e6b3aa869668d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f9cbc3e76fc414fa7e6b3aa869668d5"}]}] Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1342090583 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 3f9cbc3e76fc414fa7e6b3aa869668d5 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1342090583 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: dc06764d7ab8496e8cd24290f70f6fd1 Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: {"status": "disabled"} Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: exception: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'bbe30e71-5268-47d9-be46-d646954983cd', 'body': {'status': 'disabled'}} Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:36.358413 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Returning 404 to user: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a813a8a1-fb3d-423d-ad5b-c8ce5f71d61d tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/bbe30e71-5268-47d9-be46-d646954983cd" status: 404 len: 110 microversion: 2.53 time: 0.053077 Oct 01 20:57:36.361770 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1145/2219] 10.222.0.17 () {62 vars in 1309 bytes} [Sat Oct 1 20:57:36 2022] PUT /compute/v2.1/os-services/bbe30e71-5268-47d9-be46-d646954983cd => generated 110 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:36.366890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:36.367523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:36.374135 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7171605d-88f0-40d8-bb86-118e3a2debaf tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action" status: 202 len: 1067 microversion: 2.1 time: 0.244866 Oct 01 20:57:36.376974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.377646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.378773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.379653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.380366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.380939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.387183 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1075/2220] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:57:36 2022] POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action => generated 1067 bytes in 259 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 01 20:57:36.397202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Action: 'update', calling method: .version_select at 0x7f4173ab4040>, body: {"status": "enabled"} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:36.401334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.401829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.402274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.411111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.411548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.411989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.420375 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] HTTP exception thrown: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Request method failure captured: Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/os-services/bbe30e71-5268-47d9-be46-d646954983cd HTTP/1.1 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 21 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKm_cnDByKuo_IjZz7pKmR7QKyW_ZB7TL4r9oCMLtrK1iWiIv67MPxjZtDRAsXjPJM698cGrXhbgg4KO8gMIq9gH5_f6CkOS4asEJJsetm_TcfesSnGX19_5y7K8RCOG5aukwzcNOBOG6GOgPFRBA3syMGgeBc_buehFQx8JpXMVeLU Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.53 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 3f9cbc3e76fc414fa7e6b3aa869668d5 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1342090583 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3f9cbc3e76fc414fa7e6b3aa869668d5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f9cbc3e76fc414fa7e6b3aa869668d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3f9cbc3e76fc414fa7e6b3aa869668d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f9cbc3e76fc414fa7e6b3aa869668d5"}]}] Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1342090583 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 3f9cbc3e76fc414fa7e6b3aa869668d5 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1342090583 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: dc06764d7ab8496e8cd24290f70f6fd1 Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: {"status": "enabled"} Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: exception: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'bbe30e71-5268-47d9-be46-d646954983cd', 'body': {'status': 'enabled'}} Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:57:36.422211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. Oct 01 20:57:36.426376 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:36.428458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Returning 404 to user: Service bbe30e71-5268-47d9-be46-d646954983cd could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:36.429661 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-44963f59-36b2-49d6-9dd7-a419d6a78d12 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/bbe30e71-5268-47d9-be46-d646954983cd" status: 404 len: 110 microversion: 2.53 time: 0.041164 Oct 01 20:57:36.434750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1076/2221] 10.222.0.17 () {62 vars in 1309 bytes} [Sat Oct 1 20:57:36 2022] PUT /compute/v2.1/os-services/bbe30e71-5268-47d9-be46-d646954983cd => generated 110 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:36.442437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:36.443082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:36.457036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.457901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.458653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.459522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.460406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.461006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.610423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=14 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:36.621873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:36.632021 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9657d78e-0eac-4ba3-b093-f4bb4962281f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1308 microversion: 2.1 time: 0.270379 Oct 01 20:57:36.632610 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1146/2222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:36.638043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f2b614d6-eb8b-421d-beed-ec78c28d5eca tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:36.641589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b614d6-eb8b-421d-beed-ec78c28d5eca tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.642283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b614d6-eb8b-421d-beed-ec78c28d5eca tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.642902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b614d6-eb8b-421d-beed-ec78c28d5eca tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.644875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b614d6-eb8b-421d-beed-ec78c28d5eca tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.645544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b614d6-eb8b-421d-beed-ec78c28d5eca tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.646156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2b614d6-eb8b-421d-beed-ec78c28d5eca tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.674602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:36.683348 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6fe1b3e9-db4b-4e91-a702-ea32e1526859 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.246977 Oct 01 20:57:36.684138 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1077/2223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:36.686691 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f2b614d6-eb8b-421d-beed-ec78c28d5eca tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.052844 Oct 01 20:57:36.687801 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1147/2224] 10.222.0.17 () {60 vars in 1178 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:36.709512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cf314992-91a5-4d5f-8234-1c066f27a06c tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:36.713901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf314992-91a5-4d5f-8234-1c066f27a06c tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.716988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf314992-91a5-4d5f-8234-1c066f27a06c tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.717937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf314992-91a5-4d5f-8234-1c066f27a06c tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.719913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf314992-91a5-4d5f-8234-1c066f27a06c tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.720830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf314992-91a5-4d5f-8234-1c066f27a06c tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.721420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cf314992-91a5-4d5f-8234-1c066f27a06c tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.786197 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cf314992-91a5-4d5f-8234-1c066f27a06c tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.082467 Oct 01 20:57:36.787429 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1148/2225] 10.222.0.17 () {60 vars in 1211 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:36.802353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80f6594a-ca0a-49f0-8a0a-9bced1c4ddec tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:36.806631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f6594a-ca0a-49f0-8a0a-9bced1c4ddec tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.807463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f6594a-ca0a-49f0-8a0a-9bced1c4ddec tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.808130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f6594a-ca0a-49f0-8a0a-9bced1c4ddec tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.809170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f6594a-ca0a-49f0-8a0a-9bced1c4ddec tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.809847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f6594a-ca0a-49f0-8a0a-9bced1c4ddec tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.810873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80f6594a-ca0a-49f0-8a0a-9bced1c4ddec tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.846671 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80f6594a-ca0a-49f0-8a0a-9bced1c4ddec tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.049464 Oct 01 20:57:36.855275 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1078/2226] 10.222.0.17 () {60 vars in 1178 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:36.860411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2ffdc04e-ac66-49ca-8baf-3bfdcc283395 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:36.865066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ffdc04e-ac66-49ca-8baf-3bfdcc283395 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.865569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ffdc04e-ac66-49ca-8baf-3bfdcc283395 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.866020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ffdc04e-ac66-49ca-8baf-3bfdcc283395 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.866992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ffdc04e-ac66-49ca-8baf-3bfdcc283395 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.867463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ffdc04e-ac66-49ca-8baf-3bfdcc283395 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.867904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ffdc04e-ac66-49ca-8baf-3bfdcc283395 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.907554 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2ffdc04e-ac66-49ca-8baf-3bfdcc283395 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.050833 Oct 01 20:57:36.911477 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1149/2227] 10.222.0.17 () {60 vars in 1237 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:36.928867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e567af72-5cb6-4476-a0bb-57bfcb6fffb0 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:36.935332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e567af72-5cb6-4476-a0bb-57bfcb6fffb0 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.936603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e567af72-5cb6-4476-a0bb-57bfcb6fffb0 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.937268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e567af72-5cb6-4476-a0bb-57bfcb6fffb0 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.938040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e567af72-5cb6-4476-a0bb-57bfcb6fffb0 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.939234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e567af72-5cb6-4476-a0bb-57bfcb6fffb0 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.940583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e567af72-5cb6-4476-a0bb-57bfcb6fffb0 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.946141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:36.949529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:36.968988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.971490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.973403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.976027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:36.978427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:36.979523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:36.987608 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e567af72-5cb6-4476-a0bb-57bfcb6fffb0 tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.069752 Oct 01 20:57:36.991641 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1079/2228] 10.222.0.17 () {60 vars in 1178 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 20:57:37.012359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a69b535-a02d-4228-83fd-300786485bdb tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:37.026907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a69b535-a02d-4228-83fd-300786485bdb tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:37.028003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a69b535-a02d-4228-83fd-300786485bdb tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:37.031192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a69b535-a02d-4228-83fd-300786485bdb tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:37.033190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a69b535-a02d-4228-83fd-300786485bdb tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:37.035922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a69b535-a02d-4228-83fd-300786485bdb tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:37.036539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a69b535-a02d-4228-83fd-300786485bdb tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:37.074283 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a69b535-a02d-4228-83fd-300786485bdb tempest-ServicesAdminNegativeV253TestJSON-1342090583 tempest-ServicesAdminNegativeV253TestJSON-1342090583-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.067974 Oct 01 20:57:37.075320 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1080/2229] 10.222.0.17 () {60 vars in 1239 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:37.320525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:37.333153 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a8b64248-ceb9-4554-b04b-26808eb684f9 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1317 microversion: 2.1 time: 0.399620 Oct 01 20:57:37.347036 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1150/2230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:36 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:37.365400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:37.366440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:37.374440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:37.375490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:37.376159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:37.377689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:37.378361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:37.379183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:37.420461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b632ae5-6c43-44a0-b7aa-e916727fa241 tempest-ServicesAdminNegativeV253TestJSON-1208986492 tempest-ServicesAdminNegativeV253TestJSON-1208986492-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:37.425077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7b632ae5-6c43-44a0-b7aa-e916727fa241 tempest-ServicesAdminNegativeV253TestJSON-1208986492 tempest-ServicesAdminNegativeV253TestJSON-1208986492-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '66e0ab3f29ca4b1dafbd5a3e30587c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e9bf185e0e40219dc7deefa296173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:37.426296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b632ae5-6c43-44a0-b7aa-e916727fa241 tempest-ServicesAdminNegativeV253TestJSON-1208986492 tempest-ServicesAdminNegativeV253TestJSON-1208986492-project] Request method failure captured: Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKm-spjxkFne4oqV_z6lowLgD8bY_Mzk3N9MsAq537fkhCWK7Q91iEFi4lEgq4Zgj1O38op1eXPkR3FT3YyACURi6IKMGx67wZ63OF-EbbjqerlTSGu8VPukgQt6xV5tJEK61lFD7QipwKFFv87zT5JC3iXHFmbTXFQTA3254bkjEMU Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.53 Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: f5e9bf185e0e40219dc7deefa296173d Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1208986492 Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f5e9bf185e0e40219dc7deefa296173d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e9bf185e0e40219dc7deefa296173d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f5e9bf185e0e40219dc7deefa296173d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e9bf185e0e40219dc7deefa296173d"}]}] Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1208986492 Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: f5e9bf185e0e40219dc7deefa296173d Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1208986492 Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1208986492-project Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 66e0ab3f29ca4b1dafbd5a3e30587c36 Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1208986492-project Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: action_args: {} Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise self.value Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 01 20:57:37.429994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b632ae5-6c43-44a0-b7aa-e916727fa241 tempest-ServicesAdminNegativeV253TestJSON-1208986492 tempest-ServicesAdminNegativeV253TestJSON-1208986492-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:37.434167 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7b632ae5-6c43-44a0-b7aa-e916727fa241 tempest-ServicesAdminNegativeV253TestJSON-1208986492 tempest-ServicesAdminNegativeV253TestJSON-1208986492-project] 10.222.0.17 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.349026 Oct 01 20:57:37.436640 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1081/2231] 10.222.0.17 () {60 vars in 1178 bytes} [Sat Oct 1 20:57:37 2022] GET /compute/v2.1/os-services => generated 112 bytes in 352 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:37.463065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:37.463870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:37.464565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:37.465221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lazy-loading 'fault' on Instance uuid 2436dc36-6559-4fc9-bb2b-6fe7350953be {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:37.542219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:37.553065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:37.554751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:37.555963 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d6e55db3-2bae-4d19-b3f1-81bd7a3f3762 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1411 microversion: 2.54 time: 0.207093 Oct 01 20:57:37.568711 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1151/2232] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:37 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1411 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:37.661854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:37.662529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:37.669476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:37.670025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:37.670584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:37.671220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:37.671833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:37.672077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:37.711184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:37.711815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:37.720168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:37.720673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:37.721115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:37.721832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:37.722297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:37.722791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:38.002515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:38.011260 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80797615-c6a2-4f2d-9e45-36e753be88f4 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1308 microversion: 2.1 time: 0.354389 Oct 01 20:57:38.036415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:38.044772 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3095ef66-e89c-4982-bc40-948caf4f3641 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.337537 Oct 01 20:57:38.045880 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1152/2233] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:37 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:38.047217 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1082/2234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:37 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:38.189604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1833973625", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:38.252396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] validate_networks() for None {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:57:38.362041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:38.363515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:38.370378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:38.370911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:38.371349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:38.372665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:38.373313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:38.373752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:38.378470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:38.673074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:57:38.673572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:57:38.674107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:57:38.675278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:57:38.675781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:57:38.680379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:38.689310 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac523b4f-282a-430c-a857-2d01d2e9560a tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1317 microversion: 2.1 time: 0.331905 Oct 01 20:57:38.689891 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1083/2235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:38 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:38.700848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:38.701462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:38.705604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:38.706175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:38.706641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:38.708015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:38.708515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:38.708845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:38.730560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:38.731348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:38.732060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:38.733458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:38.734435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:38.734643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:38.735451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:38.746659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Getting quotas for project 3cf38b1a4bc4458199fea3373632117d. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:57:38.753286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Getting quotas for user 4e76b153982141d8964ecbb118d19eab and project 3cf38b1a4bc4458199fea3373632117d. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:57:38.769055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:38.771378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:57:38.774361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:57:38.826457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:38.826858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:38.827301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:38.827868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lazy-loading 'fault' on Instance uuid 2436dc36-6559-4fc9-bb2b-6fe7350953be {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:38.871479 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-db58d17c-88d9-4e67-977b-833eccf465e1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823240 Oct 01 20:57:38.873551 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1153/2236] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:57:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:57:38.886522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-49e1c6b6-7b24-40a5-b173-da3589122f30 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:38.887178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-49e1c6b6-7b24-40a5-b173-da3589122f30 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:38.901580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:38.915174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:38.918161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a418c7b850684796bf4022c5b05e936d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49706c672bdd47d39405f8d7b80636ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:38.923417 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a3ad75af-92b4-4772-80e1-c242842401b5 tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 200 len: 1411 microversion: 2.54 time: 0.231396 Oct 01 20:57:38.928520 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1084/2237] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:38 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 1411 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 20:57:39.011378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-49e1c6b6-7b24-40a5-b173-da3589122f30 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:39.022682 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-49e1c6b6-7b24-40a5-b173-da3589122f30 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1217 microversion: 2.1 time: 0.140625 Oct 01 20:57:39.026657 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1154/2238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:38 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1217 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:39.041525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:39.042867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:39.056397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:39.056896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:39.057339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:39.063262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:39.063877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:39.064919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:39.073716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:39.074513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:39.086854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:39.087560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:39.089435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:39.090273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:39.092197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:39.092813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:39.427147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:39.438513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:39.440963 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8f96987-47d1-4f0d-a743-06b7273dded1 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1308 microversion: 2.1 time: 0.403918 Oct 01 20:57:39.443279 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1085/2239] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:39 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:39.451069 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-63c41036-c517-4012-a082-def4c9641ce2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.381240 Oct 01 20:57:39.462541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-68ecf293-38e0-4544-8cb8-43fac447eb47 req-cf3306b3-d442-432e-be8c-5fb028c500aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c801254-bf56-4ffe-9124-3d27ac319f92", "name": "network-vif-plugged", "status": "completed", "tag": "e5468503-c18d-4820-827a-3372343bea82"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:39.473357 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1155/2240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:39 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:39.474873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-68ecf293-38e0-4544-8cb8-43fac447eb47 req-cf3306b3-d442-432e-be8c-5fb028c500aa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:39.475368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-68ecf293-38e0-4544-8cb8-43fac447eb47 req-cf3306b3-d442-432e-be8c-5fb028c500aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:39.475821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-68ecf293-38e0-4544-8cb8-43fac447eb47 req-cf3306b3-d442-432e-be8c-5fb028c500aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:39.488498 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-68ecf293-38e0-4544-8cb8-43fac447eb47 req-cf3306b3-d442-432e-be8c-5fb028c500aa service nova] Creating event network-vif-plugged:e5468503-c18d-4820-827a-3372343bea82 for instance 6c801254-bf56-4ffe-9124-3d27ac319f92 on nch1-master-1 Oct 01 20:57:39.511539 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-68ecf293-38e0-4544-8cb8-43fac447eb47 req-cf3306b3-d442-432e-be8c-5fb028c500aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066000 Oct 01 20:57:39.514310 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1086/2241] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:39.713359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:39.713976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:39.720714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:39.721559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:39.723300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:39.724388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:39.725166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:39.726332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:39.959329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:39.960329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] [instance: 2436dc36-6559-4fc9-bb2b-6fe7350953be] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:39.969573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:39.970617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:39.971277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:39.972311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:39.973557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:39.974466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:39.996564 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] HTTP exception thrown: Instance 2436dc36-6559-4fc9-bb2b-6fe7350953be could not be found. Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Request method failure captured: Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be HTTP/1.1 Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKmPRVzLEM3vrsgQkFzIAsXNyCMrspp1Dy4FuIPFip16CTnM8-sXGwvUjLCIaKSwx_BEJSTDXjJPhUn7spy9gk4-b2CI66Pk6s9irRO45NWlOw5vBlfIBIthGN4fdlm1ZlWHo9vhF6p3E_0HoeWdvxwPD9GLV28BNdHvgY2Da-x0jo4 Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.54 Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 49706c672bdd47d39405f8d7b80636ca Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerShowV254Test-1653226477 Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_49706c672bdd47d39405f8d7b80636ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49706c672bdd47d39405f8d7b80636ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/49706c672bdd47d39405f8d7b80636ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49706c672bdd47d39405f8d7b80636ca"}]}] Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerShowV254Test-1653226477 Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 49706c672bdd47d39405f8d7b80636ca Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerShowV254Test-1653226477 Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerShowV254Test-1653226477-project Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a418c7b850684796bf4022c5b05e936d Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerShowV254Test-1653226477-project Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 2436dc36-6559-4fc9-bb2b-6fe7350953be could not be found. Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2436dc36-6559-4fc9-bb2b-6fe7350953be'} Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2436dc36-6559-4fc9-bb2b-6fe7350953be could not be found. Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2436dc36-6559-4fc9-bb2b-6fe7350953be could not be found. Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:39.999090 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:40.002416 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:40.002416 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:40.002416 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:40.002416 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:40.002416 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:40.002416 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2436dc36-6559-4fc9-bb2b-6fe7350953be could not be found. Oct 01 20:57:40.002416 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:40.004628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] Returning 404 to user: Instance 2436dc36-6559-4fc9-bb2b-6fe7350953be could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:40.005678 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-705f4151-8dce-40cd-8019-3bc76437748c tempest-ServerShowV254Test-1653226477 tempest-ServerShowV254Test-1653226477-project] 10.222.0.17 "GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be" status: 404 len: 111 microversion: 2.54 time: 0.054289 Oct 01 20:57:40.006412 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1087/2242] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 20:57:39 2022] GET /compute/v2.1/servers/2436dc36-6559-4fc9-bb2b-6fe7350953be => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:57:40.050705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:40.052887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:40.069624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:40.071487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:40.071947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:40.072698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:40.073777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:40.074228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:40.260557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:40.272033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f20b12a-95f0-41c5-9270-5442a8d1e102 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1269 microversion: 2.1 time: 0.229307 Oct 01 20:57:40.273366 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1088/2243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:40 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1269 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:40.447734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:40.468617 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c3478d95-5526-495a-95af-13ae4854d3ab tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1317 microversion: 2.1 time: 0.759562 Oct 01 20:57:40.469287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:40.487027 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1156/2244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:39 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1317 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:40.487349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:40.487349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:40.487349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:40.487349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:40.487349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:40.487970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:40.487970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:40.488333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:40.488727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:40.494793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:40.495683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:40.496198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:40.497008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:40.497648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:40.498526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:41.011441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:41.026773 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3ef55c47-860a-4080-85c9-9f3f2c4ba966 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.545071 Oct 01 20:57:41.027607 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1157/2245] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:40 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:41.117448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:41.125644 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8e4c5c62-5f91-4766-91eb-8b76e369d3e5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1308 microversion: 2.1 time: 0.661057 Oct 01 20:57:41.143271 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1089/2246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:40 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1308 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:41.307872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:41.311167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:41.340533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:41.343091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:41.348345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:41.350091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:41.350521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:41.351642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:41.492066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:41.494332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:41.495020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:41.501531 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6843270e-a2e1-4d77-88e1-8f976959bdcb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1275 microversion: 2.1 time: 0.208236 Oct 01 20:57:41.518581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:41.518766 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1158/2247] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:41 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:41.519856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:41.519856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:41.519856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:41.519856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:41.519856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:41.857084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:41.883718 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b96822de-c675-43e2-b170-14ec8319c11e tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1317 microversion: 2.1 time: 0.386496 Oct 01 20:57:41.886090 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1090/2248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:41 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:42.051802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:42.054778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:42.070244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:42.070244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:42.070244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:42.070244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:42.070244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:42.070820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:42.294260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-96cbcd27-cc17-4643-a805-bdaa8b98724b tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] Calling method '.version_select at 0x7f4173c41c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:42.391632 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-96cbcd27-cc17-4643-a805-bdaa8b98724b tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104/defaults" status: 200 len: 371 microversion: 2.1 time: 0.316466 Oct 01 20:57:42.403702 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1091/2249] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 20:57:42 2022] GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104/defaults => generated 371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:57:42.422302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:42.422302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:42.428532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:42.429048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:42.430204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:42.430998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:42.431542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:42.431998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:42.643573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:42.655115 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3f70fa86-a08a-4590-b21a-44eaaee7df7c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.607433 Oct 01 20:57:42.659774 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1159/2250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:42 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:42.667363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9da03f24-7b32-44af-a24d-217d7ccc7ec1 tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] Calling method '.version_select at 0x7f417359cf70>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:42.785552 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9da03f24-7b32-44af-a24d-217d7ccc7ec1 tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104" status: 200 len: 371 microversion: 2.1 time: 0.124335 Oct 01 20:57:42.787122 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1160/2251] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Oct 1 20:57:42 2022] GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:42.797682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:42.799274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:42.808203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:42.808997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:42.809666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:42.811183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:42.811927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:42.812434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:42.958470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:42.966132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:42.968040 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8c5abeb1-e9f6-4baa-b0b3-92521caba81d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1486 microversion: 2.1 time: 0.559727 Oct 01 20:57:42.974969 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3630597d-dc76-458a-826a-8cb72f24cebc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1275 microversion: 2.1 time: 0.186595 Oct 01 20:57:42.977259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1092/2252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:42 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1486 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:42.977997 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1161/2253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:42 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:42.985604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6645608c-b0fa-41bd-9f86-f752e2be0e0e tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] Calling method '.version_select at 0x7f41737dba60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:42.990988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:42.991782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:42.998322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:42.999444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:43.000285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:43.001210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:43.001984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:43.002650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:43.122629 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6645608c-b0fa-41bd-9f86-f752e2be0e0e tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104/defaults" status: 200 len: 371 microversion: 2.1 time: 0.144050 Oct 01 20:57:43.123753 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1093/2254] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 20:57:42 2022] GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104/defaults => generated 371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:43.137023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2b8e867-7cd2-460c-b8cd-284471a3c641 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1384530981"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:43.140731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2b8e867-7cd2-460c-b8cd-284471a3c641 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:43.191346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2b8e867-7cd2-460c-b8cd-284471a3c641 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:43.192000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2b8e867-7cd2-460c-b8cd-284471a3c641 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:43.192559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2b8e867-7cd2-460c-b8cd-284471a3c641 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:43.198187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2b8e867-7cd2-460c-b8cd-284471a3c641 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:43.199057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2b8e867-7cd2-460c-b8cd-284471a3c641 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:43.199719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2b8e867-7cd2-460c-b8cd-284471a3c641 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:43.499199 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2b8e867-7cd2-460c-b8cd-284471a3c641 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "POST /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92/action" status: 202 len: 0 microversion: 2.1 time: 0.373995 Oct 01 20:57:43.505246 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1094/2255] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:57:43 2022] POST /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 20:57:43.510803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2d5d1be-d47f-4b33-bdb4-2c9c2467be77 tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] Calling method '.version_select at 0x7f4173028940>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:43.646530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:43.655641 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c2d5d1be-d47f-4b33-bdb4-2c9c2467be77 tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104" status: 200 len: 371 microversion: 2.1 time: 0.148929 Oct 01 20:57:43.664008 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1095/2256] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Oct 1 20:57:43 2022] GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104 => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:43.671340 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1fafdd9a-63b3-4892-be1d-3535b39b1446 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1317 microversion: 2.1 time: 0.692026 Oct 01 20:57:43.674699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-05310797-4fc6-400a-bae5-6c7c2b011e1f req-1258ae26-e600-49b5-a513-f9fab24f99ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42b06b0-81ad-4fc3-a82e-790eb097e105", "name": "network-vif-plugged", "status": "completed", "tag": "45614db4-614d-41b4-b508-a44dd8e41c58"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:43.677345 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1162/2257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:42 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:43.687840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ee95865-8303-4160-b93b-1b906c246887 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41727b31f0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:43.712789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-05310797-4fc6-400a-bae5-6c7c2b011e1f req-1258ae26-e600-49b5-a513-f9fab24f99ec service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:43.713282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-05310797-4fc6-400a-bae5-6c7c2b011e1f req-1258ae26-e600-49b5-a513-f9fab24f99ec service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:43.713898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-05310797-4fc6-400a-bae5-6c7c2b011e1f req-1258ae26-e600-49b5-a513-f9fab24f99ec service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:43.743879 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-05310797-4fc6-400a-bae5-6c7c2b011e1f req-1258ae26-e600-49b5-a513-f9fab24f99ec service nova] Creating event network-vif-plugged:45614db4-614d-41b4-b508-a44dd8e41c58 for instance f42b06b0-81ad-4fc3-a82e-790eb097e105 on nch1-master-1 Oct 01 20:57:43.759909 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-05310797-4fc6-400a-bae5-6c7c2b011e1f req-1258ae26-e600-49b5-a513-f9fab24f99ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100707 Oct 01 20:57:43.760698 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1096/2258] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:43.789177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7438027d-9b50-4e60-8f74-0fc6e3bea5ac tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] Calling method '.version_select at 0x7f4173ac2b80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:43.792395 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3ee95865-8303-4160-b93b-1b906c246887 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e" status: 200 len: 1412 microversion: 2.1 time: 0.113525 Oct 01 20:57:43.793014 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1163/2259] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:43 2022] GET /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:43.809302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:43.823245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:43.844167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:43.845065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:43.845928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:43.847132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:43.847938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:43.848589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:43.951048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:44.005942 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7438027d-9b50-4e60-8f74-0fc6e3bea5ac tempest-QuotasTestJSON-303158974 tempest-QuotasTestJSON-303158974-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104?user_id=6249e0b4b3954668ad9313180a72cba5" status: 200 len: 371 microversion: 2.1 time: 0.241185 Oct 01 20:57:44.014533 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1097/2260] 10.222.0.17 () {58 vars in 1323 bytes} [Sat Oct 1 20:57:43 2022] GET /compute/v2.1/os-quota-sets/5e3d28e616bc412da6a6698f461dd104?user_id=6249e0b4b3954668ad9313180a72cba5 => generated 371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:44.027765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02a0ebf3-55a5-4cba-a5dd-dfad0ccc903a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f4172f76310>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:44.113544 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02a0ebf3-55a5-4cba-a5dd-dfad0ccc903a tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e" status: 200 len: 1412 microversion: 2.1 time: 0.096800 Oct 01 20:57:44.114136 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1098/2261] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:44 2022] GET /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:44.124093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:44.125085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:44.134218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:44.135140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:44.135735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:44.136770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:44.137842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:44.138454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:44.916434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:44.936044 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b3362658-c28f-438e-9673-8c8736e9b2ae tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 1.141280 Oct 01 20:57:44.938473 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1164/2262] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:43 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:44.946762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d6173ae1-8c63-47e6-bf09-949c4b460069 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417272d430>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:45.176829 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d6173ae1-8c63-47e6-bf09-949c4b460069 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e" status: 204 len: 0 microversion: 2.1 time: 0.235989 Oct 01 20:57:45.177663 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1165/2263] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:44 2022] DELETE /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:57:45.182927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:45.184459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:45.193229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:45.194060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:45.194753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:45.195891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:45.196734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:45.198851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:45.254406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:45.265554 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-04334d00-e58b-4745-a94e-181ae8a11247 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1317 microversion: 2.1 time: 1.146077 Oct 01 20:57:45.266914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1099/2264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:44 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1317 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:45.274145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d54595ff-ddbf-4793-80c4-199e9822def2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417303a1f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:45.312585 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d54595ff-ddbf-4793-80c4-199e9822def2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Image not found. Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d54595ff-ddbf-4793-80c4-199e9822def2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e HTTP/1.1 Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '123402f3-dc79-479e-81fd-11a8d230121e'} Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 123402f3-dc79-479e-81fd-11a8d230121e Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 20:57:45.316916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 123402f3-dc79-479e-81fd-11a8d230121e could not be found. Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d54595ff-ddbf-4793-80c4-199e9822def2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:45.320980 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d54595ff-ddbf-4793-80c4-199e9822def2 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e" status: 404 len: 62 microversion: 2.1 time: 0.051891 Oct 01 20:57:45.328139 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1100/2265] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:45 2022] GET /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:45.331106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:45.331761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:45.341344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:45.342076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:45.342690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:45.343745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:45.344497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:45.345204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:45.581617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:45.598272 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8c7e13a6-8ffe-4bb6-be63-cc23746f7af3 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1317 microversion: 2.1 time: 0.417377 Oct 01 20:57:45.600118 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1166/2266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:45 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:45.751403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:45.771575 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80d082f7-8edf-44c1-9769-7a71188e165c tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1504 microversion: 2.1 time: 0.445128 Oct 01 20:57:45.787886 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1101/2267] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:45 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1504 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:45.962668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:45.963304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:45.980000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:45.980690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:45.981277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:45.982191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:45.982832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:45.983419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:46.295476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:46.296834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:46.313460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:46.318632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:46.319337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:46.320566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:46.321238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:46.321863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:46.468817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:46.480819 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0cef8f96-0b16-46cb-ba60-030e2d0afa0c tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.521977 Oct 01 20:57:46.497871 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1167/2268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:45 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:46.623252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:46.624134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:46.634775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:46.635208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:46.635835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:46.636858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:46.637347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:46.637784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:46.666546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:46.675917 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd7ef5b0-c529-47d1-81cd-dc667a617edc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1317 microversion: 2.1 time: 0.385950 Oct 01 20:57:46.680931 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1102/2269] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:46 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:46.723844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6e320982-fbce-47b3-b6c1-9640861880cd req-023f9915-68e9-48d2-88e6-e2eb8d5d07ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7a2841-f1d1-4a9e-8121-d1e0a418dd21", "tag": "21b76ebd-44ca-4ccb-9d42-c987237b2347"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:46.751158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6e320982-fbce-47b3-b6c1-9640861880cd req-023f9915-68e9-48d2-88e6-e2eb8d5d07ff service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:46.751720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6e320982-fbce-47b3-b6c1-9640861880cd req-023f9915-68e9-48d2-88e6-e2eb8d5d07ff service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:46.752167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6e320982-fbce-47b3-b6c1-9640861880cd req-023f9915-68e9-48d2-88e6-e2eb8d5d07ff service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:46.765787 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6e320982-fbce-47b3-b6c1-9640861880cd req-023f9915-68e9-48d2-88e6-e2eb8d5d07ff service nova] Creating event network-changed:21b76ebd-44ca-4ccb-9d42-c987237b2347 for instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 on nch2-master-1 Oct 01 20:57:46.783854 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6e320982-fbce-47b3-b6c1-9640861880cd req-023f9915-68e9-48d2-88e6-e2eb8d5d07ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063728 Oct 01 20:57:46.785282 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1103/2270] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:57:46.795628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:46.796517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:46.805129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:46.805856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:46.806637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:46.807735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:46.808780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:46.809404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.053141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:47.148800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:47.158033 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c505992a-20b1-480e-86cc-3272899c210f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1506 microversion: 2.1 time: 0.538667 Oct 01 20:57:47.167779 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1168/2271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:46 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:47.194082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d569e2a3-cd90-409f-a9ee-98a12c710435 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:47.194782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d569e2a3-cd90-409f-a9ee-98a12c710435 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:47.201881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d569e2a3-cd90-409f-a9ee-98a12c710435 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.202564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d569e2a3-cd90-409f-a9ee-98a12c710435 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.203185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d569e2a3-cd90-409f-a9ee-98a12c710435 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.204742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d569e2a3-cd90-409f-a9ee-98a12c710435 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.205335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d569e2a3-cd90-409f-a9ee-98a12c710435 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.205874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d569e2a3-cd90-409f-a9ee-98a12c710435 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.245077 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d569e2a3-cd90-409f-a9ee-98a12c710435 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105/ips" status: 200 len: 109 microversion: 2.1 time: 0.055057 Oct 01 20:57:47.256761 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1169/2272] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 20:57:47 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105/ips => generated 109 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:57:47.263438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2fef9544-58c1-4f76-b956-05cd66a6c0ca tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:47.264305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2fef9544-58c1-4f76-b956-05cd66a6c0ca tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:47.276379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fef9544-58c1-4f76-b956-05cd66a6c0ca tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.277461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fef9544-58c1-4f76-b956-05cd66a6c0ca tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.278334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fef9544-58c1-4f76-b956-05cd66a6c0ca tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.280338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fef9544-58c1-4f76-b956-05cd66a6c0ca tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.281086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fef9544-58c1-4f76-b956-05cd66a6c0ca tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.283686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fef9544-58c1-4f76-b956-05cd66a6c0ca tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.322909 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2fef9544-58c1-4f76-b956-05cd66a6c0ca tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105/ips" status: 200 len: 109 microversion: 2.1 time: 0.064260 Oct 01 20:57:47.332090 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1170/2273] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 20:57:47 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105/ips => generated 109 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:47.339914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b473aecc-52a0-4cfc-8023-1581a89c03c0 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:47.343898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b473aecc-52a0-4cfc-8023-1581a89c03c0 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:47.354513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b473aecc-52a0-4cfc-8023-1581a89c03c0 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.355688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b473aecc-52a0-4cfc-8023-1581a89c03c0 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.357512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b473aecc-52a0-4cfc-8023-1581a89c03c0 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.359230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b473aecc-52a0-4cfc-8023-1581a89c03c0 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.360040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b473aecc-52a0-4cfc-8023-1581a89c03c0 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.361290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b473aecc-52a0-4cfc-8023-1581a89c03c0 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.379715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:47.390105 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-835aa517-c021-4c5f-ad60-95fe05a4cf24 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1499 microversion: 2.1 time: 0.598756 Oct 01 20:57:47.393315 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1104/2274] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:46 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1499 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:47.462091 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b473aecc-52a0-4cfc-8023-1581a89c03c0 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105/ips/tempest-ServerAddressesTestJSON-1567832070-network" status: 200 len: 94 microversion: 2.1 time: 0.128141 Oct 01 20:57:47.466804 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1171/2275] 10.222.0.17 () {58 vars in 1401 bytes} [Sat Oct 1 20:57:47 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105/ips/tempest-ServerAddressesTestJSON-1567832070-network => generated 94 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:57:47.479923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:47.480583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:47.488854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.489354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.489795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.490893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.491710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.492151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.506953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:47.507845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:47.515976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.517533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.521270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.522184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.522700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.523137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.534815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:57:47.589500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:47.666381 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e5e03986-fe1f-4bfe-988f-ffc05996247d tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 204 len: 0 microversion: 2.1 time: 0.191264 Oct 01 20:57:47.672218 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1105/2276] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:57:47 2022] DELETE /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:57:47.687583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:47.689178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:47.701049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.702289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.702928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.705571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:47.707351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:47.707958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:47.949989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:47.964237 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-88d83c52-7917-4525-9db1-7aecec5469ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.463409 Oct 01 20:57:47.974853 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1172/2277] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:47 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:48.164497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-05bb712b-2e20-4f24-906d-db9c40a792ce tempest-ComputeTenantNetworksTest-1381998791 tempest-ComputeTenantNetworksTest-1381998791-project] Calling method '.version_select at 0x7f4173237670>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:48.513871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:48.523431 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a0909b1-6ba0-460c-8d40-c6971d0f91ad tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1512 microversion: 2.1 time: 0.843224 Oct 01 20:57:48.524021 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1106/2278] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:47 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1512 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:48.528641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:48.529249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:48.535436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:48.536079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:48.536653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:48.537518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:48.538273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:48.538863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:48.675839 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-05bb712b-2e20-4f24-906d-db9c40a792ce tempest-ComputeTenantNetworksTest-1381998791 tempest-ComputeTenantNetworksTest-1381998791-project] 10.222.0.17 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.709058 Oct 01 20:57:48.683959 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1173/2279] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 20:57:47 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:48.692097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:48.694543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:48.730455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:48.731000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:48.735241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:48.736444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:48.737443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:48.739115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:48.741287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=20 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:48.771437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:48.784186 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4aeaf40-4cc6-4db8-9004-38f0c057e203 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1317 microversion: 2.1 time: 0.258932 Oct 01 20:57:48.785778 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1107/2280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:48 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:48.799086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99b3f18c-b461-4d7e-bab2-e3cbf8285dc1 tempest-ComputeTenantNetworksTest-1381998791 tempest-ComputeTenantNetworksTest-1381998791-project] Calling method '.version_select at 0x7f4173bc8820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:49.017737 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99b3f18c-b461-4d7e-bab2-e3cbf8285dc1 tempest-ComputeTenantNetworksTest-1381998791 tempest-ComputeTenantNetworksTest-1381998791-project] 10.222.0.17 "GET /compute/v2.1/os-tenant-networks/8b8ac916-2a87-4233-904f-75234ee09b4e" status: 200 len: 140 microversion: 2.1 time: 0.230824 Oct 01 20:57:49.018647 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1108/2281] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 20:57:48 2022] GET /compute/v2.1/os-tenant-networks/8b8ac916-2a87-4233-904f-75234ee09b4e => generated 140 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:49.024105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:49.024480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:49.051735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:49.052420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:49.053046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:49.053921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:49.054553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:49.055129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:49.611402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:49.625809 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e1e83592-3a83-4add-85e0-2da98666740f tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1486 microversion: 2.1 time: 0.939678 Oct 01 20:57:49.627740 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1174/2282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:48 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1486 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:49.633759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:49.634639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:49.641856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:49.642641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:49.643333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:49.644258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:49.644867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:49.645521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:49.686840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:49.698360 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2391d6d-602d-45f7-9276-834c4d673c81 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.678094 Oct 01 20:57:49.699163 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1109/2283] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:49 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:49.710906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:49.711587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:49.726004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:49.727337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:49.728320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:49.729029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:49.729523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:49.734888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:49.780873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:57:49.929102 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec51b3d7-0b8e-4386-a67d-7a05a66cba6e tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 204 len: 0 microversion: 2.1 time: 0.227155 Oct 01 20:57:49.935071 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1110/2284] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:57:49 2022] DELETE /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:57:49.942087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:49.942891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:49.951309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:49.951811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:49.952257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:49.952981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:49.954265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:49.954707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:50.521419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:50.537002 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5909e358-10b9-4b40-88d8-1f82124f3521 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1512 microversion: 2.1 time: 0.906008 Oct 01 20:57:50.566734 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1175/2285] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:49 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1512 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:50.585041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0bafeb32-62b6-47d5-a7c7-c8aab87a76d3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41727564c0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:50.704496 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-0bafeb32-62b6-47d5-a7c7-c8aab87a76d3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Image not found. Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0bafeb32-62b6-47d5-a7c7-c8aab87a76d3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e HTTP/1.1 Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: exception: Image not found. Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '123402f3-dc79-479e-81fd-11a8d230121e'} Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 123402f3-dc79-479e-81fd-11a8d230121e to delete Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 123402f3-dc79-479e-81fd-11a8d230121e could not be found. Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:50.708127 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0bafeb32-62b6-47d5-a7c7-c8aab87a76d3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Image not found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:50.712054 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0bafeb32-62b6-47d5-a7c7-c8aab87a76d3 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e" status: 404 len: 62 microversion: 2.1 time: 0.142935 Oct 01 20:57:50.713344 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1176/2286] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:50 2022] DELETE /compute/v2.1/images/123402f3-dc79-479e-81fd-11a8d230121e => generated 62 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:50.736393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:50.737525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:50.762932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:50.763943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:50.764592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:50.767574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:50.768314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:50.770713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:50.806539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:50.838509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:57:50.921173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:50.937384 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9714e74f-9812-4a65-8732-09c1e9c033ba tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1317 microversion: 2.1 time: 0.999505 Oct 01 20:57:50.952086 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1111/2287] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:49 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1317 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:50.969776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:50.971374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:50.979597 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.compute.api [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Instance is already in deleting state, ignoring this request Oct 01 20:57:50.981093 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e3ee1725-0d98-434f-8f02-8f9a51e89981 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 204 len: 0 microversion: 2.1 time: 0.264482 Oct 01 20:57:50.982867 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1177/2288] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:57:50 2022] DELETE /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:57:50.989123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:50.989913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:50.991375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:50.992789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:50.994327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:50.996956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:51.002435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:51.003543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:51.022911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:51.023423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:51.023872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:51.024606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:51.035978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:51.046326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:51.427651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:51.441339 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-59607259-2e7d-48d6-9b12-7146cffa5886 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.483221 Oct 01 20:57:51.443300 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1112/2289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:50 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:51.564612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:51.566004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:51.587721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:51.589232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:51.590333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:51.592698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:51.593360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:51.596200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:52.040605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:52.058384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d08233105349009c9dcf5f25b82229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c007c403f0b8414eb5bb14d11897c71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:52.070315 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-32f3f8ff-75c9-447c-b073-0066d0943b4f tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 200 len: 1470 microversion: 2.1 time: 0.510814 Oct 01 20:57:52.070832 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e2abdadf-3671-470d-a3cd-dce40650ac3d tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1492 microversion: 2.1 time: 1.079830 Oct 01 20:57:52.075316 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1178/2290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:50 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1492 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:52.097749 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1113/2291] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:51 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 1470 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:52.104383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:52.105019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:52.109404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-f9f6e451-f045-4173-badc-09cbcc33b378 req-cab4f447-761e-4b4d-8f63-ce74e4dc95d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42b06b0-81ad-4fc3-a82e-790eb097e105", "name": "network-vif-deleted", "tag": "45614db4-614d-41b4-b508-a44dd8e41c58"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:52.137785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:52.138335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:52.138823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:52.140267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:52.144747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:52.145920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:52.156451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f9f6e451-f045-4173-badc-09cbcc33b378 req-cab4f447-761e-4b4d-8f63-ce74e4dc95d3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:52.157125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f9f6e451-f045-4173-badc-09cbcc33b378 req-cab4f447-761e-4b4d-8f63-ce74e4dc95d3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:52.161389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f9f6e451-f045-4173-badc-09cbcc33b378 req-cab4f447-761e-4b4d-8f63-ce74e4dc95d3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:52.210938 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-f9f6e451-f045-4173-badc-09cbcc33b378 req-cab4f447-761e-4b4d-8f63-ce74e4dc95d3 service nova] Creating event network-vif-deleted:45614db4-614d-41b4-b508-a44dd8e41c58 for instance f42b06b0-81ad-4fc3-a82e-790eb097e105 on nch1-master-1 Oct 01 20:57:52.234375 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-f9f6e451-f045-4173-badc-09cbcc33b378 req-cab4f447-761e-4b4d-8f63-ce74e4dc95d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132033 Oct 01 20:57:52.239335 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1114/2292] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:52.473370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:52.474722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:52.493575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:52.493998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:52.498152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:52.498955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:52.499438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:52.499899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:52.779235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=10 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:52.903112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:52.922225 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c9a0a418-71e1-4720-86d4-6f6dde700ca7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1317 microversion: 2.1 time: 0.845292 Oct 01 20:57:52.924538 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1179/2293] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:52 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1317 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:52.996154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:53.015293 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-124f2630-6f5d-4dce-b2f9-403686a21f5e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.543739 Oct 01 20:57:53.031093 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1115/2294] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:52 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:53.104289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:53.105195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] [instance: f42b06b0-81ad-4fc3-a82e-790eb097e105] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:53.110542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:53.111891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:53.120944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:53.123477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:53.125058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:53.125774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:53.127050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:53.130172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:53.134439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:53.134821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:53.136441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:53.136794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:53.139275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:53.141339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:53.177601 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] HTTP exception thrown: Instance f42b06b0-81ad-4fc3-a82e-790eb097e105 could not be found. Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Request method failure captured: Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 HTTP/1.1 Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKmzEaD7h8r8WjqGIjiY6Z0_sr2BHvtIErhxp3a5j_H9MLVmlF51Zgoab7ecpr395cBuq79g7DzPPfb66mFtEzHIOiPjxZFOvogy1N_IqOzT5sfQzLJMKm-Eu8gzhH7SdNFz9AIi0zugeiiL3rOuFjGXVcX36NQZxIvWUEd8VvCLKC4 Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: c007c403f0b8414eb5bb14d11897c71a Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerAddressesTestJSON-520614790 Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c007c403f0b8414eb5bb14d11897c71a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c007c403f0b8414eb5bb14d11897c71a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c007c403f0b8414eb5bb14d11897c71a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c007c403f0b8414eb5bb14d11897c71a"}]}] Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerAddressesTestJSON-520614790 Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: c007c403f0b8414eb5bb14d11897c71a Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerAddressesTestJSON-520614790 Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerAddressesTestJSON-520614790-project Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 60d08233105349009c9dcf5f25b82229 Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerAddressesTestJSON-520614790-project Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance f42b06b0-81ad-4fc3-a82e-790eb097e105 could not be found. Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'f42b06b0-81ad-4fc3-a82e-790eb097e105'} Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f42b06b0-81ad-4fc3-a82e-790eb097e105 could not be found. Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f42b06b0-81ad-4fc3-a82e-790eb097e105 could not be found. Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:53.182866 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:53.187332 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:53.187332 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:53.187332 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:53.187332 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:53.187332 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:53.187332 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f42b06b0-81ad-4fc3-a82e-790eb097e105 could not be found. Oct 01 20:57:53.187332 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:53.191324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] Returning 404 to user: Instance f42b06b0-81ad-4fc3-a82e-790eb097e105 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:53.192623 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b9daded1-ce37-46ce-baa9-524271153746 tempest-ServerAddressesTestJSON-520614790 tempest-ServerAddressesTestJSON-520614790-project] 10.222.0.17 "GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105" status: 404 len: 111 microversion: 2.1 time: 0.092724 Oct 01 20:57:53.194947 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1180/2295] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:53 2022] GET /compute/v2.1/servers/f42b06b0-81ad-4fc3-a82e-790eb097e105 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:57:53.209923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f4ec4403-1bec-421e-8381-6051940e3442 req-15328837-0af4-4340-9e27-85b870a55aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7a2841-f1d1-4a9e-8121-d1e0a418dd21", "name": "network-vif-plugged", "status": "completed", "tag": "21b76ebd-44ca-4ccb-9d42-c987237b2347"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:53.229246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f4ec4403-1bec-421e-8381-6051940e3442 req-15328837-0af4-4340-9e27-85b870a55aed service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:53.230329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f4ec4403-1bec-421e-8381-6051940e3442 req-15328837-0af4-4340-9e27-85b870a55aed service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:53.231012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f4ec4403-1bec-421e-8381-6051940e3442 req-15328837-0af4-4340-9e27-85b870a55aed service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:53.245623 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f4ec4403-1bec-421e-8381-6051940e3442 req-15328837-0af4-4340-9e27-85b870a55aed service nova] Creating event network-vif-plugged:21b76ebd-44ca-4ccb-9d42-c987237b2347 for instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 on nch2-master-1 Oct 01 20:57:53.252327 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f4ec4403-1bec-421e-8381-6051940e3442 req-15328837-0af4-4340-9e27-85b870a55aed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053913 Oct 01 20:57:53.254295 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1181/2296] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:53.949655 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:53.950609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:53.963543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:53.965244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:53.965703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:53.967330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:53.971514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:53.972272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:53.994995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:54.252613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:54.268367 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-717bd293-fa92-40c3-92ee-8274d82c1fbd tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1492 microversion: 2.1 time: 1.162858 Oct 01 20:57:54.272325 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1116/2297] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:53 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1492 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:54.292836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:54.295862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:54.331186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:54.335019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:54.342707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:54.343589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:54.344426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:54.344878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:54.674300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:54.697153 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f789244b-b99d-476e-8fa2-5ff7626b4fa1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1317 microversion: 2.1 time: 0.747733 Oct 01 20:57:54.698805 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1182/2298] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:53 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:54.720956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c6d23ef7-301b-4cb1-81e9-a5a66a44721e req-97fb01a0-9972-480d-a158-b7d5cc96fa02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c801254-bf56-4ffe-9124-3d27ac319f92", "name": "network-vif-deleted", "tag": "e5468503-c18d-4820-827a-3372343bea82"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:54.762057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c6d23ef7-301b-4cb1-81e9-a5a66a44721e req-97fb01a0-9972-480d-a158-b7d5cc96fa02 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:54.762576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c6d23ef7-301b-4cb1-81e9-a5a66a44721e req-97fb01a0-9972-480d-a158-b7d5cc96fa02 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:54.763248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c6d23ef7-301b-4cb1-81e9-a5a66a44721e req-97fb01a0-9972-480d-a158-b7d5cc96fa02 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:54.801108 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c6d23ef7-301b-4cb1-81e9-a5a66a44721e req-97fb01a0-9972-480d-a158-b7d5cc96fa02 service nova] Creating event network-vif-deleted:e5468503-c18d-4820-827a-3372343bea82 for instance 6c801254-bf56-4ffe-9124-3d27ac319f92 on nch1-master-1 Oct 01 20:57:54.813568 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c6d23ef7-301b-4cb1-81e9-a5a66a44721e req-97fb01a0-9972-480d-a158-b7d5cc96fa02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109466 Oct 01 20:57:54.816451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:54.816888 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1183/2299] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:57:54.834625 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77e82ae6-e0bd-4c91-b81f-9d69df3927e1 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.553333 Oct 01 20:57:54.835770 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1117/2300] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:54 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:55.301628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:55.302739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:55.334178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:55.336195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:55.337445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:55.338775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:55.340892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:55.343213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:55.433168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:55.433670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:55.440439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:55.441162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lazy-loading 'fault' on Instance uuid 6c801254-bf56-4ffe-9124-3d27ac319f92 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:57:55.596126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d180849a694494e89843c0c315acd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0b38cea2c345c68c51c4d8cb9c07e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:55.609395 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b340b1e2-6d50-43cf-9c20-96505c7f64b6 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 200 len: 1298 microversion: 2.1 time: 0.311457 Oct 01 20:57:55.611164 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1184/2301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:55 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 1298 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:55.724599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:55.726080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:55.739720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:55.740229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:55.740681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:55.741412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:55.741881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:55.742320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:55.859292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:55.859925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:55.870316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:55.870875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:55.871528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:55.872453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:55.873094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:55.873820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:56.119248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:56.132578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff4145a4-9f1f-4662-956e-eb86a340786b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1466 microversion: 2.1 time: 0.412355 Oct 01 20:57:56.139014 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1118/2302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:55 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1466 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:56.163987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-957819019", "metadata": {"image_type": "test"}}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:57:56.167045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:56.174679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:56.175675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:56.176719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:56.178382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:56.179113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:56.180998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:56.308886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Getting quotas for project 3cf38b1a4bc4458199fea3373632117d. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:57:56.327863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:56.328887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Getting quotas for user 4e76b153982141d8964ecbb118d19eab and project 3cf38b1a4bc4458199fea3373632117d. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:57:56.348937 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ad028421-477e-4b90-aebd-96c127bf6586 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.493217 Oct 01 20:57:56.349388 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1185/2303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:55 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:56.635497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:56.636210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 6c801254-bf56-4ffe-9124-3d27ac319f92] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:56.658143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:56.658826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:56.666418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:56.668927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:56.670436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:56.672330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:56.677632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:57:56.726442 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c6cee1fa-ce9c-4725-a536-224dd8ed6889 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "POST /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21/action" status: 202 len: 0 microversion: 2.1 time: 0.564521 Oct 01 20:57:56.736127 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1119/2304] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:57:56 2022] POST /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 01 20:57:56.745753 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Instance 6c801254-bf56-4ffe-9124-3d27ac319f92 could not be found. Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 HTTP/1.1 Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 6c801254-bf56-4ffe-9124-3d27ac319f92 could not be found. Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '6c801254-bf56-4ffe-9124-3d27ac319f92'} Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c801254-bf56-4ffe-9124-3d27ac319f92 could not be found. Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c801254-bf56-4ffe-9124-3d27ac319f92 could not be found. Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.750968 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:56.757333 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:56.757333 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:56.757333 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:56.757333 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:56.757333 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c801254-bf56-4ffe-9124-3d27ac319f92 could not be found. Oct 01 20:57:56.757333 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.758000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e845c5c0-dd33-47cc-9009-7c0f240a813c tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4173822a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:56.758143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Instance 6c801254-bf56-4ffe-9124-3d27ac319f92 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:56.758143 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-efd44dc9-afdb-40f1-875b-2ddea3cb4921 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92" status: 404 len: 111 microversion: 2.1 time: 0.125102 Oct 01 20:57:56.762851 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1186/2305] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:56 2022] GET /compute/v2.1/servers/6c801254-bf56-4ffe-9124-3d27ac319f92 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:57:56.794883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5dfdd7a1-6c2f-4b10-9f9b-60e06e7673ec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417369d820>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:56.860562 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-5dfdd7a1-6c2f-4b10-9f9b-60e06e7673ec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Image not found. Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5dfdd7a1-6c2f-4b10-9f9b-60e06e7673ec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 HTTP/1.1 Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: exception: Image not found. Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'b3398fc3-2b0e-47e9-8f1a-801f36223488'} Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b3398fc3-2b0e-47e9-8f1a-801f36223488 to delete Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3398fc3-2b0e-47e9-8f1a-801f36223488 could not be found. Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.864855 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:56.868451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5dfdd7a1-6c2f-4b10-9f9b-60e06e7673ec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Image not found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:56.869994 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5dfdd7a1-6c2f-4b10-9f9b-60e06e7673ec tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488" status: 404 len: 62 microversion: 2.1 time: 0.102993 Oct 01 20:57:56.874411 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1187/2306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:56 2022] DELETE /compute/v2.1/images/b3398fc3-2b0e-47e9-8f1a-801f36223488 => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:56.894656 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e845c5c0-dd33-47cc-9009-7c0f240a813c tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.154021 Oct 01 20:57:56.895618 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1120/2307] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:56 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:56.908223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:56.915176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:56.936542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:56.937069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:56.937523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:56.938266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:56.941168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:56.952241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.002576 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 HTTP/1.1 Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '1a034bac-1433-439f-8bd0-f22a00cb0e32'} Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:57.008509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.011945 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.015309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:57.018015 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b32f2ec3-17bb-425a-b7dd-7f155253d7fe tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 404 len: 111 microversion: 2.1 time: 0.138341 Oct 01 20:57:57.023021 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1188/2308] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:57:56 2022] DELETE /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:57:57.032960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:57.033803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 1a034bac-1433-439f-8bd0-f22a00cb0e32] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:57.059858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.063219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.064346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.069348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.070240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.073565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.137797 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 HTTP/1.1 Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1a034bac-1433-439f-8bd0-f22a00cb0e32'} Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.139510 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.143028 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.143028 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.143028 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:57.143028 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:57.143028 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. Oct 01 20:57:57.143028 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.143028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Instance 1a034bac-1433-439f-8bd0-f22a00cb0e32 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:57.143028 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eed73857-e01a-4de8-bf4e-3fc521a99985 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32" status: 404 len: 111 microversion: 2.1 time: 0.115285 Oct 01 20:57:57.143028 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1121/2309] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:57 2022] GET /compute/v2.1/servers/1a034bac-1433-439f-8bd0-f22a00cb0e32 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:57:57.150480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a3cc7de0-8e63-44dc-8b27-d6aeb69613cf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f41735ef8b0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:57.207168 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-a3cc7de0-8e63-44dc-8b27-d6aeb69613cf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Image not found. Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a3cc7de0-8e63-44dc-8b27-d6aeb69613cf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc HTTP/1.1 Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: exception: Image not found. Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc'} Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc to delete Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc could not be found. Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.208732 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a3cc7de0-8e63-44dc-8b27-d6aeb69613cf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Image not found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:57.212417 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a3cc7de0-8e63-44dc-8b27-d6aeb69613cf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc" status: 404 len: 62 microversion: 2.1 time: 0.063943 Oct 01 20:57:57.216025 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1189/2310] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:57 2022] DELETE /compute/v2.1/images/2ec38a73-e9b7-4f1d-803e-dad1e06fd6fc => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:57.224126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:57.224918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:57.243492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.244007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.244451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.245172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.245631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.246060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.262451 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 HTTP/1.1 Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '12bb9a33-87d3-4429-93d5-2f740d08b463'} Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:57.280979 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.284542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.286894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:57.287971 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f0ea8465-71a2-4bd7-8eeb-126121940cdf tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 404 len: 111 microversion: 2.1 time: 0.072012 Oct 01 20:57:57.288728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1122/2311] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:57:57 2022] DELETE /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:57:57.297088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:57.297758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 12bb9a33-87d3-4429-93d5-2f740d08b463] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:57.326720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.327840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.328834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.329927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.330800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.332403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.376779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:57.377437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:57.391105 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.392540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.393248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.395724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 HTTP/1.1 Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '12bb9a33-87d3-4429-93d5-2f740d08b463'} Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.395834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.399805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.399805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.399805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:57.399805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:57.399805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. Oct 01 20:57:57.399805 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.399805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Instance 12bb9a33-87d3-4429-93d5-2f740d08b463 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:57.400362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.400362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.400610 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c904df91-5ac1-4d3c-8888-e2843a68a7d0 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463" status: 404 len: 111 microversion: 2.1 time: 0.104255 Oct 01 20:57:57.400683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.404428 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1190/2312] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:57 2022] GET /compute/v2.1/servers/12bb9a33-87d3-4429-93d5-2f740d08b463 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:57:57.414617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-df135749-3b93-4794-a03d-f4c8679d6ccb tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '.version_select at 0x7f417369d550>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:57.490520 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-df135749-3b93-4794-a03d-f4c8679d6ccb tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Image not found. Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-df135749-3b93-4794-a03d-f4c8679d6ccb tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 HTTP/1.1 Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: exception: Image not found. Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'f94ecfa5-bce6-45fc-9162-d2d388fb7903'} Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f94ecfa5-bce6-45fc-9162-d2d388fb7903 to delete Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f94ecfa5-bce6-45fc-9162-d2d388fb7903 could not be found. Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.492604 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-df135749-3b93-4794-a03d-f4c8679d6ccb tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Image not found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:57.496434 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-df135749-3b93-4794-a03d-f4c8679d6ccb tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903" status: 404 len: 62 microversion: 2.1 time: 0.088666 Oct 01 20:57:57.500194 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1191/2313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:57 2022] DELETE /compute/v2.1/images/f94ecfa5-bce6-45fc-9162-d2d388fb7903 => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:57:57.506435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:57.506982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:57.514965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.515484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.515938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.516674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.517144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.517589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.541815 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b HTTP/1.1 Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '4bec5b02-88e5-450e-b5ee-61fc18b2349b'} Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:57.543526 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:57.547396 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ed76c423-a56d-43fc-8ec3-015d1bcca313 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 404 len: 111 microversion: 2.1 time: 0.043777 Oct 01 20:57:57.548957 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1192/2314] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:57:57 2022] DELETE /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:57:57.554446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:57.555542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] [instance: 4bec5b02-88e5-450e-b5ee-61fc18b2349b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:57.562185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.562724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.563174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.563987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:57.564459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:57.564896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:57.587562 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] HTTP exception thrown: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Request method failure captured: Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b HTTP/1.1 Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKjtVBP1kdtFpj4t62dcogA0GtlX1eba4wICZv9CDFz_wzhKZVmwb3BQG_6LgmF9Y2lqV6TW0BreaoaPEPOsY2yoMRBbltseMeVYrq1HskeHAKob_A74K9bIaN7BF3_WYaQ0lqUU4Sf8kCzlYCl3HyP8k1hiN9C6HoZa6FkrUSPaLRA Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c0b38cea2c345c68c51c4d8cb9c07e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c0b38cea2c345c68c51c4d8cb9c07e7"}]}] Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9c0b38cea2c345c68c51c4d8cb9c07e7 Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesTestJSON-941235706 Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1d180849a694494e89843c0c315acd6d Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesTestJSON-941235706-project Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '4bec5b02-88e5-450e-b5ee-61fc18b2349b'} Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.590632 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:57:57.599409 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:57:57.599409 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:57:57.599409 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:57:57.599409 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:57:57.599409 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. Oct 01 20:57:57.599409 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:57:57.599409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] Returning 404 to user: Instance 4bec5b02-88e5-450e-b5ee-61fc18b2349b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:57:57.599409 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2127439f-ce26-48b5-97cf-361f6a4229f5 tempest-ImagesTestJSON-941235706 tempest-ImagesTestJSON-941235706-project] 10.222.0.17 "GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b" status: 404 len: 111 microversion: 2.1 time: 0.042273 Oct 01 20:57:57.599409 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1193/2315] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:57 2022] GET /compute/v2.1/servers/4bec5b02-88e5-450e-b5ee-61fc18b2349b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:57:57.913538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60bebc4e-7b85-4452-947f-5d34233e2944 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41727c7550>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:58.013032 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-60bebc4e-7b85-4452-947f-5d34233e2944 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.104335 Oct 01 20:57:58.015192 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1194/2316] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:57 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:58.045043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:58.064537 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab59bee9-67c3-4f1d-8ab4-d3b1ce39211f tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.696468 Oct 01 20:57:58.068965 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1123/2317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:57 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:57:59.031002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1bdb5053-2c7f-43a9-ba62-ddb53fb85964 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f417369d820>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:59.107998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:57:59.110904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:57:59.121600 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1bdb5053-2c7f-43a9-ba62-ddb53fb85964 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.092020 Oct 01 20:57:59.124428 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1195/2318] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:57:59 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:57:59.133170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:59.133740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:59.138022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:59.138901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:57:59.139456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:57:59.139908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:57:59.661234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:57:59.682282 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4fa0238-e507-4798-9776-48e0b15a408b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.591065 Oct 01 20:57:59.684523 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1124/2319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:57:59 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:00.142517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-729dccb3-ed78-44dd-8b86-993f3ac692aa tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f417369da60>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:00.210233 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-729dccb3-ed78-44dd-8b86-993f3ac692aa tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.076854 Oct 01 20:58:00.212229 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1196/2320] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:00 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:58:00.705600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:00.706989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:00.715469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:00.715971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:00.716411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:00.717134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:00.717593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:00.718022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:01.229229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f8281c59-0b52-40c7-906a-917c5463c9ce tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41726cd160>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:01.312260 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f8281c59-0b52-40c7-906a-917c5463c9ce tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.088305 Oct 01 20:58:01.312940 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1197/2321] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:01 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:58:01.367614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:01.380620 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-65ffb04c-2f55-4905-ac87-f4cac481380d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.678817 Oct 01 20:58:01.381606 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1125/2322] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:00 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:02.332735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-88665002-e3d0-4585-8073-65c2f2976d8e tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41736dca60>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:02.411815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:02.413831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:02.425049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:02.425656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:02.426256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:02.432898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:02.433499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:02.434401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:02.468792 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-88665002-e3d0-4585-8073-65c2f2976d8e tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.143278 Oct 01 20:58:02.469617 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1198/2323] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:02 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:02.966373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:02.985697 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b5c334df-acd1-46f9-82ec-6b7efa1ac00e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1472 microversion: 2.1 time: 0.580160 Oct 01 20:58:02.993320 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1126/2324] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:02 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1472 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:03.487781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bfbe0565-e012-4fe6-94c6-6fbf77dda0a2 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41737bb160>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:03.598485 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bfbe0565-e012-4fe6-94c6-6fbf77dda0a2 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.117443 Oct 01 20:58:03.602225 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1199/2325] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:03 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:04.031712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:04.037249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:04.065101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:04.070745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:04.081976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:04.091263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:04.091847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:04.092312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:04.144854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a9d55b39-4b11-49c4-98b7-ff8d45773fe6 req-ff9ac311-f71a-479c-a74b-aa9088e31a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7a2841-f1d1-4a9e-8121-d1e0a418dd21", "name": "network-vif-plugged", "status": "completed", "tag": "21b76ebd-44ca-4ccb-9d42-c987237b2347"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:04.205871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a9d55b39-4b11-49c4-98b7-ff8d45773fe6 req-ff9ac311-f71a-479c-a74b-aa9088e31a47 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:04.206644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a9d55b39-4b11-49c4-98b7-ff8d45773fe6 req-ff9ac311-f71a-479c-a74b-aa9088e31a47 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:04.207111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a9d55b39-4b11-49c4-98b7-ff8d45773fe6 req-ff9ac311-f71a-479c-a74b-aa9088e31a47 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:04.265783 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a9d55b39-4b11-49c4-98b7-ff8d45773fe6 req-ff9ac311-f71a-479c-a74b-aa9088e31a47 service nova] Creating event network-vif-plugged:21b76ebd-44ca-4ccb-9d42-c987237b2347 for instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 on nch2-master-1 Oct 01 20:58:04.291738 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a9d55b39-4b11-49c4-98b7-ff8d45773fe6 req-ff9ac311-f71a-479c-a74b-aa9088e31a47 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150625 Oct 01 20:58:04.292378 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1200/2326] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:04.618540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4a400a64-1337-436f-bf88-d41ffd83ade7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41736158b0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:04.715658 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4a400a64-1337-436f-bf88-d41ffd83ade7 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.099956 Oct 01 20:58:04.722345 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1201/2327] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:04 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:04.803254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:04.852245 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-604d82f5-53e5-40c0-9e7d-507b66ec6499 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1478 microversion: 2.1 time: 0.835890 Oct 01 20:58:04.865101 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1127/2328] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:04 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1478 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:05.734608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e7528e4f-9a84-4117-a33b-fc91efc2ba71 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f417365df70>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:05.822336 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e7528e4f-9a84-4117-a33b-fc91efc2ba71 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.092055 Oct 01 20:58:05.846034 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1202/2329] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:05 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:05.897663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:05.899215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:05.916439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:05.918096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:05.919705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:05.921938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:05.923136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:05.925252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:06.713693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:06.727317 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37a7aba5-dae4-4b3f-90bb-1b1c9f7b27e2 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1478 microversion: 2.1 time: 0.850044 Oct 01 20:58:06.728162 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1128/2330] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:05 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1478 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:06.842388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-64758868-4f52-49e6-b382-ebf06b3247dc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41736158b0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:07.517272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:07.529867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:07.535712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Searching by: {'deleted': False, 'project_id': 'a4961525068042aba372c046eb589a7a'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:58:07.568705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:07.570068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:07.571144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:07.572381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:07.576774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:07.578094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:07.680182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:58:07.787868 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-810ca584-abb3-401b-863f-c074bf8ec2fd tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.275925 Oct 01 20:58:07.798371 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1129/2331] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 20:58:07 2022] GET /compute/v2.1/servers => generated 339 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:07.810524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:07.811512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:07.831959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:07.832706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:07.846619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:07.848556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:07.850854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:07.851998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:09.104778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:09.115718 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd66c1ae-7359-4169-a202-d4c0931580ed tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1463 microversion: 2.1 time: 1.314654 Oct 01 20:58:09.132109 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1130/2332] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:07 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1463 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:09.169339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:09.180452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:09.207233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Searching by: {'deleted': False, 'project_id': 'a4961525068042aba372c046eb589a7a'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:58:09.233870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:09.245961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:09.247986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:09.255555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:09.258338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:09.258928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:09.379717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:58:09.517107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:09.551134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:09.554885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:09.556696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:11.161363 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-96430f1e-94e0-41e6-8a46-771f0cb80f13 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 2.025809 Oct 01 20:58:11.169889 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1131/2333] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:58:09 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:11.235323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f8a39c7-a9fa-4c1c-bad5-b12df9c8ffd0 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:11.245173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f8a39c7-a9fa-4c1c-bad5-b12df9c8ffd0 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:11.303978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a39c7-a9fa-4c1c-bad5-b12df9c8ffd0 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:11.304795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a39c7-a9fa-4c1c-bad5-b12df9c8ffd0 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:11.306774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a39c7-a9fa-4c1c-bad5-b12df9c8ffd0 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:11.309831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a39c7-a9fa-4c1c-bad5-b12df9c8ffd0 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:11.310821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a39c7-a9fa-4c1c-bad5-b12df9c8ffd0 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:11.313904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f8a39c7-a9fa-4c1c-bad5-b12df9c8ffd0 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:11.828758 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f8a39c7-a9fa-4c1c-bad5-b12df9c8ffd0 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.598313 Oct 01 20:58:11.846571 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1132/2334] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:58:11 2022] POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:58:11.893479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3203714a-96d1-4403-92e6-a9fa9fd7a8b3 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:11.921161 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3203714a-96d1-4403-92e6-a9fa9fd7a8b3 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.055114 Oct 01 20:58:11.921717 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1133/2335] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:58:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:11.937478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:11.939158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:11.957383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:11.960104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:11.961821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:11.962599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:11.976386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:11.978023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:12.132593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:12.137976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:12.138658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:12.144937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lazy-loading 'fault' on Instance uuid 41b9ddc4-96e9-4c59-b07f-e785f2179e8c {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:58:12.459214 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-64758868-4f52-49e6-b382-ebf06b3247dc tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 5.621911 Oct 01 20:58:12.459975 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1203/2336] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:06 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 5625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:12.508184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:12.511399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:12.546701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:12.596211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:12.596734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:12.597198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:12.614912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:12.615524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:12.615994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:12.795420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:58:13.145979 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6fe9380a-16d4-4d5d-b5ed-c6a000a99227 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1597 microversion: 2.1 time: 1.218357 Oct 01 20:58:13.152266 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1134/2337] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:11 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1597 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:13.181943 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5df6484d-b444-4e45-9d40-aa28424d1eb2 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 204 len: 0 microversion: 2.1 time: 0.716318 Oct 01 20:58:13.185902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64c69cbb-0555-4c84-88bf-d7ea69836494 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:13.196439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64c69cbb-0555-4c84-88bf-d7ea69836494 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:13.197413 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1204/2338] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:58:12 2022] DELETE /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:58:13.221397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:13.228884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c69cbb-0555-4c84-88bf-d7ea69836494 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:13.229616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:13.234893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c69cbb-0555-4c84-88bf-d7ea69836494 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:13.237977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c69cbb-0555-4c84-88bf-d7ea69836494 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:13.240447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c69cbb-0555-4c84-88bf-d7ea69836494 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:13.244305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c69cbb-0555-4c84-88bf-d7ea69836494 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:13.249788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c69cbb-0555-4c84-88bf-d7ea69836494 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:13.251104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:13.251744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:13.254349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:13.263300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:13.264076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:13.264720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:13.586059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:13.656734 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64c69cbb-0555-4c84-88bf-d7ea69836494 tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.476164 Oct 01 20:58:13.666606 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1135/2339] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:58:13 2022] POST /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:58:13.700201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7709e1b7-d082-494a-8ab2-db9bfc047816 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4172f76160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:13.828661 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7709e1b7-d082-494a-8ab2-db9bfc047816 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.160702 Oct 01 20:58:13.829628 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1136/2340] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:13 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:13.839343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3673dbec-8661-496b-a610-e6d43d0db1ee tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:13.865683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3673dbec-8661-496b-a610-e6d43d0db1ee tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:13.898190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3673dbec-8661-496b-a610-e6d43d0db1ee tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:13.901408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3673dbec-8661-496b-a610-e6d43d0db1ee tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:13.901994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3673dbec-8661-496b-a610-e6d43d0db1ee tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:13.905480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3673dbec-8661-496b-a610-e6d43d0db1ee tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:13.909380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3673dbec-8661-496b-a610-e6d43d0db1ee tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:13.912864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3673dbec-8661-496b-a610-e6d43d0db1ee tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:14.555376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:14.568075 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fc102db4-4d07-4a1b-b09f-8c2f1976db5c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1714 microversion: 2.1 time: 1.356526 Oct 01 20:58:14.569057 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1205/2341] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:13 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1714 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:14.849454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-93815d52-04bd-4e95-8e0c-c0fc5eb8da6d tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f417365df70>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:14.952057 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-93815d52-04bd-4e95-8e0c-c0fc5eb8da6d tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.107086 Oct 01 20:58:14.953213 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1206/2342] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:14 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:15.420799 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3673dbec-8661-496b-a610-e6d43d0db1ee tempest-ServersAdminTestJSON-242761385 tempest-ServersAdminTestJSON-242761385-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1614 microversion: 2.1 time: 1.589587 Oct 01 20:58:15.422842 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1137/2343] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:13 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1614 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:15.455074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:15.456128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:15.480083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:15.480584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:15.487193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:15.488156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:15.493057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:15.493556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:15.604026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:15.605151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:15.621403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:15.623247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:58:15.648804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:15.649490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:15.649946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:15.650737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:15.651204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:15.651627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:15.993971 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-937fdd3b-28c2-4f29-80e2-17ede91fd289 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "DELETE /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 204 len: 0 microversion: 2.1 time: 0.543516 Oct 01 20:58:16.013644 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1207/2344] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:58:15 2022] DELETE /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:58:16.027540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9184288d-d0f6-4aa5-b0ea-be9bf38cf896 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41736d7310>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:16.354249 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9184288d-d0f6-4aa5-b0ea-be9bf38cf896 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.333531 Oct 01 20:58:16.365174 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1208/2345] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:16 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:16.382443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:16.383843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:16.404948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:16.405924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:16.411484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:16.412629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:16.416201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:16.417329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:16.529826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:19.011712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:19.025574 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-86e54765-de5e-4d74-9b4f-051e247450d8 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1469 microversion: 2.1 time: 2.665636 Oct 01 20:58:19.034978 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1209/2346] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:16 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1469 bytes in 2677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:19.062562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0c80f4f3-8ea9-4897-a6fc-8bf14339d3d6 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f417276c5e0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:19.176112 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0c80f4f3-8ea9-4897-a6fc-8bf14339d3d6 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1423 microversion: 2.1 time: 0.139415 Oct 01 20:58:19.186699 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1210/2347] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:19 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1423 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:19.215942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-9c83bbf3-7f71-43f8-9db3-9799f5865a89 req-edc4694a-53f1-499a-941b-8dda1b3c4c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b9ddc4-96e9-4c59-b07f-e785f2179e8c", "name": "network-vif-plugged", "status": "completed", "tag": "edbfb05d-0450-4747-beea-2150a81bba2f"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:19.271605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:19.274087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9c83bbf3-7f71-43f8-9db3-9799f5865a89 req-edc4694a-53f1-499a-941b-8dda1b3c4c2e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:19.274933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9c83bbf3-7f71-43f8-9db3-9799f5865a89 req-edc4694a-53f1-499a-941b-8dda1b3c4c2e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:19.276262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9c83bbf3-7f71-43f8-9db3-9799f5865a89 req-edc4694a-53f1-499a-941b-8dda1b3c4c2e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:19.329850 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-9c83bbf3-7f71-43f8-9db3-9799f5865a89 req-edc4694a-53f1-499a-941b-8dda1b3c4c2e service nova] Creating event network-vif-plugged:edbfb05d-0450-4747-beea-2150a81bba2f for instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c on nch2-master-1 Oct 01 20:58:19.374837 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-9c83bbf3-7f71-43f8-9db3-9799f5865a89 req-edc4694a-53f1-499a-941b-8dda1b3c4c2e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170040 Oct 01 20:58:19.375481 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1211/2348] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:19.515916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:19.650010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b4d78c7c6c450fb5fc1d3ac587fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4961525068042aba372c046eb589a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:19.667647 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd2a852b-873e-4e43-9d50-42513ec2d51c tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 200 len: 1714 microversion: 2.1 time: 4.062900 Oct 01 20:58:19.668904 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1138/2349] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:15 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 1714 bytes in 4070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:20.074302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:20.082360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:20.092864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:20.098736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:20.100067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:20.103317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:20.104037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:20.105537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:20.223887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-380697562", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c456b33d-b15d-4b44-92e2-16732dccc63f"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:20.575550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] validate_networks() for [('c456b33d-b15d-4b44-92e2-16732dccc63f', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:58:21.738776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:21.779387 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f93d9870-0630-44ff-9834-8ad1aac79090 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1469 microversion: 2.1 time: 1.709929 Oct 01 20:58:21.785918 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1139/2350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:20 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1469 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:58:21.815754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e49ee2cb-9f23-4d4e-81c5-4d8ab2acee11 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4172b6a670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:23.628456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:58:23.629034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:58:23.629351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:58:23.629809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:58:23.630231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:58:23.662014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:23.662651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:23.662989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:23.663723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:23.664187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:23.664619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:23.756996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Getting quotas for project 7f84f3e4972f4a9c968100efa5775214. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:58:23.784316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Getting quotas for user f407ee9fccbf4fd6a9286642f8a015ad and project 7f84f3e4972f4a9c968100efa5775214. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:58:23.828746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Going to run 3 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:58:23.834996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 51127763-f98b-43aa-8f93-e47e9ccc3c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:58:23.977201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: d47b361c-dc29-495f-803e-f50b3421d788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=51127763-f98b-43aa-8f93-e47e9ccc3c77,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:58:24.085371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=d47b361c-dc29-495f-803e-f50b3421d788,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:58:24.355061 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4b77922b-fafd-42bf-bff2-30d5c6a90882 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.966206 Oct 01 20:58:24.356052 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1212/2351] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:58:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:58:24.368426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:24.371354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] [instance: d1f5ad45-c060-47b7-9ec8-1c1dd15231b3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:24.389904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:24.393662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:24.396441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:24.397981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:24.400691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:24.402287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:24.444646 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] HTTP exception thrown: Instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 could not be found. Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Request method failure captured: Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 HTTP/1.1 Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKmcdVptYAMlMZWk15AjepHiJdJqqTlHY0nz-XA7ybCQUCD-P5mQ2XYq2uAIdeICyTyyXotfhs7uBocvTOUlyBNIoc2OmktDbI6fKbZSSLSdjxS7TTl3-HbzNuUtIwxUE-jezb0IiPf9hVkHrTluBujGlbMazbxphgUa0JplEfsegBk Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: a4961525068042aba372c046eb589a7a Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersTestManualDisk-1454892508 Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a4961525068042aba372c046eb589a7a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4961525068042aba372c046eb589a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a4961525068042aba372c046eb589a7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4961525068042aba372c046eb589a7a"}]}] Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersTestManualDisk-1454892508 Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: a4961525068042aba372c046eb589a7a Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersTestManualDisk-1454892508 Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersTestManualDisk-1454892508-project Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 56b4d78c7c6c450fb5fc1d3ac587fb26 Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersTestManualDisk-1454892508-project Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 could not be found. Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'd1f5ad45-c060-47b7-9ec8-1c1dd15231b3'} Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 could not be found. Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 could not be found. Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:24.453765 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 could not be found. Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Returning 404 to user: Instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5926427d-30e6-4511-a26c-fabeda0999ea tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3" status: 404 len: 111 microversion: 2.1 time: 0.098329 Oct 01 20:58:24.458186 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1213/2352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:24 2022] GET /compute/v2.1/servers/d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:58:24.471856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b7bdcdda-72d3-4f7f-95d3-fcf5a0afc6a3 req-9aeba0f9-bae4-4e24-9e7a-cfe8adddbde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f5ad45-c060-47b7-9ec8-1c1dd15231b3", "name": "network-vif-deleted", "tag": "6d7c99e5-4b66-4d43-879f-9bad18c158fe"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:24.503733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b7bdcdda-72d3-4f7f-95d3-fcf5a0afc6a3 req-9aeba0f9-bae4-4e24-9e7a-cfe8adddbde2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:24.507150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b7bdcdda-72d3-4f7f-95d3-fcf5a0afc6a3 req-9aeba0f9-bae4-4e24-9e7a-cfe8adddbde2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:24.510310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b7bdcdda-72d3-4f7f-95d3-fcf5a0afc6a3 req-9aeba0f9-bae4-4e24-9e7a-cfe8adddbde2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:24.536959 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b7bdcdda-72d3-4f7f-95d3-fcf5a0afc6a3 req-9aeba0f9-bae4-4e24-9e7a-cfe8adddbde2 service nova] Creating event network-vif-deleted:6d7c99e5-4b66-4d43-879f-9bad18c158fe for instance d1f5ad45-c060-47b7-9ec8-1c1dd15231b3 on nch1-master-1 Oct 01 20:58:24.554311 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b7bdcdda-72d3-4f7f-95d3-fcf5a0afc6a3 req-9aeba0f9-bae4-4e24-9e7a-cfe8adddbde2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091409 Oct 01 20:58:24.556338 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1214/2353] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:24.570747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:24.573242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:24.598049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:24.601056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:24.603415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:24.605031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:24.607173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:24.607811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:24.884655 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:24.900994 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4cd710bd-c409-466f-a12e-a6854c2d211e tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1427 microversion: 2.1 time: 0.342079 Oct 01 20:58:24.901727 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1215/2354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:24 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1427 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:24.929926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:24.951702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:24.956756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Searching by: {'deleted': False, 'project_id': '7f84f3e4972f4a9c968100efa5775214'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:58:25.070684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:25.076404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:25.076932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:25.081771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:25.082406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:25.083848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:25.154625 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a2dbf633-eacb-4f64-af8e-3f76b3303410 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.251523 Oct 01 20:58:25.156913 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1216/2355] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 20:58:24 2022] GET /compute/v2.1/servers => generated 1015 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:25.199289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-74383201-32f6-4e41-920f-d9feb3da7847 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] Calling method '.version_select at 0x7f41735d1310>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:25.300211 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-74383201-32f6-4e41-920f-d9feb3da7847 tempest-ServersTestManualDisk-1454892508 tempest-ServersTestManualDisk-1454892508-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011407176" status: 202 len: 0 microversion: 2.1 time: 0.137066 Oct 01 20:58:25.307032 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1217/2356] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 20:58:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011407176 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 20:58:25.335284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ca76679e-9033-4470-8f84-1d7f4efd1148 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:25.339149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ca76679e-9033-4470-8f84-1d7f4efd1148 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:25.683487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ca76679e-9033-4470-8f84-1d7f4efd1148 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:25.696650 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ca76679e-9033-4470-8f84-1d7f4efd1148 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1222 microversion: 2.1 time: 0.387084 Oct 01 20:58:25.699215 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1218/2357] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:25 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1222 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:25.927192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:25.928756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:25.943880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:25.944809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:25.945493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:25.948673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:25.950713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:25.951482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:26.056510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:26.059094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:26.061267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:26.062004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lazy-loading 'fault' on Instance uuid 68f148ce-57dc-4294-bbe5-56948f7f3470 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:58:26.408756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:26.434578 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3a490a6b-2b62-4278-b6f1-15dd22ff3213 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 200 len: 1303 microversion: 2.1 time: 0.511975 Oct 01 20:58:26.463592 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1219/2358] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:25 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 1303 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:26.699506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-2c951f41-5a16-42a2-8485-6cf0c50de6d8 req-fceeb717-a139-4f22-bb18-82a304877a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f148ce-57dc-4294-bbe5-56948f7f3470", "name": "network-vif-deleted", "tag": "bbcf5a9d-7ccf-47c9-a2f0-ed1efe7ff151"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:26.735385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2c951f41-5a16-42a2-8485-6cf0c50de6d8 req-fceeb717-a139-4f22-bb18-82a304877a5e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:26.738432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2c951f41-5a16-42a2-8485-6cf0c50de6d8 req-fceeb717-a139-4f22-bb18-82a304877a5e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:26.740261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2c951f41-5a16-42a2-8485-6cf0c50de6d8 req-fceeb717-a139-4f22-bb18-82a304877a5e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:26.794946 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-2c951f41-5a16-42a2-8485-6cf0c50de6d8 req-fceeb717-a139-4f22-bb18-82a304877a5e service nova] Creating event network-vif-deleted:bbcf5a9d-7ccf-47c9-a2f0-ed1efe7ff151 for instance 68f148ce-57dc-4294-bbe5-56948f7f3470 on nch2-master-1 Oct 01 20:58:26.810161 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-2c951f41-5a16-42a2-8485-6cf0c50de6d8 req-fceeb717-a139-4f22-bb18-82a304877a5e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114900 Oct 01 20:58:26.822014 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1220/2359] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:58:26.833198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fc02795e-f9c4-4412-a16c-b9b6fdeb8700 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:26.834915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fc02795e-f9c4-4412-a16c-b9b6fdeb8700 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:27.243056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fc02795e-f9c4-4412-a16c-b9b6fdeb8700 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:27.253401 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fc02795e-f9c4-4412-a16c-b9b6fdeb8700 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1222 microversion: 2.1 time: 0.429438 Oct 01 20:58:27.254028 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1221/2360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:26 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1222 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:27.458661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:27.459591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 68f148ce-57dc-4294-bbe5-56948f7f3470] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:27.475685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:27.482114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:27.482800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:27.485183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:27.489453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:27.489990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:27.592143 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] HTTP exception thrown: Instance 68f148ce-57dc-4294-bbe5-56948f7f3470 could not be found. Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Request method failure captured: Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 HTTP/1.1 Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKl0fQwWklNQ3ecXzjDfUVUcAmSmuqpBXH-3K0-GmDFInU2g7nuPPp_5KoPcluRmRHaX_KoSLc3hWW_5F08tsW4gHXmgSQpFaKL4iwrclo4QBKF4VwCn4Ds2YWi12MtDYE4A8-gM88H84maf1LC7e3sN2JzQQYaqiXuC2T2CrCTTuPU Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: a6bdd72ba854403e8fef7f651a3ef106 Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersAdminTestJSON-971673996 Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a6bdd72ba854403e8fef7f651a3ef106", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a6bdd72ba854403e8fef7f651a3ef106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a6bdd72ba854403e8fef7f651a3ef106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a6bdd72ba854403e8fef7f651a3ef106"}]}] Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersAdminTestJSON-971673996 Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: a6bdd72ba854403e8fef7f651a3ef106 Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersAdminTestJSON-971673996 Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersAdminTestJSON-971673996-project Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 123a8a1d0b65407098b5a8e91091b9ca Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersAdminTestJSON-971673996-project Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 68f148ce-57dc-4294-bbe5-56948f7f3470 could not be found. Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '68f148ce-57dc-4294-bbe5-56948f7f3470'} Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f148ce-57dc-4294-bbe5-56948f7f3470 could not be found. Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f148ce-57dc-4294-bbe5-56948f7f3470 could not be found. Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:27.598278 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:27.602111 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:27.602111 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:27.602111 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:27.602111 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:58:27.602111 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:58:27.602111 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f148ce-57dc-4294-bbe5-56948f7f3470 could not be found. Oct 01 20:58:27.602111 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:27.607669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Returning 404 to user: Instance 68f148ce-57dc-4294-bbe5-56948f7f3470 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:58:27.608580 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3aa95939-4150-45f6-a04a-1ee5c1f5eed7 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470" status: 404 len: 111 microversion: 2.1 time: 0.154919 Oct 01 20:58:27.611836 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1222/2361] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:27 2022] GET /compute/v2.1/servers/68f148ce-57dc-4294-bbe5-56948f7f3470 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 20:58:27.632673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:27.633196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:27.661998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:27.665111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:27.665602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:27.666359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:27.666856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:27.673080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:27.793428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:58:28.270843 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0f32ae5d-2cb1-4725-9f5e-509adccf1cd4 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 204 len: 0 microversion: 2.1 time: 0.653588 Oct 01 20:58:28.273244 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1223/2362] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:58:27 2022] DELETE /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:58:28.291977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:28.304406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:28.335183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:28.338233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:28.338932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:28.339869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:28.342942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:28.346021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:29.113606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:29.128857 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe52773b-53ea-46ba-b514-9f353a3c06c5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1274 microversion: 2.1 time: 0.848778 Oct 01 20:58:29.130798 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1224/2363] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:28 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1274 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:29.148289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:29.149118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:29.160455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:29.161651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:29.162110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:29.165219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:29.167875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:29.168333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:30.093294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:31.382474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:31.398961 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c16f1c22-f6d6-4560-8413-9072f07187b9 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 200 len: 1469 microversion: 2.1 time: 2.260515 Oct 01 20:58:31.416463 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1225/2364] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:29 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 1469 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:31.436268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:31.437307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:31.452007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:31.461994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:31.462907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:31.463907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:31.466044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:31.475278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:31.767858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:31.908178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:31.922480 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e93ecaee-571c-43ce-96b0-86e044889de1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1280 microversion: 2.1 time: 0.499409 Oct 01 20:58:31.941763 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1226/2365] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:31 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1280 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:32.572973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-170273440", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "062e2ff2-0c1d-4777-97ae-55ac7590accf"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:34.503434 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e49ee2cb-9f23-4d4e-81c5-4d8ab2acee11 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1432 microversion: 2.1 time: 12.707805 Oct 01 20:58:34.504732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] validate_networks() for [('062e2ff2-0c1d-4777-97ae-55ac7590accf', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:58:34.505985 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1140/2366] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:21 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1432 bytes in 12718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:34.519825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:34.520835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: f88d037c-9adb-4bbc-9431-52326a81f876] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:34.536688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:34.540941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:34.541438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:34.543821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:34.544584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:34.544895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:34.578166 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] HTTP exception thrown: Instance f88d037c-9adb-4bbc-9431-52326a81f876 could not be found. Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Request method failure captured: Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 HTTP/1.1 Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKl0fQwWklNQ3ecXzjDfUVUcAmSmuqpBXH-3K0-GmDFInU2g7nuPPp_5KoPcluRmRHaX_KoSLc3hWW_5F08tsW4gHXmgSQpFaKL4iwrclo4QBKF4VwCn4Ds2YWi12MtDYE4A8-gM88H84maf1LC7e3sN2JzQQYaqiXuC2T2CrCTTuPU Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a6bdd72ba854403e8fef7f651a3ef106 Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersAdminTestJSON-971673996 Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a6bdd72ba854403e8fef7f651a3ef106", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a6bdd72ba854403e8fef7f651a3ef106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a6bdd72ba854403e8fef7f651a3ef106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a6bdd72ba854403e8fef7f651a3ef106"}]}] Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersAdminTestJSON-971673996 Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a6bdd72ba854403e8fef7f651a3ef106 Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersAdminTestJSON-971673996 Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersAdminTestJSON-971673996-project Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 123a8a1d0b65407098b5a8e91091b9ca Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersAdminTestJSON-971673996-project Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance f88d037c-9adb-4bbc-9431-52326a81f876 could not be found. Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f88d037c-9adb-4bbc-9431-52326a81f876'} Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f88d037c-9adb-4bbc-9431-52326a81f876 could not be found. Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f88d037c-9adb-4bbc-9431-52326a81f876 could not be found. Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:34.580916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:34.585202 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:34.585202 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:34.585202 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:34.585202 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:58:34.585202 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:58:34.585202 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f88d037c-9adb-4bbc-9431-52326a81f876 could not be found. Oct 01 20:58:34.585202 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:34.585202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Returning 404 to user: Instance f88d037c-9adb-4bbc-9431-52326a81f876 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:58:34.585202 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82b2cef9-eac7-4c0b-b394-77abaaad0324 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876" status: 404 len: 111 microversion: 2.1 time: 0.076187 Oct 01 20:58:34.592958 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1141/2367] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:34 2022] GET /compute/v2.1/servers/f88d037c-9adb-4bbc-9431-52326a81f876 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:58:34.622751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:34.625082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:34.641437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:34.643868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:34.644322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:34.646120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:34.646412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:34.646873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:35.124595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:36.495616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:36.511489 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae7c501c-5997-4065-979e-7db1f432ffc1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1322 microversion: 2.1 time: 1.914920 Oct 01 20:58:36.514721 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1142/2368] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:34 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1322 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:36.527364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5df497c1-19f9-48bd-9916-a47f52c0bdce req-b6d07a63-c7ea-4bf1-ac68-b7c757e08139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88d037c-9adb-4bbc-9431-52326a81f876", "name": "network-vif-deleted", "tag": "8e4735ae-fb8d-40df-a185-339aa25f7014"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:36.569392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5df497c1-19f9-48bd-9916-a47f52c0bdce req-b6d07a63-c7ea-4bf1-ac68-b7c757e08139 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:36.569890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5df497c1-19f9-48bd-9916-a47f52c0bdce req-b6d07a63-c7ea-4bf1-ac68-b7c757e08139 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:36.572729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5df497c1-19f9-48bd-9916-a47f52c0bdce req-b6d07a63-c7ea-4bf1-ac68-b7c757e08139 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:36.602168 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5df497c1-19f9-48bd-9916-a47f52c0bdce req-b6d07a63-c7ea-4bf1-ac68-b7c757e08139 service nova] Creating event network-vif-deleted:8e4735ae-fb8d-40df-a185-339aa25f7014 for instance f88d037c-9adb-4bbc-9431-52326a81f876 on nch2-master-1 Oct 01 20:58:36.614759 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5df497c1-19f9-48bd-9916-a47f52c0bdce req-b6d07a63-c7ea-4bf1-ac68-b7c757e08139 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096748 Oct 01 20:58:36.615621 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1143/2369] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:36.628002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-de203bb9-8c7e-4b66-aa1f-7e0298339aee tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4173b06820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:36.717531 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-de203bb9-8c7e-4b66-aa1f-7e0298339aee tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 200 len: 1432 microversion: 2.1 time: 0.095350 Oct 01 20:58:36.731315 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1144/2370] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:36 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 1432 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:36.744804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:36.747897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:36.772743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:36.773880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:36.776344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:36.778587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:36.780783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:36.781383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:36.864472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:58:37.061701 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4af64b27-b09f-44f0-b22a-85e413439527 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "DELETE /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 204 len: 0 microversion: 2.1 time: 0.326855 Oct 01 20:58:37.063413 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1145/2371] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:58:36 2022] DELETE /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:58:37.073938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:37.081247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:37.095316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:37.098783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:37.099914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:37.101126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:37.103440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:37.105133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:37.250698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=10 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:37.561139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:58:37.561877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:58:37.562633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:58:37.563509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:58:37.564739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:58:37.580668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:37.587944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:37.594941 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a65f9339-31b8-449b-92dd-a42c7fba0154 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1466 microversion: 2.1 time: 0.525126 Oct 01 20:58:37.595527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:37.595641 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1146/2372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:37 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1466 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:37.596968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:37.600851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:37.605718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:37.605868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:37.609953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:37.614234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:37.634448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:37.634942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:37.635441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:37.636241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:37.636726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:37.637201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:37.700471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Getting quotas for project 35315d2dc0e749a9910aa04a2ed06b42. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:58:37.724775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Getting quotas for user 1de7837875cf4298b7ac7f328a74694c and project 35315d2dc0e749a9910aa04a2ed06b42. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:58:37.794359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:58:37.803884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:58:37.879894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:37.928609 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a0abcc7e-e5f2-4f07-92c2-d1d34983837f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.984011 Oct 01 20:58:37.932123 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1227/2373] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 5989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:58:37.944234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:37.945442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:37.985501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:37.989513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:37.990135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:37.991175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:37.992900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:37.993539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:40.479626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:40.492325 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bce9fff0-1e13-44d6-a248-0dcb7f1cd9d0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1322 microversion: 2.1 time: 2.558594 Oct 01 20:58:40.493232 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1228/2374] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:37 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1322 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:40.513727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f9a8d27-c2de-49ff-8d92-83d17d35eb57 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41727564c0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:40.614959 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1f9a8d27-c2de-49ff-8d92-83d17d35eb57 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/90f3f35e-76ec-4c31-b581-329b315fe607" status: 200 len: 784 microversion: 2.1 time: 0.119172 Oct 01 20:58:40.628627 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1229/2375] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:40 2022] GET /compute/v2.1/images/90f3f35e-76ec-4c31-b581-329b315fe607 => generated 784 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:40.635944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:40.642880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:40.656267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:40.660542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:40.663112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:40.664144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:40.664810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:40.667860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:40.795542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:40.800060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:40.804870 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f771ba7a-36ad-4d4d-a989-1c33d182538c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1285 microversion: 2.1 time: 0.174705 Oct 01 20:58:40.812595 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1230/2376] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:40 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:40.827127 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8c37eb6c-db26-4895-af39-bc68d5498fd0 tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1469 microversion: 2.1 time: 3.213500 Oct 01 20:58:40.832184 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1147/2377] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:37 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1469 bytes in 3236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:40.841728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff110a67-719e-4271-abd6-de5e834a0455 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:40.850360 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff110a67-719e-4271-abd6-de5e834a0455 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016601 Oct 01 20:58:40.850604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-efc23de9-1d0c-4322-b6e5-b509701e0fba req-f52a5d81-0076-432d-bd12-8b10419fbaaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7a2841-f1d1-4a9e-8121-d1e0a418dd21", "name": "network-vif-unplugged", "status": "completed", "tag": "21b76ebd-44ca-4ccb-9d42-c987237b2347"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:40.851671 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1148/2378] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 20:58:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:40.875155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4cc52924-0442-4a26-b547-8e21d6f056eb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4172b6a5e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:40.898359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-efc23de9-1d0c-4322-b6e5-b509701e0fba req-f52a5d81-0076-432d-bd12-8b10419fbaaf service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:40.899233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-efc23de9-1d0c-4322-b6e5-b509701e0fba req-f52a5d81-0076-432d-bd12-8b10419fbaaf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:40.899835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-efc23de9-1d0c-4322-b6e5-b509701e0fba req-f52a5d81-0076-432d-bd12-8b10419fbaaf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:40.942221 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-efc23de9-1d0c-4322-b6e5-b509701e0fba req-f52a5d81-0076-432d-bd12-8b10419fbaaf service nova] Creating event network-vif-unplugged:21b76ebd-44ca-4ccb-9d42-c987237b2347 for instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 on nch2-master-1 Oct 01 20:58:40.961344 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-efc23de9-1d0c-4322-b6e5-b509701e0fba req-f52a5d81-0076-432d-bd12-8b10419fbaaf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132715 Oct 01 20:58:40.966569 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1231/2379] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:41.521995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:41.523999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:41.543604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:41.547021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:41.547510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:41.548842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:41.549335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:41.549758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:42.111283 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4cc52924-0442-4a26-b547-8e21d6f056eb tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "DELETE /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 204 len: 0 microversion: 2.1 time: 1.245700 Oct 01 20:58:42.112750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1149/2380] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:40 2022] DELETE /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 0 bytes in 1248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:58:42.120025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:42.120674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:42.133719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:42.134222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:42.134717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:42.135441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:42.135902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:42.136330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:43.076042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:43.085576 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05a76b06-9384-43c5-964f-22acdd4425c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1273 microversion: 2.1 time: 0.971555 Oct 01 20:58:43.113093 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1150/2381] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:42 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1273 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:43.113093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:43.113093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:43.159643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:43.160231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:43.160675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:43.162021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:43.163006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:43.168222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:43.246190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:43.247944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:43.249240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:43.249892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lazy-loading 'fault' on Instance uuid 41b9ddc4-96e9-4c59-b07f-e785f2179e8c {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:58:43.345371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:43.373520 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b78ce32-8078-411a-94ec-4482cf2f8cce tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1322 microversion: 2.1 time: 1.850814 Oct 01 20:58:43.401919 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1232/2382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:41 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1322 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:43.410054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-28325a8d-f983-41e3-81d0-3195dc88d91b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41781b3820>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:43.485168 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-28325a8d-f983-41e3-81d0-3195dc88d91b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] HTTP exception thrown: Image not found. Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-28325a8d-f983-41e3-81d0-3195dc88d91b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Request method failure captured: Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 HTTP/1.1 Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKnBl0X_UXplChwy9siL1vN85wRvWLkvyWyU5BoUnWUs61sm7v1kknNj98DWCrOutUEjFHrhHajNHDtj3L5zUAaJkGUCiW1aiSCw1oy_-LGSRUWhIjiV-levMk1oSqHhVyYXIXdMdBHEvwmuoe9Awiu-N8lm82uL2hieyZBLNwU5ryQ Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 3cf38b1a4bc4458199fea3373632117d Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesOneServerTestJSON-1983688695 Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3cf38b1a4bc4458199fea3373632117d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3cf38b1a4bc4458199fea3373632117d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3cf38b1a4bc4458199fea3373632117d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3cf38b1a4bc4458199fea3373632117d"}]}] Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesOneServerTestJSON-1983688695 Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 3cf38b1a4bc4458199fea3373632117d Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1983688695 Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesOneServerTestJSON-1983688695-project Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e76b153982141d8964ecbb118d19eab Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesOneServerTestJSON-1983688695-project Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: exception: Image not found. Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '9942dd83-c129-4865-b77e-9eaa56449664'} Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9942dd83-c129-4865-b77e-9eaa56449664 Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 20:58:43.488648 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9942dd83-c129-4865-b77e-9eaa56449664 could not be found. Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:58:43.492209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-28325a8d-f983-41e3-81d0-3195dc88d91b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Returning 404 to user: Image not found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:58:43.499220 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-28325a8d-f983-41e3-81d0-3195dc88d91b tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 404 len: 62 microversion: 2.1 time: 0.094650 Oct 01 20:58:43.515432 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1233/2383] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:43 2022] GET /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:58:43.547174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-19617913-ce42-404c-9217-af0df440f385 req-deb140b4-9cf3-46fa-bd6c-bada97ecce3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b9ddc4-96e9-4c59-b07f-e785f2179e8c", "name": "network-vif-deleted", "tag": "edbfb05d-0450-4747-beea-2150a81bba2f"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:43.572730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-19617913-ce42-404c-9217-af0df440f385 req-deb140b4-9cf3-46fa-bd6c-bada97ecce3e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:43.573661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-19617913-ce42-404c-9217-af0df440f385 req-deb140b4-9cf3-46fa-bd6c-bada97ecce3e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:43.574704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-19617913-ce42-404c-9217-af0df440f385 req-deb140b4-9cf3-46fa-bd6c-bada97ecce3e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:43.604681 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-19617913-ce42-404c-9217-af0df440f385 req-deb140b4-9cf3-46fa-bd6c-bada97ecce3e service nova] Creating event network-vif-deleted:edbfb05d-0450-4747-beea-2150a81bba2f for instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c on nch2-master-1 Oct 01 20:58:43.627247 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-19617913-ce42-404c-9217-af0df440f385 req-deb140b4-9cf3-46fa-bd6c-bada97ecce3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110247 Oct 01 20:58:43.629264 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1234/2384] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:43.662363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-361c67d7-0723-435d-971d-9e091f513c32 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1519078239"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:43.666918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-361c67d7-0723-435d-971d-9e091f513c32 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:43.688783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-361c67d7-0723-435d-971d-9e091f513c32 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:43.689515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-361c67d7-0723-435d-971d-9e091f513c32 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:43.690144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-361c67d7-0723-435d-971d-9e091f513c32 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:43.691139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-361c67d7-0723-435d-971d-9e091f513c32 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:43.691755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-361c67d7-0723-435d-971d-9e091f513c32 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:43.692344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-361c67d7-0723-435d-971d-9e091f513c32 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:43.738025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123a8a1d0b65407098b5a8e91091b9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bdd72ba854403e8fef7f651a3ef106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:43.745603 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1013c1e-4e78-4957-b29c-db2d51cdf11d tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 200 len: 1303 microversion: 2.1 time: 0.643914 Oct 01 20:58:43.747569 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1151/2385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:43 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 1303 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:44.059019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:44.127489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:44.129135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:44.148369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:44.154220 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-361c67d7-0723-435d-971d-9e091f513c32 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "POST /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21/action" status: 202 len: 0 microversion: 2.1 time: 0.522853 Oct 01 20:58:44.155406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:44.156557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:44.159430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:44.160136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:44.166762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:44.172727 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1235/2386] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:58:43 2022] POST /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 20:58:44.184411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b79b25c1-6a5d-4168-ab2c-42c9f546a3e4 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41736d71f0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:44.276067 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b79b25c1-6a5d-4168-ab2c-42c9f546a3e4 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 0.096259 Oct 01 20:58:44.279553 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1236/2387] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:44 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:58:44.408091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:44.408837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:44.434930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:44.435428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:44.436215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:44.436945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:44.437404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:44.437832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:44.963497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:44.981433 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2fd2c91b-4777-4dd1-bffc-c9b00146af0a tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1315 microversion: 2.1 time: 0.853339 Oct 01 20:58:44.983297 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1152/2388] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:44 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:44.994928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8275b913-06dd-4f89-b44d-0c59015761c7 req-77086835-26ae-4d97-8912-11104a85529d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47b361c-dc29-495f-803e-f50b3421d788", "tag": "0c5fbea5-655b-4b16-8bb6-9579c9205942"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:45.024105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8275b913-06dd-4f89-b44d-0c59015761c7 req-77086835-26ae-4d97-8912-11104a85529d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:45.029847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8275b913-06dd-4f89-b44d-0c59015761c7 req-77086835-26ae-4d97-8912-11104a85529d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:45.031135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8275b913-06dd-4f89-b44d-0c59015761c7 req-77086835-26ae-4d97-8912-11104a85529d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:45.067863 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8275b913-06dd-4f89-b44d-0c59015761c7 req-77086835-26ae-4d97-8912-11104a85529d service nova] Creating event network-changed:0c5fbea5-655b-4b16-8bb6-9579c9205942 for instance d47b361c-dc29-495f-803e-f50b3421d788 on nch1-master-1 Oct 01 20:58:45.083292 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8275b913-06dd-4f89-b44d-0c59015761c7 req-77086835-26ae-4d97-8912-11104a85529d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098003 Oct 01 20:58:45.083978 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1153/2389] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:45.095781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:45.097419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] [instance: 41b9ddc4-96e9-4c59-b07f-e785f2179e8c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:45.110088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:45.113432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:45.116741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:45.118179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:45.127434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:45.128273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:45.152124 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] HTTP exception thrown: Instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c could not be found. Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Request method failure captured: Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c HTTP/1.1 Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKl0fQwWklNQ3ecXzjDfUVUcAmSmuqpBXH-3K0-GmDFInU2g7nuPPp_5KoPcluRmRHaX_KoSLc3hWW_5F08tsW4gHXmgSQpFaKL4iwrclo4QBKF4VwCn4Ds2YWi12MtDYE4A8-gM88H84maf1LC7e3sN2JzQQYaqiXuC2T2CrCTTuPU Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a6bdd72ba854403e8fef7f651a3ef106 Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersAdminTestJSON-971673996 Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a6bdd72ba854403e8fef7f651a3ef106", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a6bdd72ba854403e8fef7f651a3ef106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a6bdd72ba854403e8fef7f651a3ef106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a6bdd72ba854403e8fef7f651a3ef106"}]}] Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersAdminTestJSON-971673996 Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a6bdd72ba854403e8fef7f651a3ef106 Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersAdminTestJSON-971673996 Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersAdminTestJSON-971673996-project Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 123a8a1d0b65407098b5a8e91091b9ca Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersAdminTestJSON-971673996-project Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c could not be found. Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '41b9ddc4-96e9-4c59-b07f-e785f2179e8c'} Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c could not be found. Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c could not be found. Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:58:45.154077 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:45.158148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:58:45.158148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:58:45.158148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:58:45.158148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:58:45.158148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:58:45.158148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c could not be found. Oct 01 20:58:45.158148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:58:45.171411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] Returning 404 to user: Instance 41b9ddc4-96e9-4c59-b07f-e785f2179e8c could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:58:45.172728 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99db6b04-2fe0-4aeb-8728-584c3d54b85b tempest-ServersAdminTestJSON-971673996 tempest-ServersAdminTestJSON-971673996-project] 10.222.0.17 "GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c" status: 404 len: 111 microversion: 2.1 time: 0.087383 Oct 01 20:58:45.173393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1154/2390] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:45 2022] GET /compute/v2.1/servers/41b9ddc4-96e9-4c59-b07f-e785f2179e8c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:58:45.490890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-299132150", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "9417f59c-8d13-4179-a6ee-0176ac73cf1c"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:45.624059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] validate_networks() for [('9417f59c-8d13-4179-a6ee-0176ac73cf1c', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:58:45.922280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:45.947345 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8e64f190-c19b-47ac-aec0-c28bf1358fb1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1322 microversion: 2.1 time: 1.537474 Oct 01 20:58:45.949576 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1237/2391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:44 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1322 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:45.962471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-59065129-dadf-40de-ad3d-ac72117f87f2 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41736e99d0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:46.054235 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-59065129-dadf-40de-ad3d-ac72117f87f2 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 0.101485 Oct 01 20:58:46.054883 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1238/2392] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:45 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:46.075112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:46.075757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:46.097204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:46.098263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:46.099068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:46.101517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:46.102248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:46.112020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:46.800125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:46.809062 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9b8fa74a-566f-446c-9e37-85a77ae69e56 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1315 microversion: 2.1 time: 0.751895 Oct 01 20:58:46.819722 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1239/2393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:46 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:46.975316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:46.975946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:46.999329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:47.010821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:47.011637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:47.012571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:47.016282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:47.019061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:47.657448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:47.760471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:49.788440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:49.832932 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2a80e60c-f787-4fee-9249-534b9dabd074 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1322 microversion: 2.1 time: 2.860605 Oct 01 20:58:49.834208 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1240/2394] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:46 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1322 bytes in 2863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:49.846214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a12c6cdf-e0ea-477b-8fcc-524c6d1f57f1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41784e4550>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:50.468365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:58:50.468799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:58:50.469112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:58:50.469565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:58:50.470063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:58:50.494685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:50.508122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:50.508734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:50.514893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:50.515400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:50.515846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:50.582751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:58:50.599155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for user 775ff9091a794faaacc05a37550c8a72 and project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:58:50.642124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:58:50.660849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:58:50.840804 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fdbd4d4-6c93-4ed1-a53d-18ff9dad9925 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.666008 Oct 01 20:58:50.842261 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1155/2395] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 5668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:58:50.847935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:50.849301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:50.870833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:50.871338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:50.871783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:50.872514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:50.876504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:50.878128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:52.170949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:52.198634 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c198585-1091-4a40-8654-c1880586be2e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1315 microversion: 2.1 time: 1.353558 Oct 01 20:58:52.200935 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1156/2396] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:50 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1315 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:52.211983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1a231db2-2a15-422b-a7ae-04d54f313158 req-85a314e8-b97f-40c5-a632-2186b6930d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41357236-51bf-4aa8-bab9-b84f5ca4f6df", "tag": "70243b27-5cf0-4793-82b5-048b3f9c335b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:52.246035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a231db2-2a15-422b-a7ae-04d54f313158 req-85a314e8-b97f-40c5-a632-2186b6930d00 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:52.249037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a231db2-2a15-422b-a7ae-04d54f313158 req-85a314e8-b97f-40c5-a632-2186b6930d00 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:52.249750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a231db2-2a15-422b-a7ae-04d54f313158 req-85a314e8-b97f-40c5-a632-2186b6930d00 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:52.284994 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1a231db2-2a15-422b-a7ae-04d54f313158 req-85a314e8-b97f-40c5-a632-2186b6930d00 service nova] Creating event network-changed:70243b27-5cf0-4793-82b5-048b3f9c335b for instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df on nch2-master-1 Oct 01 20:58:52.310303 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1a231db2-2a15-422b-a7ae-04d54f313158 req-85a314e8-b97f-40c5-a632-2186b6930d00 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106395 Oct 01 20:58:52.328797 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1157/2397] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:52.349395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8647c42f-43bf-42bf-8d82-be2406c63be0 req-2e184eb8-6b72-465a-800c-0b51332e0e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fde56d8-52d5-4c10-8bda-46dc98250a1b", "tag": "b505102b-e3b6-452d-b2b3-882dda410c8a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:52.384912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8647c42f-43bf-42bf-8d82-be2406c63be0 req-2e184eb8-6b72-465a-800c-0b51332e0e6c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:52.385710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8647c42f-43bf-42bf-8d82-be2406c63be0 req-2e184eb8-6b72-465a-800c-0b51332e0e6c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:52.388291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8647c42f-43bf-42bf-8d82-be2406c63be0 req-2e184eb8-6b72-465a-800c-0b51332e0e6c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:52.427688 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8647c42f-43bf-42bf-8d82-be2406c63be0 req-2e184eb8-6b72-465a-800c-0b51332e0e6c service nova] Creating event network-changed:b505102b-e3b6-452d-b2b3-882dda410c8a for instance 6fde56d8-52d5-4c10-8bda-46dc98250a1b on nch2-master-1 Oct 01 20:58:52.440845 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8647c42f-43bf-42bf-8d82-be2406c63be0 req-2e184eb8-6b72-465a-800c-0b51332e0e6c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108113 Oct 01 20:58:52.444302 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1158/2398] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:52.478625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:52.484121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:52.514937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:52.517234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:52.519887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:52.527006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:52.530378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:52.535152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:52.892823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:52.908747 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ec9bd7f-0416-4336-9e6b-7544b8ed7085 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1196 microversion: 2.1 time: 0.445084 Oct 01 20:58:52.910138 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1159/2399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:52 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1196 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:52.932171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:52.937376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:52.965511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:52.970961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:52.975239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:52.975957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:52.976439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:52.976870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:53.392749 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a12c6cdf-e0ea-477b-8fcc-524c6d1f57f1 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 3.555964 Oct 01 20:58:53.393342 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1241/2400] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:49 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 3558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:53.403535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ec7245a4-aec1-4395-ac13-a6086a84e171 req-6026d7b5-ff6c-4de9-acd2-c9a2174dfcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7a2841-f1d1-4a9e-8121-d1e0a418dd21", "name": "network-vif-plugged", "status": "completed", "tag": "21b76ebd-44ca-4ccb-9d42-c987237b2347"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:53.456808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ec7245a4-aec1-4395-ac13-a6086a84e171 req-6026d7b5-ff6c-4de9-acd2-c9a2174dfcdc service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:53.457323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ec7245a4-aec1-4395-ac13-a6086a84e171 req-6026d7b5-ff6c-4de9-acd2-c9a2174dfcdc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:53.467105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ec7245a4-aec1-4395-ac13-a6086a84e171 req-6026d7b5-ff6c-4de9-acd2-c9a2174dfcdc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:53.509980 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ec7245a4-aec1-4395-ac13-a6086a84e171 req-6026d7b5-ff6c-4de9-acd2-c9a2174dfcdc service nova] Creating event network-vif-plugged:21b76ebd-44ca-4ccb-9d42-c987237b2347 for instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 on nch2-master-1 Oct 01 20:58:53.529456 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ec7245a4-aec1-4395-ac13-a6086a84e171 req-6026d7b5-ff6c-4de9-acd2-c9a2174dfcdc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134259 Oct 01 20:58:53.530091 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1242/2401] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:54.170596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:54.188994 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8722847-0139-4849-9105-86c361b98a5b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1322 microversion: 2.1 time: 1.272485 Oct 01 20:58:54.190372 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1160/2402] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:52 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1322 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:54.207025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:54.209080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:54.234513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:54.237551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:54.239864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:54.240799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:54.244378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:54.244837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:54.308289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e1f39811-e1c2-4855-b6c8-c83ce902a870 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Action: 'create', calling method: .version_select at 0x7f4173729940>, body: {"keypair": {"name": "tempest-keypair-711079135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHzlHiR36eenyLsLk5AcfJcOoAurC++ytL8+VIcSnf+WUDWiu4CZy9dZ7errkeJkj2/zOVpUklTjmA+oOXDiTgBC8nGhtJLbX7q1AsdXA/zDGgcJ0N3VxlkOmzhzHDzYA=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:54.391808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e1f39811-e1c2-4855-b6c8-c83ce902a870 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Getting quotas for project bcdb77df347145639f2de60eb820a3ca. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:58:54.404801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e1f39811-e1c2-4855-b6c8-c83ce902a870 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Getting quotas for user ccbf2c814364466baca8dfcabd2c13f9 and project bcdb77df347145639f2de60eb820a3ca. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:58:54.462223 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e1f39811-e1c2-4855-b6c8-c83ce902a870 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.929786 Oct 01 20:58:54.463148 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1243/2403] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:58:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:54.476837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:54.477933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:54.495747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:54.496249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:54.499481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:54.503745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:54.504269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:54.504713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:54.832102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:54.846631 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3601f95d-a363-436a-9803-2c2ead0ab0be tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1250 microversion: 2.1 time: 0.379820 Oct 01 20:58:54.847265 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1244/2404] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:54 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1250 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:54.866869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c6fbdab3-960a-414b-b916-5aa4d21824d8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41737a0d30>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:54.951772 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c6fbdab3-960a-414b-b916-5aa4d21824d8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 0.098330 Oct 01 20:58:54.952622 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1245/2405] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:54 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:54.968127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-25a843f6-7825-404c-8e13-9d0fa0a3a26f req-a31f536c-df9e-44a3-8631-b03f5b9e484f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51127763-f98b-43aa-8f93-e47e9ccc3c77", "tag": "4e4bfaef-3969-44c6-ba14-6fb4e2e50603"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:54.999808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-25a843f6-7825-404c-8e13-9d0fa0a3a26f req-a31f536c-df9e-44a3-8631-b03f5b9e484f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:55.002364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-25a843f6-7825-404c-8e13-9d0fa0a3a26f req-a31f536c-df9e-44a3-8631-b03f5b9e484f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:55.003003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-25a843f6-7825-404c-8e13-9d0fa0a3a26f req-a31f536c-df9e-44a3-8631-b03f5b9e484f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:55.049999 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-25a843f6-7825-404c-8e13-9d0fa0a3a26f req-a31f536c-df9e-44a3-8631-b03f5b9e484f service nova] Creating event network-changed:4e4bfaef-3969-44c6-ba14-6fb4e2e50603 for instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 on nch1-master-1 Oct 01 20:58:55.057373 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-25a843f6-7825-404c-8e13-9d0fa0a3a26f req-a31f536c-df9e-44a3-8631-b03f5b9e484f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095206 Oct 01 20:58:55.059162 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1246/2406] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:55.063466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:55.074375 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-de88c40b-1474-4eea-ab59-0c8114501d5c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1315 microversion: 2.1 time: 0.882690 Oct 01 20:58:55.088875 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1161/2407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:54 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:55.218220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:55.219588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:55.232236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:55.235470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:55.236264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:55.238372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:55.239560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:55.240225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:55.870628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:55.871246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:55.888896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:55.889681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:55.890371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:55.891884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:55.893187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:55.893973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:56.283519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:56.303599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e6f9505a-a47e-4074-b572-0c6b1345bbcc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1250 microversion: 2.1 time: 0.429219 Oct 01 20:58:56.304728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1162/2408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:55 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1250 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:58:56.311907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8580918a-cf62-48ab-8417-c0a3d06da268 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4172b62f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:56.401749 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8580918a-cf62-48ab-8417-c0a3d06da268 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 0.095777 Oct 01 20:58:56.406989 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1163/2409] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:56 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:56.425758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:56.428532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:56.447913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:56.448427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:56.458662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:56.462387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:56.463482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:56.464759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:56.479561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:58:56.575629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:56.595267 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aa6af2c4-9d4d-4a83-ac3c-bf8891f65e6c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1322 microversion: 2.1 time: 1.381539 Oct 01 20:58:56.597092 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1247/2410] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:55 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1322 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:56.603282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-32aea7a9-f8f9-4c5d-8895-db7167a150b3 req-b45bae88-caa2-4989-b069-031ef64b894a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47b361c-dc29-495f-803e-f50b3421d788", "name": "network-vif-plugged", "status": "completed", "tag": "0c5fbea5-655b-4b16-8bb6-9579c9205942"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:56.639309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-32aea7a9-f8f9-4c5d-8895-db7167a150b3 req-b45bae88-caa2-4989-b069-031ef64b894a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:56.640182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-32aea7a9-f8f9-4c5d-8895-db7167a150b3 req-b45bae88-caa2-4989-b069-031ef64b894a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:56.641455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-32aea7a9-f8f9-4c5d-8895-db7167a150b3 req-b45bae88-caa2-4989-b069-031ef64b894a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:56.665546 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-32aea7a9-f8f9-4c5d-8895-db7167a150b3 req-b45bae88-caa2-4989-b069-031ef64b894a service nova] Creating event network-vif-plugged:0c5fbea5-655b-4b16-8bb6-9579c9205942 for instance d47b361c-dc29-495f-803e-f50b3421d788 on nch1-master-1 Oct 01 20:58:56.680433 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-32aea7a9-f8f9-4c5d-8895-db7167a150b3 req-b45bae88-caa2-4989-b069-031ef64b894a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081645 Oct 01 20:58:56.685397 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1248/2411] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:58:57.334045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:57.337682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:57.357086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:57.357893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:57.358612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:57.360182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:57.360854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:57.371663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:57.757099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:57.767088 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-89af3659-208d-4a9f-8e87-19a0be279147 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1250 microversion: 2.1 time: 0.439500 Oct 01 20:58:57.767688 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1249/2412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:57 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1250 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:58:57.799356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-51f01c6c-88d8-48fe-b90e-f280228ef503 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41739bb820>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:57.868981 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-51f01c6c-88d8-48fe-b90e-f280228ef503 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 0.100186 Oct 01 20:58:57.870090 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1250/2413] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:57 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:57.881618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:57.889962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:57.911201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:57.921583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:57.924670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:57.925873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:57.928811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:57.932026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:58.027098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:58.037404 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4df42138-6f75-461a-b6d8-b3e9a30e0c1f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1315 microversion: 2.1 time: 1.625919 Oct 01 20:58:58.041756 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1164/2414] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:56 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1315 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:58.778849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d00fbebe-e261-47c9-be42-61dc43663e4c req-6f6c4a11-b1c6-487a-8ecc-3640290289c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41357236-51bf-4aa8-bab9-b84f5ca4f6df", "name": "network-vif-plugged", "status": "completed", "tag": "70243b27-5cf0-4793-82b5-048b3f9c335b"}, {"server_uuid": "6fde56d8-52d5-4c10-8bda-46dc98250a1b", "name": "network-vif-plugged", "status": "completed", "tag": "b505102b-e3b6-452d-b2b3-882dda410c8a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:58:58.797697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d00fbebe-e261-47c9-be42-61dc43663e4c req-6f6c4a11-b1c6-487a-8ecc-3640290289c0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:58.805514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d00fbebe-e261-47c9-be42-61dc43663e4c req-6f6c4a11-b1c6-487a-8ecc-3640290289c0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:58.806398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d00fbebe-e261-47c9-be42-61dc43663e4c req-6f6c4a11-b1c6-487a-8ecc-3640290289c0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:58.837085 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d00fbebe-e261-47c9-be42-61dc43663e4c req-6f6c4a11-b1c6-487a-8ecc-3640290289c0 service nova] Creating event network-vif-plugged:70243b27-5cf0-4793-82b5-048b3f9c335b for instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df on nch2-master-1 Oct 01 20:58:58.838191 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d00fbebe-e261-47c9-be42-61dc43663e4c req-6f6c4a11-b1c6-487a-8ecc-3640290289c0 service nova] Creating event network-vif-plugged:b505102b-e3b6-452d-b2b3-882dda410c8a for instance 6fde56d8-52d5-4c10-8bda-46dc98250a1b on nch2-master-1 Oct 01 20:58:58.852966 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d00fbebe-e261-47c9-be42-61dc43663e4c req-6f6c4a11-b1c6-487a-8ecc-3640290289c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077855 Oct 01 20:58:58.854450 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1165/2415] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:58:58.867181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:58.868240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:58.887599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:58.888537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:58.892260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:58.893343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:58.896136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:58.896920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:59.276264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:59.288145 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f519fed8-7918-49fc-aaf9-f4aeaceee6e5 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1322 microversion: 2.1 time: 1.416687 Oct 01 20:58:59.290789 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1251/2416] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:57 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1322 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:59.321117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3af6a31d-315c-4f81-a211-22a1e1c2ee95 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4178440a60>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:59.324636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:58:59.376705 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc4faa03-8c5f-4f59-b7ae-1df6097c23c8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1250 microversion: 2.1 time: 0.519554 Oct 01 20:58:59.385898 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1166/2417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:58 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1250 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:59.455937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:58:59.464795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:58:59.496327 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3af6a31d-315c-4f81-a211-22a1e1c2ee95 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 0.203157 Oct 01 20:58:59.507968 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1252/2418] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:58:59 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:58:59.508195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:59.508623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:59.509068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:58:59.509790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:58:59.510249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:58:59.519204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:00.250685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:00.264660 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-52259d1f-880e-4c77-83ff-c32306a87d12 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1315 microversion: 2.1 time: 0.873445 Oct 01 20:59:00.267063 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1167/2419] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:58:59 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:00.318115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:00.318838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:00.341096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:00.341643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:00.342153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:00.342996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:00.343482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:00.344498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:00.416331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:00.421361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:00.433657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:00.439374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:00.440308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:00.441129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:00.449084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:00.451365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:00.454568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:00.554122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:00.627262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:01.341424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:01.353113 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-41149a9f-07df-4bab-8cbd-34840f092703 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1322 microversion: 2.1 time: 1.037345 Oct 01 20:59:01.356067 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1253/2420] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:00 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1322 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:01.361525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-651e4873-59de-4b57-be8c-ac871cc68902 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41739bb670>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:01.369581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:01.381176 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62d0a2c1-3dc7-4d97-9a7f-cd7b331b05cf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1292 microversion: 2.1 time: 0.971393 Oct 01 20:59:01.400199 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1168/2421] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:00 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1292 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:01.407455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cd5f8914-7673-44a6-b1d5-7db2ea6febb0 req-ab45113e-90ca-4f45-873f-dbe3f00f91c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51127763-f98b-43aa-8f93-e47e9ccc3c77", "name": "network-vif-plugged", "status": "completed", "tag": "4e4bfaef-3969-44c6-ba14-6fb4e2e50603"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:01.426234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cd5f8914-7673-44a6-b1d5-7db2ea6febb0 req-ab45113e-90ca-4f45-873f-dbe3f00f91c0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:01.427570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cd5f8914-7673-44a6-b1d5-7db2ea6febb0 req-ab45113e-90ca-4f45-873f-dbe3f00f91c0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:01.428303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cd5f8914-7673-44a6-b1d5-7db2ea6febb0 req-ab45113e-90ca-4f45-873f-dbe3f00f91c0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:01.445579 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cd5f8914-7673-44a6-b1d5-7db2ea6febb0 req-ab45113e-90ca-4f45-873f-dbe3f00f91c0 service nova] Creating event network-vif-plugged:4e4bfaef-3969-44c6-ba14-6fb4e2e50603 for instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 on nch1-master-1 Oct 01 20:59:01.451634 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cd5f8914-7673-44a6-b1d5-7db2ea6febb0 req-ab45113e-90ca-4f45-873f-dbe3f00f91c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049505 Oct 01 20:59:01.452972 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1169/2422] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:01.460484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:01.461613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:01.469458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:01.470414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:01.471297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:01.472752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:01.473437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:01.474107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:01.512560 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-651e4873-59de-4b57-be8c-ac871cc68902 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 0.155340 Oct 01 20:59:01.513168 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1254/2423] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:59:01 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:01.729368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-286888375", "imageRef": "a57e4b63-2e79-4db4-b78c-4cd92f47a231", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e97188c1-97c2-44c4-b954-79cd102d3f9a"}], "security_groups": [{"name": "tempest-securitygroup--183611082"}], "key_name": "tempest-keypair-711079135", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:02.264160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] validate_networks() for [('e97188c1-97c2-44c4-b954-79cd102d3f9a', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:59:02.565446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:02.575557 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4688c8a9-a4c7-4c05-9211-0432cbf2362e tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1502 microversion: 2.1 time: 1.120438 Oct 01 20:59:02.600231 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1170/2424] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:01 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1502 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:02.632690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:02.645609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:02.665518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:02.684943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:02.688587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:02.696981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:02.703952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:02.704519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:04.095556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:04.107647 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd818f72-4f71-43a9-a89a-127d78819d72 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 200 len: 1516 microversion: 2.1 time: 1.505982 Oct 01 20:59:04.108250 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1171/2425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:02 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 1516 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:04.112836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:04.113448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:04.145442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:04.145949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:04.146387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:04.147133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:04.147591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:04.148015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:04.415200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:04.540589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:59:04.541021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:59:04.541504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:59:04.541922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:59:04.542341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:59:04.566472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:04.567007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:04.567454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:04.568203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:04.568671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:04.569090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:04.627056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Getting quotas for project bcdb77df347145639f2de60eb820a3ca. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:04.643620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Getting quotas for user ccbf2c814364466baca8dfcabd2c13f9 and project bcdb77df347145639f2de60eb820a3ca. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:04.684733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:59:04.694789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a57e4b63-2e79-4db4-b78c-4cd92f47a231',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:59:04.734212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:04.742729 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5476db15-c301-451a-8b4d-1663e4df1a98 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1292 microversion: 2.1 time: 0.633398 Oct 01 20:59:04.758003 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1172/2426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:04 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1292 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:04.770529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ce681adb-526e-4ae7-bd1d-bf3fbb4fa8a0 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4172b4cdc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:04.867770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ce681adb-526e-4ae7-bd1d-bf3fbb4fa8a0 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 0.108427 Oct 01 20:59:04.875876 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1173/2427] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:59:04 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:04.876290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:04.888268 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8f841f64-0a02-4f6f-9ef8-35ce0a4f0004 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.162865 Oct 01 20:59:04.888951 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1255/2428] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:59:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 3164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:59:04.890851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:04.911861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:04.912644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: d47b361c-dc29-495f-803e-f50b3421d788] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:04.914613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:04.916902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:04.917514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:04.918403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:04.921284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:04.926103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:04.977152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:04.987179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:04.987841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:04.988445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:04.988921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:04.989352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:05.080038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:59:05.294428 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7bffde6c-4dce-4e67-8e75-ec1f8e6295c0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "DELETE /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 204 len: 0 microversion: 2.1 time: 0.421802 Oct 01 20:59:05.304294 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1174/2429] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:59:04 2022] DELETE /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:05.315842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a646bec8-0aa6-40eb-95f6-d487e3e780ee tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:05.334040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a646bec8-0aa6-40eb-95f6-d487e3e780ee tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:05.524157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a646bec8-0aa6-40eb-95f6-d487e3e780ee tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:05.541186 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a646bec8-0aa6-40eb-95f6-d487e3e780ee tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1244 microversion: 2.1 time: 0.232109 Oct 01 20:59:05.542241 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1175/2430] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:05 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1244 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:05.559860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2d44554d-316b-48bc-b0ad-6a6f2a5b86bf req-dcc90f3d-ab03-4676-8b5d-e5d186db72ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a421824-9059-433a-b77f-6bf3ea622301", "tag": "9304dc9e-52d8-4c39-a272-dd40574a2d6b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:05.576892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2d44554d-316b-48bc-b0ad-6a6f2a5b86bf req-dcc90f3d-ab03-4676-8b5d-e5d186db72ec service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:05.579125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2d44554d-316b-48bc-b0ad-6a6f2a5b86bf req-dcc90f3d-ab03-4676-8b5d-e5d186db72ec service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:05.579733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2d44554d-316b-48bc-b0ad-6a6f2a5b86bf req-dcc90f3d-ab03-4676-8b5d-e5d186db72ec service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:05.601770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2d44554d-316b-48bc-b0ad-6a6f2a5b86bf req-dcc90f3d-ab03-4676-8b5d-e5d186db72ec service nova] Creating event network-changed:9304dc9e-52d8-4c39-a272-dd40574a2d6b for instance 7a421824-9059-433a-b77f-6bf3ea622301 on nch1-master-1 Oct 01 20:59:05.620268 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2d44554d-316b-48bc-b0ad-6a6f2a5b86bf req-dcc90f3d-ab03-4676-8b5d-e5d186db72ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073671 Oct 01 20:59:05.621439 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1176/2431] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:05.635435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:05.636658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:05.649950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:05.650751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:05.652502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:05.655823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:05.656561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:05.657186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:05.927677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:05.949573 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6fac22c0-30a8-4237-9f13-18824c3be0f0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788" status: 200 len: 1516 microversion: 2.1 time: 1.059409 Oct 01 20:59:05.971831 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1256/2432] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:04 2022] GET /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788 => generated 1516 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:05.984772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:05.988787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:06.008049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:06.008544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:06.008987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:06.009702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:06.010153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:06.024867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:07.003665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:07.014439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-86723108-6154-430e-8601-3d5d9ea39c3c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1508 microversion: 2.1 time: 1.391503 Oct 01 20:59:07.025266 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1177/2433] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:05 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1508 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:07.032448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7461c7d4-bf76-42ea-bc87-3c3f653cae3c tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4173822a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:07.146263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:07.171890 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-33c16b08-0c09-4612-ac72-53432cf5b884 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1292 microversion: 2.1 time: 1.196881 Oct 01 20:59:07.173687 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1257/2434] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:05 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1292 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:07.178088 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7461c7d4-bf76-42ea-bc87-3c3f653cae3c tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1429 microversion: 2.1 time: 0.149988 Oct 01 20:59:07.193104 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1178/2435] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:59:07 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1429 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:07.206350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:07.207607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 51127763-f98b-43aa-8f93-e47e9ccc3c77] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:07.211518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:07.222830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:07.231168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:07.234373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:07.236720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:07.237734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:07.242219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:07.243239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:07.245520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:07.253445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:07.257084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:07.259748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:07.264626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:07.267023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:07.962283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:07.977541 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-11163ff2-6e0c-4fde-aaf2-f752f7b83776 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1296 microversion: 2.1 time: 0.777167 Oct 01 20:59:07.978755 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1179/2436] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:07 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1296 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:08.083026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:08.084549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:08.104988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:08.106440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:08.109142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:08.113026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:08.113545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:08.114065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:08.681275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de7837875cf4298b7ac7f328a74694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35315d2dc0e749a9910aa04a2ed06b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:08.692294 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4b2bdbd-c29d-4354-ab4a-6a2af003744f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 200 len: 1508 microversion: 2.1 time: 0.633307 Oct 01 20:59:08.702809 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1180/2437] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:08 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 1508 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:08.721765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b03db124-3c3a-4b24-b673-b443a0f7092a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4173ab4160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:09.571232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:09.583258 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b3590bda-4bfc-4c25-9537-fdd83eebd180 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77" status: 200 len: 1515 microversion: 2.1 time: 2.404106 Oct 01 20:59:09.605519 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1258/2438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:07 2022] GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 => generated 1515 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:09.619676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:09.621202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:09.634857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=67 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:09.646887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:09.648859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:09.651228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:09.653033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:09.655614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:09.658341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:10.075234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:10.086889 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-11998aaf-a91d-4b63-8e4f-c65ceb5d845e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1292 microversion: 2.1 time: 0.479658 Oct 01 20:59:10.097935 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1259/2439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:09 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1292 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:10.401428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-559679832", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "4f939274-1e9a-43b9-bf60-e54c963a636d"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:14.605103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:14.666421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:15.540509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:17.263693 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b03db124-3c3a-4b24-b673-b443a0f7092a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1438 microversion: 2.1 time: 8.557979 Oct 01 20:59:17.275665 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1181/2440] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:59:08 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1438 bytes in 8570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:17.284720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:17.286638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:17.294213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] validate_networks() for [('4f939274-1e9a-43b9-bf60-e54c963a636d', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:59:17.317713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:17.320777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:17.321664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:17.326632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:17.328214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:17.329152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:17.874120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:17.883561 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37cde2c4-8197-41e8-9d10-f280a787b30f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 0.606558 Oct 01 20:59:17.884159 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1182/2441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:17 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:17.919189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:17.919767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 51127763-f98b-43aa-8f93-e47e9ccc3c77] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:17.940288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:17.940789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:17.941233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:17.941952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:17.942409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:17.942873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:18.017768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 51127763-f98b-43aa-8f93-e47e9ccc3c77] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:59:18.144148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:18.247391 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-08d15f27-b15d-4f0b-8629-513988cc6e40 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "DELETE /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77" status: 204 len: 0 microversion: 2.1 time: 0.361732 Oct 01 20:59:18.247939 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1183/2442] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:59:17 2022] DELETE /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:18.258728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:18.261214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:18.276257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:18.276934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:18.281582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:18.282342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:18.287424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:18.288123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:18.322579 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] HTTP exception thrown: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Request method failure captured: Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df HTTP/1.1 Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKn2jlxi70MGPCsXYXPX9ItfmrQ-e8NkkymKcXNoRaU2-NS_lyuGq1w0VJj7SA8NvgQXiOjHGTprcHyRCv1kdpHj6C1q3KxcvFGIAfiOzMgJZf6Na1qSgcsyoN2w7_S6a4X1x6Bq_GPl1woatwJAIB7z1crpTpo2Qx9I8q4FqywBjsM Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35315d2dc0e749a9910aa04a2ed06b42", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}] Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1de7837875cf4298b7ac7f328a74694c Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '41357236-51bf-4aa8-bab9-b84f5ca4f6df'} Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:18.328696 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:18.332379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:18.332379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:18.332379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:18.332379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:18.332379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:18.332379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:18.332379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:18.334702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Returning 404 to user: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:18.340996 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1000aec7-e46f-452e-988a-c801ae49ddb7 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 404 len: 111 microversion: 2.1 time: 0.087877 Oct 01 20:59:18.341900 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1184/2443] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:18 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:18.347490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:18.358995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:18.379219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:18.381282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:18.384943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:18.387157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:18.395279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:18.396391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:19.078389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:19.094006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:59:19.094527 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-42d2077e-929b-4357-a63c-92f8eb6c50c4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1292 microversion: 2.1 time: 0.751050 Oct 01 20:59:19.096653 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1185/2444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:18 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1292 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:19.097012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:59:19.099103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:59:19.100452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:59:19.101022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:59:19.149927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:19.150976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:19.151676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:19.154020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:19.157798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:19.158762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:19.182084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:19.240177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Getting quotas for project 9566fa9a44f94c4ea3081a1a2e658de0. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:19.251207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Getting quotas for user e84a109e337d450698e630acfb49f9a5 and project 9566fa9a44f94c4ea3081a1a2e658de0. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:19.287881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:59:19.290410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:59:19.486468 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4fdbe40e-e96f-4142-a305-df109f9326c3 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.387020 Oct 01 20:59:19.489684 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1260/2445] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:59:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 9391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:59:19.632504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e4beeba8-331e-4905-af14-5fadb6559d8a req-867c974a-7e50-4c5b-9295-c3ef35037689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41357236-51bf-4aa8-bab9-b84f5ca4f6df", "name": "network-vif-deleted", "tag": "70243b27-5cf0-4793-82b5-048b3f9c335b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:19.668537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e4beeba8-331e-4905-af14-5fadb6559d8a req-867c974a-7e50-4c5b-9295-c3ef35037689 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:19.669128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e4beeba8-331e-4905-af14-5fadb6559d8a req-867c974a-7e50-4c5b-9295-c3ef35037689 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:19.674470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e4beeba8-331e-4905-af14-5fadb6559d8a req-867c974a-7e50-4c5b-9295-c3ef35037689 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:19.707277 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e4beeba8-331e-4905-af14-5fadb6559d8a req-867c974a-7e50-4c5b-9295-c3ef35037689 service nova] Creating event network-vif-deleted:70243b27-5cf0-4793-82b5-048b3f9c335b for instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df on nch2-master-1 Oct 01 20:59:19.719926 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e4beeba8-331e-4905-af14-5fadb6559d8a req-867c974a-7e50-4c5b-9295-c3ef35037689 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.621492 Oct 01 20:59:19.722618 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1186/2446] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:19.922342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7636b544-263f-46ad-83a8-7bc40381fb96 req-f58ca127-fd0f-4536-8ad8-f229abb1dea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4377bd0-2f2e-4373-b1ef-a98c06edc04f", "tag": "9f755ca0-b3c5-4016-8d9c-782b032ab956"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:19.956526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7636b544-263f-46ad-83a8-7bc40381fb96 req-f58ca127-fd0f-4536-8ad8-f229abb1dea9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:19.960127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7636b544-263f-46ad-83a8-7bc40381fb96 req-f58ca127-fd0f-4536-8ad8-f229abb1dea9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:19.961182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7636b544-263f-46ad-83a8-7bc40381fb96 req-f58ca127-fd0f-4536-8ad8-f229abb1dea9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:19.976415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6dd820af-5e22-4905-94da-91e95f26bb2f req-979645a4-b548-4ce3-b387-a3621ff7b0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a421824-9059-433a-b77f-6bf3ea622301", "name": "network-vif-plugged", "status": "completed", "tag": "9304dc9e-52d8-4c39-a272-dd40574a2d6b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:19.998618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6dd820af-5e22-4905-94da-91e95f26bb2f req-979645a4-b548-4ce3-b387-a3621ff7b0e8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:19.999506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6dd820af-5e22-4905-94da-91e95f26bb2f req-979645a4-b548-4ce3-b387-a3621ff7b0e8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:20.000347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6dd820af-5e22-4905-94da-91e95f26bb2f req-979645a4-b548-4ce3-b387-a3621ff7b0e8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:20.001419 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7636b544-263f-46ad-83a8-7bc40381fb96 req-f58ca127-fd0f-4536-8ad8-f229abb1dea9 service nova] Creating event network-changed:9f755ca0-b3c5-4016-8d9c-782b032ab956 for instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f on nch2-master-1 Oct 01 20:59:20.016433 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7636b544-263f-46ad-83a8-7bc40381fb96 req-f58ca127-fd0f-4536-8ad8-f229abb1dea9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522306 Oct 01 20:59:20.017598 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1261/2447] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:20.030988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d38f2342-7f40-4fd1-b27e-92d1a1369504 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f4173df9dc0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:20.051599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6dd820af-5e22-4905-94da-91e95f26bb2f req-979645a4-b548-4ce3-b387-a3621ff7b0e8 service nova] Creating event network-vif-plugged:9304dc9e-52d8-4c39-a272-dd40574a2d6b for instance 7a421824-9059-433a-b77f-6bf3ea622301 on nch1-master-1 Oct 01 20:59:20.098789 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6dd820af-5e22-4905-94da-91e95f26bb2f req-979645a4-b548-4ce3-b387-a3621ff7b0e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373796 Oct 01 20:59:20.099479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1187/2448] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:20.143896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:20.144697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 51127763-f98b-43aa-8f93-e47e9ccc3c77] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:20.184738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:20.192140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:20.192680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:20.193456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:20.193921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:20.194351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:20.198231 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d38f2342-7f40-4fd1-b27e-92d1a1369504 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 200 len: 1438 microversion: 2.1 time: 0.178706 Oct 01 20:59:20.198854 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1262/2449] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 20:59:20 2022] GET /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 1438 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:20.215103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-538121789", "metadata": {"image_type": "test"}}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:20.229316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:20.242176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:20.243003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:20.244513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:20.245457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:20.247795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:20.248762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:20.296639 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] HTTP exception thrown: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Request method failure captured: Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df/action HTTP/1.1 Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 111 Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKn2jlxi70MGPCsXYXPX9ItfmrQ-e8NkkymKcXNoRaU2-NS_lyuGq1w0VJj7SA8NvgQXiOjHGTprcHyRCv1kdpHj6C1q3KxcvFGIAfiOzMgJZf6Na1qSgcsyoN2w7_S6a4X1x6Bq_GPl1woatwJAIB7z1crpTpo2Qx9I8q4FqywBjsM Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35315d2dc0e749a9910aa04a2ed06b42", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}] Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1de7837875cf4298b7ac7f328a74694c Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-538121789", "metadata": {"image_type": "test"}}} Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '41357236-51bf-4aa8-bab9-b84f5ca4f6df', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-538121789', 'metadata': {'image_type': 'test'}}}} Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 01 20:59:20.304509 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:20.308657 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:20.313892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Returning 404 to user: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:20.317016 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-72f13daf-23cc-4aa1-b506-1a2767be6b7c tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "POST /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df/action" status: 404 len: 111 microversion: 2.1 time: 0.113106 Oct 01 20:59:20.318851 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1263/2450] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Oct 1 20:59:20 2022] POST /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df/action => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:20.344363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:20.345859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:20.365357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:20.368167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:20.370302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:20.373385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:20.373891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:20.379327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:21.290172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:21.302192 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ffed23e3-8b45-4a9b-b00d-5d836d16e92c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 0.975841 Oct 01 20:59:21.304573 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1264/2451] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:20 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:21.319681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:21.320592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:21.336606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:21.337617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:21.339921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:21.341531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:21.342172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:21.344549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:21.478067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:21.488419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f6c3e16-95b6-49d7-9928-8c1a29398144 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77" status: 200 len: 1521 microversion: 2.1 time: 1.387635 Oct 01 20:59:21.502375 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1188/2452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:20 2022] GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 => generated 1521 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:21.517041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:21.536922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:21.539068 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7bb56f7b-a30c-4a83-b7b1-d24580cf9eed tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1213 microversion: 2.1 time: 0.229220 Oct 01 20:59:21.554687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:21.555194 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1265/2453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:21 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1213 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:21.570172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:21.574067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:21.580269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:21.585750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:21.588264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:21.588771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:21.589074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:21.589276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:21.606057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:21.606821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:21.607723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:21.610019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:21.611338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:21.612376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:22.248564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:22.270922 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf584241-ab3c-4a7a-b936-6fd1f7d00ce4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1292 microversion: 2.1 time: 0.751907 Oct 01 20:59:22.275509 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1189/2454] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:21 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1292 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:22.286558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3346b8a4-f492-4b9c-8a67-a3ada00322d6 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-69527958", "metadata": {"image_type": "test"}}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:22.292403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3346b8a4-f492-4b9c-8a67-a3ada00322d6 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Failed to fetch instance by id tempest-invalid-1671089500 {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 01 20:59:22.293650 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3346b8a4-f492-4b9c-8a67-a3ada00322d6 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] HTTP exception thrown: Instance tempest-invalid-1671089500 could not be found. Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3346b8a4-f492-4b9c-8a67-a3ada00322d6 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Request method failure captured: Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/tempest-invalid-1671089500/action HTTP/1.1 Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 110 Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKn2jlxi70MGPCsXYXPX9ItfmrQ-e8NkkymKcXNoRaU2-NS_lyuGq1w0VJj7SA8NvgQXiOjHGTprcHyRCv1kdpHj6C1q3KxcvFGIAfiOzMgJZf6Na1qSgcsyoN2w7_S6a4X1x6Bq_GPl1woatwJAIB7z1crpTpo2Qx9I8q4FqywBjsM Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35315d2dc0e749a9910aa04a2ed06b42", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}] Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1de7837875cf4298b7ac7f328a74694c Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-69527958", "metadata": {"image_type": "test"}}} Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance tempest-invalid-1671089500 could not be found. Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'tempest-invalid-1671089500', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-69527958', 'metadata': {'image_type': 'test'}}}} Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1671089500 could not be found. Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:22.308145 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1671089500 could not be found. Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1671089500 could not be found. Oct 01 20:59:22.315831 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.319198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3346b8a4-f492-4b9c-8a67-a3ada00322d6 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Returning 404 to user: Instance tempest-invalid-1671089500 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:22.320501 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3346b8a4-f492-4b9c-8a67-a3ada00322d6 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "POST /compute/v2.1/servers/tempest-invalid-1671089500/action" status: 404 len: 101 microversion: 2.1 time: 0.041963 Oct 01 20:59:22.321778 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1190/2455] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Oct 1 20:59:22 2022] POST /compute/v2.1/servers/tempest-invalid-1671089500/action => generated 101 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:22.338536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6a88361b-faef-4eb1-9688-6e8254a71176 req-b9c16f73-5ef9-4fb2-a8f1-0be9d7440215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51127763-f98b-43aa-8f93-e47e9ccc3c77", "name": "network-vif-deleted", "tag": "4e4bfaef-3969-44c6-ba14-6fb4e2e50603"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:22.364464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6a88361b-faef-4eb1-9688-6e8254a71176 req-b9c16f73-5ef9-4fb2-a8f1-0be9d7440215 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:22.365627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6a88361b-faef-4eb1-9688-6e8254a71176 req-b9c16f73-5ef9-4fb2-a8f1-0be9d7440215 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:22.366546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6a88361b-faef-4eb1-9688-6e8254a71176 req-b9c16f73-5ef9-4fb2-a8f1-0be9d7440215 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:22.406512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:22.412707 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6a88361b-faef-4eb1-9688-6e8254a71176 req-b9c16f73-5ef9-4fb2-a8f1-0be9d7440215 service nova] Creating event network-vif-deleted:4e4bfaef-3969-44c6-ba14-6fb4e2e50603 for instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 on nch1-master-1 Oct 01 20:59:22.425509 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ea558b8d-1ee1-4edf-b984-a0627db9bdf8 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1466 microversion: 2.1 time: 0.869043 Oct 01 20:59:22.426839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6a88361b-faef-4eb1-9688-6e8254a71176 req-b9c16f73-5ef9-4fb2-a8f1-0be9d7440215 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102311 Oct 01 20:59:22.428484 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1191/2456] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:22.452005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:22.462768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:22.464657 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1266/2457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:21 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1466 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:22.470127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-28d3f56a-cbd3-477c-b2c9-dd71756d6a54 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-206762494"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:22.478482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-28d3f56a-cbd3-477c-b2c9-dd71756d6a54 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 01 20:59:22.479321 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-28d3f56a-cbd3-477c-b2c9-dd71756d6a54 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-28d3f56a-cbd3-477c-b2c9-dd71756d6a54 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Request method failure captured: Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 56 Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKn2jlxi70MGPCsXYXPX9ItfmrQ-e8NkkymKcXNoRaU2-NS_lyuGq1w0VJj7SA8NvgQXiOjHGTprcHyRCv1kdpHj6C1q3KxcvFGIAfiOzMgJZf6Na1qSgcsyoN2w7_S6a4X1x6Bq_GPl1woatwJAIB7z1crpTpo2Qx9I8q4FqywBjsM Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35315d2dc0e749a9910aa04a2ed06b42", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}] Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1de7837875cf4298b7ac7f328a74694c Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: {"createImage": {"name": "tempest-test-snap-206762494"}} Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-206762494'}}} Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:22.481088 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.486016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:22.486016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.486016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:22.486016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:22.486016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:22.486016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:22.486016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:22.486016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:22.486016 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:22.487624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-28d3f56a-cbd3-477c-b2c9-dd71756d6a54 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:22.490695 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-28d3f56a-cbd3-477c-b2c9-dd71756d6a54 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.022747 Oct 01 20:59:22.491854 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1267/2458] 10.222.0.17 () {60 vars in 1275 bytes} [Sat Oct 1 20:59:22 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:22.495116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:22.498216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:22.500243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e9a03aec-205c-4b5c-bef5-c13d7b522a21 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41780b2e50>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:22.502271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:22.512038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:22.515059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:22.515729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:23.406334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:23.425420 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64f1f896-6d27-4dc8-b723-e1bdb9b1eb69 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 0.992533 Oct 01 20:59:23.426055 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1192/2459] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:22 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:23.447755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5929b729-d913-4baa-9dde-f0a5e62186d0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-61436633"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:23.458084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5929b729-d913-4baa-9dde-f0a5e62186d0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 01 20:59:23.464417 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5929b729-d913-4baa-9dde-f0a5e62186d0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5929b729-d913-4baa-9dde-f0a5e62186d0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Request method failure captured: Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 55 Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKn2jlxi70MGPCsXYXPX9ItfmrQ-e8NkkymKcXNoRaU2-NS_lyuGq1w0VJj7SA8NvgQXiOjHGTprcHyRCv1kdpHj6C1q3KxcvFGIAfiOzMgJZf6Na1qSgcsyoN2w7_S6a4X1x6Bq_GPl1woatwJAIB7z1crpTpo2Qx9I8q4FqywBjsM Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35315d2dc0e749a9910aa04a2ed06b42", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}] Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1de7837875cf4298b7ac7f328a74694c Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: {"createImage": {"name": "tempest-test-snap-61436633"}} Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-61436633'}}} Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:23.484995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:23.490405 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:23.490405 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:23.490405 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:23.490405 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:23.490405 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:23.490405 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:23.490405 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:23.490405 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 01 20:59:23.490405 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:23.492497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5929b729-d913-4baa-9dde-f0a5e62186d0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:23.505964 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5929b729-d913-4baa-9dde-f0a5e62186d0 tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.077674 Oct 01 20:59:23.512297 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1193/2460] 10.222.0.17 () {60 vars in 1281 bytes} [Sat Oct 1 20:59:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:23.518457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:23.519793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 51127763-f98b-43aa-8f93-e47e9ccc3c77] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:23.527617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:23.528430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:23.529072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:23.530832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:23.531684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:23.532469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:23.588497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:23.589191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:23.589711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:23.590249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lazy-loading 'fault' on Instance uuid 51127763-f98b-43aa-8f93-e47e9ccc3c77 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:59:23.692283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:23.706670 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-647179e3-5784-4a13-b772-28f8d0ee6d1c tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77" status: 200 len: 1312 microversion: 2.1 time: 0.192677 Oct 01 20:59:23.707571 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1194/2461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:23 2022] GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:23.722631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:23.723896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:23.736464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:23.736971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:23.737419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:23.738146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:23.738689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:23.739118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:23.917462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:23.936409 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-14ceb2b0-ac04-4892-aa14-84ab11b19a48 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1275 microversion: 2.1 time: 0.222258 Oct 01 20:59:23.937911 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1195/2462] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:23 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:23.944389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:23.945239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:23.955259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:23.959337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:23.960002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:23.969004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:23.969766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:23.973616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:24.292734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:24.310633 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f6ccc90-f6f4-4002-bec2-d2d10168cf70 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1472 microversion: 2.1 time: 0.370175 Oct 01 20:59:24.312654 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1196/2463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:23 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:24.319841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7ff6600c-6be7-412c-a6b0-17d776cec5ce req-36e38292-1f6b-4045-a30a-e0146d66a9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7a2841-f1d1-4a9e-8121-d1e0a418dd21", "name": "network-vif-unplugged", "status": "completed", "tag": "21b76ebd-44ca-4ccb-9d42-c987237b2347"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:24.352493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7ff6600c-6be7-412c-a6b0-17d776cec5ce req-36e38292-1f6b-4045-a30a-e0146d66a9b5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:24.358864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7ff6600c-6be7-412c-a6b0-17d776cec5ce req-36e38292-1f6b-4045-a30a-e0146d66a9b5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:24.359575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7ff6600c-6be7-412c-a6b0-17d776cec5ce req-36e38292-1f6b-4045-a30a-e0146d66a9b5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:24.393666 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7ff6600c-6be7-412c-a6b0-17d776cec5ce req-36e38292-1f6b-4045-a30a-e0146d66a9b5 service nova] Creating event network-vif-unplugged:21b76ebd-44ca-4ccb-9d42-c987237b2347 for instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 on nch2-master-1 Oct 01 20:59:24.424368 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7ff6600c-6be7-412c-a6b0-17d776cec5ce req-36e38292-1f6b-4045-a30a-e0146d66a9b5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110249 Oct 01 20:59:24.424994 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1197/2464] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:24.437793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:24.442752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:24.450344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:24.451211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:24.451982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:24.452905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:24.453690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:24.454278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:24.470849 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] HTTP exception thrown: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Request method failure captured: Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df HTTP/1.1 Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKn2jlxi70MGPCsXYXPX9ItfmrQ-e8NkkymKcXNoRaU2-NS_lyuGq1w0VJj7SA8NvgQXiOjHGTprcHyRCv1kdpHj6C1q3KxcvFGIAfiOzMgJZf6Na1qSgcsyoN2w7_S6a4X1x6Bq_GPl1woatwJAIB7z1crpTpo2Qx9I8q4FqywBjsM Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35315d2dc0e749a9910aa04a2ed06b42", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}] Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1de7837875cf4298b7ac7f328a74694c Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '41357236-51bf-4aa8-bab9-b84f5ca4f6df'} Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:24.472863 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.477024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.478664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Returning 404 to user: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:24.479711 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f59b0cab-0f4d-4682-b800-e1260cb28b6f tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "DELETE /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 404 len: 111 microversion: 2.1 time: 0.052679 Oct 01 20:59:24.484290 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1198/2465] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:59:24 2022] DELETE /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:24.491519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:24.492391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:24.499535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:24.500426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:24.501081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:24.502020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:24.502747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:24.503513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:24.516626 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e9a03aec-205c-4b5c-bef5-c13d7b522a21 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "DELETE /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e" status: 204 len: 0 microversion: 2.1 time: 2.023273 Oct 01 20:59:24.517219 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1268/2466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:22 2022] DELETE /compute/v2.1/images/30ee3dc4-6c82-4ff5-baff-cce49f3c0b7e => generated 0 bytes in 2025 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:24.525959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:24.526619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] [instance: 41357236-51bf-4aa8-bab9-b84f5ca4f6df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:24.557852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:24.560453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:24.560892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:24.563868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:24.566697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:24.567161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:24.623037 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] HTTP exception thrown: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Request method failure captured: Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df HTTP/1.1 Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKn2jlxi70MGPCsXYXPX9ItfmrQ-e8NkkymKcXNoRaU2-NS_lyuGq1w0VJj7SA8NvgQXiOjHGTprcHyRCv1kdpHj6C1q3KxcvFGIAfiOzMgJZf6Na1qSgcsyoN2w7_S6a4X1x6Bq_GPl1woatwJAIB7z1crpTpo2Qx9I8q4FqywBjsM Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35315d2dc0e749a9910aa04a2ed06b42", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35315d2dc0e749a9910aa04a2ed06b42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35315d2dc0e749a9910aa04a2ed06b42"}]}] Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 35315d2dc0e749a9910aa04a2ed06b42 Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-893589154 Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1de7837875cf4298b7ac7f328a74694c Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesNegativeTestJSON-893589154-project Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '41357236-51bf-4aa8-bab9-b84f5ca4f6df'} Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:24.630958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.634650 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.634650 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:24.634650 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:24.634650 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:24.634650 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:24.634650 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. Oct 01 20:59:24.634650 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.639007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] Returning 404 to user: Instance 41357236-51bf-4aa8-bab9-b84f5ca4f6df could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:24.646854 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-370f690f-17f5-44c7-870d-e1d79a1cf7ef tempest-ImagesNegativeTestJSON-893589154 tempest-ImagesNegativeTestJSON-893589154-project] 10.222.0.17 "GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df" status: 404 len: 111 microversion: 2.1 time: 0.122328 Oct 01 20:59:24.647845 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1269/2467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:24 2022] GET /compute/v2.1/servers/41357236-51bf-4aa8-bab9-b84f5ca4f6df => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:24.672295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9dc7cf01-8d45-4922-84a7-d979adeb78f9 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '.version_select at 0x7f41739bb9d0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:24.733860 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-9dc7cf01-8d45-4922-84a7-d979adeb78f9 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] HTTP exception thrown: Image not found. Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9dc7cf01-8d45-4922-84a7-d979adeb78f9 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Request method failure captured: Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 HTTP/1.1 Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKnBl0X_UXplChwy9siL1vN85wRvWLkvyWyU5BoUnWUs61sm7v1kknNj98DWCrOutUEjFHrhHajNHDtj3L5zUAaJkGUCiW1aiSCw1oy_-LGSRUWhIjiV-levMk1oSqHhVyYXIXdMdBHEvwmuoe9Awiu-N8lm82uL2hieyZBLNwU5ryQ Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 3cf38b1a4bc4458199fea3373632117d Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ImagesOneServerTestJSON-1983688695 Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3cf38b1a4bc4458199fea3373632117d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3cf38b1a4bc4458199fea3373632117d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3cf38b1a4bc4458199fea3373632117d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3cf38b1a4bc4458199fea3373632117d"}]}] Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ImagesOneServerTestJSON-1983688695 Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 3cf38b1a4bc4458199fea3373632117d Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1983688695 Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ImagesOneServerTestJSON-1983688695-project Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 4e76b153982141d8964ecbb118d19eab Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ImagesOneServerTestJSON-1983688695-project Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: method: Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: exception: Image not found. Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '9942dd83-c129-4865-b77e-9eaa56449664'} Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9942dd83-c129-4865-b77e-9eaa56449664 to delete Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9942dd83-c129-4865-b77e-9eaa56449664 could not be found. Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.736274 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 20:59:24.741811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9dc7cf01-8d45-4922-84a7-d979adeb78f9 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Returning 404 to user: Image not found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:24.745535 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9dc7cf01-8d45-4922-84a7-d979adeb78f9 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "DELETE /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664" status: 404 len: 62 microversion: 2.1 time: 0.090168 Oct 01 20:59:24.746839 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1270/2468] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:24 2022] DELETE /compute/v2.1/images/9942dd83-c129-4865-b77e-9eaa56449664 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 20:59:24.761529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1259ada0-649e-40f4-991a-ee9cde93bc82 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1557023418", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:24.904085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-1259ada0-649e-40f4-991a-ee9cde93bc82 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] validate_networks() for [('9417f59c-8d13-4179-a6ee-0176ac73cf1c', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:59:25.300456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:25.313710 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9d29cd18-909c-48d1-8678-bfb8c463899c tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 0.827888 Oct 01 20:59:25.335495 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1199/2469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:24 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:25.349191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:25.352567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 51127763-f98b-43aa-8f93-e47e9ccc3c77] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:25.401939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:25.403335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:25.404966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:25.408438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:25.410712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:25.411363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:25.440689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] HTTP exception thrown: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Request method failure captured: Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 HTTP/1.1 Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnpl8_L26Vz-0WO2A14uND6rGQYIwQwKY335gQaTEm8K8q-CiT2hrHvTSOSQgxoH8RqAZ4xpPTOHu-oiWb-dZDhv9B0HB-1uKNQBnVNo8FJFlSjsh8foaWJzj0ovueiUT_VsOqHnZr5W9E6_p_jusyLPl_2faorJrmmxiOiZL4ScFA Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f84f3e4972f4a9c968100efa5775214", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}] Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f407ee9fccbf4fd6a9286642f8a015ad Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '51127763-f98b-43aa-8f93-e47e9ccc3c77'} Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:25.447124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:25.453549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:25.453549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:25.453549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:25.453549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:25.453549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:25.453549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:25.453549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:25.453549 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:25.459579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Returning 404 to user: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:25.460707 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5737f422-5f70-4797-90b7-a2d55fe19e7d tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77" status: 404 len: 111 microversion: 2.1 time: 0.123844 Oct 01 20:59:25.461768 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1200/2470] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:25 2022] GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:25.472702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:25.473640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:25.495243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:25.496072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:25.496771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:25.497909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:25.498737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:25.499434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:25.553984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:59:25.768602 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad9fff93-12c4-479a-9698-4c5aadaa2e3f tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 204 len: 0 microversion: 2.1 time: 0.305009 Oct 01 20:59:25.774021 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1201/2471] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:59:25 2022] DELETE /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:25.781175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:25.785913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:25.804576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:25.805445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:25.806136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:25.809457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:25.810192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:25.810896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:26.085530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:26.100180 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-25215bf1-5e19-40c7-8f39-d101b25ba3cf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1275 microversion: 2.1 time: 0.324209 Oct 01 20:59:26.101963 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1202/2472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:25 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1275 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:26.112311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:26.125850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:26.128866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '7f84f3e4972f4a9c968100efa5775214'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:59:26.144906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:26.147575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:26.148144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:26.151961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:26.152590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:26.153354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:26.305372 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71978dd3-36f4-4e99-a87a-cb5ec3a435e0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.194870 Oct 01 20:59:26.308255 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1203/2473] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Oct 1 20:59:26 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:59:26.324036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:26.326873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:26.338599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:26.339115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:26.339563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:26.340943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:26.340943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:26.341239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:26.788475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:26.805685 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07383def-e33a-4980-b932-99e89c388a18 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1472 microversion: 2.1 time: 0.495244 Oct 01 20:59:26.808142 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1204/2474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:26 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:26.818664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fbd4a65f-94be-4c4e-b151-e2d5c0b2a926 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fbd4a65f-94be-4c4e-b151-e2d5c0b2a926 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Request method failure captured: Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnpl8_L26Vz-0WO2A14uND6rGQYIwQwKY335gQaTEm8K8q-CiT2hrHvTSOSQgxoH8RqAZ4xpPTOHu-oiWb-dZDhv9B0HB-1uKNQBnVNo8FJFlSjsh8foaWJzj0ovueiUT_VsOqHnZr5W9E6_p_jusyLPl_2faorJrmmxiOiZL4ScFA Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f84f3e4972f4a9c968100efa5775214", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}] Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f407ee9fccbf4fd6a9286642f8a015ad Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: action_args: {} Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 01 20:59:26.830471 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 01 20:59:26.836759 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:26.841279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fbd4a65f-94be-4c4e-b151-e2d5c0b2a926 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:26.842819 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fbd4a65f-94be-4c4e-b151-e2d5c0b2a926 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.032825 Oct 01 20:59:26.844015 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1205/2475] 10.222.0.17 () {58 vars in 1182 bytes} [Sat Oct 1 20:59:26 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:59:26.855870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:26.856916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:26.866968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:26.867924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:26.868597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:26.870761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:26.872175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:26.873341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:26.902521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:27.147590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:27.156767 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2660f24f-c2f6-4b0f-b4a5-4aebe38da63d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 0.311357 Oct 01 20:59:27.171465 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1206/2476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:26 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:27.174970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:27.179830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:27.180500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Searching by: {'deleted': False, 'project_id': '7f84f3e4972f4a9c968100efa5775214'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:59:27.195178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:27.195984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:27.196594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:27.197740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:27.198404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:27.199088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:27.252434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:59:27.299763 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-821b7267-d8a6-4b11-af09-2d5b56c12861 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.141169 Oct 01 20:59:27.302916 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1207/2477] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 20:59:27 2022] GET /compute/v2.1/servers => generated 681 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:27.312741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:27.318848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:27.329593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:27.336243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:27.336717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:27.337504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:27.337969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:27.341995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:27.686932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:27.701495 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5adfbae5-a4a4-4d16-829e-14e4801166d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1317 microversion: 2.1 time: 0.397446 Oct 01 20:59:27.704386 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1208/2478] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:27 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:27.720145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:27.737823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:27.749110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.servers [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Removing options 'limit' from query {{(pid=140438) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 01 20:59:27.752208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Searching by: {'deleted': False, 'project_id': '7f84f3e4972f4a9c968100efa5775214'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:59:27.762632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:27.765489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:27.766130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:27.771168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:27.771850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:27.772653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:27.843910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:59:27.902544 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f900d8d0-2c1b-4411-b013-68a5dbc15c76 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.196731 Oct 01 20:59:27.904776 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1209/2479] 10.222.0.17 () {58 vars in 1144 bytes} [Sat Oct 1 20:59:27 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:27.919642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:27.924140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:27.980448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:27.981042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:27.981519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:27.982377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:27.982879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:27.983369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:28.938532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:28.947289 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7eae45ba-6970-416f-ad78-6ffd1242b798 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1472 microversion: 2.1 time: 1.040851 Oct 01 20:59:28.947969 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1210/2480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:27 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1472 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:28.952899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-793b6b77-56d4-4961-bea5-d7d987c39591 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-793b6b77-56d4-4961-bea5-d7d987c39591 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Request method failure captured: Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnpl8_L26Vz-0WO2A14uND6rGQYIwQwKY335gQaTEm8K8q-CiT2hrHvTSOSQgxoH8RqAZ4xpPTOHu-oiWb-dZDhv9B0HB-1uKNQBnVNo8FJFlSjsh8foaWJzj0ovueiUT_VsOqHnZr5W9E6_p_jusyLPl_2faorJrmmxiOiZL4ScFA Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f84f3e4972f4a9c968100efa5775214", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}] Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f407ee9fccbf4fd6a9286642f8a015ad Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: action_args: {} Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '-1' Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 01 20:59:28.957534 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 01 20:59:28.961484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:28.964022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-793b6b77-56d4-4961-bea5-d7d987c39591 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:28.965131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-793b6b77-56d4-4961-bea5-d7d987c39591 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.015859 Oct 01 20:59:28.965766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1211/2481] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Oct 1 20:59:28 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:59:28.971095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:28.972004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:28.979921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:28.980647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:28.981084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:28.981792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:28.982254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:28.982708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:29.182697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:29.268381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:29.307996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:29.318172 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07644421-fca2-4cc8-8c76-68c8cdc547ef tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 0.350910 Oct 01 20:59:29.319065 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1212/2482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:28 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:29.511973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ab4233d-d045-40ee-8321-5e0405a57a70 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Action: 'create', calling method: .version_select at 0x7f4172b62b80>, body: {"keypair": {"name": "tempest-keypair-1176311408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMS5uEJ96d3zQwdpPypPqVD4bTvhZW2ZcDAmoRM8TttBz7tOAPW8s3vu+6nYvytWrMyLd0e26TWqpmSwxK0rA3/Xw8eOwTPF2nskb6E00NWJdBp1f0gwdAQSfl87NhiOYA=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:29.521966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:29.535575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9ab4233d-d045-40ee-8321-5e0405a57a70 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Getting quotas for project d27e9cda0a6d47d4acdbadc890b996c9. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:29.542421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9ab4233d-d045-40ee-8321-5e0405a57a70 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Getting quotas for user 69002d46d4e54eadadf911ec3589d95c and project d27e9cda0a6d47d4acdbadc890b996c9. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:29.585735 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ab4233d-d045-40ee-8321-5e0405a57a70 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.265185 Oct 01 20:59:29.588278 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1213/2483] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 20:59:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:29.601332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:29.602306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:29.615157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:29.616264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:29.616623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:29.617457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:29.617908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:29.618591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:29.955180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:29.972412 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-480b28c7-05b5-451d-9543-49a38a43e574 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1317 microversion: 2.1 time: 0.379488 Oct 01 20:59:29.974050 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1214/2484] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:29 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:29.985527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-824b79e4-e47b-4c1a-8ae8-381c882a829a req-a9085c56-f277-4c15-be51-6b476a0cce2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7a2841-f1d1-4a9e-8121-d1e0a418dd21", "name": "network-vif-deleted", "tag": "21b76ebd-44ca-4ccb-9d42-c987237b2347"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:30.003476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-824b79e4-e47b-4c1a-8ae8-381c882a829a req-a9085c56-f277-4c15-be51-6b476a0cce2b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:30.004707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-824b79e4-e47b-4c1a-8ae8-381c882a829a req-a9085c56-f277-4c15-be51-6b476a0cce2b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:30.006017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-824b79e4-e47b-4c1a-8ae8-381c882a829a req-a9085c56-f277-4c15-be51-6b476a0cce2b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:30.025041 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-824b79e4-e47b-4c1a-8ae8-381c882a829a req-a9085c56-f277-4c15-be51-6b476a0cce2b service nova] Creating event network-vif-deleted:21b76ebd-44ca-4ccb-9d42-c987237b2347 for instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 on nch2-master-1 Oct 01 20:59:30.034088 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-824b79e4-e47b-4c1a-8ae8-381c882a829a req-a9085c56-f277-4c15-be51-6b476a0cce2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057630 Oct 01 20:59:30.036057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1215/2485] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:30.043181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-285e2da1-e109-49fe-acde-55a86563a125 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-285e2da1-e109-49fe-acde-55a86563a125 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Request method failure captured: Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnpl8_L26Vz-0WO2A14uND6rGQYIwQwKY335gQaTEm8K8q-CiT2hrHvTSOSQgxoH8RqAZ4xpPTOHu-oiWb-dZDhv9B0HB-1uKNQBnVNo8FJFlSjsh8foaWJzj0ovueiUT_VsOqHnZr5W9E6_p_jusyLPl_2faorJrmmxiOiZL4ScFA Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f84f3e4972f4a9c968100efa5775214", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}] Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f407ee9fccbf4fd6a9286642f8a015ad Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: action_args: {} Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'testing' Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 01 20:59:30.048967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-285e2da1-e109-49fe-acde-55a86563a125 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-285e2da1-e109-49fe-acde-55a86563a125 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.013821 Oct 01 20:59:30.053619 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1216/2486] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 20:59:30 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 20:59:30.058581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:30.061110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:30.071696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:30.072369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:30.073087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:30.073983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:30.075434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:30.075958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:30.120847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:30.121384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:30.121864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:30.122297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lazy-loading 'fault' on Instance uuid 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 20:59:30.241910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76b153982141d8964ecbb118d19eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf38b1a4bc4458199fea3373632117d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:30.254259 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24ac3937-94ec-4aff-80b4-ffd33726b77a tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 200 len: 1307 microversion: 2.1 time: 0.200889 Oct 01 20:59:30.269559 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1217/2487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:30 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:30.269559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-59abb289-036b-4915-84d9-231d776a8a69 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:30.288888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59abb289-036b-4915-84d9-231d776a8a69 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:30.289831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-59abb289-036b-4915-84d9-231d776a8a69 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '7f84f3e4972f4a9c968100efa5775214'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:59:30.300285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.servers [None req-59abb289-036b-4915-84d9-231d776a8a69 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Flavor 'non_existing_flavor' could not be found {{(pid=140438) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 01 20:59:30.301865 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-59abb289-036b-4915-84d9-231d776a8a69 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.044187 Oct 01 20:59:30.302849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1218/2488] 10.222.0.17 () {58 vars in 1178 bytes} [Sat Oct 1 20:59:30 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:59:30.307664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0b81760d-11e2-4131-a00b-1e5a28702a77 req-f70b97a2-1f56-4eca-9ea4-e751f91f3d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46", "tag": "d7ce4d28-55d5-42a3-9e7f-72988ea1ebd1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:30.322763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0b81760d-11e2-4131-a00b-1e5a28702a77 req-f70b97a2-1f56-4eca-9ea4-e751f91f3d0b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:30.323260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0b81760d-11e2-4131-a00b-1e5a28702a77 req-f70b97a2-1f56-4eca-9ea4-e751f91f3d0b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:30.323710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0b81760d-11e2-4131-a00b-1e5a28702a77 req-f70b97a2-1f56-4eca-9ea4-e751f91f3d0b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:30.339068 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0b81760d-11e2-4131-a00b-1e5a28702a77 req-f70b97a2-1f56-4eca-9ea4-e751f91f3d0b service nova] Creating event network-changed:d7ce4d28-55d5-42a3-9e7f-72988ea1ebd1 for instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 on nch2-master-1 Oct 01 20:59:30.344207 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0b81760d-11e2-4131-a00b-1e5a28702a77 req-f70b97a2-1f56-4eca-9ea4-e751f91f3d0b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039951 Oct 01 20:59:30.344966 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1219/2489] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:30.351283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:30.357068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:30.357857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '7f84f3e4972f4a9c968100efa5775214'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:59:30.365576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:30.366268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:30.368001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:30.369041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:30.369631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:30.370199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:30.563518 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ed666492-963d-4ca0-9268-44aa22218b03 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.217261 Oct 01 20:59:30.564322 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1220/2490] 10.222.0.17 () {58 vars in 1174 bytes} [Sat Oct 1 20:59:30 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:59:30.574353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:30.582761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:30.657493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:30.658077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:30.668189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:30.671688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:30.674093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:30.690175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:30.988758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:30.997424 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f1df739-67fd-47f2-b3f0-3abab92a69c5 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 0.431806 Oct 01 20:59:30.998286 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1221/2491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:30 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:31.003822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:31.009181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:31.010199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '7f84f3e4972f4a9c968100efa5775214'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:59:31.016004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:31.016631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:31.017165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:31.018002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:31.018699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:31.019239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:31.153444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92193cbe-4212-4363-afe5-03205898c7a0 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.153068 Oct 01 20:59:31.154354 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1222/2492] 10.222.0.17 () {58 vars in 1184 bytes} [Sat Oct 1 20:59:30 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:59:31.169492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:31.171327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:31.190100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:31.190672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:31.191215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:31.192165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:31.192636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:31.193180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:31.452664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:31.465220 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29cd5507-e027-41e1-9c74-00cd559b323a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1317 microversion: 2.1 time: 0.308657 Oct 01 20:59:31.474200 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1223/2493] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:31 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:31.487815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:31.493841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:31.494246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Searching by: {'deleted': False, 'project_id': '7f84f3e4972f4a9c968100efa5775214'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:59:31.500201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:31.500699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:31.501141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:31.501887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:31.502346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:31.502823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:31.537477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:59:31.614455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:31.627461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:31.628216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:31.628668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:31.934566 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c96ad704-4514-41ab-ad0f-e2ebac482b74 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.458408 Oct 01 20:59:31.945590 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1224/2494] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 20:59:31 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:31.962732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:31.963366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] [instance: 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:31.975856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:31.976531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:31.977136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:31.978025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:31.978667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:31.979306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:31.995282 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] HTTP exception thrown: Instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 could not be found. Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Request method failure captured: Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 HTTP/1.1 Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnBl0X_UXplChwy9siL1vN85wRvWLkvyWyU5BoUnWUs61sm7v1kknNj98DWCrOutUEjFHrhHajNHDtj3L5zUAaJkGUCiW1aiSCw1oy_-LGSRUWhIjiV-levMk1oSqHhVyYXIXdMdBHEvwmuoe9Awiu-N8lm82uL2hieyZBLNwU5ryQ Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 3cf38b1a4bc4458199fea3373632117d Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerTestJSON-1983688695 Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3cf38b1a4bc4458199fea3373632117d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3cf38b1a4bc4458199fea3373632117d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3cf38b1a4bc4458199fea3373632117d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3cf38b1a4bc4458199fea3373632117d"}]}] Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerTestJSON-1983688695 Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 3cf38b1a4bc4458199fea3373632117d Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1983688695 Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerTestJSON-1983688695-project Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 4e76b153982141d8964ecbb118d19eab Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerTestJSON-1983688695-project Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 could not be found. Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '3d7a2841-f1d1-4a9e-8121-d1e0a418dd21'} Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 could not be found. Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 could not be found. Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:31.997824 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:32.003162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:32.003162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:32.003162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:32.003162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:32.003162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:32.003162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 could not be found. Oct 01 20:59:32.003162 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:32.004927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] Returning 404 to user: Instance 3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:32.005989 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e643e260-4968-4981-9b8f-910053197f59 tempest-ImagesOneServerTestJSON-1983688695 tempest-ImagesOneServerTestJSON-1983688695-project] 10.222.0.17 "GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21" status: 404 len: 111 microversion: 2.1 time: 0.050677 Oct 01 20:59:32.012162 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1225/2495] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:31 2022] GET /compute/v2.1/servers/3d7a2841-f1d1-4a9e-8121-d1e0a418dd21 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:32.032679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5fbce76f-11be-467b-a5b7-4b4a14dd3afe tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:32.050112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5fbce76f-11be-467b-a5b7-4b4a14dd3afe tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:32.051367 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5fbce76f-11be-467b-a5b7-4b4a14dd3afe tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.029328 Oct 01 20:59:32.059810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1226/2496] 10.222.0.17 () {58 vars in 1178 bytes} [Sat Oct 1 20:59:32 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 20:59:32.075251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:32.076156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:32.087790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:32.091942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:32.092611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:32.095009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:32.095669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:32.102124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:32.454903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:32.464930 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7139fc0-63af-4c4f-bd4b-32cec2fdf8b0 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 0.403733 Oct 01 20:59:32.468087 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1227/2497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:32 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:32.484147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:32.489677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:32.490350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Searching by: {'deleted': False, 'project_id': '7f84f3e4972f4a9c968100efa5775214'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 20:59:32.503405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:32.503744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:32.504185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:32.504925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:32.505384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:32.515235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:32.561042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 20:59:32.605850 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-619a3394-46dd-4abb-b6e0-c6f672f9bd91 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.135890 Oct 01 20:59:32.606659 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1228/2498] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 20:59:32 2022] GET /compute/v2.1/servers => generated 681 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:32.611042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:32.611650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:32.634225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:32.635802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:32.636406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:32.642468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:32.643183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:32.643779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:32.675079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:33.064283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:33.085933 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-08cbad2a-ac49-4790-be9a-9fd0c2f57653 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1317 microversion: 2.1 time: 0.478238 Oct 01 20:59:33.089220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1229/2499] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:32 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:33.095868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:33.097653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 51127763-f98b-43aa-8f93-e47e9ccc3c77] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:33.123703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:33.124740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:33.126149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:33.127613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:33.128158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:33.129183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:33.146675 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] HTTP exception thrown: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Request method failure captured: Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 HTTP/1.1 Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnpl8_L26Vz-0WO2A14uND6rGQYIwQwKY335gQaTEm8K8q-CiT2hrHvTSOSQgxoH8RqAZ4xpPTOHu-oiWb-dZDhv9B0HB-1uKNQBnVNo8FJFlSjsh8foaWJzj0ovueiUT_VsOqHnZr5W9E6_p_jusyLPl_2faorJrmmxiOiZL4ScFA Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f84f3e4972f4a9c968100efa5775214", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}] Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f407ee9fccbf4fd6a9286642f8a015ad Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '51127763-f98b-43aa-8f93-e47e9ccc3c77'} Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:33.149341 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:33.156708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:33.160060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Returning 404 to user: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:33.161897 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1ff46e44-c400-486b-9523-d72ba6f7842b tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "DELETE /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77" status: 404 len: 111 microversion: 2.1 time: 0.070773 Oct 01 20:59:33.163096 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1230/2500] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:59:33 2022] DELETE /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:33.168514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1008238396", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "0e873cc9-0708-450f-bd4e-516af62445dd"}], "security_groups": [{"name": "tempest-securitygroup--270416606"}], "key_name": "tempest-keypair-1176311408", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:33.394044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] validate_networks() for [('0e873cc9-0708-450f-bd4e-516af62445dd', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:59:34.096052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:59:34.097817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:59:34.098799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:59:34.099432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:59:34.100006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:59:34.119976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:34.120686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:34.121299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:34.122182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:34.122811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:34.123383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:34.143625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Getting quotas for project d27e9cda0a6d47d4acdbadc890b996c9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:34.150105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Getting quotas for user 69002d46d4e54eadadf911ec3589d95c and project d27e9cda0a6d47d4acdbadc890b996c9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:34.167642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:59:34.171339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:59:34.293862 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-89f4d862-117e-4030-87a9-4a3af651e16a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.126296 Oct 01 20:59:34.294944 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1231/2501] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:59:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:59:34.334116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:34.339383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: d47b361c-dc29-495f-803e-f50b3421d788] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:34.369664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:34.370571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:34.371254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:34.372179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:34.373473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:34.374172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:34.413831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: d47b361c-dc29-495f-803e-f50b3421d788] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:59:34.551036 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3e63a7ec-cecb-4fe5-8aee-4862dc60ca02 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788" status: 204 len: 0 microversion: 2.1 time: 0.251618 Oct 01 20:59:34.551702 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1232/2502] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:59:34 2022] DELETE /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:34.557231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:34.559463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:34.584424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:34.585027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:34.585479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:34.586288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:34.586960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:34.588369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:34.620884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=25 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:34.803212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:34.818972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:34.828759 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-41e82ec3-cb41-4847-a951-e58b7c872c76 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 0.275295 Oct 01 20:59:34.829639 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1233/2503] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:34 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:34.848545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:34.849441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:34.857328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:34.858829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:34.859504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:34.860762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:34.861753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:34.862406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:35.116081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:35.128686 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-56361a69-0898-444f-8985-665b0db6479a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1317 microversion: 2.1 time: 0.297701 Oct 01 20:59:35.129869 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1234/2504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:34 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:35.336384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-89cd7659-73b8-4897-9467-3a26d64deb74 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Action: 'create', calling method: .version_select at 0x7f4172989dc0>, body: {"keypair": {"name": "tempest-keypair-488963940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp1U96sZAtTkl/qxHRUw7Jh+k+nHNLZP0/8+QEBg0GVBL6Cj/7RIVpZWHSj5qTQ+IuoEvuYKR9RNt3an5Od771RB+t4KXHd2XETjQNJFB1P0B3o4D9Nmnh4hwSrxETxeQ=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:35.354415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-89cd7659-73b8-4897-9467-3a26d64deb74 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:35.360382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-89cd7659-73b8-4897-9467-3a26d64deb74 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for user 50d792f641674214bd6f1b5d6900c32c and project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:35.386128 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-89cd7659-73b8-4897-9467-3a26d64deb74 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.254928 Oct 01 20:59:35.387089 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1235/2505] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Oct 1 20:59:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 256 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 01 20:59:35.397627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:35.398734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:35.409649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:35.410868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:35.411619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:35.412800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:35.413636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:35.414407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:35.501265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:35.510577 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d0e83c7-6bad-46cc-92f2-b2aa69a6f369 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1246 microversion: 2.1 time: 0.122016 Oct 01 20:59:35.511856 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1236/2506] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:35 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1246 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:35.516750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:35.517476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:35.523728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:35.524494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:35.525133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:35.526040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:35.526756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:35.527384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:35.556046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 20:59:35.649954 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4f17a7b-26e9-41bc-96ef-d6e7a9cd0c48 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 204 len: 0 microversion: 2.1 time: 0.136604 Oct 01 20:59:35.651251 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1237/2507] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 20:59:35 2022] DELETE /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:35.657445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-98e1afdd-b1ec-46e3-9352-cb16797f8cbf req-b991e42d-1b34-4528-9fe7-15aec3fdacc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4377bd0-2f2e-4373-b1ef-a98c06edc04f", "name": "network-vif-plugged", "status": "completed", "tag": "9f755ca0-b3c5-4016-8d9c-782b032ab956"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:35.668734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-98e1afdd-b1ec-46e3-9352-cb16797f8cbf req-b991e42d-1b34-4528-9fe7-15aec3fdacc6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:35.669220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-98e1afdd-b1ec-46e3-9352-cb16797f8cbf req-b991e42d-1b34-4528-9fe7-15aec3fdacc6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:35.669847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-98e1afdd-b1ec-46e3-9352-cb16797f8cbf req-b991e42d-1b34-4528-9fe7-15aec3fdacc6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:35.686433 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-98e1afdd-b1ec-46e3-9352-cb16797f8cbf req-b991e42d-1b34-4528-9fe7-15aec3fdacc6 service nova] Creating event network-vif-plugged:9f755ca0-b3c5-4016-8d9c-782b032ab956 for instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f on nch2-master-1 Oct 01 20:59:35.692381 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-98e1afdd-b1ec-46e3-9352-cb16797f8cbf req-b991e42d-1b34-4528-9fe7-15aec3fdacc6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039461 Oct 01 20:59:35.692998 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1238/2508] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:35.698481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84ee94cf-2676-485c-b65e-39665eea5318 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4172989280>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:35.707506 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84ee94cf-2676-485c-b65e-39665eea5318 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-488963940" status: 200 len: 512 microversion: 2.2 time: 0.013055 Oct 01 20:59:35.709083 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1239/2509] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Oct 1 20:59:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-488963940 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:35.714822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:35.715845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 51127763-f98b-43aa-8f93-e47e9ccc3c77] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:35.718624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:35.725386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:35.725971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:35.726531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:35.727487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:35.728016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:35.728517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:35.750568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] HTTP exception thrown: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Request method failure captured: Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 HTTP/1.1 Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnpl8_L26Vz-0WO2A14uND6rGQYIwQwKY335gQaTEm8K8q-CiT2hrHvTSOSQgxoH8RqAZ4xpPTOHu-oiWb-dZDhv9B0HB-1uKNQBnVNo8FJFlSjsh8foaWJzj0ovueiUT_VsOqHnZr5W9E6_p_jusyLPl_2faorJrmmxiOiZL4ScFA Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f84f3e4972f4a9c968100efa5775214", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}] Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f407ee9fccbf4fd6a9286642f8a015ad Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '51127763-f98b-43aa-8f93-e47e9ccc3c77'} Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:35.753348 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:35.758652 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:35.758652 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:35.758652 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:35.758652 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:35.758652 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:35.758652 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:35.758652 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. Oct 01 20:59:35.758652 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:35.762136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Returning 404 to user: Instance 51127763-f98b-43aa-8f93-e47e9ccc3c77 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:35.763330 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c1c54e75-3f2d-4c9b-ab48-0524c3f770bb tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77" status: 404 len: 111 microversion: 2.1 time: 0.052938 Oct 01 20:59:35.764150 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1240/2510] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:35 2022] GET /compute/v2.1/servers/51127763-f98b-43aa-8f93-e47e9ccc3c77 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:35.769987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2fd1ad46-8a1f-4510-8162-4d82f757f084 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4172a49f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:35.798702 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2fd1ad46-8a1f-4510-8162-4d82f757f084 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488963940" status: 204 len: 0 microversion: 2.2 time: 0.033164 Oct 01 20:59:35.800199 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1241/2511] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Oct 1 20:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488963940 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:35.805599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:35.807256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: d47b361c-dc29-495f-803e-f50b3421d788] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:35.815555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:35.816131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:35.816532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:35.817239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:35.817687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:35.818165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:36.133962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:36.142078 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-40b37ca5-9c73-46fc-a701-315729d4ded1 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788" status: 200 len: 1522 microversion: 2.1 time: 0.340042 Oct 01 20:59:36.162402 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1242/2512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:35 2022] GET /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:36.170115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2e3469b-0342-4a77-b802-9bb27819a050 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Action: 'create', calling method: .version_select at 0x7f417298ab80>, body: {"keypair": {"name": "tempest-keypair-338867663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1dJToLQlBJ8lzShV5q7F7SfzrbYOQi4O0F7fNN0B4ABKTRb5dSOQE1XLraCVpbUuEQFDqCOyZQ6m3GvLCiSnAp4eptFTWlW7NPPuGbEf4FI2JURS0NJAR+hoMbdXjZPA=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:36.188635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e2e3469b-0342-4a77-b802-9bb27819a050 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:36.206058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e2e3469b-0342-4a77-b802-9bb27819a050 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for user 50d792f641674214bd6f1b5d6900c32c and project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:36.248009 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2e3469b-0342-4a77-b802-9bb27819a050 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.082698 Oct 01 20:59:36.249545 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1243/2513] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Oct 1 20:59:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 01 20:59:36.260274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:36.270982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:36.277445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:36.278152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:36.278661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:36.279364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:36.280372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:36.280807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:37.273007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:37.284102 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3084a9dd-c21e-4789-b9ee-d3123f7fc983 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1369 microversion: 2.1 time: 1.027568 Oct 01 20:59:37.284806 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1244/2514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:36 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1369 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:37.300685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:37.301938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:37.310339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:37.311215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:37.311825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:37.312744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:37.313373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:37.313968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:37.751650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:37.790023 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-391289d8-3baa-4fa2-b112-441bcddd767b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1317 microversion: 2.1 time: 0.503764 Oct 01 20:59:37.795861 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1245/2515] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:37 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:37.806861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a829cfc6-1317-45d5-bf81-757e6cac1bac tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f417298aee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:37.838483 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a829cfc6-1317-45d5-bf81-757e6cac1bac tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-338867663" status: 204 len: 0 microversion: 2.2 time: 0.041102 Oct 01 20:59:37.840006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1246/2516] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Oct 1 20:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-338867663 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:37.847559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:37.848337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:37.869701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:37.871114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:37.871845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:37.873323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:37.874563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:37.876271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:38.044897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:38.059492 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98e8f85f-e3e6-4577-b3fb-5d822ea2be06 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1300 microversion: 2.1 time: 0.217594 Oct 01 20:59:38.062789 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1247/2517] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:37 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1300 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:38.068054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:38.087001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: d47b361c-dc29-495f-803e-f50b3421d788] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:38.096765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:38.097489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:38.098203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:38.099197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:38.099832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:38.101828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:38.259698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f407ee9fccbf4fd6a9286642f8a015ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f84f3e4972f4a9c968100efa5775214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:38.265896 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f184bb76-40bf-4333-9f1b-238ec1db6423 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788" status: 200 len: 1480 microversion: 2.1 time: 0.201662 Oct 01 20:59:38.281445 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1248/2518] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:38 2022] GET /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788 => generated 1480 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:38.293699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-dd173ec2-4d38-4623-b22e-e09e6cb28493 req-f188496d-b122-4b45-bf95-9a2f7b843848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46", "name": "network-vif-plugged", "status": "completed", "tag": "d7ce4d28-55d5-42a3-9e7f-72988ea1ebd1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:38.309816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dd173ec2-4d38-4623-b22e-e09e6cb28493 req-f188496d-b122-4b45-bf95-9a2f7b843848 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:38.310675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dd173ec2-4d38-4623-b22e-e09e6cb28493 req-f188496d-b122-4b45-bf95-9a2f7b843848 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:38.311985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dd173ec2-4d38-4623-b22e-e09e6cb28493 req-f188496d-b122-4b45-bf95-9a2f7b843848 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:38.325998 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-dd173ec2-4d38-4623-b22e-e09e6cb28493 req-f188496d-b122-4b45-bf95-9a2f7b843848 service nova] Creating event network-vif-plugged:d7ce4d28-55d5-42a3-9e7f-72988ea1ebd1 for instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 on nch2-master-1 Oct 01 20:59:38.333826 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-dd173ec2-4d38-4623-b22e-e09e6cb28493 req-f188496d-b122-4b45-bf95-9a2f7b843848 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047098 Oct 01 20:59:38.334708 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1249/2519] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:38.341979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e1b24f3e-07ef-4cb1-b300-78d6a45ec638 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Action: 'create', calling method: .version_select at 0x7f4172989ca0>, body: {"keypair": {"name": "tempest-keypair-460234590", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:38.390131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e1b24f3e-07ef-4cb1-b300-78d6a45ec638 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:38.407973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e1b24f3e-07ef-4cb1-b300-78d6a45ec638 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for user 50d792f641674214bd6f1b5d6900c32c and project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:38.490688 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e1b24f3e-07ef-4cb1-b300-78d6a45ec638 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.148622 Oct 01 20:59:38.494070 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1250/2520] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Oct 1 20:59:38 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 01 20:59:38.525294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-fce8995b-1d4a-47d4-9b95-5e23086db881 req-15d3cac1-1493-4ac1-9718-9be0e142bb21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47b361c-dc29-495f-803e-f50b3421d788", "name": "network-vif-deleted", "tag": "0c5fbea5-655b-4b16-8bb6-9579c9205942"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:38.561530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fce8995b-1d4a-47d4-9b95-5e23086db881 req-15d3cac1-1493-4ac1-9718-9be0e142bb21 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:38.564051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fce8995b-1d4a-47d4-9b95-5e23086db881 req-15d3cac1-1493-4ac1-9718-9be0e142bb21 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:38.564535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fce8995b-1d4a-47d4-9b95-5e23086db881 req-15d3cac1-1493-4ac1-9718-9be0e142bb21 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:38.597280 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-fce8995b-1d4a-47d4-9b95-5e23086db881 req-15d3cac1-1493-4ac1-9718-9be0e142bb21 service nova] Creating event network-vif-deleted:0c5fbea5-655b-4b16-8bb6-9579c9205942 for instance d47b361c-dc29-495f-803e-f50b3421d788 on nch1-master-1 Oct 01 20:59:38.626525 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-fce8995b-1d4a-47d4-9b95-5e23086db881 req-15d3cac1-1493-4ac1-9718-9be0e142bb21 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130112 Oct 01 20:59:38.626750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1251/2521] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:38.655285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:38.658035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:38.687921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:38.688429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:38.688884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:38.689616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:38.690085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:38.707281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:39.326239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:39.330016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:39.339385 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-63abf6f0-ead6-469e-bb8c-2d40d3229129 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1554 microversion: 2.1 time: 0.711424 Oct 01 20:59:39.345188 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1252/2522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:38 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1554 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:39.371088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-eef50aeb-5864-44ee-85a5-4393a8c87075 req-54adc8df-1b96-4c96-b463-25e97f2e4a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fde56d8-52d5-4c10-8bda-46dc98250a1b", "name": "network-vif-deleted", "tag": "b505102b-e3b6-452d-b2b3-882dda410c8a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:39.397052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-eef50aeb-5864-44ee-85a5-4393a8c87075 req-54adc8df-1b96-4c96-b463-25e97f2e4a53 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:39.397885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-eef50aeb-5864-44ee-85a5-4393a8c87075 req-54adc8df-1b96-4c96-b463-25e97f2e4a53 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:39.398529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-eef50aeb-5864-44ee-85a5-4393a8c87075 req-54adc8df-1b96-4c96-b463-25e97f2e4a53 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:39.444308 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-eef50aeb-5864-44ee-85a5-4393a8c87075 req-54adc8df-1b96-4c96-b463-25e97f2e4a53 service nova] Creating event network-vif-deleted:b505102b-e3b6-452d-b2b3-882dda410c8a for instance 6fde56d8-52d5-4c10-8bda-46dc98250a1b on nch2-master-1 Oct 01 20:59:39.459550 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-eef50aeb-5864-44ee-85a5-4393a8c87075 req-54adc8df-1b96-4c96-b463-25e97f2e4a53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112713 Oct 01 20:59:39.460326 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1253/2523] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:39.472441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-072b0d65-c4d7-4c15-8658-6396c53e7148 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4172a49ca0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:39.518716 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-072b0d65-c4d7-4c15-8658-6396c53e7148 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460234590" status: 204 len: 0 microversion: 2.2 time: 0.056831 Oct 01 20:59:39.520086 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1254/2524] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Oct 1 20:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460234590 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:39.525175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:39.526437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:39.534009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:39.534746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:39.535417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:39.536389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:39.536920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:39.537640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:39.824540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:39.836101 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d5d2c684-5507-4683-8e6c-ae07934aefb0 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1317 microversion: 2.1 time: 0.314343 Oct 01 20:59:39.838265 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1255/2525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:39 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:39.843962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:39.844821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:39.851968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:39.852724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:39.853395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:39.854333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:39.854892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:39.855540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:40.238468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:40.266604 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a036ef95-de3b-4ca1-bf28-5f83622fa576 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1367 microversion: 2.1 time: 0.425667 Oct 01 20:59:40.268484 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1256/2526] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:39 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:40.277252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:40.278178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: d47b361c-dc29-495f-803e-f50b3421d788] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:40.286869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:40.287724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:40.288619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:40.290723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:40.291467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:40.294875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:40.328643 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] HTTP exception thrown: Instance d47b361c-dc29-495f-803e-f50b3421d788 could not be found. Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Request method failure captured: Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788 HTTP/1.1 Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnpl8_L26Vz-0WO2A14uND6rGQYIwQwKY335gQaTEm8K8q-CiT2hrHvTSOSQgxoH8RqAZ4xpPTOHu-oiWb-dZDhv9B0HB-1uKNQBnVNo8FJFlSjsh8foaWJzj0ovueiUT_VsOqHnZr5W9E6_p_jusyLPl_2faorJrmmxiOiZL4ScFA Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f84f3e4972f4a9c968100efa5775214", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}] Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f407ee9fccbf4fd6a9286642f8a015ad Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance d47b361c-dc29-495f-803e-f50b3421d788 could not be found. Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd47b361c-dc29-495f-803e-f50b3421d788'} Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47b361c-dc29-495f-803e-f50b3421d788 could not be found. Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47b361c-dc29-495f-803e-f50b3421d788 could not be found. Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.331632 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:40.335435 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.335435 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:40.335435 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:40.335435 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:40.335435 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:40.335435 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:40.335435 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47b361c-dc29-495f-803e-f50b3421d788 could not be found. Oct 01 20:59:40.335435 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.338315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Returning 404 to user: Instance d47b361c-dc29-495f-803e-f50b3421d788 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:40.339678 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45420b12-f16a-48d7-8004-26088d017e57 tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788" status: 404 len: 111 microversion: 2.1 time: 0.069993 Oct 01 20:59:40.344355 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1257/2527] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:40 2022] GET /compute/v2.1/servers/d47b361c-dc29-495f-803e-f50b3421d788 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:40.351255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c458abbd-c242-4d46-9d25-c6d92123bf37 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:40.352104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c458abbd-c242-4d46-9d25-c6d92123bf37 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:40.359978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c458abbd-c242-4d46-9d25-c6d92123bf37 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:40.360844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c458abbd-c242-4d46-9d25-c6d92123bf37 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:40.362179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c458abbd-c242-4d46-9d25-c6d92123bf37 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:40.376247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c458abbd-c242-4d46-9d25-c6d92123bf37 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:40.378006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c458abbd-c242-4d46-9d25-c6d92123bf37 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:40.380041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c458abbd-c242-4d46-9d25-c6d92123bf37 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:40.531217 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c458abbd-c242-4d46-9d25-c6d92123bf37 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185268 Oct 01 20:59:40.533119 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1258/2528] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 20:59:40 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:40.538691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94e613f5-eeb4-44ae-bf44-247497ab852b tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Action: 'create', calling method: .version_select at 0x7f4172989670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2111517612", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsUuNm32U53iZzi+d3yoBhkf1lMy9WP9pHTFbUfyTv4Bhb3fxK7z/YuqJ10CGQf5ImnJB46bSgMTsot/J6b4oSFLZMg1jYw9BjYlqxA7I+xZvPBofv4yhnxhQTb81ir7g=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:40.564832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-94e613f5-eeb4-44ae-bf44-247497ab852b tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:40.572667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-94e613f5-eeb4-44ae-bf44-247497ab852b tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for user 50d792f641674214bd6f1b5d6900c32c and project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:40.612921 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94e613f5-eeb4-44ae-bf44-247497ab852b tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.077755 Oct 01 20:59:40.614426 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1259/2529] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Oct 1 20:59:40 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 01 20:59:40.631343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:40.633424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] [instance: 6fde56d8-52d5-4c10-8bda-46dc98250a1b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:40.649732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:40.654230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:40.655670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:40.656667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:40.658603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:40.659214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:40.687850 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] HTTP exception thrown: Instance 6fde56d8-52d5-4c10-8bda-46dc98250a1b could not be found. Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Request method failure captured: Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b HTTP/1.1 Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnpl8_L26Vz-0WO2A14uND6rGQYIwQwKY335gQaTEm8K8q-CiT2hrHvTSOSQgxoH8RqAZ4xpPTOHu-oiWb-dZDhv9B0HB-1uKNQBnVNo8FJFlSjsh8foaWJzj0ovueiUT_VsOqHnZr5W9E6_p_jusyLPl_2faorJrmmxiOiZL4ScFA Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f84f3e4972f4a9c968100efa5775214", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f84f3e4972f4a9c968100efa5775214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f84f3e4972f4a9c968100efa5775214"}]}] Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7f84f3e4972f4a9c968100efa5775214 Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-770870988 Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f407ee9fccbf4fd6a9286642f8a015ad Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListServersNegativeTestJSON-770870988-project Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 6fde56d8-52d5-4c10-8bda-46dc98250a1b could not be found. Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '6fde56d8-52d5-4c10-8bda-46dc98250a1b'} Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fde56d8-52d5-4c10-8bda-46dc98250a1b could not be found. Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fde56d8-52d5-4c10-8bda-46dc98250a1b could not be found. Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.696797 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 20:59:40.702001 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.702001 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 20:59:40.702001 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 20:59:40.702001 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 20:59:40.702001 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 20:59:40.702001 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 20:59:40.702001 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fde56d8-52d5-4c10-8bda-46dc98250a1b could not be found. Oct 01 20:59:40.702001 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 20:59:40.703154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] Returning 404 to user: Instance 6fde56d8-52d5-4c10-8bda-46dc98250a1b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 20:59:40.704183 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c11f0cf4-6ecf-438a-966a-0c9b25816f0f tempest-ListServersNegativeTestJSON-770870988 tempest-ListServersNegativeTestJSON-770870988-project] 10.222.0.17 "GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b" status: 404 len: 111 microversion: 2.1 time: 0.087795 Oct 01 20:59:40.706748 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1260/2530] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:40 2022] GET /compute/v2.1/servers/6fde56d8-52d5-4c10-8bda-46dc98250a1b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 20:59:40.722360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a87bc6b9-0a13-46a4-aa0f-7e012d771e6d tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Action: 'create', calling method: .version_select at 0x7f4172f76160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-94249669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlE3mXX7Su9z/UMDFSIb7n7T6dS7Kcnw8PvgIQDcbrNqvP1KWl7kaN5KnGXU3FMC/byRDS7nxPIQyhxbrrlWxFW1aOtXyuhZeqem8aqAyiq5UmuMFIIuRkUPoL8UM4aNg=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:40.757927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a87bc6b9-0a13-46a4-aa0f-7e012d771e6d tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:40.768290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a87bc6b9-0a13-46a4-aa0f-7e012d771e6d tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for user 50d792f641674214bd6f1b5d6900c32c and project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:40.808488 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a87bc6b9-0a13-46a4-aa0f-7e012d771e6d tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.099945 Oct 01 20:59:40.809761 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1261/2531] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Oct 1 20:59:40 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 01 20:59:40.824394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ce7e8345-83ad-449a-a5d9-a7bd9a990425 req-5b23b116-d855-4001-8d29-28e53910436e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ab1c5d-571f-4b9e-bfaf-c03add40162d", "tag": "9de569b7-13dc-4354-80e1-b6de7aa370dd"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:40.847293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ce7e8345-83ad-449a-a5d9-a7bd9a990425 req-5b23b116-d855-4001-8d29-28e53910436e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:40.847782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ce7e8345-83ad-449a-a5d9-a7bd9a990425 req-5b23b116-d855-4001-8d29-28e53910436e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:40.848287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ce7e8345-83ad-449a-a5d9-a7bd9a990425 req-5b23b116-d855-4001-8d29-28e53910436e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:40.868009 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ce7e8345-83ad-449a-a5d9-a7bd9a990425 req-5b23b116-d855-4001-8d29-28e53910436e service nova] Creating event network-changed:9de569b7-13dc-4354-80e1-b6de7aa370dd for instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d on nch1-master-1 Oct 01 20:59:40.877705 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ce7e8345-83ad-449a-a5d9-a7bd9a990425 req-5b23b116-d855-4001-8d29-28e53910436e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065513 Oct 01 20:59:40.878642 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1262/2532] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:40.884402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b15bb699-2e2b-4bd7-b31f-bcf640927b83 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Action: 'create', calling method: .version_select at 0x7f4172989670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-815642367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8fc5vbtbIjqV+biBzb+3Y0NDTbFwNzDfh7PeknCH5bHB7xQoPA9lHpRrn9APoPBZUJzjaJE9GbMPda8lRuowVp8IOM27365LDNI2ZmQIpKYBCTTdbw2YIB9pe10+/4dQ=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:40.908335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b15bb699-2e2b-4bd7-b31f-bcf640927b83 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:40.917816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b15bb699-2e2b-4bd7-b31f-bcf640927b83 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for user 50d792f641674214bd6f1b5d6900c32c and project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:40.937435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:40.964731 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b15bb699-2e2b-4bd7-b31f-bcf640927b83 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.084714 Oct 01 20:59:40.967057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1263/2533] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Oct 1 20:59:40 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 01 20:59:40.976006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:40.977031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:40.985016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:40.985901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:40.986636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:40.987959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:40.988649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:40.989519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:41.292876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:41.301065 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-96ac1c70-8bd4-46a8-94a3-ff2526a1ccba tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1507 microversion: 2.1 time: 0.331690 Oct 01 20:59:41.301646 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1264/2534] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:40 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:41.316166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e980e658-b51a-450a-9a68-a9ddfbbeef64 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4173022820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:41.323538 ncdv-master-1 devstack@n-api.service[140438]: WARNING oslo_db.sqlalchemy.utils [None req-e980e658-b51a-450a-9a68-a9ddfbbeef64 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 01 20:59:41.332526 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e980e658-b51a-450a-9a68-a9ddfbbeef64 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.029804 Oct 01 20:59:41.342855 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1265/2535] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Oct 1 20:59:41 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:41.356840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:41.357758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:41.364608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:41.365344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:41.365939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:41.366871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:41.367482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:41.368061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:41.554094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:41.564111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-468cdd5c-62e5-4dc8-995c-2d236ad93e72 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1367 microversion: 2.1 time: 0.211344 Oct 01 20:59:41.565518 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1266/2536] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:41 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:41.574660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:41.575703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:41.588388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:41.588916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:41.589375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:41.590080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:41.590566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:41.591099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:41.737849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:41.746127 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-050cf4cc-d766-4d28-b6a4-df416361e1d7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1507 microversion: 2.1 time: 0.179284 Oct 01 20:59:41.746744 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1267/2537] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:41 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:41.752125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-93c83899-275c-41a8-917c-96b5a952c4f0 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f41729e6b80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:41.779357 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-93c83899-275c-41a8-917c-96b5a952c4f0 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-815642367" status: 204 len: 0 microversion: 2.2 time: 0.031399 Oct 01 20:59:41.781042 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1268/2538] 10.222.0.17 () {60 vars in 1318 bytes} [Sat Oct 1 20:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-815642367 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:41.786291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:41.789201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:41.797242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:41.797746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:41.798191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:41.798962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:41.799415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:41.799882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:41.899228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:59:41.899665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:59:41.900165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:59:41.900652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:59:41.901137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:59:41.974300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:41.980499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:41.981013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:41.981558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:41.982399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:41.983489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:41.983997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:42.015989 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f64bcf15-56f3-45d6-a73d-9e8ec513fa2a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "POST /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46/action" status: 202 len: 1109 microversion: 2.1 time: 0.233677 Oct 01 20:59:42.016934 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1269/2539] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 20:59:41 2022] POST /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46/action => generated 1109 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 01 20:59:42.056223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64f6ac1f-6d60-4de8-bffc-1008d534988d tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4172946e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:42.095532 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64f6ac1f-6d60-4de8-bffc-1008d534988d tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-94249669" status: 204 len: 0 microversion: 2.2 time: 0.067743 Oct 01 20:59:42.096841 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1270/2540] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Oct 1 20:59:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-94249669 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:42.103551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:42.104172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:42.116321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:42.116976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:42.117566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:42.118418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:42.119053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:42.119626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:42.290643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:42.308342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1eed01bb-f9e5-42cc-928b-0ec51c51efc8 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.210354 Oct 01 20:59:42.310366 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1271/2541] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:42 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:42.329925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df44ab39-9833-425f-861c-3df2c79a34b0 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4172a49f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:42.361476 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df44ab39-9833-425f-861c-3df2c79a34b0 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2111517612" status: 204 len: 0 microversion: 2.2 time: 0.048923 Oct 01 20:59:42.378081 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1272/2542] 10.222.0.17 () {60 vars in 1321 bytes} [Sat Oct 1 20:59:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2111517612 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:42.383735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a53dc95-defa-443c-b093-27b9d232c7cf tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Action: 'create', calling method: .version_select at 0x7f417298ab80>, body: {"keypair": {"name": "tempest-keypair-856751515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIUCYyJCkctRs+93ow7M5xxrcuyPtiJlkmfeWA8ufsy7rKB4HJusmwSnkz9VdPI+SmjxwpxcfYTMN3+b3qYD3EfknyszdUsBbh5yZ4tRwtyeoDdewlDjcVWsE3jP9k0hg=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:42.423266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9a53dc95-defa-443c-b093-27b9d232c7cf tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:42.434547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9a53dc95-defa-443c-b093-27b9d232c7cf tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for user 50d792f641674214bd6f1b5d6900c32c and project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:42.491700 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a53dc95-defa-443c-b093-27b9d232c7cf tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.111749 Oct 01 20:59:42.502444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1273/2543] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Oct 1 20:59:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 01 20:59:42.522781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bab93dc2-30a2-4304-b929-e47542c31550 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4172a9aca0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:42.544643 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bab93dc2-30a2-4304-b929-e47542c31550 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-856751515" status: 200 len: 512 microversion: 2.2 time: 0.038609 Oct 01 20:59:42.546111 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1274/2544] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Oct 1 20:59:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-856751515 => generated 512 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:42.558023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b37d22c1-adca-4275-bdd0-3ca399587285 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f417294b9d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:42.563155 ncdv-master-1 devstack@n-api.service[140438]: WARNING oslo_db.sqlalchemy.utils [None req-b37d22c1-adca-4275-bdd0-3ca399587285 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 01 20:59:42.568472 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b37d22c1-adca-4275-bdd0-3ca399587285 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.014364 Oct 01 20:59:42.574967 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1275/2545] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Oct 1 20:59:42 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:42.581208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6fb134b0-a0d1-4492-a70d-a22fcd1d824a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4172971f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:42.630895 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6fb134b0-a0d1-4492-a70d-a22fcd1d824a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-856751515" status: 204 len: 0 microversion: 2.2 time: 0.053863 Oct 01 20:59:42.631119 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1276/2546] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Oct 1 20:59:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-856751515 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:42.643908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:42.645473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:42.652916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:42.660594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:42.661422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:42.662362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:42.663022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:42.663606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:42.918020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:42.931281 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9d72f4a9-034f-41a5-9999-931ba92809be tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1367 microversion: 2.1 time: 0.294426 Oct 01 20:59:42.932471 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1277/2547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:42 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:42.938903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Action: 'create', calling method: .version_select at 0x7f41729713a0>, body: {"keypair": {"name": "tempest-keypair-186805700", "type": "x509"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:42.969321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:42.975779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for user 50d792f641674214bd6f1b5d6900c32c and project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:43.003304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.processutils [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpf3kvd4ko/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpf3kvd4ko/temp.key -subj /CN=50d792f641674214bd6f1b5d6900c32c -extensions v3_req_client {{(pid=140438) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 01 20:59:43.094021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.processutils [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpf3kvd4ko/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpf3kvd4ko/temp.key -subj /CN=50d792f641674214bd6f1b5d6900c32c -extensions v3_req_client" returned: 0 in 0.090s {{(pid=140438) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 01 20:59:43.095076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.processutils [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpf3kvd4ko/temp.key -password pass: {{(pid=140438) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 01 20:59:43.125511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.processutils [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpf3kvd4ko/temp.key -password pass:" returned: 0 in 0.030s {{(pid=140438) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 01 20:59:43.186891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:43.194299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Getting quotas for user 50d792f641674214bd6f1b5d6900c32c and project e041ae5d1fee42ebb7179ed70ff8bc28. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:43.211913 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1258691c-3b9d-48e9-aec6-6d75eac9209a tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.278113 Oct 01 20:59:43.213364 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1278/2548] 10.222.0.17 () {62 vars in 1198 bytes} [Sat Oct 1 20:59:42 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 280 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:43.226190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39e705d1-5e9a-471c-b7ae-7e98a8f283e5 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f417298ab80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:43.237189 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-39e705d1-5e9a-471c-b7ae-7e98a8f283e5 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-186805700" status: 200 len: 1533 microversion: 2.2 time: 0.016571 Oct 01 20:59:43.243290 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1279/2549] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Oct 1 20:59:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-186805700 => generated 1533 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:59:43.250327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf626a0f-813c-47a0-b71b-d3000fc16c38 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4172971040>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:43.255940 ncdv-master-1 devstack@n-api.service[140438]: WARNING oslo_db.sqlalchemy.utils [None req-bf626a0f-813c-47a0-b71b-d3000fc16c38 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 01 20:59:43.262137 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf626a0f-813c-47a0-b71b-d3000fc16c38 tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.016360 Oct 01 20:59:43.262441 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1280/2550] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Oct 1 20:59:43 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:59:43.275214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d069d7a-d863-4e10-b3c4-944d76d86d1c tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] Calling method '.version_select at 0x7f4172946af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:43.297079 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d069d7a-d863-4e10-b3c4-944d76d86d1c tempest-KeyPairsV22TestJSON-1427418912 tempest-KeyPairsV22TestJSON-1427418912-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-186805700" status: 204 len: 0 microversion: 2.2 time: 0.027443 Oct 01 20:59:43.298046 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1281/2551] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Oct 1 20:59:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-186805700 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 20:59:43.337492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:43.338549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:43.347418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:43.348029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:43.349268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:43.350532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:43.351030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:43.351544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:43.573589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:43.589234 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c869584e-edd4-4b71-bf57-d8c5694cda45 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.255736 Oct 01 20:59:43.604042 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1282/2552] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:43 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:43.651256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-bf0cfc72-000e-4d10-8056-09bb3b99e6fa req-727cd366-09b0-496d-b15a-276159e13983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4377bd0-2f2e-4373-b1ef-a98c06edc04f", "tag": "9f755ca0-b3c5-4016-8d9c-782b032ab956"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:43.674614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bf0cfc72-000e-4d10-8056-09bb3b99e6fa req-727cd366-09b0-496d-b15a-276159e13983 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:43.675234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bf0cfc72-000e-4d10-8056-09bb3b99e6fa req-727cd366-09b0-496d-b15a-276159e13983 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:43.678362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bf0cfc72-000e-4d10-8056-09bb3b99e6fa req-727cd366-09b0-496d-b15a-276159e13983 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:43.714748 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-bf0cfc72-000e-4d10-8056-09bb3b99e6fa req-727cd366-09b0-496d-b15a-276159e13983 service nova] Creating event network-changed:9f755ca0-b3c5-4016-8d9c-782b032ab956 for instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f on nch2-master-1 Oct 01 20:59:43.728102 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-bf0cfc72-000e-4d10-8056-09bb3b99e6fa req-727cd366-09b0-496d-b15a-276159e13983 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083575 Oct 01 20:59:43.730845 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1283/2553] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:43.966102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:43.966931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:43.987923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:43.992671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:43.993214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:43.993987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:43.994471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:44.001094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:44.135199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=16 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:44.427148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:44.444286 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3fb72682-a41c-484d-bd52-cb3db8c30696 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1367 microversion: 2.1 time: 0.484258 Oct 01 20:59:44.445096 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1284/2554] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:43 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:44.616689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:44.618180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:44.630824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:44.631622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:44.634844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:44.635830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:44.636494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:44.642280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:44.982157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:44.992853 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6ac78ac6-ec1c-4d6b-a3e6-4b91067db282 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.381955 Oct 01 20:59:44.993465 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1285/2555] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:44 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:45.475632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:45.476462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:45.489237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:45.491221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:45.491750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:45.495265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:45.496896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:45.498567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:45.777171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:45.798294 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bb8ecd0a-15ae-47b8-8c6b-3c242aa33452 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1367 microversion: 2.1 time: 0.332208 Oct 01 20:59:45.801709 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1286/2556] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:45 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:59:46.140715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23375454-f9eb-4fca-b109-dd05c9dd4a99 tempest-AbsoluteLimitsTestJSON-1378027628 tempest-AbsoluteLimitsTestJSON-1378027628-project] Calling method '.version_select at 0x7f4172946430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:46.159848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23375454-f9eb-4fca-b109-dd05c9dd4a99 tempest-AbsoluteLimitsTestJSON-1378027628 tempest-AbsoluteLimitsTestJSON-1378027628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:46.160360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23375454-f9eb-4fca-b109-dd05c9dd4a99 tempest-AbsoluteLimitsTestJSON-1378027628 tempest-AbsoluteLimitsTestJSON-1378027628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:46.160809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23375454-f9eb-4fca-b109-dd05c9dd4a99 tempest-AbsoluteLimitsTestJSON-1378027628 tempest-AbsoluteLimitsTestJSON-1378027628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:46.161890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23375454-f9eb-4fca-b109-dd05c9dd4a99 tempest-AbsoluteLimitsTestJSON-1378027628 tempest-AbsoluteLimitsTestJSON-1378027628-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:46.162354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23375454-f9eb-4fca-b109-dd05c9dd4a99 tempest-AbsoluteLimitsTestJSON-1378027628 tempest-AbsoluteLimitsTestJSON-1378027628-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:46.163953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23375454-f9eb-4fca-b109-dd05c9dd4a99 tempest-AbsoluteLimitsTestJSON-1378027628 tempest-AbsoluteLimitsTestJSON-1378027628-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:46.180364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:46.204215 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23375454-f9eb-4fca-b109-dd05c9dd4a99 tempest-AbsoluteLimitsTestJSON-1378027628 tempest-AbsoluteLimitsTestJSON-1378027628-project] 10.222.0.17 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.264843 Oct 01 20:59:46.205603 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1287/2557] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Oct 1 20:59:45 2022] GET /compute/v2.1/limits => generated 511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:46.212629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:46.214947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:46.225901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:46.228317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:46.229051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:46.229724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:46.230692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:46.231359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:46.232563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:46.457512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:46.466863 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8f0f4e17-c16c-4208-852c-44696f8b31c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.259719 Oct 01 20:59:46.468371 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1288/2558] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:46 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:46.827673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:46.828483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:46.848060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:46.848720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:46.849272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:46.850157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:46.850804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:46.851319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:47.128970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:47.139760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1576b0cf-8373-4ad8-9d1d-03841c603180 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1367 microversion: 2.1 time: 0.313810 Oct 01 20:59:47.141039 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1289/2559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:46 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:59:47.493474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:47.495016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:47.526837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:47.527362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:47.527820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:47.528545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:47.529961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:47.531283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:48.740641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:48.761129 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-03cf85c9-fb19-421e-aba0-0c9256315da1 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 1.273468 Oct 01 20:59:48.783027 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1290/2560] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:47 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:59:48.795917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-712165533", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "fb505354-c45c-4b41-8482-ef547331e6ec"}, {"uuid": "ef5433f2-f574-431f-8410-8c00e3886223"}, {"uuid": "fb505354-c45c-4b41-8482-ef547331e6ec"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:48.910166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] validate_networks() for [('fb505354-c45c-4b41-8482-ef547331e6ec', None, None, None, None, None), ('ef5433f2-f574-431f-8410-8c00e3886223', None, None, None, None, None), ('fb505354-c45c-4b41-8482-ef547331e6ec', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 20:59:50.660748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 20:59:50.661264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 20:59:50.661649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 20:59:50.662064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 20:59:50.662505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 20:59:50.689345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:50.689860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:50.690310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:50.698916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:50.699490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:50.703183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:50.748785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Getting quotas for project 04cc84345d874fc69776490bea69d81a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 20:59:50.754883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Getting quotas for user 6ade3ba047d348a387e8e4077072b90a and project 04cc84345d874fc69776490bea69d81a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 20:59:50.783141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 20:59:50.789102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 20:59:50.892742 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-12de7654-9b35-4bac-b407-2473a1a36cb1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.106109 Oct 01 20:59:50.895214 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1291/2561] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 20:59:50.909680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:50.910316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:50.953546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:50.954580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:50.955528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:50.956621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:50.957479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:50.958271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:51.227032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:51.242093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9fe0add9-7e8d-4d17-9902-b84b4751b12f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1367 microversion: 2.1 time: 0.341561 Oct 01 20:59:51.242895 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1292/2562] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:50 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:51.267663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-032e7550-f5e5-4022-a133-500d4fdfdaa9 req-26f99f79-bb7f-4ba8-8b02-fea45e14342b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ab1c5d-571f-4b9e-bfaf-c03add40162d", "name": "network-vif-plugged", "status": "completed", "tag": "9de569b7-13dc-4354-80e1-b6de7aa370dd"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:51.304527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-032e7550-f5e5-4022-a133-500d4fdfdaa9 req-26f99f79-bb7f-4ba8-8b02-fea45e14342b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:51.305401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-032e7550-f5e5-4022-a133-500d4fdfdaa9 req-26f99f79-bb7f-4ba8-8b02-fea45e14342b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:51.306026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-032e7550-f5e5-4022-a133-500d4fdfdaa9 req-26f99f79-bb7f-4ba8-8b02-fea45e14342b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:51.322235 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-032e7550-f5e5-4022-a133-500d4fdfdaa9 req-26f99f79-bb7f-4ba8-8b02-fea45e14342b service nova] Creating event network-vif-plugged:9de569b7-13dc-4354-80e1-b6de7aa370dd for instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d on nch1-master-1 Oct 01 20:59:51.327825 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-032e7550-f5e5-4022-a133-500d4fdfdaa9 req-26f99f79-bb7f-4ba8-8b02-fea45e14342b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071377 Oct 01 20:59:51.328768 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1293/2563] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:51.336006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:51.336734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:51.343791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:51.344187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:51.344819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:51.345538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:51.346164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:51.346998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:51.874576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:51.893869 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf8cae84-e9ec-483e-b433-c6067a28058a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.563276 Oct 01 20:59:51.907071 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1294/2564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:51 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:51.919773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e8adda10-2f8a-44c9-9edb-f5504645d7a1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:51.926675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e8adda10-2f8a-44c9-9edb-f5504645d7a1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:52.024066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e8adda10-2f8a-44c9-9edb-f5504645d7a1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:52.038742 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e8adda10-2f8a-44c9-9edb-f5504645d7a1 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1212 microversion: 2.1 time: 0.126411 Oct 01 20:59:52.040536 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1295/2565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:51 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1212 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:52.274914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:52.275776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:52.290813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:52.292631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:52.293383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:52.296138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:52.296867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:52.298297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:52.528470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:52.542171 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c654193c-c1d6-47e4-bc3e-fce03418c28a tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1367 microversion: 2.1 time: 0.275526 Oct 01 20:59:52.563505 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1296/2566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:52 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:52.931703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:52.933835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:52.972501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:52.973212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:52.976202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:52.981205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:52.987167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:52.987167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:53.328775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:53.344155 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4224244-1121-4b22-8e29-3144e5f08d94 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.417772 Oct 01 20:59:53.346743 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1297/2567] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:52 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:53.368500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:53.369613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:53.386417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:53.388126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:53.391798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:53.393482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:53.394156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:53.396259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:53.554869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:53.575468 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-503c5bd4-4eac-44eb-8c15-128c6ca5348f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1264 microversion: 2.1 time: 0.227005 Oct 01 20:59:53.587212 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1298/2568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:53 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:53.613523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:53.614156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:53.645298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:53.646163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:53.646879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:53.647830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:53.648500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:53.649244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:54.005494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:54.019238 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-66783d59-9d18-43c4-875b-aa2c6d227999 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1557 microversion: 2.1 time: 0.419458 Oct 01 20:59:54.019918 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1299/2569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:53 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1557 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:54.046672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-db42c429-8c93-458c-8e10-791e8066ba3b tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:54.048059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-db42c429-8c93-458c-8e10-791e8066ba3b tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:54.054864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db42c429-8c93-458c-8e10-791e8066ba3b tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:54.055677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db42c429-8c93-458c-8e10-791e8066ba3b tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:54.056348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db42c429-8c93-458c-8e10-791e8066ba3b tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:54.057513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db42c429-8c93-458c-8e10-791e8066ba3b tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:54.058324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db42c429-8c93-458c-8e10-791e8066ba3b tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:54.059318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db42c429-8c93-458c-8e10-791e8066ba3b tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:54.240458 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-db42c429-8c93-458c-8e10-791e8066ba3b tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198613 Oct 01 20:59:54.250479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1300/2570] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 20:59:54 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 20:59:54.370376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:54.371568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:54.381925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:54.385157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:54.385993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:54.387114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:54.387665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:54.388398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:54.909271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:54.920745 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-976971ea-06d8-4c5d-ac7a-34da2ee9909f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.555896 Oct 01 20:59:54.938027 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1301/2571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:54 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:59:54.944762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:54.945696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:54.955003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:54.955823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:54.957187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:54.958255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:54.958848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:54.959399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:55.203570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:55.212465 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84a747ef-51bd-4294-8c75-9eb892d57d87 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1270 microversion: 2.1 time: 0.272606 Oct 01 20:59:55.227624 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1302/2572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:54 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:55.944690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:55.945482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:55.956381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:55.957275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:55.960619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:55.962036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:55.962815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:55.963891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:56.695612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:56.728594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d5eb7000-a3d5-48b4-b368-51902a6b39b6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.787756 Oct 01 20:59:56.745674 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1303/2573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:55 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 20:59:56.753287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:56.755149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:56.761453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:56.762160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:56.762870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:56.764524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:56.765591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:56.766185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:57.289737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:57.298121 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-261bcf49-ea19-4ea9-8985-e4249b00ed30 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1312 microversion: 2.1 time: 0.550261 Oct 01 20:59:57.299695 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1304/2574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:56 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1312 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:57.624784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5af89d69-c572-40b5-90db-7a98b7b9bd18 req-88b6d3ea-880c-4d27-ba42-a1272478216f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ab1c5d-571f-4b9e-bfaf-c03add40162d", "tag": "9de569b7-13dc-4354-80e1-b6de7aa370dd"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 20:59:57.649450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5af89d69-c572-40b5-90db-7a98b7b9bd18 req-88b6d3ea-880c-4d27-ba42-a1272478216f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:57.658734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5af89d69-c572-40b5-90db-7a98b7b9bd18 req-88b6d3ea-880c-4d27-ba42-a1272478216f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:57.659457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5af89d69-c572-40b5-90db-7a98b7b9bd18 req-88b6d3ea-880c-4d27-ba42-a1272478216f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:57.690645 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5af89d69-c572-40b5-90db-7a98b7b9bd18 req-88b6d3ea-880c-4d27-ba42-a1272478216f service nova] Creating event network-changed:9de569b7-13dc-4354-80e1-b6de7aa370dd for instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d on nch1-master-1 Oct 01 20:59:57.698984 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5af89d69-c572-40b5-90db-7a98b7b9bd18 req-88b6d3ea-880c-4d27-ba42-a1272478216f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079123 Oct 01 20:59:57.715579 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1305/2575] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 20:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 20:59:57.751878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:57.752874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:57.763640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:57.770666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:57.771605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:57.772590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:57.773004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:57.773445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:58.581895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:58.596201 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb46f512-a302-4aec-a90e-0e6acb34421c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.848901 Oct 01 20:59:58.597116 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1306/2576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:57 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:58.601974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:58.610996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:58.619406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:58.623693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:58.624350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:58.625306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:58.625733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:58.626157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:59.427521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 20:59:59.441892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 20:59:59.454714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d08a136-834c-40d3-bcd1-0fe30dfb88ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1333 microversion: 2.1 time: 0.856220 Oct 01 20:59:59.457023 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1307/2577] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:58 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1333 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 20:59:59.625885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 20:59:59.626799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 20:59:59.636721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:59.637213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:59.637659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 20:59:59.638423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 20:59:59.644628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 20:59:59.645248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:00.485810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:00.504731 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ad000a5-137f-4056-953b-821c6fbffc9c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.879452 Oct 01 21:00:00.508957 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1308/2578] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 20:59:59 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:00.521572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:00.522540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:00.542870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:00.543463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:00.544362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:00.547975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:00.548461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:00.549734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:00.720371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:00.820056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:00.847144 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7095699c-594b-40ee-bf75-775c78a4b796 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1333 microversion: 2.1 time: 0.336222 Oct 01 21:00:00.925604 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1309/2579] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:00 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1333 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:01.215355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37ca9c26-d99a-4591-9bb5-b28a66802c4c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Calling method '.version_select at 0x7f4172952ca0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:01.326761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-37ca9c26-d99a-4591-9bb5-b28a66802c4c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c89eda2e-427c-40b9-84c6-f9e327cdac79 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:00:01.328498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-37ca9c26-d99a-4591-9bb5-b28a66802c4c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Neutron security group c89eda2e-427c-40b9-84c6-f9e327cdac79 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:00:01.329170 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-37ca9c26-d99a-4591-9bb5-b28a66802c4c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] HTTP exception thrown: Security group c89eda2e-427c-40b9-84c6-f9e327cdac79 does not exist Oct 01 21:00:01.329170 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-49ce4711-7d35-427a-945b-543cf8066628'] Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37ca9c26-d99a-4591-9bb5-b28a66802c4c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Request method failure captured: Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/c89eda2e-427c-40b9-84c6-f9e327cdac79 HTTP/1.1 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpQt51DUJ4VSswI91X9kVpzGxawJLKbA6kM4AVoq1PXf1UVzM6jAU46QT8mmP5LdEFKKH9Cko6e8Pn6RazsWcV571K0DtYEuaguClLKuekIBCeJ4MdW0wG_gUTXNz0HpFAyDvnOoz4o9MIfx0_jB0XQI_qUurb8qIBPwfalZs_9Fd8 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 840cdc42d8e1415da91572fac902d284 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_840cdc42d8e1415da91572fac902d284", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/840cdc42d8e1415da91572fac902d284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/840cdc42d8e1415da91572fac902d284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/840cdc42d8e1415da91572fac902d284"}]}] Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 840cdc42d8e1415da91572fac902d284 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsNegativeTestJSON-1865886093-project Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0779a741ea8946b28756ddd87fd7a792 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093-project Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group c89eda2e-427c-40b9-84c6-f9e327cdac79 does not exist Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-49ce4711-7d35-427a-945b-543cf8066628'] Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'c89eda2e-427c-40b9-84c6-f9e327cdac79'} Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:00:01.387552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c89eda2e-427c-40b9-84c6-f9e327cdac79 does not exist Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49ce4711-7d35-427a-945b-543cf8066628'] Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c89eda2e-427c-40b9-84c6-f9e327cdac79 does not exist Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49ce4711-7d35-427a-945b-543cf8066628'] Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c89eda2e-427c-40b9-84c6-f9e327cdac79 does not exist Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49ce4711-7d35-427a-945b-543cf8066628'] Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c89eda2e-427c-40b9-84c6-f9e327cdac79 does not exist Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49ce4711-7d35-427a-945b-543cf8066628'] Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37ca9c26-d99a-4591-9bb5-b28a66802c4c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Returning 404 to user: Security group c89eda2e-427c-40b9-84c6-f9e327cdac79 does not exist Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-49ce4711-7d35-427a-945b-543cf8066628'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:01.391362 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37ca9c26-d99a-4591-9bb5-b28a66802c4c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/c89eda2e-427c-40b9-84c6-f9e327cdac79" status: 404 len: 194 microversion: 2.1 time: 0.462239 Oct 01 21:00:01.403402 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1310/2580] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:00:00 2022] DELETE /compute/v2.1/os-security-groups/c89eda2e-427c-40b9-84c6-f9e327cdac79 => generated 194 bytes in 468 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:00:01.405931 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b42b3359-5d03-446f-9b8f-ea447a8062cf tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005692 Oct 01 21:00:01.406505 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1311/2581] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Oct 1 21:00:01 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 01 21:00:01.415502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f5dc2023-c0b1-4104-a7d2-f47f794fe2ce tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Calling method '.version_select at 0x7f41729711f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:01.788866 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f5dc2023-c0b1-4104-a7d2-f47f794fe2ce tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.377353 Oct 01 21:00:01.789543 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1312/2582] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 21:00:01 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:01.795244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:01.796364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:01.815354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:01.816108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:01.816722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:01.817595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:01.818214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:01.818828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:02.032319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=58 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:02.604807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:02.620272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac807248-7bc9-4ac5-806b-87c944aa8019 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.829288 Oct 01 21:00:02.622655 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1313/2583] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:01 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:02.629388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ef52108-dfba-4cad-994d-c5c471023d7c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Calling method '.version_select at 0x7f4172952b80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:03.082916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-9ef52108-dfba-4cad-994d-c5c471023d7c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:00:03.083424 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-9ef52108-dfba-4cad-994d-c5c471023d7c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 01 21:00:03.083424 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-d872a088-993c-4501-a806-e24f7224eeb8'] Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ef52108-dfba-4cad-994d-c5c471023d7c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Request method failure captured: Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/d1ba516c-233a-4f90-9fdc-46e8bfbc75a9 HTTP/1.1 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpQt51DUJ4VSswI91X9kVpzGxawJLKbA6kM4AVoq1PXf1UVzM6jAU46QT8mmP5LdEFKKH9Cko6e8Pn6RazsWcV571K0DtYEuaguClLKuekIBCeJ4MdW0wG_gUTXNz0HpFAyDvnOoz4o9MIfx0_jB0XQI_qUurb8qIBPwfalZs_9Fd8 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 840cdc42d8e1415da91572fac902d284 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_840cdc42d8e1415da91572fac902d284", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/840cdc42d8e1415da91572fac902d284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/840cdc42d8e1415da91572fac902d284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/840cdc42d8e1415da91572fac902d284"}]}] Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 840cdc42d8e1415da91572fac902d284 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsNegativeTestJSON-1865886093-project Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0779a741ea8946b28756ddd87fd7a792 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093-project Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: exception: Insufficient rights for removing default security group. Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-d872a088-993c-4501-a806-e24f7224eeb8'] Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd1ba516c-233a-4f90-9fdc-46e8bfbc75a9'} Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:00:03.090608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d872a088-993c-4501-a806-e24f7224eeb8'] Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d872a088-993c-4501-a806-e24f7224eeb8'] Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d872a088-993c-4501-a806-e24f7224eeb8'] Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d872a088-993c-4501-a806-e24f7224eeb8'] Oct 01 21:00:03.095784 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:03.100022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ef52108-dfba-4cad-994d-c5c471023d7c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 01 21:00:03.100022 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-d872a088-993c-4501-a806-e24f7224eeb8'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:03.101526 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ef52108-dfba-4cad-994d-c5c471023d7c tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d1ba516c-233a-4f90-9fdc-46e8bfbc75a9" status: 400 len: 182 microversion: 2.1 time: 0.477115 Oct 01 21:00:03.110307 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1314/2584] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:00:02 2022] DELETE /compute/v2.1/os-security-groups/d1ba516c-233a-4f90-9fdc-46e8bfbc75a9 => generated 182 bytes in 486 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:00:03.117583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:03.118369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:03.128348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:03.129067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:03.130098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:03.134001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:03.134679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:03.135851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:03.613459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:03.622519 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20955053-0b65-4281-bade-3f738ab36804 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.510758 Oct 01 21:00:03.630510 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1315/2585] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:03 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:03.722521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-848d53c9-f553-4da9-9764-d1b58f297834 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Action: 'create', calling method: .version_select at 0x7f4172921dc0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:03.747312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-848d53c9-f553-4da9-9764-d1b58f297834 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Getting quotas for project 4ad79e5d6445413588cd919bd2d8cd3c. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:00:03.753910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-848d53c9-f553-4da9-9764-d1b58f297834 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Getting quotas for user bfca41094f1a4d45b18c099226150268 and project 4ad79e5d6445413588cd919bd2d8cd3c. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:00:03.850994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-848d53c9-f553-4da9-9764-d1b58f297834 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Getting quotas for project 4ad79e5d6445413588cd919bd2d8cd3c. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:00:03.869817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-848d53c9-f553-4da9-9764-d1b58f297834 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Getting quotas for user bfca41094f1a4d45b18c099226150268 and project 4ad79e5d6445413588cd919bd2d8cd3c. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:00:03.902303 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-848d53c9-f553-4da9-9764-d1b58f297834 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.270474 Oct 01 21:00:03.910782 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1316/2586] 10.222.0.17 () {62 vars in 1214 bytes} [Sat Oct 1 21:00:03 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:00:03.916103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbcfe016-17b2-4814-a27c-f77873e4d10a tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Calling method '.version_select at 0x7f4172952dc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:04.027621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-cbcfe016-17b2-4814-a27c-f77873e4d10a tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a265c6bf-3c83-4aaf-802f-160e735c2f16 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:00:04.028244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-cbcfe016-17b2-4814-a27c-f77873e4d10a tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Neutron security group a265c6bf-3c83-4aaf-802f-160e735c2f16 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:00:04.028832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-cbcfe016-17b2-4814-a27c-f77873e4d10a tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] HTTP exception thrown: Security group a265c6bf-3c83-4aaf-802f-160e735c2f16 does not exist Oct 01 21:00:04.028832 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-873643d1-b83d-4c1e-901e-e744e82e07ed'] Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbcfe016-17b2-4814-a27c-f77873e4d10a tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Request method failure captured: Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-security-groups/a265c6bf-3c83-4aaf-802f-160e735c2f16 HTTP/1.1 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpQt51DUJ4VSswI91X9kVpzGxawJLKbA6kM4AVoq1PXf1UVzM6jAU46QT8mmP5LdEFKKH9Cko6e8Pn6RazsWcV571K0DtYEuaguClLKuekIBCeJ4MdW0wG_gUTXNz0HpFAyDvnOoz4o9MIfx0_jB0XQI_qUurb8qIBPwfalZs_9Fd8 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 840cdc42d8e1415da91572fac902d284 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_840cdc42d8e1415da91572fac902d284", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/840cdc42d8e1415da91572fac902d284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/840cdc42d8e1415da91572fac902d284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/840cdc42d8e1415da91572fac902d284"}]}] Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 840cdc42d8e1415da91572fac902d284 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsNegativeTestJSON-1865886093-project Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0779a741ea8946b28756ddd87fd7a792 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093-project Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group a265c6bf-3c83-4aaf-802f-160e735c2f16 does not exist Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-873643d1-b83d-4c1e-901e-e744e82e07ed'] Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a265c6bf-3c83-4aaf-802f-160e735c2f16'} Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:00:04.030734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a265c6bf-3c83-4aaf-802f-160e735c2f16 does not exist Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-873643d1-b83d-4c1e-901e-e744e82e07ed'] Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a265c6bf-3c83-4aaf-802f-160e735c2f16 does not exist Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-873643d1-b83d-4c1e-901e-e744e82e07ed'] Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a265c6bf-3c83-4aaf-802f-160e735c2f16 does not exist Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-873643d1-b83d-4c1e-901e-e744e82e07ed'] Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a265c6bf-3c83-4aaf-802f-160e735c2f16 does not exist Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-873643d1-b83d-4c1e-901e-e744e82e07ed'] Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbcfe016-17b2-4814-a27c-f77873e4d10a tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Returning 404 to user: Security group a265c6bf-3c83-4aaf-802f-160e735c2f16 does not exist Oct 01 21:00:04.034927 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-873643d1-b83d-4c1e-901e-e744e82e07ed'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:04.037451 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cbcfe016-17b2-4814-a27c-f77873e4d10a tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/a265c6bf-3c83-4aaf-802f-160e735c2f16" status: 404 len: 194 microversion: 2.1 time: 0.122358 Oct 01 21:00:04.041546 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1317/2587] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:00:03 2022] GET /compute/v2.1/os-security-groups/a265c6bf-3c83-4aaf-802f-160e735c2f16 => generated 194 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:00:04.063204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6aeba78a-1b29-4d6a-b911-c2292f61c122 req-25437ee6-bd37-4cc9-a085-91302cba45d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143e0afb-b691-486b-a8a2-7832f2dbfdd4", "tag": "8bfc6fc7-457b-4099-9c3f-fc6d6cb93c27"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:04.073823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6aeba78a-1b29-4d6a-b911-c2292f61c122 req-25437ee6-bd37-4cc9-a085-91302cba45d7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:04.074605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6aeba78a-1b29-4d6a-b911-c2292f61c122 req-25437ee6-bd37-4cc9-a085-91302cba45d7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:04.075364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6aeba78a-1b29-4d6a-b911-c2292f61c122 req-25437ee6-bd37-4cc9-a085-91302cba45d7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:04.088226 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6aeba78a-1b29-4d6a-b911-c2292f61c122 req-25437ee6-bd37-4cc9-a085-91302cba45d7 service nova] Creating event network-changed:8bfc6fc7-457b-4099-9c3f-fc6d6cb93c27 for instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 on nch1-master-1 Oct 01 21:00:04.094363 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6aeba78a-1b29-4d6a-b911-c2292f61c122 req-25437ee6-bd37-4cc9-a085-91302cba45d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051080 Oct 01 21:00:04.095560 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1318/2588] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:04.100792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:04.101765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:04.113679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:04.114352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:04.115395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:04.116220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:04.116802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:04.117307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:04.698949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:04.707139 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2a66025-b98a-4c36-b4df-32e0c15b562f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.610232 Oct 01 21:00:04.707843 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1319/2589] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:04 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:04.730299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76b973e6-68ef-46b5-84c4-24f07551b129 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:04.746506 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76b973e6-68ef-46b5-84c4-24f07551b129 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.025589 Oct 01 21:00:04.747920 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1320/2590] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Oct 1 21:00:04 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:00:04.752294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7c14c09-5cd8-41c5-9f8a-470e47ae12f4 tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Action: 'update', calling method: .version_select at 0x7f4172921280>, body: {"security_group": {"name": "tempest-sg-1225501203", "description": "tempest-description-2071026608"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:04.887753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-c7c14c09-5cd8-41c5-9f8a-470e47ae12f4 tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 39123e7e-e4d6-4b23-ab47-4e51d3b28d38 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:00:04.889034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-c7c14c09-5cd8-41c5-9f8a-470e47ae12f4 tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Neutron security group 39123e7e-e4d6-4b23-ab47-4e51d3b28d38 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:00:04.890168 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c7c14c09-5cd8-41c5-9f8a-470e47ae12f4 tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] HTTP exception thrown: Security group 39123e7e-e4d6-4b23-ab47-4e51d3b28d38 does not exist Oct 01 21:00:04.890168 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-dac782ee-31b2-412a-8960-862cb6a79b74'] Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7c14c09-5cd8-41c5-9f8a-470e47ae12f4 tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Request method failure captured: Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/os-security-groups/39123e7e-e4d6-4b23-ab47-4e51d3b28d38 HTTP/1.1 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 102 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpQt51DUJ4VSswI91X9kVpzGxawJLKbA6kM4AVoq1PXf1UVzM6jAU46QT8mmP5LdEFKKH9Cko6e8Pn6RazsWcV571K0DtYEuaguClLKuekIBCeJ4MdW0wG_gUTXNz0HpFAyDvnOoz4o9MIfx0_jB0XQI_qUurb8qIBPwfalZs_9Fd8 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 840cdc42d8e1415da91572fac902d284 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_840cdc42d8e1415da91572fac902d284", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/840cdc42d8e1415da91572fac902d284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/840cdc42d8e1415da91572fac902d284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/840cdc42d8e1415da91572fac902d284"}]}] Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 840cdc42d8e1415da91572fac902d284 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsNegativeTestJSON-1865886093-project Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0779a741ea8946b28756ddd87fd7a792 Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1865886093-project Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: {"security_group": {"name": "tempest-sg-1225501203", "description": "tempest-description-2071026608"}} Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group 39123e7e-e4d6-4b23-ab47-4e51d3b28d38 does not exist Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-dac782ee-31b2-412a-8960-862cb6a79b74'] Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '39123e7e-e4d6-4b23-ab47-4e51d3b28d38', 'body': {'security_group': {'name': 'tempest-sg-1225501203', 'description': 'tempest-description-2071026608'}}} Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:00:04.893252 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 39123e7e-e4d6-4b23-ab47-4e51d3b28d38 does not exist Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dac782ee-31b2-412a-8960-862cb6a79b74'] Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 39123e7e-e4d6-4b23-ab47-4e51d3b28d38 does not exist Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dac782ee-31b2-412a-8960-862cb6a79b74'] Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 39123e7e-e4d6-4b23-ab47-4e51d3b28d38 does not exist Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dac782ee-31b2-412a-8960-862cb6a79b74'] Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 39123e7e-e4d6-4b23-ab47-4e51d3b28d38 does not exist Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dac782ee-31b2-412a-8960-862cb6a79b74'] Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7c14c09-5cd8-41c5-9f8a-470e47ae12f4 tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] Returning 404 to user: Security group 39123e7e-e4d6-4b23-ab47-4e51d3b28d38 does not exist Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-dac782ee-31b2-412a-8960-862cb6a79b74'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7c14c09-5cd8-41c5-9f8a-470e47ae12f4 tempest-SecurityGroupsNegativeTestJSON-1865886093 tempest-SecurityGroupsNegativeTestJSON-1865886093-project] 10.222.0.17 "PUT /compute/v2.1/os-security-groups/39123e7e-e4d6-4b23-ab47-4e51d3b28d38" status: 404 len: 194 microversion: 2.1 time: 0.146434 Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1321/2591] 10.222.0.17 () {60 vars in 1290 bytes} [Sat Oct 1 21:00:04 2022] PUT /compute/v2.1/os-security-groups/39123e7e-e4d6-4b23-ab47-4e51d3b28d38 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:04.905474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:04.914453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:04.914453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:04.914453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:04.914453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:04.915725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:04.916906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:05.367340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:05.377980 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac1e2811-deb3-48b6-9299-367127c5f556 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.480600 Oct 01 21:00:05.379209 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1322/2592] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:04 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:05.409224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc916255-2439-4ec5-adac-69398fce2db3 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:05.414203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:05.435574 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc916255-2439-4ec5-adac-69398fce2db3 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/1a52800f-4c68-4ecc-9233-0217ce26ee24" status: 200 len: 235 microversion: 2.64 time: 0.053968 Oct 01 21:00:05.438709 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1323/2593] 10.222.0.17 () {60 vars in 1304 bytes} [Sat Oct 1 21:00:05 2022] GET /compute/v2.1/os-server-groups/1a52800f-4c68-4ecc-9233-0217ce26ee24 => generated 235 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:00:05.458610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4867e273-7f59-4e55-b51d-0227faec7d15 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:05.513855 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4867e273-7f59-4e55-b51d-0227faec7d15 tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/1a52800f-4c68-4ecc-9233-0217ce26ee24" status: 204 len: 0 microversion: 2.64 time: 0.066431 Oct 01 21:00:05.515444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1324/2594] 10.222.0.17 () {60 vars in 1307 bytes} [Sat Oct 1 21:00:05 2022] DELETE /compute/v2.1/os-server-groups/1a52800f-4c68-4ecc-9233-0217ce26ee24 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:00:05.525382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d6e3934-b86c-408f-a574-a8b1c96f805a tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:05.555517 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-9d6e3934-b86c-408f-a574-a8b1c96f805a tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] HTTP exception thrown: Instance group 1a52800f-4c68-4ecc-9233-0217ce26ee24 could not be found. Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d6e3934-b86c-408f-a574-a8b1c96f805a tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Request method failure captured: Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-server-groups/1a52800f-4c68-4ecc-9233-0217ce26ee24 HTTP/1.1 Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpS7YJjs_-QEJdpz1KHSQJg6d9hg-XmiNEIrzqv8jVxngg7f0bVCpKyvICqPpzmtLWZyrJiqZOhiroIJ1N3_GR5GlkCQe7qFFx0dEPMpXmYxeKN1vZLdM7_iuNwt3VGXtyvsmBuGbjQX3YO1eewdJqaRCTeXjQXYW1F-4WJOMuN8oI Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.64 Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 4ad79e5d6445413588cd919bd2d8cd3c Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerGroup264TestJSON-927966401 Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ad79e5d6445413588cd919bd2d8cd3c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ad79e5d6445413588cd919bd2d8cd3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ad79e5d6445413588cd919bd2d8cd3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ad79e5d6445413588cd919bd2d8cd3c"}]}] Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerGroup264TestJSON-927966401 Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 4ad79e5d6445413588cd919bd2d8cd3c Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerGroup264TestJSON-927966401 Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerGroup264TestJSON-927966401-project Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: bfca41094f1a4d45b18c099226150268 Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerGroup264TestJSON-927966401-project Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance group 1a52800f-4c68-4ecc-9233-0217ce26ee24 could not be found. Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1a52800f-4c68-4ecc-9233-0217ce26ee24'} Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1a52800f-4c68-4ecc-9233-0217ce26ee24 could not be found. Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1a52800f-4c68-4ecc-9233-0217ce26ee24 could not be found. Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:05.566748 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:05.570596 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:05.570596 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:05.570596 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:05.570596 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:05.570596 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1a52800f-4c68-4ecc-9233-0217ce26ee24 could not be found. Oct 01 21:00:05.570596 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:05.570596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d6e3934-b86c-408f-a574-a8b1c96f805a tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] Returning 404 to user: Instance group 1a52800f-4c68-4ecc-9233-0217ce26ee24 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:05.582011 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9d6e3934-b86c-408f-a574-a8b1c96f805a tempest-ServerGroup264TestJSON-927966401 tempest-ServerGroup264TestJSON-927966401-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/1a52800f-4c68-4ecc-9233-0217ce26ee24" status: 404 len: 117 microversion: 2.64 time: 0.060436 Oct 01 21:00:05.592529 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1325/2595] 10.222.0.17 () {60 vars in 1307 bytes} [Sat Oct 1 21:00:05 2022] DELETE /compute/v2.1/os-server-groups/1a52800f-4c68-4ecc-9233-0217ce26ee24 => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:00:05.740231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:05.741498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:05.752584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:05.753094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:05.753539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:05.759406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:05.760224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:05.760875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:06.648950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:06.662874 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-694b0674-2e21-49a4-9520-3da2dffac1c2 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.931303 Oct 01 21:00:06.675955 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1326/2596] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:05 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:06.686845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6cbea902-d55e-4c2c-be77-3cea702dd465 req-1d179c9c-283d-47e2-9486-aaad32a7587a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143e0afb-b691-486b-a8a2-7832f2dbfdd4", "tag": "1bfe4d22-c73b-403b-9084-4ab6c132af84"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:06.703472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6cbea902-d55e-4c2c-be77-3cea702dd465 req-1d179c9c-283d-47e2-9486-aaad32a7587a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:06.704277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6cbea902-d55e-4c2c-be77-3cea702dd465 req-1d179c9c-283d-47e2-9486-aaad32a7587a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:06.705368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6cbea902-d55e-4c2c-be77-3cea702dd465 req-1d179c9c-283d-47e2-9486-aaad32a7587a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:06.726933 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6cbea902-d55e-4c2c-be77-3cea702dd465 req-1d179c9c-283d-47e2-9486-aaad32a7587a service nova] Creating event network-changed:1bfe4d22-c73b-403b-9084-4ab6c132af84 for instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 on nch1-master-1 Oct 01 21:00:06.739144 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6cbea902-d55e-4c2c-be77-3cea702dd465 req-1d179c9c-283d-47e2-9486-aaad32a7587a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060257 Oct 01 21:00:06.740914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1327/2597] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:06.755948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:06.758563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:06.775566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:06.776499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:06.776954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:06.780789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:06.781298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:06.781744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:07.389391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:07.404277 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f545feb-57d5-4a0a-aef9-5fde4b18c62c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.660435 Oct 01 21:00:07.404897 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1328/2598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:06 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:07.688861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:07.693457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:07.701117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:07.702081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:07.702884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:07.705383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:07.706086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:07.707423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:08.017973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:08.035594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8a050b47-b0de-401b-868b-9798033fe92a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1514 microversion: 2.1 time: 0.350883 Oct 01 21:00:08.036208 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1329/2599] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:07 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1514 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:00:08.431800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:08.432339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:08.442480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:08.443013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:08.443464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:08.444191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:08.444656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:08.445093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:09.021067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:09.062650 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8aa23f31-4d05-464b-b57c-c6d5c3c4300a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.634848 Oct 01 21:00:09.064660 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1330/2600] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:08 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:00:09.070066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-87960183-6309-45b6-82a0-eb18daaa58e0 req-5fbddfab-bc44-4b5c-8057-778fa5e27a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143e0afb-b691-486b-a8a2-7832f2dbfdd4", "tag": "8749820e-6c5c-4e96-973a-cc34684ddd48"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:09.093085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-87960183-6309-45b6-82a0-eb18daaa58e0 req-5fbddfab-bc44-4b5c-8057-778fa5e27a40 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:09.093849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-87960183-6309-45b6-82a0-eb18daaa58e0 req-5fbddfab-bc44-4b5c-8057-778fa5e27a40 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:09.094449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-87960183-6309-45b6-82a0-eb18daaa58e0 req-5fbddfab-bc44-4b5c-8057-778fa5e27a40 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:09.112000 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-87960183-6309-45b6-82a0-eb18daaa58e0 req-5fbddfab-bc44-4b5c-8057-778fa5e27a40 service nova] Creating event network-changed:8749820e-6c5c-4e96-973a-cc34684ddd48 for instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 on nch1-master-1 Oct 01 21:00:09.120807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-87960183-6309-45b6-82a0-eb18daaa58e0 req-5fbddfab-bc44-4b5c-8057-778fa5e27a40 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054343 Oct 01 21:00:09.122656 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1331/2601] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:09.141473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:09.142946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:09.159108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:09.160431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:09.161033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:09.164778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:09.167775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:09.169171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:09.491786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:09.501608 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49b8367a-e59d-41f0-994f-59e5a7f74ba7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1520 microversion: 2.1 time: 0.376787 Oct 01 21:00:09.506534 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1332/2602] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:09 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:10.090565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:10.091779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:10.098137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:10.098739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:10.099182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:10.099902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:10.100357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:10.100784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:11.056601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:11.066778 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26dff9d6-b858-4053-8d48-bcb637ea6984 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.979976 Oct 01 21:00:11.087690 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1333/2603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:10 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:11.108719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:11.109351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:11.150780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:11.151710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:11.152356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:11.153358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:11.154514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:11.158069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:11.527254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:11.574791 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20a75410-bc20-406f-ae26-e25d9c0210cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1520 microversion: 2.1 time: 0.484825 Oct 01 21:00:11.580757 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1334/2604] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:11 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:12.098943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:12.099771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:12.111788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:12.113245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:12.115252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:12.117572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:12.118294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:12.119748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:12.404146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:12.414381 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9b4de262-9608-4008-a197-8d0487a8d5c0 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.319694 Oct 01 21:00:12.420829 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1335/2605] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:12 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:12.617788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:12.618899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:12.639196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:12.640580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:12.641235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:12.642798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:12.643501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:12.649651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:12.944352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:12.957032 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05ea0717-f3b7-448f-8c59-987a9f2022cb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1520 microversion: 2.1 time: 0.353107 Oct 01 21:00:12.960215 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1336/2606] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:12 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:00:12.980488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6142fe81-86a0-409a-83c8-67dce0222e36 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08131bb6-39bf-46fc-b169-736844ac1286"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:12.983509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6142fe81-86a0-409a-83c8-67dce0222e36 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:12.993175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6142fe81-86a0-409a-83c8-67dce0222e36 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:12.995616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6142fe81-86a0-409a-83c8-67dce0222e36 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:12.996128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6142fe81-86a0-409a-83c8-67dce0222e36 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:13.002481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6142fe81-86a0-409a-83c8-67dce0222e36 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:13.003337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6142fe81-86a0-409a-83c8-67dce0222e36 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:13.004573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6142fe81-86a0-409a-83c8-67dce0222e36 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:13.037660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:13.531235 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6142fe81-86a0-409a-83c8-67dce0222e36 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "POST /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538522 Oct 01 21:00:13.543644 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1337/2607] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:00:12 2022] POST /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments => generated 194 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:13.567518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:13.569327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:13.583600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:13.583947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:13.584398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:13.585705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:13.586182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:13.587604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:13.898599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:13.903690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:13.917035 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b597678f-90f7-4e07-93f1-b086346de079 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.361255 Oct 01 21:00:13.919192 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1338/2608] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:13 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:13.985742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:13.986379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:13.997084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:14.000790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:14.001525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:14.002288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:14.002789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:14.003225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:14.208243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:14.216856 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8b29370e-b488-468c-9dc1-7c887b1dc147 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1520 microversion: 2.1 time: 0.237425 Oct 01 21:00:14.217849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1339/2609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:13 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:14.621284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0992ce77-aab9-40de-8bac-b9dcc76e117c req-e9a333aa-d1ee-446b-8130-e773505ae1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46", "name": "network-vif-plugged", "status": "completed", "tag": "d7ce4d28-55d5-42a3-9e7f-72988ea1ebd1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:14.641834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0992ce77-aab9-40de-8bac-b9dcc76e117c req-e9a333aa-d1ee-446b-8130-e773505ae1c4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:14.642337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0992ce77-aab9-40de-8bac-b9dcc76e117c req-e9a333aa-d1ee-446b-8130-e773505ae1c4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:14.643767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0992ce77-aab9-40de-8bac-b9dcc76e117c req-e9a333aa-d1ee-446b-8130-e773505ae1c4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:14.684198 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0992ce77-aab9-40de-8bac-b9dcc76e117c req-e9a333aa-d1ee-446b-8130-e773505ae1c4 service nova] Creating event network-vif-plugged:d7ce4d28-55d5-42a3-9e7f-72988ea1ebd1 for instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 on nch2-master-1 Oct 01 21:00:14.697226 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0992ce77-aab9-40de-8bac-b9dcc76e117c req-e9a333aa-d1ee-446b-8130-e773505ae1c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079584 Oct 01 21:00:14.698855 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1340/2610] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:00:14.941781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:14.942695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:14.950171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:14.951115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:14.951768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:14.952941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:14.953772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:14.954695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:15.194348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:15.210620 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0be14668-0eea-4439-bd45-9c45bea758d6 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.271536 Oct 01 21:00:15.213099 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1341/2611] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:14 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:00:15.262096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:15.264213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:15.286127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:15.288784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:15.291962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:15.296493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:15.297881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:15.298721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:15.622608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:15.657845 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7103822d-a0e3-4684-8af4-3a1cf58070be tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1520 microversion: 2.1 time: 0.399405 Oct 01 21:00:15.657845 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1342/2612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:15 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:16.236089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:16.236927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:16.250058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:16.252382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:16.252870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:16.253624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:16.254081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:16.254536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:16.565347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:16.581700 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0e703eb5-bf92-4c6d-806d-8bb54da95416 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.349432 Oct 01 21:00:16.596027 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1343/2613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:16 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:16.673765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:16.675636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:16.693132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:16.693132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:16.693132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:16.693887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:16.694358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:16.694827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:17.091736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:17.103628 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f87c6747-be9a-4e5d-aa40-0fd545ddc756 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1505 microversion: 2.1 time: 0.435762 Oct 01 21:00:17.107716 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1344/2614] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:16 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:17.130147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:17.131142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:17.138803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:17.139560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:17.140213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:17.141121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:17.141766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:17.142375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:17.473357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:17.489907 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c8670af1-ca2a-4d0a-b9b1-dd74402b6731 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 200 len: 1505 microversion: 2.1 time: 0.363796 Oct 01 21:00:17.491788 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1345/2615] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:17 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:17.520023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:17.521009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:17.529301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:17.530343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:17.531055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:17.532060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:17.533179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:17.533830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:18.007879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:00:18.204019 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b7739e27-227e-4231-823d-b4309b793d3c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 204 len: 0 microversion: 2.1 time: 0.691452 Oct 01 21:00:18.222523 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1346/2616] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:00:17 2022] DELETE /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:00:18.223711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:18.224853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:18.248322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:18.252273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:18.253083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:18.256770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:18.259037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:18.260859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:18.950982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:18.965567 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45ea925e-14d9-4ad9-b6b5-d1b68cdf441f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.754290 Oct 01 21:00:18.966610 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1347/2617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:18 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:18.972129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8860675b-ea6f-4ed6-8194-55ab185131dc tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:18.974579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8860675b-ea6f-4ed6-8194-55ab185131dc tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:18.980800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8860675b-ea6f-4ed6-8194-55ab185131dc tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:18.982731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8860675b-ea6f-4ed6-8194-55ab185131dc tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:18.983425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8860675b-ea6f-4ed6-8194-55ab185131dc tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:18.987096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8860675b-ea6f-4ed6-8194-55ab185131dc tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:18.987662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8860675b-ea6f-4ed6-8194-55ab185131dc tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:18.988129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8860675b-ea6f-4ed6-8194-55ab185131dc tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:19.039829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8860675b-ea6f-4ed6-8194-55ab185131dc tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071755 Oct 01 21:00:19.041308 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1348/2618] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:00:18 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:19.054218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-148924830", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "4f939274-1e9a-43b9-bf60-e54c963a636d"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:19.148765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] validate_networks() for [('4f939274-1e9a-43b9-bf60-e54c963a636d', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:00:20.714405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:00:20.716158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:00:20.716654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:00:20.717072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:00:20.717490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:00:20.736679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:20.737183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:20.741347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:20.744109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:20.744736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:20.748787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:20.789965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Getting quotas for project 9566fa9a44f94c4ea3081a1a2e658de0. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:00:20.802174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Getting quotas for user e84a109e337d450698e630acfb49f9a5 and project 9566fa9a44f94c4ea3081a1a2e658de0. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:00:20.836867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:00:20.844768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:00:20.964999 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c1132aac-700c-4b9f-96b3-736dde890521 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.914953 Oct 01 21:00:20.970446 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1349/2619] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:00:20.978012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:20.979700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:20.995447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:20.995957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:20.996401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:21.002267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:21.002883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:21.003340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:21.205902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lazy-loading 'services' on Instance uuid a4377bd0-2f2e-4373-b1ef-a98c06edc04f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:00:21.405526 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8023f697-ee7c-44ac-8c58-185e5b329aec tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments/08131bb6-39bf-46fc-b169-736844ac1286" status: 202 len: 0 microversion: 2.1 time: 0.432714 Oct 01 21:00:21.406460 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1350/2620] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:00:20 2022] DELETE /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments/08131bb6-39bf-46fc-b169-736844ac1286 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:00:21.432974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:21.443485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:21.493449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:21.499229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:21.504591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:21.505255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:21.509336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:21.515214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:22.471510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:22.475594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:22.487900 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-acaaf03f-98bd-4d3f-bff7-fe450acbc657 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 1.079809 Oct 01 21:00:22.490745 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1351/2621] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:21 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:22.548468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:22.549124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:22.590804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:22.591429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:22.598615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:22.606903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:22.607594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:22.610570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:23.015222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:23.060600 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-181a91cd-1b0e-433f-ae1f-8c5ac7ac823c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1213 microversion: 2.1 time: 0.566528 Oct 01 21:00:23.061847 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1352/2622] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:22 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1213 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:23.072099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a05eaa05-96d0-4c34-89e4-cad638286a94 req-38489496-d049-42eb-8117-a1c6ed66e7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46", "name": "network-vif-deleted", "tag": "d7ce4d28-55d5-42a3-9e7f-72988ea1ebd1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:23.084212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a05eaa05-96d0-4c34-89e4-cad638286a94 req-38489496-d049-42eb-8117-a1c6ed66e7de service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:23.085054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a05eaa05-96d0-4c34-89e4-cad638286a94 req-38489496-d049-42eb-8117-a1c6ed66e7de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:23.086351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a05eaa05-96d0-4c34-89e4-cad638286a94 req-38489496-d049-42eb-8117-a1c6ed66e7de service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:23.104859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a05eaa05-96d0-4c34-89e4-cad638286a94 req-38489496-d049-42eb-8117-a1c6ed66e7de service nova] Creating event network-vif-deleted:d7ce4d28-55d5-42a3-9e7f-72988ea1ebd1 for instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 on nch2-master-1 Oct 01 21:00:23.113925 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a05eaa05-96d0-4c34-89e4-cad638286a94 req-38489496-d049-42eb-8117-a1c6ed66e7de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049837 Oct 01 21:00:23.115069 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1353/2623] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:23.122897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-013c6431-7eff-4376-b929-7697ee622b56 req-597eb397-c5a6-40d7-a3a9-c0aadfee523d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143e0afb-b691-486b-a8a2-7832f2dbfdd4", "name": "network-vif-plugged", "status": "completed", "tag": "8bfc6fc7-457b-4099-9c3f-fc6d6cb93c27"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:23.136868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-013c6431-7eff-4376-b929-7697ee622b56 req-597eb397-c5a6-40d7-a3a9-c0aadfee523d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:23.137756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-013c6431-7eff-4376-b929-7697ee622b56 req-597eb397-c5a6-40d7-a3a9-c0aadfee523d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:23.138650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-013c6431-7eff-4376-b929-7697ee622b56 req-597eb397-c5a6-40d7-a3a9-c0aadfee523d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:23.156877 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-013c6431-7eff-4376-b929-7697ee622b56 req-597eb397-c5a6-40d7-a3a9-c0aadfee523d service nova] Creating event network-vif-plugged:8bfc6fc7-457b-4099-9c3f-fc6d6cb93c27 for instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 on nch1-master-1 Oct 01 21:00:23.173187 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-013c6431-7eff-4376-b929-7697ee622b56 req-597eb397-c5a6-40d7-a3a9-c0aadfee523d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056120 Oct 01 21:00:23.174732 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1354/2624] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:23.537194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:23.550929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:23.589499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:23.590195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:23.590687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:23.592308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:23.595954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:23.598040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:24.658266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:24.669771 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea01af8d-62bc-4d42-bdc6-25da2b8713b7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 1.152570 Oct 01 21:00:24.671016 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1355/2625] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:23 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:00:24.706781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2158dd61-74fa-4175-831a-b68cbbfa2cb3 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:24.716409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2158dd61-74fa-4175-831a-b68cbbfa2cb3 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:24.738036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2158dd61-74fa-4175-831a-b68cbbfa2cb3 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:24.738957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2158dd61-74fa-4175-831a-b68cbbfa2cb3 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:24.739921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2158dd61-74fa-4175-831a-b68cbbfa2cb3 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:24.740958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2158dd61-74fa-4175-831a-b68cbbfa2cb3 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:24.742237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2158dd61-74fa-4175-831a-b68cbbfa2cb3 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:24.743105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2158dd61-74fa-4175-831a-b68cbbfa2cb3 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:24.799363 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2158dd61-74fa-4175-831a-b68cbbfa2cb3 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126920 Oct 01 21:00:24.800079 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1356/2626] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:00:24 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:00:24.809655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:24.810987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:24.828486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:24.829629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:24.830735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:24.834268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:24.836469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:24.836936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:25.295267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:25.310623 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c436597d-4013-4fe0-a8f3-533a537d8196 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1317 microversion: 2.1 time: 0.509256 Oct 01 21:00:25.311898 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1357/2627] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:24 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:25.505441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2126048608", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:25.604238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] validate_networks() for [('035e612c-d25c-4b96-8033-611a957990be', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:00:26.670600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:00:26.671227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:00:26.671450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:00:26.672092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:00:26.672705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:00:26.701079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:26.703189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:26.709530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:26.711032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:26.711781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:26.712469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:26.751565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:26.757518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Getting quotas for project b9e916618c504ec2b23064c883ba7d56. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:00:26.765131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Getting quotas for user 7cd23af965b147248c5f8c7b9098fc3d and project b9e916618c504ec2b23064c883ba7d56. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:00:26.780580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:00:26.783523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:00:26.841535 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-96d03578-7f30-4320-8d2a-2659ea2bba0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528237 Oct 01 21:00:26.842621 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1358/2628] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:00:26.856200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c13e74ce-35a2-4f13-a033-0a4db8e8f7cf tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:26.858683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c13e74ce-35a2-4f13-a033-0a4db8e8f7cf tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:26.882874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c13e74ce-35a2-4f13-a033-0a4db8e8f7cf tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:26.883570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c13e74ce-35a2-4f13-a033-0a4db8e8f7cf tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:26.884212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c13e74ce-35a2-4f13-a033-0a4db8e8f7cf tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:26.885292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c13e74ce-35a2-4f13-a033-0a4db8e8f7cf tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:26.885976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c13e74ce-35a2-4f13-a033-0a4db8e8f7cf tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:26.886778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c13e74ce-35a2-4f13-a033-0a4db8e8f7cf tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:26.978398 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c13e74ce-35a2-4f13-a033-0a4db8e8f7cf tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133462 Oct 01 21:00:26.994300 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1359/2629] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:00:26 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:00:27.014924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1650481168", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "9417f59c-8d13-4179-a6ee-0176ac73cf1c"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:27.134037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] validate_networks() for [('9417f59c-8d13-4179-a6ee-0176ac73cf1c', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:00:27.837480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:00:27.839955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:00:27.840800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:00:27.841236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:00:27.841673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:00:27.852359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:27.852860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:27.853305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:27.854078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:27.854566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:27.855007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:27.923476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:00:27.930245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for user 775ff9091a794faaacc05a37550c8a72 and project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:00:27.952966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:00:27.955639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:00:28.056319 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ebd55f7-fb86-4d99-b2b2-5d429aee294a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060497 Oct 01 21:00:28.057013 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1360/2630] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:00:28.071910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-feff3239-0581-4006-bb24-80b566db49b8 req-93b2aec3-c303-4a32-8b53-7aa7ccde86a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143e0afb-b691-486b-a8a2-7832f2dbfdd4", "name": "network-vif-plugged", "status": "completed", "tag": "8749820e-6c5c-4e96-973a-cc34684ddd48"}, {"server_uuid": "143e0afb-b691-486b-a8a2-7832f2dbfdd4", "name": "network-vif-plugged", "status": "completed", "tag": "1bfe4d22-c73b-403b-9084-4ab6c132af84"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:28.120030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-feff3239-0581-4006-bb24-80b566db49b8 req-93b2aec3-c303-4a32-8b53-7aa7ccde86a8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:28.120590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-feff3239-0581-4006-bb24-80b566db49b8 req-93b2aec3-c303-4a32-8b53-7aa7ccde86a8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:28.121039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-feff3239-0581-4006-bb24-80b566db49b8 req-93b2aec3-c303-4a32-8b53-7aa7ccde86a8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:28.146885 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-feff3239-0581-4006-bb24-80b566db49b8 req-93b2aec3-c303-4a32-8b53-7aa7ccde86a8 service nova] Creating event network-vif-plugged:8749820e-6c5c-4e96-973a-cc34684ddd48 for instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 on nch1-master-1 Oct 01 21:00:28.147410 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-feff3239-0581-4006-bb24-80b566db49b8 req-93b2aec3-c303-4a32-8b53-7aa7ccde86a8 service nova] Creating event network-vif-plugged:1bfe4d22-c73b-403b-9084-4ab6c132af84 for instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 on nch1-master-1 Oct 01 21:00:28.163486 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-feff3239-0581-4006-bb24-80b566db49b8 req-93b2aec3-c303-4a32-8b53-7aa7ccde86a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104703 Oct 01 21:00:28.165362 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1361/2631] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:28.173700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:28.174416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:28.195756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:28.196458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:28.196907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:28.197628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:28.198095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:28.198570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:28.547704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:28.593530 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d016fad4-dec0-4d5e-82c4-93c921b26231 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1354 microversion: 2.1 time: 0.426807 Oct 01 21:00:28.596357 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1362/2632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:28 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1354 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:28.603307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-08563c4c-d993-4fd9-9e3b-6ed65c5391d4 req-c54f7fcd-5faf-4ecb-b05e-30be9bed335e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1431fcc7-a23c-42aa-b324-44adc7bb8a68", "tag": "917511ad-abce-4ae4-ba7b-d32b38483fb1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:28.641362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-08563c4c-d993-4fd9-9e3b-6ed65c5391d4 req-c54f7fcd-5faf-4ecb-b05e-30be9bed335e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:28.641854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-08563c4c-d993-4fd9-9e3b-6ed65c5391d4 req-c54f7fcd-5faf-4ecb-b05e-30be9bed335e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:28.642294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-08563c4c-d993-4fd9-9e3b-6ed65c5391d4 req-c54f7fcd-5faf-4ecb-b05e-30be9bed335e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:28.681000 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-08563c4c-d993-4fd9-9e3b-6ed65c5391d4 req-c54f7fcd-5faf-4ecb-b05e-30be9bed335e service nova] Creating event network-changed:917511ad-abce-4ae4-ba7b-d32b38483fb1 for instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 on nch2-master-1 Oct 01 21:00:28.693839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-08563c4c-d993-4fd9-9e3b-6ed65c5391d4 req-c54f7fcd-5faf-4ecb-b05e-30be9bed335e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094019 Oct 01 21:00:28.696990 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1363/2633] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:28.706338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:28.711955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:28.729434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:28.730226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:28.731073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:28.737603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:28.740491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:28.741254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:29.365826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:29.394304 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f137870-13f5-40e0-9ea3-f85e789dc82e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1317 microversion: 2.1 time: 0.695962 Oct 01 21:00:29.399771 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1364/2634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:28 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1317 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:29.413788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:29.414671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:29.432066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:29.432577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:29.433017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:29.434743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:29.437646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:29.440904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:29.580753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd23af965b147248c5f8c7b9098fc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e916618c504ec2b23064c883ba7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:29.595128 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-851ff503-0303-4f5c-b14a-6013ecdace6d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 200 len: 1282 microversion: 2.1 time: 0.193151 Oct 01 21:00:29.596120 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1365/2635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:29 2022] GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:29.602912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:29.603782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:29.617458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:29.618442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:29.619706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:29.621566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:29.623051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:29.623516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:29.677830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:00:29.858157 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6249cf82-46d7-4cda-bce2-67a7d4f00ce9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 204 len: 0 microversion: 2.1 time: 0.260399 Oct 01 21:00:29.858793 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1366/2636] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:00:29 2022] DELETE /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:00:29.935149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-260ec4cc-b9d8-4c3b-b04b-29c1f2b2d985 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Action: 'create', calling method: .version_select at 0x7f41729893a0>, body: {"keypair": {"name": "tempest-keypair-251023824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuNqYY/CHpu58ITTaLu7CL3pcHVZpMXPu8O7YIuD7kXJz9sR9FRW1Y1dzbbSHsba5fIACS6j0rdVIGq3stcfbl52DjeUJGTzVSsPRmxFQ7YS+t2683RbN4EjVYu+zeITA=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:29.984997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-260ec4cc-b9d8-4c3b-b04b-29c1f2b2d985 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Getting quotas for project 91d32a0fa04648de8ec34b7937b36ef3. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:00:30.002209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-260ec4cc-b9d8-4c3b-b04b-29c1f2b2d985 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Getting quotas for user ce758fa3950048549fbc375a80deb1a7 and project 91d32a0fa04648de8ec34b7937b36ef3. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:00:30.059603 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-260ec4cc-b9d8-4c3b-b04b-29c1f2b2d985 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199505 Oct 01 21:00:30.060490 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1367/2637] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:00:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:30.067295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:30.073656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:30.099792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:30.100544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:30.101161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:30.102078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:30.102735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:30.103662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:30.240016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:30.251477 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b6843f47-5ba6-4651-8cd3-af1ee37a40c6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1273 microversion: 2.1 time: 0.189449 Oct 01 21:00:30.270901 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1368/2638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:30 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:30.276431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:30.277382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:30.299943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:30.301688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:30.302317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:30.303317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:30.303954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:30.304567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:31.306888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:31.318134 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3226066d-3eb7-4727-877e-b3076880692c tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1802 microversion: 2.1 time: 1.045717 Oct 01 21:00:31.319912 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1369/2639] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:30 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1802 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:31.333296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:31.334086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:31.348015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:31.350328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:31.351007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:31.351770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:31.352225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:31.352670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:31.890742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:31.909488 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-548e435f-30bf-4e84-8f60-00b4e423a29d tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1679 microversion: 2.1 time: 0.587723 Oct 01 21:00:31.910118 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1370/2640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:31 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1679 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:31.915613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:31.921472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:31.937173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:31.937699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:31.938155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:31.938922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:31.939393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:31.939830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:32.382445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:32.401914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:32.409021 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-929e2faa-8854-46f8-b3d6-e2a1eb21765f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1317 microversion: 2.1 time: 0.497629 Oct 01 21:00:32.409945 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1371/2641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:31 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:32.415819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:32.416740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:32.428692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:32.429315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:32.429993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:32.430839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:32.431572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:32.432335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:32.854786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd23af965b147248c5f8c7b9098fc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e916618c504ec2b23064c883ba7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:32.864751 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-01e403eb-0ebc-434a-97a1-911400babd4e tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 200 len: 1324 microversion: 2.1 time: 0.453450 Oct 01 21:00:32.878112 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1372/2642] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:32 2022] GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:32.878112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-35abd6d3-febd-49fd-81f1-3bc8f5ad231c req-c58abb01-2e26-4980-98f4-82a63c621f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1431fcc7-a23c-42aa-b324-44adc7bb8a68", "name": "network-vif-plugged", "status": "completed", "tag": "917511ad-abce-4ae4-ba7b-d32b38483fb1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:32.882554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-35abd6d3-febd-49fd-81f1-3bc8f5ad231c req-c58abb01-2e26-4980-98f4-82a63c621f29 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:32.883329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-35abd6d3-febd-49fd-81f1-3bc8f5ad231c req-c58abb01-2e26-4980-98f4-82a63c621f29 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:32.883982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-35abd6d3-febd-49fd-81f1-3bc8f5ad231c req-c58abb01-2e26-4980-98f4-82a63c621f29 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:32.897963 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-35abd6d3-febd-49fd-81f1-3bc8f5ad231c req-c58abb01-2e26-4980-98f4-82a63c621f29 service nova] Creating event network-vif-plugged:917511ad-abce-4ae4-ba7b-d32b38483fb1 for instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 on nch2-master-1 Oct 01 21:00:32.906100 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-35abd6d3-febd-49fd-81f1-3bc8f5ad231c req-c58abb01-2e26-4980-98f4-82a63c621f29 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038647 Oct 01 21:00:32.907579 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1373/2643] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:32.916548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:32.917478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:32.924377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:32.924875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:32.925311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:32.926283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:32.926973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:32.927470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:33.099006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:33.108868 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a8414bf2-a56c-4fc0-8cb2-0b05d8d334bf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1279 microversion: 2.1 time: 0.198027 Oct 01 21:00:33.109472 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1374/2644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:32 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:33.115601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6afa2dee-35e4-4052-9d8f-8e4cde4d25ae tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:33.116371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6afa2dee-35e4-4052-9d8f-8e4cde4d25ae tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:33.123615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6afa2dee-35e4-4052-9d8f-8e4cde4d25ae tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:33.124415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6afa2dee-35e4-4052-9d8f-8e4cde4d25ae tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:33.125099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6afa2dee-35e4-4052-9d8f-8e4cde4d25ae tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:33.126075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6afa2dee-35e4-4052-9d8f-8e4cde4d25ae tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:33.127169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6afa2dee-35e4-4052-9d8f-8e4cde4d25ae tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:33.127891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6afa2dee-35e4-4052-9d8f-8e4cde4d25ae tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:33.157543 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6afa2dee-35e4-4052-9d8f-8e4cde4d25ae tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4/ips" status: 200 len: 216 microversion: 2.1 time: 0.046260 Oct 01 21:00:33.158589 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1375/2645] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:00:33 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4/ips => generated 216 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:33.164035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-36b5eba3-26d8-4a09-9c91-cdc48799157c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8854826b-5d7e-43c4-9404-d505ad354cdc"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:33.167746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-36b5eba3-26d8-4a09-9c91-cdc48799157c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:33.175461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36b5eba3-26d8-4a09-9c91-cdc48799157c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:33.192788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36b5eba3-26d8-4a09-9c91-cdc48799157c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:33.193466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36b5eba3-26d8-4a09-9c91-cdc48799157c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:33.194804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36b5eba3-26d8-4a09-9c91-cdc48799157c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:33.195358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36b5eba3-26d8-4a09-9c91-cdc48799157c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:33.196001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36b5eba3-26d8-4a09-9c91-cdc48799157c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:33.736118 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-36b5eba3-26d8-4a09-9c91-cdc48799157c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "POST /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.575628 Oct 01 21:00:33.737858 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1376/2646] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:00:33 2022] POST /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-volume_attachments => generated 194 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:33.758370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:33.759951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:33.772363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:33.773177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:33.773829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:33.774817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:33.775832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:33.778608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:33.977253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf2c814364466baca8dfcabd2c13f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdb77df347145639f2de60eb820a3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:33.990335 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb4f11a7-c2cd-4fca-86e3-cc2b7e0cd927 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 200 len: 1612 microversion: 2.1 time: 0.250181 Oct 01 21:00:33.998947 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1377/2647] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:33 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 1612 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:34.000830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:34.001344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:34.017703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:34.020493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:34.020964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:34.035089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:34.035677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:34.036150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:34.080527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:00:34.289694 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-898d26cb-a687-4d00-a671-e61d0c078023 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "DELETE /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 204 len: 0 microversion: 2.1 time: 0.296326 Oct 01 21:00:34.291085 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1378/2648] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:00:33 2022] DELETE /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:00:34.302276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-813e2733-95bd-4315-9a69-c8212d1643df req-507a7516-68ef-4e7f-89a4-ba7ade78748a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd87ee65-e260-4911-a7f3-13869a562abf", "tag": "9035a175-f098-4b76-b137-43d2d3997dd2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:34.321779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-813e2733-95bd-4315-9a69-c8212d1643df req-507a7516-68ef-4e7f-89a4-ba7ade78748a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:34.330294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-813e2733-95bd-4315-9a69-c8212d1643df req-507a7516-68ef-4e7f-89a4-ba7ade78748a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:34.331029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-813e2733-95bd-4315-9a69-c8212d1643df req-507a7516-68ef-4e7f-89a4-ba7ade78748a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:34.343733 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-813e2733-95bd-4315-9a69-c8212d1643df req-507a7516-68ef-4e7f-89a4-ba7ade78748a service nova] Creating event network-changed:9035a175-f098-4b76-b137-43d2d3997dd2 for instance fd87ee65-e260-4911-a7f3-13869a562abf on nch2-master-1 Oct 01 21:00:34.349305 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-813e2733-95bd-4315-9a69-c8212d1643df req-507a7516-68ef-4e7f-89a4-ba7ade78748a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056599 Oct 01 21:00:34.350577 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1379/2649] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:34.358593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:34.359617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:34.366240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:34.367280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:34.367979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:34.368934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:34.369678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:34.370348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:34.686349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:34.706369 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-529cc3f3-45d9-4d60-b2b9-10ec3ef0ff9a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1317 microversion: 2.1 time: 0.349686 Oct 01 21:00:34.711032 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1380/2650] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:34 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:34.720614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:34.721482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:34.729286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:34.733554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:34.734280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:34.735273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:34.736167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:34.737260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:35.170123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd23af965b147248c5f8c7b9098fc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e916618c504ec2b23064c883ba7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:35.178858 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-347bd88d-125a-4dde-b2e8-d34d59d4ebed tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 200 len: 1324 microversion: 2.1 time: 0.465453 Oct 01 21:00:35.197403 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1381/2651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:34 2022] GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 1324 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:35.206668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:35.207468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:35.214100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:35.214671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:35.215175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:35.215895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:35.216361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:35.216796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:35.553679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:35.565946 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5dac9015-8981-4614-a808-2a266c01009c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1321 microversion: 2.1 time: 0.364191 Oct 01 21:00:35.584107 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1382/2652] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:35 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:35.590020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:35.590845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:35.610173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:35.610768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:35.611228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:35.612454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:35.613154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:35.613597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:36.419152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:36.427862 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0cee3e5e-bd91-47c9-82b3-3cc54abc02e7 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1808 microversion: 2.1 time: 0.842105 Oct 01 21:00:36.428590 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1383/2653] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:35 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1808 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:36.434271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "0343b9e1-ff31-47d4-831c-09e1491bf472"}], "security_groups": [{"name": "tempest-securitygroup--1953592730"}], "key_name": "tempest-keypair-251023824", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:36.687872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] validate_networks() for [('0343b9e1-ff31-47d4-831c-09e1491bf472', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:00:37.328009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:37.885427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:38.108634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:00:38.109221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:00:38.109811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:00:38.110352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:00:38.111015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:00:38.120874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:38.122165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:38.123064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:38.123814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:38.124395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:38.124825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:38.142724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Getting quotas for project 91d32a0fa04648de8ec34b7937b36ef3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:00:38.148291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Getting quotas for user ce758fa3950048549fbc375a80deb1a7 and project 91d32a0fa04648de8ec34b7937b36ef3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:00:38.162249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:00:38.164718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:00:38.221700 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-66a9372f-ead3-4ff1-921b-051268597133 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.791315 Oct 01 21:00:38.222712 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1384/2654] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:00:38.227573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:38.228234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:38.237486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:38.238120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:38.238733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:38.239455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:38.240077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:38.240513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:38.260479 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] HTTP exception thrown: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Request method failure captured: Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f HTTP/1.1 Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnPJRvXtQGXjt7DKNhHxXOx0VGhHaW1kztSFpExwdi8iAB3UZbdpU8FX-NvtrtcE3zmadIZpomXJH2XRnzToqjS2mEg-sQv_SQgAXoHnTrZA0BDZoiOdvX8UijMVhBkyUCyFnb3Wq-x9z5SThsMqOhj5CJ9MtoxBRYJ_CnON--sB1U Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bcdb77df347145639f2de60eb820a3ca Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1704747336 Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcdb77df347145639f2de60eb820a3ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdb77df347145639f2de60eb820a3ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcdb77df347145639f2de60eb820a3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdb77df347145639f2de60eb820a3ca"}]}] Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1704747336 Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bcdb77df347145639f2de60eb820a3ca Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1704747336 Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachSCSIVolumeTestJSON-1704747336-project Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: ccbf2c814364466baca8dfcabd2c13f9 Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1704747336-project Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a4377bd0-2f2e-4373-b1ef-a98c06edc04f'} Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:38.262443 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:38.267277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:38.267277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:38.267277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:38.267277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:38.267277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:38.267277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:38.267277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:38.268445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Returning 404 to user: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:38.269552 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a6d063f1-7901-4422-ba47-fdf06bc15c7f tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 404 len: 111 microversion: 2.1 time: 0.045793 Oct 01 21:00:38.270415 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1385/2655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:38 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:00:38.275128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:38.275751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:38.282602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:38.283141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:38.283728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:38.284449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:38.285048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:38.285662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:38.966930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:38.976241 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c8a1425d-3160-41ee-9435-2b42160c382e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1507 microversion: 2.1 time: 0.704706 Oct 01 21:00:39.021376 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1386/2656] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:38 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1507 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:39.038681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-37a54fa2-2f2d-463e-901c-6c07b8cce84b req-c710569f-7026-4230-86fa-15588cfb28d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0dd6bea-3abb-4f96-8959-84a72945a1ee", "tag": "b1593f3a-ed0c-471b-a6c0-57c1949e7fe8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:39.061110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-37a54fa2-2f2d-463e-901c-6c07b8cce84b req-c710569f-7026-4230-86fa-15588cfb28d2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:39.061962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-37a54fa2-2f2d-463e-901c-6c07b8cce84b req-c710569f-7026-4230-86fa-15588cfb28d2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:39.062678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-37a54fa2-2f2d-463e-901c-6c07b8cce84b req-c710569f-7026-4230-86fa-15588cfb28d2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:39.086134 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-37a54fa2-2f2d-463e-901c-6c07b8cce84b req-c710569f-7026-4230-86fa-15588cfb28d2 service nova] Creating event network-changed:b1593f3a-ed0c-471b-a6c0-57c1949e7fe8 for instance a0dd6bea-3abb-4f96-8959-84a72945a1ee on nch1-master-1 Oct 01 21:00:39.093807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-37a54fa2-2f2d-463e-901c-6c07b8cce84b req-c710569f-7026-4230-86fa-15588cfb28d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060159 Oct 01 21:00:39.094810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1387/2657] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:39.109325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:39.110151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:39.118118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:39.118816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:39.119295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:39.120384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:39.121501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:39.126455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:39.593804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd23af965b147248c5f8c7b9098fc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e916618c504ec2b23064c883ba7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:39.609131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9dd88467-ea9a-47f2-b0ab-14094d813b4b tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 200 len: 1324 microversion: 2.1 time: 0.511955 Oct 01 21:00:39.630431 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1388/2658] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:39 2022] GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 1324 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:39.637020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6c9dc8fe-d3eb-4399-85cf-b0de3bdd2ac4 req-64daa30d-32fa-457e-96ad-08a60bd9ef3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4377bd0-2f2e-4373-b1ef-a98c06edc04f", "name": "network-vif-deleted", "tag": "9f755ca0-b3c5-4016-8d9c-782b032ab956"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:39.650081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6c9dc8fe-d3eb-4399-85cf-b0de3bdd2ac4 req-64daa30d-32fa-457e-96ad-08a60bd9ef3e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:39.651782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6c9dc8fe-d3eb-4399-85cf-b0de3bdd2ac4 req-64daa30d-32fa-457e-96ad-08a60bd9ef3e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:39.653168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6c9dc8fe-d3eb-4399-85cf-b0de3bdd2ac4 req-64daa30d-32fa-457e-96ad-08a60bd9ef3e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:39.664350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:39.694237 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6c9dc8fe-d3eb-4399-85cf-b0de3bdd2ac4 req-64daa30d-32fa-457e-96ad-08a60bd9ef3e service nova] Creating event network-vif-deleted:9f755ca0-b3c5-4016-8d9c-782b032ab956 for instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f on nch2-master-1 Oct 01 21:00:39.713764 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6c9dc8fe-d3eb-4399-85cf-b0de3bdd2ac4 req-64daa30d-32fa-457e-96ad-08a60bd9ef3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080781 Oct 01 21:00:39.714303 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1389/2659] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:39.727042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:39.727761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:39.748786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:39.750696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:39.752033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:39.753208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:39.757787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:39.758542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.080917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:40.091664 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37bd41f9-b979-43b1-85a3-cbda3922c0fa tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1321 microversion: 2.1 time: 0.375572 Oct 01 21:00:40.102535 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1390/2660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:39 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:40.305479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4d91c21f-3869-4f30-9ae7-585673c48a85"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:40.308995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:40.316434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.317195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.317819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.318585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.319604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.320322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.509440 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] HTTP exception thrown: Volume 4d91c21f-3869-4f30-9ae7-585673c48a85 could not be found. Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Request method failure captured: Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-volume_attachments/8854826b-5d7e-43c4-9404-d505ad354cdc HTTP/1.1 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 74 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKowXTpYtq81zRNrfRvZ0ZV2H7zoBJEzKpUDPCTAJ9uUIij0DuujmsWUBXS7yUzAjAyNcHTP-r3xTDchvo9P5ntuv0tkGncwb7RGi1oslM6RSDpUomQSVmw7WGxBnDBhj__PWASade2VvspwOWEu1OdMTSCONSQsIOGPwnizkeFwCs0 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 29689e74f89d4e7b9b48d5872770ccb9 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesAdminNegativeTest-659661032 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_29689e74f89d4e7b9b48d5872770ccb9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29689e74f89d4e7b9b48d5872770ccb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/29689e74f89d4e7b9b48d5872770ccb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29689e74f89d4e7b9b48d5872770ccb9"}]}] Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesAdminNegativeTest-659661032 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 29689e74f89d4e7b9b48d5872770ccb9 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-659661032 Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesAdminNegativeTest-659661032-project-admin Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: b7334bfa53c0483e8f5d15c550e0db5a Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesAdminNegativeTest-659661032-project-admin Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: {"volumeAttachment": {"volumeId": "4d91c21f-3869-4f30-9ae7-585673c48a85"}} Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: exception: Volume 4d91c21f-3869-4f30-9ae7-585673c48a85 could not be found. Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': '89ab1c5d-571f-4b9e-bfaf-c03add40162d', 'id': '8854826b-5d7e-43c4-9404-d505ad354cdc', 'body': {'volumeAttachment': {'volumeId': '4d91c21f-3869-4f30-9ae7-585673c48a85'}}} Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d91c21f-3869-4f30-9ae7-585673c48a85 could not be found. (HTTP 404) (Request-ID: req-87340d44-2110-40c6-9a1e-fae235e8434f) Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:00:40.550925 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d91c21f-3869-4f30-9ae7-585673c48a85 could not be found. Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 4d91c21f-3869-4f30-9ae7-585673c48a85 could not be found. Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d91c21f-3869-4f30-9ae7-585673c48a85 could not be found. Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:40.555490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Returning 400 to user: Volume 4d91c21f-3869-4f30-9ae7-585673c48a85 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:40.563162 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88c33893-d6a9-463c-9328-163d8b832637 tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] 10.222.0.17 "PUT /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-volume_attachments/8854826b-5d7e-43c4-9404-d505ad354cdc" status: 400 len: 107 microversion: 2.1 time: 0.464054 Oct 01 21:00:40.563162 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1391/2661] 10.222.0.17 () {60 vars in 1433 bytes} [Sat Oct 1 21:00:40 2022] PUT /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-volume_attachments/8854826b-5d7e-43c4-9404-d505ad354cdc => generated 107 bytes in 466 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:00:40.567095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:40.569598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:40.581218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.581731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.582421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.583249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.583741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.584187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.642358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.643024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.643504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.643968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lazy-loading 'fault' on Instance uuid 143e0afb-b691-486b-a8a2-7832f2dbfdd4 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:00:40.713261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:40.726826 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e54a6e9d-e861-4243-88e4-7bedb896d099 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 200 len: 1302 microversion: 2.1 time: 0.165936 Oct 01 21:00:40.727416 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1392/2662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:40 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 1302 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:40.733405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:40.735218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:40.742607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.743281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.743910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.744812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.745282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.746340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.844061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce758fa3950048549fbc375a80deb1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d32a0fa04648de8ec34b7937b36ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:40.852812 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29dd5b21-9b19-43ea-a5a6-952514e520f8 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 200 len: 1283 microversion: 2.1 time: 0.123959 Oct 01 21:00:40.853390 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1393/2663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:40 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 1283 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:40.858663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-565a2501-dfcd-456c-8535-75b49035e295 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '.version_select at 0x7f4172aacc10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:40.890991 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-565a2501-dfcd-456c-8535-75b49035e295 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-711079135" status: 202 len: 0 microversion: 2.1 time: 0.035685 Oct 01 21:00:40.891794 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1394/2664] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 21:00:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-711079135 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:00:40.896768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-42ea5abd-4924-4509-a719-bdc30960b0a4 req-ae3d49be-06e3-4d3b-a7d5-3b724cb23720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd87ee65-e260-4911-a7f3-13869a562abf", "name": "network-vif-plugged", "status": "completed", "tag": "9035a175-f098-4b76-b137-43d2d3997dd2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:40.911522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-42ea5abd-4924-4509-a719-bdc30960b0a4 req-ae3d49be-06e3-4d3b-a7d5-3b724cb23720 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.912435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-42ea5abd-4924-4509-a719-bdc30960b0a4 req-ae3d49be-06e3-4d3b-a7d5-3b724cb23720 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.912924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-42ea5abd-4924-4509-a719-bdc30960b0a4 req-ae3d49be-06e3-4d3b-a7d5-3b724cb23720 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.927283 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-42ea5abd-4924-4509-a719-bdc30960b0a4 req-ae3d49be-06e3-4d3b-a7d5-3b724cb23720 service nova] Creating event network-vif-plugged:9035a175-f098-4b76-b137-43d2d3997dd2 for instance fd87ee65-e260-4911-a7f3-13869a562abf on nch2-master-1 Oct 01 21:00:40.934195 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-42ea5abd-4924-4509-a719-bdc30960b0a4 req-ae3d49be-06e3-4d3b-a7d5-3b724cb23720 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039991 Oct 01 21:00:40.935307 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1395/2665] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:40.942421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:40.969065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:40.981236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.982150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.984085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:40.985122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:40.986274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:40.987156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:41.360127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:41.372674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-46d62081-0a8c-4265-9897-40fa52f8e4c5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1507 microversion: 2.1 time: 0.435443 Oct 01 21:00:41.373925 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1396/2666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:40 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:41.380623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:41.381770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:41.389995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:41.391101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:41.392404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:41.393746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:41.394211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:41.394901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:41.677424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd23af965b147248c5f8c7b9098fc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e916618c504ec2b23064c883ba7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:41.695318 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0049fc0-1f7c-4b1a-85f9-dad9482b5c29 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 200 len: 1324 microversion: 2.1 time: 0.318988 Oct 01 21:00:41.698149 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1397/2667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:41 2022] GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 1324 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:41.712315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:41.714710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:41.732713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:41.735120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:41.735942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:41.736732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:41.737206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:41.737637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:41.904704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lazy-loading 'services' on Instance uuid 89ab1c5d-571f-4b9e-bfaf-c03add40162d {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:00:41.998388 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ad0ace0-8eef-4b3d-80fe-2132fd385637 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "DELETE /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-volume_attachments/8854826b-5d7e-43c4-9404-d505ad354cdc" status: 202 len: 0 microversion: 2.1 time: 0.298634 Oct 01 21:00:41.999041 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1398/2668] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:00:41 2022] DELETE /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-volume_attachments/8854826b-5d7e-43c4-9404-d505ad354cdc => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:00:42.008606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:42.009564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:42.016925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.017708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.018621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.019812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.020444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.021175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.293579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:42.303202 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6644d4da-4a66-4971-abe2-e9229cdd5345 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1321 microversion: 2.1 time: 0.298963 Oct 01 21:00:42.322282 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1399/2669] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:42 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:42.329133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7b83bdf0-8054-40cc-8c63-99cbffe796fa req-d350546d-d1ad-4b27-ade7-c31782f16807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143e0afb-b691-486b-a8a2-7832f2dbfdd4", "name": "network-vif-deleted", "tag": "8bfc6fc7-457b-4099-9c3f-fc6d6cb93c27"}, {"server_uuid": "143e0afb-b691-486b-a8a2-7832f2dbfdd4", "name": "network-vif-deleted", "tag": "1bfe4d22-c73b-403b-9084-4ab6c132af84"}, {"server_uuid": "143e0afb-b691-486b-a8a2-7832f2dbfdd4", "name": "network-vif-deleted", "tag": "8749820e-6c5c-4e96-973a-cc34684ddd48"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:42.343911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7b83bdf0-8054-40cc-8c63-99cbffe796fa req-d350546d-d1ad-4b27-ade7-c31782f16807 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.344770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7b83bdf0-8054-40cc-8c63-99cbffe796fa req-d350546d-d1ad-4b27-ade7-c31782f16807 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.345370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7b83bdf0-8054-40cc-8c63-99cbffe796fa req-d350546d-d1ad-4b27-ade7-c31782f16807 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.359609 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7b83bdf0-8054-40cc-8c63-99cbffe796fa req-d350546d-d1ad-4b27-ade7-c31782f16807 service nova] Creating event network-vif-deleted:8bfc6fc7-457b-4099-9c3f-fc6d6cb93c27 for instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 on nch1-master-1 Oct 01 21:00:42.360128 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7b83bdf0-8054-40cc-8c63-99cbffe796fa req-d350546d-d1ad-4b27-ade7-c31782f16807 service nova] Creating event network-vif-deleted:1bfe4d22-c73b-403b-9084-4ab6c132af84 for instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 on nch1-master-1 Oct 01 21:00:42.361551 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7b83bdf0-8054-40cc-8c63-99cbffe796fa req-d350546d-d1ad-4b27-ade7-c31782f16807 service nova] Creating event network-vif-deleted:8749820e-6c5c-4e96-973a-cc34684ddd48 for instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 on nch1-master-1 Oct 01 21:00:42.369179 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7b83bdf0-8054-40cc-8c63-99cbffe796fa req-d350546d-d1ad-4b27-ade7-c31782f16807 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.045412 Oct 01 21:00:42.370319 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1400/2670] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:42.383567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-903dad21-2a09-444c-a38d-ed89c485c594 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:42.397597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-903dad21-2a09-444c-a38d-ed89c485c594 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:42.407273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-903dad21-2a09-444c-a38d-ed89c485c594 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.408933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-903dad21-2a09-444c-a38d-ed89c485c594 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.409574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-903dad21-2a09-444c-a38d-ed89c485c594 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.411199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-903dad21-2a09-444c-a38d-ed89c485c594 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.419250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-903dad21-2a09-444c-a38d-ed89c485c594 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.419924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-903dad21-2a09-444c-a38d-ed89c485c594 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.501915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-903dad21-2a09-444c-a38d-ed89c485c594 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "PUT /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1079 microversion: 2.1 time: 0.130046 Oct 01 21:00:42.519249 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1401/2671] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:00:42 2022] PUT /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1079 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:42.525296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:42.526129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:42.535045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.535547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.536429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.536760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.537311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.537752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.568664 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] HTTP exception thrown: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Request method failure captured: Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 HTTP/1.1 Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKo_RflcOM_9qmFJjmuAFqHXkIDYu_iPHNwYrFgNclP1ThBdrd7vS4ivqUJ8-ZYUpnTH6MtcnoGTTKNHRdQ5DXwvZ6_V4og9trShmN6rmcucIkz-dew9EpML7a9z97sqXj0BaI5ujDPp6UctW6VUjVSt6oub-2OG4_UrLnKX5-JxCAU Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04cc84345d874fc69776490bea69d81a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04cc84345d874fc69776490bea69d81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}] Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestMultiNic-1283043920 Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ade3ba047d348a387e8e4077072b90a Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '143e0afb-b691-486b-a8a2-7832f2dbfdd4'} Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:42.570626 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Returning 404 to user: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-57533bd5-20be-48f3-9cf9-dc2863d9910d tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 404 len: 111 microversion: 2.1 time: 0.050894 Oct 01 21:00:42.574679 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1402/2672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:42 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:00:42.585350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:42.585975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:42.608493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.608996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.609439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.610181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.610687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.611185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.934026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce758fa3950048549fbc375a80deb1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d32a0fa04648de8ec34b7937b36ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:42.949328 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60710ae5-42df-40a7-97c5-d88c1ec4da0b tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 200 len: 1351 microversion: 2.1 time: 0.371828 Oct 01 21:00:42.950660 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1403/2673] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:42 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 1351 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:42.959354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e78f4ac-0e85-4811-93f7-465d650bb849 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:42.966803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e78f4ac-0e85-4811-93f7-465d650bb849 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:42.977750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e78f4ac-0e85-4811-93f7-465d650bb849 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.978281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e78f4ac-0e85-4811-93f7-465d650bb849 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.978754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e78f4ac-0e85-4811-93f7-465d650bb849 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:42.979983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e78f4ac-0e85-4811-93f7-465d650bb849 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:42.981096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e78f4ac-0e85-4811-93f7-465d650bb849 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:42.981692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e78f4ac-0e85-4811-93f7-465d650bb849 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:43.021999 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e78f4ac-0e85-4811-93f7-465d650bb849 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070156 Oct 01 21:00:43.023254 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1404/2674] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:00:42 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:00:43.030035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-dcb9c360-2d91-4bd4-9b13-bf7a1f90a793 req-6e942035-d862-4b5c-855d-56dd99e93823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9b3856-21ac-48d1-bd95-e610b11f7280", "tag": "b81ec050-cf8b-44df-9c94-bb394da5e2b4"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:43.048772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dcb9c360-2d91-4bd4-9b13-bf7a1f90a793 req-6e942035-d862-4b5c-855d-56dd99e93823 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:43.062736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dcb9c360-2d91-4bd4-9b13-bf7a1f90a793 req-6e942035-d862-4b5c-855d-56dd99e93823 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:43.063306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dcb9c360-2d91-4bd4-9b13-bf7a1f90a793 req-6e942035-d862-4b5c-855d-56dd99e93823 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:43.092727 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-dcb9c360-2d91-4bd4-9b13-bf7a1f90a793 req-6e942035-d862-4b5c-855d-56dd99e93823 service nova] Creating event network-changed:b81ec050-cf8b-44df-9c94-bb394da5e2b4 for instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 on nch2-master-1 Oct 01 21:00:43.100139 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-dcb9c360-2d91-4bd4-9b13-bf7a1f90a793 req-6e942035-d862-4b5c-855d-56dd99e93823 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075310 Oct 01 21:00:43.101480 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1405/2675] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:43.113799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:43.114841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:43.130445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:43.131431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:43.132125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:43.133239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:43.133924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:43.134842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:43.421887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:43.443483 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-57d54047-50f7-47b9-9772-6ea94546c83b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1505 microversion: 2.1 time: 0.340021 Oct 01 21:00:43.444817 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1406/2676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:43 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:43.459474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:43.461509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:43.468727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:43.469435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:43.469890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:43.470834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:43.471303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:43.471738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:43.703946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd23af965b147248c5f8c7b9098fc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e916618c504ec2b23064c883ba7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:43.716732 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8a2f4dbf-9773-4389-9bf9-567e1c7493a0 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 200 len: 1520 microversion: 2.1 time: 0.270554 Oct 01 21:00:43.725501 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1407/2677] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:43 2022] GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:43.731186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:43.731801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:43.748930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:43.749480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:43.750899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:43.754330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:43.755422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:43.756037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:43.981465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:43.986703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:44.004855 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-771f0b24-5064-43b0-8fcc-4dfd986b5279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1321 microversion: 2.1 time: 0.278090 Oct 01 21:00:44.020988 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1408/2678] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:43 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:44.026537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1924593209", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "0e873cc9-0708-450f-bd4e-516af62445dd"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:44.123319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] validate_networks() for [('0e873cc9-0708-450f-bd4e-516af62445dd', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:00:44.710977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:00:44.713729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:00:44.715183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:00:44.715669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:00:44.716129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:00:44.737288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=29 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:44.743591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:44.744602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:44.744995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:44.746459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:44.746956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:44.747435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:44.775496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Getting quotas for project d27e9cda0a6d47d4acdbadc890b996c9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:00:44.785296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Getting quotas for user 69002d46d4e54eadadf911ec3589d95c and project d27e9cda0a6d47d4acdbadc890b996c9. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:00:44.804835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:00:44.809066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:00:44.895782 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eef6d889-fbb7-4b30-a033-366a2214cbc5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872917 Oct 01 21:00:44.896961 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1409/2679] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:00:44.903367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:44.904485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:44.927681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:44.929081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:44.930887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:44.933816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:44.934994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:44.936652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:45.209464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:45.236467 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24cba799-1c8d-44cf-8d95-5d9db92e332e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1505 microversion: 2.1 time: 0.337867 Oct 01 21:00:45.237544 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1410/2680] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:44 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:45.252116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-dce30713-449b-4b90-995f-c6a6423f9d8f req-336754e6-5789-4407-8fb2-993be24b60ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dd6bea-3abb-4f96-8959-84a72945a1ee", "name": "network-vif-plugged", "status": "completed", "tag": "b1593f3a-ed0c-471b-a6c0-57c1949e7fe8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:45.269603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dce30713-449b-4b90-995f-c6a6423f9d8f req-336754e6-5789-4407-8fb2-993be24b60ef service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:45.270388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dce30713-449b-4b90-995f-c6a6423f9d8f req-336754e6-5789-4407-8fb2-993be24b60ef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:45.271020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dce30713-449b-4b90-995f-c6a6423f9d8f req-336754e6-5789-4407-8fb2-993be24b60ef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:45.285383 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-dce30713-449b-4b90-995f-c6a6423f9d8f req-336754e6-5789-4407-8fb2-993be24b60ef service nova] Creating event network-vif-plugged:b1593f3a-ed0c-471b-a6c0-57c1949e7fe8 for instance a0dd6bea-3abb-4f96-8959-84a72945a1ee on nch1-master-1 Oct 01 21:00:45.292034 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-dce30713-449b-4b90-995f-c6a6423f9d8f req-336754e6-5789-4407-8fb2-993be24b60ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052445 Oct 01 21:00:45.293732 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1411/2681] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:45.301056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e8d4afb4-8f02-4417-bc08-4c0afd1dc188 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1580695282", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e8d4afb4-8f02-4417-bc08-4c0afd1dc188 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Request method failure captured: Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 243 Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpohxPx47fmpfAO8A7aC169HG61XmIX93hcYJPzBkvIB7L7GReUuUyLqiLIlWajUNbUwHfjJcFPTawbyjElff01-0HWeHPuimvjNewzn0A-1LfJqzkAukQpsBYu6yhTa5TyVcKPkgcAX0hmYWuxGP2roBjL_KK6K8rZ3kJcCy4wQcM Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9e916618c504ec2b23064c883ba7d56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}] Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7cd23af965b147248c5f8c7b9098fc3d Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1580695282", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1580695282', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '035e612c-d25c-4b96-8033-611a957990be'}]}}} Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:45.307122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:45.312792 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.316269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e8d4afb4-8f02-4417-bc08-4c0afd1dc188 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:45.317688 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e8d4afb4-8f02-4417-bc08-4c0afd1dc188 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.022397 Oct 01 21:00:45.329085 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1412/2682] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:45 2022] POST /compute/v2.1/servers => generated 175 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:00:45.335195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:45.336284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:45.346073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:45.346792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:45.347468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:45.348496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:45.349689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:45.350319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:45.636871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce758fa3950048549fbc375a80deb1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d32a0fa04648de8ec34b7937b36ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:45.648391 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-caf83796-d843-4759-90e9-81106db3588e tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 200 len: 1351 microversion: 2.1 time: 0.317920 Oct 01 21:00:45.649306 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1413/2683] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:45 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 1351 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:45.655148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:45.655730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:45.662795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:45.663643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:45.664311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:45.665097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:45.665590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:45.666276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:45.687838 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] HTTP exception thrown: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Request method failure captured: Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f HTTP/1.1 Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnPJRvXtQGXjt7DKNhHxXOx0VGhHaW1kztSFpExwdi8iAB3UZbdpU8FX-NvtrtcE3zmadIZpomXJH2XRnzToqjS2mEg-sQv_SQgAXoHnTrZA0BDZoiOdvX8UijMVhBkyUCyFnb3Wq-x9z5SThsMqOhj5CJ9MtoxBRYJ_CnON--sB1U Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bcdb77df347145639f2de60eb820a3ca Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1704747336 Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcdb77df347145639f2de60eb820a3ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdb77df347145639f2de60eb820a3ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcdb77df347145639f2de60eb820a3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdb77df347145639f2de60eb820a3ca"}]}] Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1704747336 Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bcdb77df347145639f2de60eb820a3ca Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1704747336 Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachSCSIVolumeTestJSON-1704747336-project Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: ccbf2c814364466baca8dfcabd2c13f9 Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1704747336-project Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a4377bd0-2f2e-4373-b1ef-a98c06edc04f'} Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:00:45.694734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:45.699821 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:45.701588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Returning 404 to user: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:45.702466 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6c0df968-dff3-4fd6-ba37-23ae4f49dbf9 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 404 len: 111 microversion: 2.1 time: 0.052211 Oct 01 21:00:45.706248 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1414/2684] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:00:45 2022] DELETE /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:00:45.711561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:45.712823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:45.719745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:45.720234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:45.720887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:45.721813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:45.722278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:45.723091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:45.798578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:45.810347 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-387e5322-ba30-4add-b9a9-780ec5fdc7b2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1222 microversion: 2.1 time: 0.102675 Oct 01 21:00:45.811326 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1415/2685] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:45 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:45.818285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:45.819165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:45.832469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:45.833198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:45.834044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:45.835116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:45.835848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:45.836677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:46.022386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:46.041182 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b51e8241-5d65-4fb2-877c-e32bb22556de tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1321 microversion: 2.1 time: 0.228234 Oct 01 21:00:46.041989 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1416/2686] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:45 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:46.048212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:46.051643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:46.064215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:46.064719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:46.065165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:46.067118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:46.072920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:46.073502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:46.163336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:00:46.164766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:00:46.165273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:00:46.165878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:00:46.166292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:00:46.249406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:46.253009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:46.257514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:46.258899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:46.259701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:46.260832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:46.262437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:46.263092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:46.297719 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0aa8eb74-ca71-4ef7-b723-88d25f7cf5f4 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "POST /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68/action" status: 202 len: 1111 microversion: 2.1 time: 0.253721 Oct 01 21:00:46.298778 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1417/2687] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:00:46 2022] POST /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68/action => generated 1111 bytes in 256 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 01 21:00:46.304295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-432d2020-51df-4774-914c-b44607c0f57f tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:46.304869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-432d2020-51df-4774-914c-b44607c0f57f tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: e1818133-548f-469e-b889-efd74a287aa5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:46.324276 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-432d2020-51df-4774-914c-b44607c0f57f tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] HTTP exception thrown: Instance e1818133-548f-469e-b889-efd74a287aa5 could not be found. Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-432d2020-51df-4774-914c-b44607c0f57f tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Request method failure captured: Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e1818133-548f-469e-b889-efd74a287aa5/metadata HTTP/1.1 Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpohxPx47fmpfAO8A7aC169HG61XmIX93hcYJPzBkvIB7L7GReUuUyLqiLIlWajUNbUwHfjJcFPTawbyjElff01-0HWeHPuimvjNewzn0A-1LfJqzkAukQpsBYu6yhTa5TyVcKPkgcAX0hmYWuxGP2roBjL_KK6K8rZ3kJcCy4wQcM Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9e916618c504ec2b23064c883ba7d56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}] Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7cd23af965b147248c5f8c7b9098fc3d Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e1818133-548f-469e-b889-efd74a287aa5 could not be found. Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': 'e1818133-548f-469e-b889-efd74a287aa5'} Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1818133-548f-469e-b889-efd74a287aa5 could not be found. Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1818133-548f-469e-b889-efd74a287aa5 could not be found. Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:46.332188 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:46.337146 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:46.337146 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:46.337146 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1818133-548f-469e-b889-efd74a287aa5 could not be found. Oct 01 21:00:46.337146 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.340304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-432d2020-51df-4774-914c-b44607c0f57f tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Returning 404 to user: Instance e1818133-548f-469e-b889-efd74a287aa5 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:46.341401 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-432d2020-51df-4774-914c-b44607c0f57f tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/e1818133-548f-469e-b889-efd74a287aa5/metadata" status: 404 len: 111 microversion: 2.1 time: 0.041604 Oct 01 21:00:46.344571 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1418/2688] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 21:00:46 2022] GET /compute/v2.1/servers/e1818133-548f-469e-b889-efd74a287aa5/metadata => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:00:46.353278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:46.353837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] [instance: a4377bd0-2f2e-4373-b1ef-a98c06edc04f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:46.371963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:46.372632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:46.373095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:46.375829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:46.378096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:46.378770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:46.418145 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] HTTP exception thrown: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Request method failure captured: Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f HTTP/1.1 Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKnPJRvXtQGXjt7DKNhHxXOx0VGhHaW1kztSFpExwdi8iAB3UZbdpU8FX-NvtrtcE3zmadIZpomXJH2XRnzToqjS2mEg-sQv_SQgAXoHnTrZA0BDZoiOdvX8UijMVhBkyUCyFnb3Wq-x9z5SThsMqOhj5CJ9MtoxBRYJ_CnON--sB1U Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bcdb77df347145639f2de60eb820a3ca Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1704747336 Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcdb77df347145639f2de60eb820a3ca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdb77df347145639f2de60eb820a3ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcdb77df347145639f2de60eb820a3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdb77df347145639f2de60eb820a3ca"}]}] Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1704747336 Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bcdb77df347145639f2de60eb820a3ca Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1704747336 Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachSCSIVolumeTestJSON-1704747336-project Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: ccbf2c814364466baca8dfcabd2c13f9 Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1704747336-project Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a4377bd0-2f2e-4373-b1ef-a98c06edc04f'} Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:46.420082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.424322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:46.424322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:46.424322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:46.424322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:46.424322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:46.424322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. Oct 01 21:00:46.424322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:46.426829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] Returning 404 to user: Instance a4377bd0-2f2e-4373-b1ef-a98c06edc04f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:46.427901 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4e8bce8-755e-41ca-87c4-bbd8b7f5dbb1 tempest-AttachSCSIVolumeTestJSON-1704747336 tempest-AttachSCSIVolumeTestJSON-1704747336-project] 10.222.0.17 "GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f" status: 404 len: 111 microversion: 2.1 time: 0.082138 Oct 01 21:00:46.432264 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1419/2689] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:46 2022] GET /compute/v2.1/servers/a4377bd0-2f2e-4373-b1ef-a98c06edc04f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:00:46.440198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:46.444559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:46.454780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:46.461019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:46.463304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:46.465562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:46.467503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:46.467955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:47.151888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:47.162981 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8b9cc845-5253-4d2d-94f0-1994f15f4e67 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1516 microversion: 2.1 time: 0.727682 Oct 01 21:00:47.164452 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1420/2690] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:46 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1516 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:47.193177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-388b6c84-2f0f-4e27-b4ac-c72bf19cf7d7 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-984395162", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-388b6c84-2f0f-4e27-b4ac-c72bf19cf7d7 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Request method failure captured: Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 498 Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpohxPx47fmpfAO8A7aC169HG61XmIX93hcYJPzBkvIB7L7GReUuUyLqiLIlWajUNbUwHfjJcFPTawbyjElff01-0HWeHPuimvjNewzn0A-1LfJqzkAukQpsBYu6yhTa5TyVcKPkgcAX0hmYWuxGP2roBjL_KK6K8rZ3kJcCy4wQcM Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9e916618c504ec2b23064c883ba7d56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}] Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7cd23af965b147248c5f8c7b9098fc3d Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-984395162", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-984395162', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '035e612c-d25c-4b96-8033-611a957990be'}]}}} Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 01 21:00:47.216165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:47.219772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:47.229647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-388b6c84-2f0f-4e27-b4ac-c72bf19cf7d7 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:47.231488 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-388b6c84-2f0f-4e27-b4ac-c72bf19cf7d7 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.065834 Oct 01 21:00:47.232721 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1421/2691] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:47 2022] POST /compute/v2.1/servers => generated 687 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:00:47.242834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:47.243630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:47.255583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:47.256961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:47.257561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:47.259194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:47.260063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:47.261324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:47.927311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce758fa3950048549fbc375a80deb1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d32a0fa04648de8ec34b7937b36ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:47.936546 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cbcddad4-26b2-48d9-a744-e51f8a04abb2 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 200 len: 1351 microversion: 2.1 time: 0.702316 Oct 01 21:00:47.949920 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1422/2692] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:47 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 1351 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:47.965375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:47.966228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:47.973103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:47.973817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:47.974418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:47.975333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:47.975963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:47.976582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:48.119358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:48.133139 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c1eade7-c4e1-4e91-956f-cc59562ec4f2 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1276 microversion: 2.1 time: 0.177215 Oct 01 21:00:48.134151 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1423/2693] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:47 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:48.140964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:48.142980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:48.158035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:48.158784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:48.159002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:48.161712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:48.163910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:48.164406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:48.566810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:48.578431 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c9d97084-c233-4693-8168-26598529e683 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1502 microversion: 2.1 time: 0.443881 Oct 01 21:00:48.579218 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1424/2694] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:48 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1502 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:48.586682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9fbd465e-3c7a-4c51-9836-5fe62d5635df req-b16f7a8f-f9bb-4a65-a8bf-88f6dbd2751c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9b3856-21ac-48d1-bd95-e610b11f7280", "name": "network-vif-plugged", "status": "completed", "tag": "b81ec050-cf8b-44df-9c94-bb394da5e2b4"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:48.601665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9fbd465e-3c7a-4c51-9836-5fe62d5635df req-b16f7a8f-f9bb-4a65-a8bf-88f6dbd2751c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:48.602418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9fbd465e-3c7a-4c51-9836-5fe62d5635df req-b16f7a8f-f9bb-4a65-a8bf-88f6dbd2751c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:48.603388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9fbd465e-3c7a-4c51-9836-5fe62d5635df req-b16f7a8f-f9bb-4a65-a8bf-88f6dbd2751c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:48.623646 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9fbd465e-3c7a-4c51-9836-5fe62d5635df req-b16f7a8f-f9bb-4a65-a8bf-88f6dbd2751c service nova] Creating event network-vif-plugged:b81ec050-cf8b-44df-9c94-bb394da5e2b4 for instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 on nch2-master-1 Oct 01 21:00:48.654939 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9fbd465e-3c7a-4c51-9836-5fe62d5635df req-b16f7a8f-f9bb-4a65-a8bf-88f6dbd2751c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073833 Oct 01 21:00:48.663057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1425/2695] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:48.680189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2ceae17d-521b-4ea8-9a1e-7be066bee8c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1142598119", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2ceae17d-521b-4ea8-9a1e-7be066bee8c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Request method failure captured: Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 500 Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpohxPx47fmpfAO8A7aC169HG61XmIX93hcYJPzBkvIB7L7GReUuUyLqiLIlWajUNbUwHfjJcFPTawbyjElff01-0HWeHPuimvjNewzn0A-1LfJqzkAukQpsBYu6yhTa5TyVcKPkgcAX0hmYWuxGP2roBjL_KK6K8rZ3kJcCy4wQcM Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9e916618c504ec2b23064c883ba7d56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}] Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7cd23af965b147248c5f8c7b9098fc3d Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1142598119", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1142598119', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '035e612c-d25c-4b96-8033-611a957990be'}]}}} Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 01 21:00:48.686572 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:48.689568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:48.694599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2ceae17d-521b-4ea8-9a1e-7be066bee8c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:48.695751 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2ceae17d-521b-4ea8-9a1e-7be066bee8c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025693 Oct 01 21:00:48.703808 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1426/2696] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:48 2022] POST /compute/v2.1/servers => generated 689 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:00:48.727088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:48.728772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:48.747099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:48.747957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:48.748551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:48.750431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:48.752235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:48.752853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:49.045811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:49.056519 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38a73e23-d354-44e5-854c-e87f436c0141 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1516 microversion: 2.1 time: 0.351264 Oct 01 21:00:49.057372 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1427/2697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:48 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1516 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:49.077744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:49.078463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:49.084766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:49.085267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:49.085714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:49.086429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:49.087106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:49.087548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:49.434984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:49.445742 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c90db95-ff53-4e04-9828-f7879547f43f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1502 microversion: 2.1 time: 0.373996 Oct 01 21:00:49.447020 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1428/2698] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:49 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1502 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:49.452851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2579af17-db4f-4fa3-a263-17313bb90b23 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-732956638", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2579af17-db4f-4fa3-a263-17313bb90b23 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Request method failure captured: Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 753 Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpohxPx47fmpfAO8A7aC169HG61XmIX93hcYJPzBkvIB7L7GReUuUyLqiLIlWajUNbUwHfjJcFPTawbyjElff01-0HWeHPuimvjNewzn0A-1LfJqzkAukQpsBYu6yhTa5TyVcKPkgcAX0hmYWuxGP2roBjL_KK6K8rZ3kJcCy4wQcM Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9e916618c504ec2b23064c883ba7d56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}] Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7cd23af965b147248c5f8c7b9098fc3d Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-732956638", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-732956638', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '035e612c-d25c-4b96-8033-611a957990be'}]}}} Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:00:49.464614 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:00:49.467242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:00:49.470769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:49.470769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:49.470769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2579af17-db4f-4fa3-a263-17313bb90b23 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:49.476623 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2579af17-db4f-4fa3-a263-17313bb90b23 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.023489 Oct 01 21:00:49.477435 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1429/2699] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:49 2022] POST /compute/v2.1/servers => generated 1197 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 01 21:00:49.490030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:49.490707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:49.502661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:49.503498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:49.503973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:49.507936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:49.508709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:49.509158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:50.143781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce758fa3950048549fbc375a80deb1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d32a0fa04648de8ec34b7937b36ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:50.165605 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb298e56-ffa8-41da-b993-bdfe09631ebc tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 200 len: 1351 microversion: 2.1 time: 0.676778 Oct 01 21:00:50.168196 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1430/2700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:49 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 1351 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:50.174268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-844783197", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "8390c3dc-269b-4fbd-9fa6-110270ee6eb9"}, {"uuid": "12b89914-c1bc-45e9-a560-ae94effd6572"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:50.312677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] validate_networks() for [('8390c3dc-269b-4fbd-9fa6-110270ee6eb9', None, None, None, None, None), ('12b89914-c1bc-45e9-a560-ae94effd6572', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:00:52.571756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:00:52.572883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:00:52.573570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:00:52.574155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:00:52.574865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:00:52.609856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:52.614181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:52.617469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:52.619492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:52.620967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:52.622180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:52.674110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Getting quotas for project 04cc84345d874fc69776490bea69d81a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:00:52.684199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Getting quotas for user 6ade3ba047d348a387e8e4077072b90a and project 04cc84345d874fc69776490bea69d81a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:00:52.704104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:00:52.706600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:00:52.777198 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d3217263-a625-48a0-b494-75046f5f5fba tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.606908 Oct 01 21:00:52.777866 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1431/2701] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:00:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:00:52.783328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:52.784090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:52.792667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:52.793167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:52.793611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:52.794329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:52.794984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:52.795419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:52.817546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:53.387294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:53.400965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-182d4a37-e7f0-4c2d-9ba8-7cfc217cc30f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1318 microversion: 2.1 time: 0.621340 Oct 01 21:00:53.415208 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1432/2702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:52 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:53.415208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:53.415208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:53.424121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:53.424816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:53.425857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:53.426762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:53.427284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:53.427793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:53.487597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:00:53.628632 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4ba22bfe-9a05-469e-9027-0cbe63dafe41 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 204 len: 0 microversion: 2.1 time: 0.224718 Oct 01 21:00:53.629559 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1433/2703] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:00:53 2022] DELETE /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:00:53.638925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-807dbd52-ef57-4421-80d8-3354bbe02222 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-38631452", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-807dbd52-ef57-4421-80d8-3354bbe02222 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Request method failure captured: Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 1264 Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpohxPx47fmpfAO8A7aC169HG61XmIX93hcYJPzBkvIB7L7GReUuUyLqiLIlWajUNbUwHfjJcFPTawbyjElff01-0HWeHPuimvjNewzn0A-1LfJqzkAukQpsBYu6yhTa5TyVcKPkgcAX0hmYWuxGP2roBjL_KK6K8rZ3kJcCy4wQcM Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9e916618c504ec2b23064c883ba7d56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}] Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7cd23af965b147248c5f8c7b9098fc3d Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-38631452", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "035e612c-d25c-4b96-8033-611a957990be"}]}} Oct 01 21:00:53.644476 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-38631452', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '035e612c-d25c-4b96-8033-611a957990be'}]}}} Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:53.647224 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:00:53.648477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:00:53.650479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:00:53.650479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:53.652482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-807dbd52-ef57-4421-80d8-3354bbe02222 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:53.654123 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-807dbd52-ef57-4421-80d8-3354bbe02222 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.022840 Oct 01 21:00:53.662048 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1434/2704] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Oct 1 21:00:53 2022] POST /compute/v2.1/servers => generated 2221 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 01 21:00:53.662048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:53.663127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:53.672402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:53.672900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:53.673578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:53.674552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:53.675515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:53.676184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.007394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:54.016689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b6af0db5-2ebd-406e-80b3-cdc1da651e87 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1516 microversion: 2.1 time: 0.360607 Oct 01 21:00:54.027691 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1435/2705] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:53 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1516 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:54.038737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:54.039474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:54.057183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.059102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.061838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.063651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.064644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.065603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.245968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce758fa3950048549fbc375a80deb1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d32a0fa04648de8ec34b7937b36ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:54.258227 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a4f5dda0-3fb9-4362-9df1-3b0a882de194 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 200 len: 1540 microversion: 2.1 time: 0.229055 Oct 01 21:00:54.259196 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1436/2706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:54 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 1540 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:54.264491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-539e6caf-2cb7-419f-a52a-e29e3ac6653d req-a4f85486-3e83-415b-b8e3-0e642dcceb6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f9298f-3dd7-4e39-8df7-05b36a378034", "tag": "25659597-3a4b-49f1-b911-398d9560adaa"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:54.274944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-539e6caf-2cb7-419f-a52a-e29e3ac6653d req-a4f85486-3e83-415b-b8e3-0e642dcceb6b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.275534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-539e6caf-2cb7-419f-a52a-e29e3ac6653d req-a4f85486-3e83-415b-b8e3-0e642dcceb6b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.276096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-539e6caf-2cb7-419f-a52a-e29e3ac6653d req-a4f85486-3e83-415b-b8e3-0e642dcceb6b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.293284 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-539e6caf-2cb7-419f-a52a-e29e3ac6653d req-a4f85486-3e83-415b-b8e3-0e642dcceb6b service nova] Creating event network-changed:25659597-3a4b-49f1-b911-398d9560adaa for instance 67f9298f-3dd7-4e39-8df7-05b36a378034 on nch1-master-1 Oct 01 21:00:54.299013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-539e6caf-2cb7-419f-a52a-e29e3ac6653d req-a4f85486-3e83-415b-b8e3-0e642dcceb6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038609 Oct 01 21:00:54.300243 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1437/2707] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:54.305564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:54.306339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:54.313527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.314064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.314726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.315373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.315887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.316354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.382635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:54.391843 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6496abc1-0eff-4f8c-9f36-2c556288584f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1282 microversion: 2.1 time: 0.090338 Oct 01 21:00:54.392686 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1438/2708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:54 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:54.397355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:54.397972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:54.405367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.405865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.406359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.407107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.407574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.408006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.557669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:54.567240 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a647e48-b1d7-4d75-8d44-2e44eb6eb2f5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1508 microversion: 2.1 time: 0.173473 Oct 01 21:00:54.567772 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1439/2709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:54 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:54.573000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b70e48b-c636-4e08-912d-76e6a368fbc4 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:54.574033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5b70e48b-c636-4e08-912d-76e6a368fbc4 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: f989a99e-9407-4252-8931-e60b45d93cf9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:54.579905 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5b70e48b-c636-4e08-912d-76e6a368fbc4 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] HTTP exception thrown: Instance f989a99e-9407-4252-8931-e60b45d93cf9 could not be found. Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b70e48b-c636-4e08-912d-76e6a368fbc4 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Request method failure captured: Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/f989a99e-9407-4252-8931-e60b45d93cf9/metadata/test2 HTTP/1.1 Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpohxPx47fmpfAO8A7aC169HG61XmIX93hcYJPzBkvIB7L7GReUuUyLqiLIlWajUNbUwHfjJcFPTawbyjElff01-0HWeHPuimvjNewzn0A-1LfJqzkAukQpsBYu6yhTa5TyVcKPkgcAX0hmYWuxGP2roBjL_KK6K8rZ3kJcCy4wQcM Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9e916618c504ec2b23064c883ba7d56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}] Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7cd23af965b147248c5f8c7b9098fc3d Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance f989a99e-9407-4252-8931-e60b45d93cf9 could not be found. Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': 'f989a99e-9407-4252-8931-e60b45d93cf9', 'id': 'test2'} Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f989a99e-9407-4252-8931-e60b45d93cf9 could not be found. Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f989a99e-9407-4252-8931-e60b45d93cf9 could not be found. Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:00:54.581684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:00:54.585543 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:00:54.585543 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:00:54.585543 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f989a99e-9407-4252-8931-e60b45d93cf9 could not be found. Oct 01 21:00:54.585543 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:00:54.587197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b70e48b-c636-4e08-912d-76e6a368fbc4 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Returning 404 to user: Instance f989a99e-9407-4252-8931-e60b45d93cf9 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:00:54.588064 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5b70e48b-c636-4e08-912d-76e6a368fbc4 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/f989a99e-9407-4252-8931-e60b45d93cf9/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.019358 Oct 01 21:00:54.588661 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1440/2710] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Oct 1 21:00:54 2022] GET /compute/v2.1/servers/f989a99e-9407-4252-8931-e60b45d93cf9/metadata/test2 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:00:54.603670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a10a3d54-75dc-41ea-9d30-de38ada484ce tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:54.604181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a10a3d54-75dc-41ea-9d30-de38ada484ce tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:54.612012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10a3d54-75dc-41ea-9d30-de38ada484ce tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.612518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10a3d54-75dc-41ea-9d30-de38ada484ce tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.612961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10a3d54-75dc-41ea-9d30-de38ada484ce tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.613674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10a3d54-75dc-41ea-9d30-de38ada484ce tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.614306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10a3d54-75dc-41ea-9d30-de38ada484ce tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.614925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10a3d54-75dc-41ea-9d30-de38ada484ce tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.706218 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a10a3d54-75dc-41ea-9d30-de38ada484ce tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106396 Oct 01 21:00:54.716064 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1441/2711] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:00:54 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:54.721784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:54.722452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:54.731893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.732401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.732850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:54.733574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:54.734042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:54.734473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:55.005163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:55.015680 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6b6236c0-e6e7-4384-8de0-dd308ebd8120 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1318 microversion: 2.1 time: 0.298533 Oct 01 21:00:55.033987 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1442/2712] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:54 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:55.039257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:55.039861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:55.047526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:55.048159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:55.048683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:55.049487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:55.050032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:55.050566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:55.093590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:00:55.212836 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e54ad426-2c2c-496e-b579-02f1b42d3a0d tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 204 len: 0 microversion: 2.1 time: 0.177057 Oct 01 21:00:55.213541 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1443/2713] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:00:55 2022] DELETE /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:00:55.444678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Calling method '.version_select at 0x7f4173bc8820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:55.456777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:55.457298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:55.457757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:55.474823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:55.475410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:55.475851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:55.488687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:55.489821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:55.490292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:55.497474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82d2e401-de1a-4b6c-8ba2-cf1d597cb60f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1998785607-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.281717 Oct 01 21:00:55.504699 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1444/2714] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 21:00:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:55.513584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:55.514348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:55.520988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:55.521937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:55.522640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:55.523369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:55.523841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:55.524274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:56.329426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:56.342093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-58893d29-d387-4c77-82b5-ec5fd019365e tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1516 microversion: 2.1 time: 0.836231 Oct 01 21:00:56.342729 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1445/2715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:55 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1516 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:56.347816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:56.348451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:56.362657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:56.363187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:56.363639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:56.364379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:56.364849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:56.365286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:57.054208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd23af965b147248c5f8c7b9098fc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e916618c504ec2b23064c883ba7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:57.075330 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9fc58900-de80-43cb-b997-4d02224bbd33 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 200 len: 1526 microversion: 2.1 time: 0.731410 Oct 01 21:00:57.076732 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1446/2716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:56 2022] GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 1526 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:57.085870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:57.087285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:57.095724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:57.096361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:57.097878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:57.098687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:57.099538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:57.100457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:57.688913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:57.714675 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e28b011c-1364-43c6-8f85-395197c4ef12 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1312 microversion: 2.1 time: 0.635997 Oct 01 21:00:57.716880 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1447/2717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:57 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1312 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:57.731665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:57.735604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:57.751982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:57.753031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:57.753862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:57.755181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:57.756005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:57.756653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:57.954453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:57.962378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:00:57.969035 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d512efe-4abe-4c82-b338-c5e93e2c2c58 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 200 len: 1466 microversion: 2.1 time: 0.249714 Oct 01 21:00:57.973159 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1448/2718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:57 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 1466 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:57.978379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:57.995702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:58.019722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:58.023311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:58.024352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:58.039672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:58.052676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:58.056116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:58.324115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:58.357666 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-654d478f-ff3a-4327-8d86-e1d2e37d22af tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1318 microversion: 2.1 time: 0.383078 Oct 01 21:00:58.362722 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1449/2719] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:57 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:58.369576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:58.375372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:58.392396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:58.393215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:58.393939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:58.395218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:58.395914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:58.396570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:58.683110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:58.708853 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-939871fc-dc75-477b-9305-e4daa732af2f tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1516 microversion: 2.1 time: 0.343037 Oct 01 21:00:58.711130 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1450/2720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:58 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1516 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:58.733011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-303dd6e7-de4f-4894-bccb-d6d2d8c67d82 req-8d0b819b-d11d-4841-b605-0a354873c110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9b3856-21ac-48d1-bd95-e610b11f7280", "tag": "b81ec050-cf8b-44df-9c94-bb394da5e2b4"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:58.754556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-303dd6e7-de4f-4894-bccb-d6d2d8c67d82 req-8d0b819b-d11d-4841-b605-0a354873c110 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:58.755031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-303dd6e7-de4f-4894-bccb-d6d2d8c67d82 req-8d0b819b-d11d-4841-b605-0a354873c110 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:58.755894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-303dd6e7-de4f-4894-bccb-d6d2d8c67d82 req-8d0b819b-d11d-4841-b605-0a354873c110 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:58.797627 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-303dd6e7-de4f-4894-bccb-d6d2d8c67d82 req-8d0b819b-d11d-4841-b605-0a354873c110 service nova] Creating event network-changed:b81ec050-cf8b-44df-9c94-bb394da5e2b4 for instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 on nch2-master-1 Oct 01 21:00:58.848390 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-303dd6e7-de4f-4894-bccb-d6d2d8c67d82 req-8d0b819b-d11d-4841-b605-0a354873c110 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132598 Oct 01 21:00:58.853037 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1451/2721] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:58.876003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:58.878007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:58.894165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:58.894724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:58.900875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:58.901962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:58.903971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:58.904663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:59.031693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:59.032963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:59.033703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:59.034424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lazy-loading 'fault' on Instance uuid fd87ee65-e260-4911-a7f3-13869a562abf {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:00:59.480280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd23af965b147248c5f8c7b9098fc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e916618c504ec2b23064c883ba7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:59.488904 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c70c079f-307d-411e-aad3-8bd64fc030c6 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 200 len: 1314 microversion: 2.1 time: 0.632150 Oct 01 21:00:59.507501 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1452/2722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:58 2022] GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:59.512246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-667e9f13-c3bd-4eb9-8d25-6a06caa6a2b2 req-e0c82311-8c96-44e1-97c2-e43515498e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd87ee65-e260-4911-a7f3-13869a562abf", "name": "network-vif-deleted", "tag": "9035a175-f098-4b76-b137-43d2d3997dd2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:00:59.523366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-667e9f13-c3bd-4eb9-8d25-6a06caa6a2b2 req-e0c82311-8c96-44e1-97c2-e43515498e4b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:59.535745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-667e9f13-c3bd-4eb9-8d25-6a06caa6a2b2 req-e0c82311-8c96-44e1-97c2-e43515498e4b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:59.535745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-667e9f13-c3bd-4eb9-8d25-6a06caa6a2b2 req-e0c82311-8c96-44e1-97c2-e43515498e4b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:59.557064 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-667e9f13-c3bd-4eb9-8d25-6a06caa6a2b2 req-e0c82311-8c96-44e1-97c2-e43515498e4b service nova] Creating event network-vif-deleted:9035a175-f098-4b76-b137-43d2d3997dd2 for instance fd87ee65-e260-4911-a7f3-13869a562abf on nch2-master-1 Oct 01 21:00:59.565663 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-667e9f13-c3bd-4eb9-8d25-6a06caa6a2b2 req-e0c82311-8c96-44e1-97c2-e43515498e4b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057443 Oct 01 21:00:59.569349 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1453/2723] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:00:59.576986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:59.578382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:00:59.589256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:59.590123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:59.590871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:59.592493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:00:59.600885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:00:59.602149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:00:59.958028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:00:59.973608 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62e2957d-b570-41a8-81da-419f950ee18b tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1333 microversion: 2.1 time: 0.402569 Oct 01 21:00:59.974913 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1454/2724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:59 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1333 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:00:59.991241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:00:59.992247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:00.002053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.007788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.009706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.011470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.014352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.014975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.045594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee HTTP/1.1 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a0dd6bea-3abb-4f96-8959-84a72945a1ee'} Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.052337 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:00.057478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:00.057478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:00.057478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:00.057478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:00.057478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:01:00.057478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.058715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:00.060884 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aa3f524b-37c5-4654-8488-9d70d054611f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 404 len: 111 microversion: 2.1 time: 0.082880 Oct 01 21:01:00.064587 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1455/2725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:00:59 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:00.076720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:00.079492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:00.084452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:00.090595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.091727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.092438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.093669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.094428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.095100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.330471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:00.340238 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e727de7e-c275-4745-95fd-1514b1f1a871 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1318 microversion: 2.1 time: 0.273543 Oct 01 21:01:00.358242 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1456/2726] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:00 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:00.366003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ffd96a96-f6b9-4eac-89a3-7ca12236cf5c req-65b1b0aa-265b-423c-b44d-a5bcd45002ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f9298f-3dd7-4e39-8df7-05b36a378034", "name": "network-vif-plugged", "status": "completed", "tag": "25659597-3a4b-49f1-b911-398d9560adaa"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:00.380002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ffd96a96-f6b9-4eac-89a3-7ca12236cf5c req-65b1b0aa-265b-423c-b44d-a5bcd45002ca service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.380852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ffd96a96-f6b9-4eac-89a3-7ca12236cf5c req-65b1b0aa-265b-423c-b44d-a5bcd45002ca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.381554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ffd96a96-f6b9-4eac-89a3-7ca12236cf5c req-65b1b0aa-265b-423c-b44d-a5bcd45002ca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.400686 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ffd96a96-f6b9-4eac-89a3-7ca12236cf5c req-65b1b0aa-265b-423c-b44d-a5bcd45002ca service nova] Creating event network-vif-plugged:25659597-3a4b-49f1-b911-398d9560adaa for instance 67f9298f-3dd7-4e39-8df7-05b36a378034 on nch1-master-1 Oct 01 21:01:00.408321 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ffd96a96-f6b9-4eac-89a3-7ca12236cf5c req-65b1b0aa-265b-423c-b44d-a5bcd45002ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047690 Oct 01 21:01:00.410304 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1457/2727] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:00.420978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:00.422289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:00.431223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.432215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.433727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.435581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.436395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.437311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.800521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:00.811892 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aa44ac18-28e5-4394-83c4-7e777cf05fc7 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1516 microversion: 2.1 time: 0.399580 Oct 01 21:01:00.812780 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1458/2728] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:00 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1516 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:00.819574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5f957966-a5d7-472c-966a-7485d6e78a7c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'create', calling method: .version_select at 0x7f41736f38b0>, body: {"keypair": {"name": "tempest-key-223602886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+J/cGcqWBTP5CMHbDc6xcWx7ok9xEKlAjRRoeBzQxvmNouZZ6Ixapu0e2m+ArGdjHBZgtaVwDhf9U2vXPdU4l7AFwDAbO7voSqmbO3u+TQBgdaTeTADQPa1dBd1Y13Cw=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:00.837328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-5f957966-a5d7-472c-966a-7485d6e78a7c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:01:00.845401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-5f957966-a5d7-472c-966a-7485d6e78a7c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for user 775ff9091a794faaacc05a37550c8a72 and project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:01:00.878997 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5f957966-a5d7-472c-966a-7485d6e78a7c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.063468 Oct 01 21:01:00.880049 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1459/2729] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:01:00 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:00.884710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:00.886312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] [instance: fd87ee65-e260-4911-a7f3-13869a562abf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:00.893798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.894661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.895299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.896022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.896659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.897101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.912565 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] HTTP exception thrown: Instance fd87ee65-e260-4911-a7f3-13869a562abf could not be found. Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Request method failure captured: Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf HTTP/1.1 Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKpohxPx47fmpfAO8A7aC169HG61XmIX93hcYJPzBkvIB7L7GReUuUyLqiLIlWajUNbUwHfjJcFPTawbyjElff01-0HWeHPuimvjNewzn0A-1LfJqzkAukQpsBYu6yhTa5TyVcKPkgcAX0hmYWuxGP2roBjL_KK6K8rZ3kJcCy4wQcM Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9e916618c504ec2b23064c883ba7d56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9e916618c504ec2b23064c883ba7d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9e916618c504ec2b23064c883ba7d56"}]}] Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b9e916618c504ec2b23064c883ba7d56 Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1917761583 Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 7cd23af965b147248c5f8c7b9098fc3d Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1917761583-project Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance fd87ee65-e260-4911-a7f3-13869a562abf could not be found. Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'fd87ee65-e260-4911-a7f3-13869a562abf'} Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd87ee65-e260-4911-a7f3-13869a562abf could not be found. Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd87ee65-e260-4911-a7f3-13869a562abf could not be found. Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.915980 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:00.921142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.921142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:00.921142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:00.921142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:00.921142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:00.921142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:00.921142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd87ee65-e260-4911-a7f3-13869a562abf could not be found. Oct 01 21:01:00.921142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:00.924388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] Returning 404 to user: Instance fd87ee65-e260-4911-a7f3-13869a562abf could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:00.925718 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6e8d851-f4c6-4846-b044-4232d8f553a8 tempest-ServerMetadataNegativeTestJSON-1917761583 tempest-ServerMetadataNegativeTestJSON-1917761583-project] 10.222.0.17 "GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf" status: 404 len: 111 microversion: 2.1 time: 0.044387 Oct 01 21:01:00.926938 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1460/2730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:00 2022] GET /compute/v2.1/servers/fd87ee65-e260-4911-a7f3-13869a562abf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:00.936668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-45b3f9ff-787d-4fea-9a49-fceceeb912d2 req-2d0607ab-af36-4b0a-a501-82625fa10732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dd6bea-3abb-4f96-8959-84a72945a1ee", "name": "network-vif-deleted", "tag": "b1593f3a-ed0c-471b-a6c0-57c1949e7fe8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:00.951547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-45b3f9ff-787d-4fea-9a49-fceceeb912d2 req-2d0607ab-af36-4b0a-a501-82625fa10732 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:00.954183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-45b3f9ff-787d-4fea-9a49-fceceeb912d2 req-2d0607ab-af36-4b0a-a501-82625fa10732 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:00.954701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-45b3f9ff-787d-4fea-9a49-fceceeb912d2 req-2d0607ab-af36-4b0a-a501-82625fa10732 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:00.969760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-45b3f9ff-787d-4fea-9a49-fceceeb912d2 req-2d0607ab-af36-4b0a-a501-82625fa10732 service nova] Creating event network-vif-deleted:b1593f3a-ed0c-471b-a6c0-57c1949e7fe8 for instance a0dd6bea-3abb-4f96-8959-84a72945a1ee on nch1-master-1 Oct 01 21:01:00.975263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-45b3f9ff-787d-4fea-9a49-fceceeb912d2 req-2d0607ab-af36-4b0a-a501-82625fa10732 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046773 Oct 01 21:01:00.976300 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1461/2731] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:00.981896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0994c94e-268c-4f09-93f9-e70e206f7a08 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '.version_select at 0x7f4173a22a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:00.986094 ncdv-master-1 devstack@n-api.service[140438]: WARNING oslo_db.sqlalchemy.utils [None req-0994c94e-268c-4f09-93f9-e70e206f7a08 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 01 21:01:00.992783 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0994c94e-268c-4f09-93f9-e70e206f7a08 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.015220 Oct 01 21:01:01.002527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1462/2732] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 21:01:00 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:01.006442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:01.007379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:01.015259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:01.015772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:01.016223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:01.016951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:01.017422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:01.017859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:01.297202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:01.305840 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bef4efd6-0d10-4fce-998a-1213d3888a08 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1333 microversion: 2.1 time: 0.307933 Oct 01 21:01:01.319103 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1463/2733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:00 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1333 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:01.329452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-357806803", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "key_name": "tempest-key-223602886", "networks": [{"uuid": "9417f59c-8d13-4179-a6ee-0176ac73cf1c"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:01.396944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] validate_networks() for [('9417f59c-8d13-4179-a6ee-0176ac73cf1c', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:01:02.268909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:01:02.270060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:01:02.272082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:01:02.274098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:01:02.274788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:01:02.286704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:02.287906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:02.288585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:02.289667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:02.290799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:02.292835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:02.324629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:01:02.340724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for user 775ff9091a794faaacc05a37550c8a72 and project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:01:02.361329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:01:02.365025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:01:02.420715 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d6f29bb-2948-4fac-9356-969708984d40 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100329 Oct 01 21:01:02.421540 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1464/2734] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:01:02.426557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:02.427647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:02.435543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:02.436373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:02.437036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:02.437985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:02.442835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:02.443395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:02.747788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:02.762383 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-225badc8-331d-4270-b26d-53483a3dfcdb tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1507 microversion: 2.1 time: 0.337725 Oct 01 21:01:02.777053 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1465/2735] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:02 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:02.788209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:02.789049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:02.799966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:02.802137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:02.804290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:02.807219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:02.808988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:02.810343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:03.452545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:03.466817 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75b1e483-14dc-4889-9819-2499363f1078 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1516 microversion: 2.1 time: 0.683872 Oct 01 21:01:03.468786 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1466/2736] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:02 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1516 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:03.479854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c0ad2a81-ce99-4a00-8b12-25e18117eb38 req-b7de1a9b-f688-480e-a652-e24f7b97344c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0573f649-4c81-4de9-9e9f-1652427fdc78", "tag": "639245c3-5c84-4b1d-9ce5-c58e18538a2f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:03.507251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c0ad2a81-ce99-4a00-8b12-25e18117eb38 req-b7de1a9b-f688-480e-a652-e24f7b97344c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:03.507903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c0ad2a81-ce99-4a00-8b12-25e18117eb38 req-b7de1a9b-f688-480e-a652-e24f7b97344c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:03.508472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c0ad2a81-ce99-4a00-8b12-25e18117eb38 req-b7de1a9b-f688-480e-a652-e24f7b97344c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:03.537457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c0ad2a81-ce99-4a00-8b12-25e18117eb38 req-b7de1a9b-f688-480e-a652-e24f7b97344c service nova] Creating event network-changed:639245c3-5c84-4b1d-9ce5-c58e18538a2f for instance 0573f649-4c81-4de9-9e9f-1652427fdc78 on nch2-master-1 Oct 01 21:01:03.548123 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c0ad2a81-ce99-4a00-8b12-25e18117eb38 req-b7de1a9b-f688-480e-a652-e24f7b97344c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077659 Oct 01 21:01:03.550220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1467/2737] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:03.573290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:03.574413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:03.582446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:03.583225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:03.583922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:03.585030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:03.585713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:03.586365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:03.914940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:03.924748 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c816af9-fa5a-4751-8d28-b68b0faeb1ab tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1333 microversion: 2.1 time: 0.373174 Oct 01 21:01:03.925766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1468/2738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:03 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1333 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:03.931588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:03.933275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:03.940470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:03.941197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:03.942622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:03.943562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:03.944252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:03.944917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:04.061570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:04.077914 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e1c40c7-bef0-41f0-8f24-e31f78a6ce3f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1279 microversion: 2.1 time: 0.150821 Oct 01 21:01:04.078550 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1469/2739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:03 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:04.415574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a7eac5bb-18dd-4a33-831a-6a51ec4fd4c8"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:04.419023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:04.437920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:04.438935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:04.439963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:04.442868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:04.444782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:04.446067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:04.548057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] HTTP exception thrown: Volume 7c606a38-7522-4b87-aecf-5018b3aa7829 could not be found. Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Request method failure captured: Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034/os-volume_attachments/7c606a38-7522-4b87-aecf-5018b3aa7829 HTTP/1.1 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 74 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKowXTpYtq81zRNrfRvZ0ZV2H7zoBJEzKpUDPCTAJ9uUIij0DuujmsWUBXS7yUzAjAyNcHTP-r3xTDchvo9P5ntuv0tkGncwb7RGi1oslM6RSDpUomQSVmw7WGxBnDBhj__PWASade2VvspwOWEu1OdMTSCONSQsIOGPwnizkeFwCs0 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 29689e74f89d4e7b9b48d5872770ccb9 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesAdminNegativeTest-659661032 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_29689e74f89d4e7b9b48d5872770ccb9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29689e74f89d4e7b9b48d5872770ccb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/29689e74f89d4e7b9b48d5872770ccb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/29689e74f89d4e7b9b48d5872770ccb9"}]}] Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesAdminNegativeTest-659661032 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 29689e74f89d4e7b9b48d5872770ccb9 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-659661032 Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesAdminNegativeTest-659661032-project-admin Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: b7334bfa53c0483e8f5d15c550e0db5a Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesAdminNegativeTest-659661032-project-admin Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: {"volumeAttachment": {"volumeId": "a7eac5bb-18dd-4a33-831a-6a51ec4fd4c8"}} Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: exception: Volume 7c606a38-7522-4b87-aecf-5018b3aa7829 could not be found. Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': '67f9298f-3dd7-4e39-8df7-05b36a378034', 'id': '7c606a38-7522-4b87-aecf-5018b3aa7829', 'body': {'volumeAttachment': {'volumeId': 'a7eac5bb-18dd-4a33-831a-6a51ec4fd4c8'}}} Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c606a38-7522-4b87-aecf-5018b3aa7829 could not be found. (HTTP 404) (Request-ID: req-77be31ee-740c-4acf-b606-62102777d67b) Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:01:04.551048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c606a38-7522-4b87-aecf-5018b3aa7829 could not be found. Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c606a38-7522-4b87-aecf-5018b3aa7829 could not be found. Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c606a38-7522-4b87-aecf-5018b3aa7829 could not be found. Oct 01 21:01:04.555475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:04.559967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] Returning 404 to user: Volume 7c606a38-7522-4b87-aecf-5018b3aa7829 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:04.561016 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2be6b235-f367-4a4f-8d76-bcff8c40a12b tempest-VolumesAdminNegativeTest-659661032 tempest-VolumesAdminNegativeTest-659661032-project-admin] 10.222.0.17 "PUT /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034/os-volume_attachments/7c606a38-7522-4b87-aecf-5018b3aa7829" status: 404 len: 109 microversion: 2.1 time: 0.150131 Oct 01 21:01:04.562114 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1470/2740] 10.222.0.17 () {60 vars in 1433 bytes} [Sat Oct 1 21:01:04 2022] PUT /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034/os-volume_attachments/7c606a38-7522-4b87-aecf-5018b3aa7829 => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:04.579626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:04.584200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:04.596482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:04.596987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:04.597430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:04.598154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:04.603435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:04.604749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:05.313079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:05.328483 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e83bf35-34cf-489e-aeb2-b2e8ccfb6849 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1522 microversion: 2.1 time: 0.764132 Oct 01 21:01:05.329318 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1471/2741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:04 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1522 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:05.345955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:05.349507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:05.363261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:05.363990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:05.364671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:05.365682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:05.366431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:05.367198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:05.705087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:05.711992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:05.721921 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f4ccc33-29e3-45b5-a939-59b77eef9ac5 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1333 microversion: 2.1 time: 0.390914 Oct 01 21:01:05.722879 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1472/2742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:05 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1333 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:05.727986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:05.729420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:05.745387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:05.746843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:05.747555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:05.748487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:05.749146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:05.750682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:05.916156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:05.925920 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6362f44a-7610-43c3-9cf0-5e30b9e7419c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1285 microversion: 2.1 time: 0.201666 Oct 01 21:01:05.927053 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1473/2743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:05 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:05.932385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-db73c45e-70f7-468b-bf74-19301a93f611 req-ffa52ab6-168e-4b1e-bb47-08dd8cfc270b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0573f649-4c81-4de9-9e9f-1652427fdc78", "tag": "36e4bd2e-1b66-4ec4-9986-2730d0b29af0"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:05.949304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-db73c45e-70f7-468b-bf74-19301a93f611 req-ffa52ab6-168e-4b1e-bb47-08dd8cfc270b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:05.951097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-db73c45e-70f7-468b-bf74-19301a93f611 req-ffa52ab6-168e-4b1e-bb47-08dd8cfc270b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:05.954173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-db73c45e-70f7-468b-bf74-19301a93f611 req-ffa52ab6-168e-4b1e-bb47-08dd8cfc270b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:05.991578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-db73c45e-70f7-468b-bf74-19301a93f611 req-ffa52ab6-168e-4b1e-bb47-08dd8cfc270b service nova] Creating event network-changed:36e4bd2e-1b66-4ec4-9986-2730d0b29af0 for instance 0573f649-4c81-4de9-9e9f-1652427fdc78 on nch2-master-1 Oct 01 21:01:06.005302 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-db73c45e-70f7-468b-bf74-19301a93f611 req-ffa52ab6-168e-4b1e-bb47-08dd8cfc270b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076663 Oct 01 21:01:06.006213 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1474/2744] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:06.012857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:06.013742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:06.021120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:06.021625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:06.022325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:06.023267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:06.023894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:06.025632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:06.079848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:01:06.274468 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-27807542-b47f-4a81-a4ca-c5f98acf2bd5 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "DELETE /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 204 len: 0 microversion: 2.1 time: 0.266002 Oct 01 21:01:06.280141 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1475/2745] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:06 2022] DELETE /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:01:06.291962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:06.293051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:06.301810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:06.302598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:06.303281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:06.305518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:06.306259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:06.306955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:06.508808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:06.519696 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-313f7a83-192d-46e7-8557-b0206023b8ec tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1513 microversion: 2.1 time: 0.234263 Oct 01 21:01:06.521108 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1476/2746] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:06 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:06.526848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:06.528216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:06.535706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:06.536520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:06.537188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:06.537889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:06.538359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:06.538830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:06.772359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:06.787196 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48b1d01a-376d-4532-a4a8-9cfb88383fe5 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1522 microversion: 2.1 time: 0.264826 Oct 01 21:01:06.798747 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1477/2747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:06 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:06.798747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:06.798747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:06.802750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:06.803915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:06.804564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:06.805930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:06.806641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:06.808041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:06.976240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:06.985831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad094922-7ec0-496f-97a1-0755e0c91b62 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1333 microversion: 2.1 time: 0.195774 Oct 01 21:01:06.986733 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1478/2748] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:06 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1333 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:07.176764 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-12536861-3714-4d9f-a270-5233d24c0fed tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] 10.222.0.17 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.188689 Oct 01 21:01:07.178056 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1479/2749] 10.222.0.17 () {58 vars in 1128 bytes} [Sat Oct 1 21:01:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 01 21:01:07.186670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:07.188391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:07.195854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:07.196504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:07.206419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:07.209107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:07.209835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:07.210690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:07.480630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:07.490710 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fb722024-b3ca-47e3-bbed-bdedc3112e56 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1327 microversion: 2.1 time: 0.311252 Oct 01 21:01:07.496137 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1480/2750] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:07 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1327 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:07.513511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b00f1217-0581-40b5-821b-297e814d02f8 req-51da44e1-b280-4f57-9889-f5cbb9a02921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1431fcc7-a23c-42aa-b324-44adc7bb8a68", "name": "network-vif-plugged", "status": "completed", "tag": "917511ad-abce-4ae4-ba7b-d32b38483fb1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:07.529045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b00f1217-0581-40b5-821b-297e814d02f8 req-51da44e1-b280-4f57-9889-f5cbb9a02921 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:07.529800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b00f1217-0581-40b5-821b-297e814d02f8 req-51da44e1-b280-4f57-9889-f5cbb9a02921 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:07.530402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b00f1217-0581-40b5-821b-297e814d02f8 req-51da44e1-b280-4f57-9889-f5cbb9a02921 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:07.550097 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b00f1217-0581-40b5-821b-297e814d02f8 req-51da44e1-b280-4f57-9889-f5cbb9a02921 service nova] Creating event network-vif-plugged:917511ad-abce-4ae4-ba7b-d32b38483fb1 for instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 on nch2-master-1 Oct 01 21:01:07.556210 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b00f1217-0581-40b5-821b-297e814d02f8 req-51da44e1-b280-4f57-9889-f5cbb9a02921 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058204 Oct 01 21:01:07.558664 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1481/2751] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:07.564708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-079278c9-89f3-46b5-b706-0c63892c3bee tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Calling method '.version_select at 0x7f4173ac2af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:07.643085 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-079278c9-89f3-46b5-b706-0c63892c3bee tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] HTTP exception thrown: Image not found. Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-079278c9-89f3-46b5-b706-0c63892c3bee tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Request method failure captured: Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqSAKfNPRyXbmqa98rJJX8_fabvV5VG0yY6gWOT1kJe7QfXuOSbuRwMfgdeJlwlofdf3ZK85IOf6M3jgiUBsA22OzS7gq3DrJCnSQwRxTn_lVqNhb02o8AjqygDc7nekBUTZtZ10sFFnbD-crFfqoHO2GKakMi_XCMLx8W70RNrjvE Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_497873f728f34c20aaa348bec348ed4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}] Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0bf5b69507cd4ca884e355454f49d5e1 Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '-1'} Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:07.647484 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-079278c9-89f3-46b5-b706-0c63892c3bee tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-079278c9-89f3-46b5-b706-0c63892c3bee tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] 10.222.0.17 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.089373 Oct 01 21:01:07.658732 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1482/2752] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Oct 1 21:01:07 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:01:07.677241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:07.678370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:07.690785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:07.691309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:07.697382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:07.699901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:07.699901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:07.700355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:08.166587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:08.177988 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-254ad98f-1059-46a8-bc23-b996ae02907c tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1513 microversion: 2.1 time: 0.517556 Oct 01 21:01:08.178737 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1483/2753] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:07 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1513 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:08.184243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec00b021-cd10-4c6e-84da-6a7fb6b56b81 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Calling method '.version_select at 0x7f417c2b3f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:08.231047 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ec00b021-cd10-4c6e-84da-6a7fb6b56b81 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] HTTP exception thrown: Image not found. Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec00b021-cd10-4c6e-84da-6a7fb6b56b81 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Request method failure captured: Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/images/0389a9f5-ae24-43d8-be19-9141213ddfaj HTTP/1.1 Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqSAKfNPRyXbmqa98rJJX8_fabvV5VG0yY6gWOT1kJe7QfXuOSbuRwMfgdeJlwlofdf3ZK85IOf6M3jgiUBsA22OzS7gq3DrJCnSQwRxTn_lVqNhb02o8AjqygDc7nekBUTZtZ10sFFnbD-crFfqoHO2GKakMi_XCMLx8W70RNrjvE Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_497873f728f34c20aaa348bec348ed4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}] Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0bf5b69507cd4ca884e355454f49d5e1 Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0389a9f5-ae24-43d8-be19-9141213ddfaj'} Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0389a9f5-ae24-43d8-be19-9141213ddfaj to delete Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0389a9f5-ae24-43d8-be19-9141213ddfaj could not be found. Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:08.233100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 21:01:08.237009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:08.240070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec00b021-cd10-4c6e-84da-6a7fb6b56b81 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:08.241177 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec00b021-cd10-4c6e-84da-6a7fb6b56b81 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] 10.222.0.17 "DELETE /compute/v2.1/images/0389a9f5-ae24-43d8-be19-9141213ddfaj" status: 404 len: 62 microversion: 2.1 time: 0.061408 Oct 01 21:01:08.242620 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1484/2754] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:08 2022] DELETE /compute/v2.1/images/0389a9f5-ae24-43d8-be19-9141213ddfaj => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:01:08.251742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:08.252657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:08.263220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:08.264125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:08.265049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:08.266116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:08.267040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:08.267692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:08.586672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:08.597363 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9e546c5a-81e0-4789-b96e-d6bcd73aa4de tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1522 microversion: 2.1 time: 0.352572 Oct 01 21:01:08.598479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1485/2755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:08 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:08.607175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:08.608074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:08.617056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:08.617787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:08.618399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:08.620529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:08.621760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:08.622461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:09.054438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:09.075430 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d70ddc70-098e-4dbf-b898-126f7fe9b978 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1333 microversion: 2.1 time: 0.473348 Oct 01 21:01:09.091491 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1486/2756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:08 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1333 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:09.110429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88f1cad5-2b32-4236-9102-8319281de3c3 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Calling method '.version_select at 0x7f417c12ed30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:09.141190 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-88f1cad5-2b32-4236-9102-8319281de3c3 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] HTTP exception thrown: Image not found. Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88f1cad5-2b32-4236-9102-8319281de3c3 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Request method failure captured: Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/images/9f487cc3-34d0-4690-a696-c89e6d660b8c1 HTTP/1.1 Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqSAKfNPRyXbmqa98rJJX8_fabvV5VG0yY6gWOT1kJe7QfXuOSbuRwMfgdeJlwlofdf3ZK85IOf6M3jgiUBsA22OzS7gq3DrJCnSQwRxTn_lVqNhb02o8AjqygDc7nekBUTZtZ10sFFnbD-crFfqoHO2GKakMi_XCMLx8W70RNrjvE Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_497873f728f34c20aaa348bec348ed4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}] Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0bf5b69507cd4ca884e355454f49d5e1 Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '9f487cc3-34d0-4690-a696-c89e6d660b8c1'} Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9f487cc3-34d0-4690-a696-c89e6d660b8c1 to delete Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f487cc3-34d0-4690-a696-c89e6d660b8c1 could not be found. Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:09.143539 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88f1cad5-2b32-4236-9102-8319281de3c3 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88f1cad5-2b32-4236-9102-8319281de3c3 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] 10.222.0.17 "DELETE /compute/v2.1/images/9f487cc3-34d0-4690-a696-c89e6d660b8c1" status: 404 len: 62 microversion: 2.1 time: 0.052217 Oct 01 21:01:09.147451 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1487/2757] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:09 2022] DELETE /compute/v2.1/images/9f487cc3-34d0-4690-a696-c89e6d660b8c1 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:01:09.160567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:09.162752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:09.184277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:09.184958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:09.187984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:09.188764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:09.190614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:09.192410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:09.433178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:09.444456 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62a7d973-5fe2-4b1b-8399-f28b3a2b8910 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1327 microversion: 2.1 time: 0.297860 Oct 01 21:01:09.445431 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1488/2758] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:09 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1327 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:09.465261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5a523dca-2143-463e-b2a6-7d3db94d6bc0 req-4f1ae626-447b-4463-8cb4-c953bfe03a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f9298f-3dd7-4e39-8df7-05b36a378034", "name": "network-vif-deleted", "tag": "25659597-3a4b-49f1-b911-398d9560adaa"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:09.476438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a523dca-2143-463e-b2a6-7d3db94d6bc0 req-4f1ae626-447b-4463-8cb4-c953bfe03a2b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:09.477161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a523dca-2143-463e-b2a6-7d3db94d6bc0 req-4f1ae626-447b-4463-8cb4-c953bfe03a2b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:09.477757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a523dca-2143-463e-b2a6-7d3db94d6bc0 req-4f1ae626-447b-4463-8cb4-c953bfe03a2b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:09.490648 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5a523dca-2143-463e-b2a6-7d3db94d6bc0 req-4f1ae626-447b-4463-8cb4-c953bfe03a2b service nova] Creating event network-vif-deleted:25659597-3a4b-49f1-b911-398d9560adaa for instance 67f9298f-3dd7-4e39-8df7-05b36a378034 on nch1-master-1 Oct 01 21:01:09.497992 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5a523dca-2143-463e-b2a6-7d3db94d6bc0 req-4f1ae626-447b-4463-8cb4-c953bfe03a2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036427 Oct 01 21:01:09.498626 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1489/2759] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:09.506435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6792ce6-86d9-4166-b955-96e2b2e5f315 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Calling method '.version_select at 0x7f417c1ebee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:09.529636 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d6792ce6-86d9-4166-b955-96e2b2e5f315 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] HTTP exception thrown: Image not found. Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6792ce6-86d9-4166-b955-96e2b2e5f315 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Request method failure captured: Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/images/tempest-invalid-511327986 HTTP/1.1 Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqSAKfNPRyXbmqa98rJJX8_fabvV5VG0yY6gWOT1kJe7QfXuOSbuRwMfgdeJlwlofdf3ZK85IOf6M3jgiUBsA22OzS7gq3DrJCnSQwRxTn_lVqNhb02o8AjqygDc7nekBUTZtZ10sFFnbD-crFfqoHO2GKakMi_XCMLx8W70RNrjvE Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_497873f728f34c20aaa348bec348ed4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}] Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0bf5b69507cd4ca884e355454f49d5e1 Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'tempest-invalid-511327986'} Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-511327986 to delete Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-511327986 could not be found. Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.532138 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6792ce6-86d9-4166-b955-96e2b2e5f315 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:09.536345 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d6792ce6-86d9-4166-b955-96e2b2e5f315 tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] 10.222.0.17 "DELETE /compute/v2.1/images/tempest-invalid-511327986" status: 404 len: 62 microversion: 2.1 time: 0.033524 Oct 01 21:01:09.538980 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1490/2760] 10.222.0.17 () {58 vars in 1203 bytes} [Sat Oct 1 21:01:09 2022] DELETE /compute/v2.1/images/tempest-invalid-511327986 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:01:09.559154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:09.563937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:09.577307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:09.578861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:09.579534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:09.580505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:09.581929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:09.582782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:09.656770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:09.657761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:09.658235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:09.658750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lazy-loading 'fault' on Instance uuid 67f9298f-3dd7-4e39-8df7-05b36a378034 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:01:09.785871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:09.795034 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29f6c22e-e27f-496c-a7b7-098a88862241 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 200 len: 1308 microversion: 2.1 time: 0.240529 Oct 01 21:01:09.811826 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1491/2761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:09 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:09.820613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d219c348-6fe6-4221-b30a-9937ddc7468b tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Calling method '.version_select at 0x7f417c1db8b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:09.847252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d219c348-6fe6-4221-b30a-9937ddc7468b tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] HTTP exception thrown: Image not found. Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d219c348-6fe6-4221-b30a-9937ddc7468b tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Request method failure captured: Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/images/9dc9196c-419d-4244-9bf9-6331fc3be4bd HTTP/1.1 Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqSAKfNPRyXbmqa98rJJX8_fabvV5VG0yY6gWOT1kJe7QfXuOSbuRwMfgdeJlwlofdf3ZK85IOf6M3jgiUBsA22OzS7gq3DrJCnSQwRxTn_lVqNhb02o8AjqygDc7nekBUTZtZ10sFFnbD-crFfqoHO2GKakMi_XCMLx8W70RNrjvE Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_497873f728f34c20aaa348bec348ed4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/497873f728f34c20aaa348bec348ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/497873f728f34c20aaa348bec348ed4f"}]}] Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 497873f728f34c20aaa348bec348ed4f Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-347846380 Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 0bf5b69507cd4ca884e355454f49d5e1 Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-347846380-project Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '9dc9196c-419d-4244-9bf9-6331fc3be4bd'} Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9dc9196c-419d-4244-9bf9-6331fc3be4bd to delete Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9dc9196c-419d-4244-9bf9-6331fc3be4bd could not be found. Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:09.849805 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:09.855314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d219c348-6fe6-4221-b30a-9937ddc7468b tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:09.858166 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d219c348-6fe6-4221-b30a-9937ddc7468b tempest-ImagesDeleteNegativeTestJSON-347846380 tempest-ImagesDeleteNegativeTestJSON-347846380-project] 10.222.0.17 "DELETE /compute/v2.1/images/9dc9196c-419d-4244-9bf9-6331fc3be4bd" status: 404 len: 62 microversion: 2.1 time: 0.044614 Oct 01 21:01:09.862953 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1492/2762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:09 2022] DELETE /compute/v2.1/images/9dc9196c-419d-4244-9bf9-6331fc3be4bd => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:01:09.870607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-efabb931-4137-42b4-8990-44c2ebb0b7e5 req-7d98075f-686a-40ba-a9c1-fa99942071ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0573f649-4c81-4de9-9e9f-1652427fdc78", "name": "network-vif-plugged", "status": "completed", "tag": "36e4bd2e-1b66-4ec4-9986-2730d0b29af0"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:09.887376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-efabb931-4137-42b4-8990-44c2ebb0b7e5 req-7d98075f-686a-40ba-a9c1-fa99942071ea service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:09.889698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-efabb931-4137-42b4-8990-44c2ebb0b7e5 req-7d98075f-686a-40ba-a9c1-fa99942071ea service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:09.890557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-efabb931-4137-42b4-8990-44c2ebb0b7e5 req-7d98075f-686a-40ba-a9c1-fa99942071ea service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:09.910010 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-efabb931-4137-42b4-8990-44c2ebb0b7e5 req-7d98075f-686a-40ba-a9c1-fa99942071ea service nova] Creating event network-vif-plugged:36e4bd2e-1b66-4ec4-9986-2730d0b29af0 for instance 0573f649-4c81-4de9-9e9f-1652427fdc78 on nch2-master-1 Oct 01 21:01:09.919543 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-efabb931-4137-42b4-8990-44c2ebb0b7e5 req-7d98075f-686a-40ba-a9c1-fa99942071ea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054380 Oct 01 21:01:09.921497 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1493/2763] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:09.931195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:09.933205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:09.975063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:09.978110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:09.979713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:09.982259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:09.983618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:09.985533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:10.539200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:10.556430 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02e6b41e-40c3-4f9b-9788-999c059b2c89 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1507 microversion: 2.1 time: 0.633003 Oct 01 21:01:10.579639 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1494/2764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:09 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1507 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:10.587323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:10.588024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:10.591747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:10.596235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:10.596986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:10.597771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:10.598779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:10.599516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:10.600185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:10.875025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:10.894007 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc2f298d-67fb-4fc4-876d-e905828875c2 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1333 microversion: 2.1 time: 0.313165 Oct 01 21:01:10.895810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1495/2765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:10 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1333 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:10.904538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:10.905194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:10.927136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:10.927761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:10.928321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:10.929180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:10.929756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:10.930298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:10.944867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:11.192035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:11.200673 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-39f945dd-f45a-4832-9268-e24a0ec01f20 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1327 microversion: 2.1 time: 0.304353 Oct 01 21:01:11.201589 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1496/2766] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:10 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1327 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:11.206607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:11.207271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:11.213606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:11.213967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:11.214537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:11.215383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:11.215896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:11.216407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:11.478880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:11.489022 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-41eb272e-e8b8-45d4-b5ad-1c5d2cd35048 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 200 len: 1507 microversion: 2.1 time: 0.285997 Oct 01 21:01:11.490263 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1497/2767] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:11 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:11.497390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:11.498436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 67f9298f-3dd7-4e39-8df7-05b36a378034] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:11.506103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:11.507483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:11.508014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:11.509185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:11.510637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:11.511371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:11.528160 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] HTTP exception thrown: Instance 67f9298f-3dd7-4e39-8df7-05b36a378034 could not be found. Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Request method failure captured: Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 HTTP/1.1 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKojmsi8hI5_m9NEduYgzMK5lz5aY4-jIObRh2Qx2edwLSpQzi3WCvnOmrCm7oPKrQLcCPpHRwhngN22asFTvc1D5dufdAjDg6fsTiWFEqrN_tEqXwRBNw5YBtetQxNSFqZHHbOQiESZJAUOTrssZh_zKI70Yid6Qxc1De7WZ6Hequ0 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d27e9cda0a6d47d4acdbadc890b996c9 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesAdminNegativeTest-1221345461 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d27e9cda0a6d47d4acdbadc890b996c9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d27e9cda0a6d47d4acdbadc890b996c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d27e9cda0a6d47d4acdbadc890b996c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d27e9cda0a6d47d4acdbadc890b996c9"}]}] Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesAdminNegativeTest-1221345461 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d27e9cda0a6d47d4acdbadc890b996c9 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1221345461 Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesAdminNegativeTest-1221345461-project Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 69002d46d4e54eadadf911ec3589d95c Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesAdminNegativeTest-1221345461-project Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 67f9298f-3dd7-4e39-8df7-05b36a378034 could not be found. Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '67f9298f-3dd7-4e39-8df7-05b36a378034'} Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f9298f-3dd7-4e39-8df7-05b36a378034 could not be found. Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f9298f-3dd7-4e39-8df7-05b36a378034 could not be found. Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:11.530356 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:11.534930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:11.534930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:11.534930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:11.534930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:11.534930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:11.534930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f9298f-3dd7-4e39-8df7-05b36a378034 could not be found. Oct 01 21:01:11.534930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:11.536956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Returning 404 to user: Instance 67f9298f-3dd7-4e39-8df7-05b36a378034 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:11.537923 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-97717be6-bb79-44e8-838c-c0c807571cbe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034" status: 404 len: 111 microversion: 2.1 time: 0.046413 Oct 01 21:01:11.538918 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1498/2768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:11 2022] GET /compute/v2.1/servers/67f9298f-3dd7-4e39-8df7-05b36a378034 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:11.571491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:11.572198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:11.582992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:11.588251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:11.590218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:11.591417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:11.592455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:11.593871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:11.633908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:01:11.825592 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02cfc5cd-789e-4726-bea1-b15958f0cc1c tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 204 len: 0 microversion: 2.1 time: 0.284613 Oct 01 21:01:11.826427 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1499/2769] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:11 2022] DELETE /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:01:11.838353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e8094af9-d64d-4cdb-818e-33524eee7dbc req-2e4e8b64-252b-4cd0-82f8-286fb01a58aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f", "tag": "562f0599-c626-467d-9ffe-d7b89d07318c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:11.856025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e8094af9-d64d-4cdb-818e-33524eee7dbc req-2e4e8b64-252b-4cd0-82f8-286fb01a58aa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:11.856875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e8094af9-d64d-4cdb-818e-33524eee7dbc req-2e4e8b64-252b-4cd0-82f8-286fb01a58aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:11.857763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e8094af9-d64d-4cdb-818e-33524eee7dbc req-2e4e8b64-252b-4cd0-82f8-286fb01a58aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:11.874598 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e8094af9-d64d-4cdb-818e-33524eee7dbc req-2e4e8b64-252b-4cd0-82f8-286fb01a58aa service nova] Creating event network-changed:562f0599-c626-467d-9ffe-d7b89d07318c for instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f on nch1-master-1 Oct 01 21:01:11.882627 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e8094af9-d64d-4cdb-818e-33524eee7dbc req-2e4e8b64-252b-4cd0-82f8-286fb01a58aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054084 Oct 01 21:01:11.884750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1500/2770] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:11.931384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:11.934995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:11.952583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:11.954932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:11.955784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:11.957755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:11.963804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:11.965126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:12.308354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:12.353531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=21 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:12.381361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:12.412822 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d6158d6a-c58f-408d-8fdd-b0edf9f3f260 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1333 microversion: 2.1 time: 0.492830 Oct 01 21:01:12.417768 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1501/2771] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:11 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1333 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:12.434303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-da8131a4-3734-4aaf-bce4-7344a9d69555 req-ad7a8c44-172f-460e-91f8-5750c48e75a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0573f649-4c81-4de9-9e9f-1652427fdc78", "name": "network-vif-plugged", "status": "completed", "tag": "639245c3-5c84-4b1d-9ce5-c58e18538a2f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:12.461705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-da8131a4-3734-4aaf-bce4-7344a9d69555 req-ad7a8c44-172f-460e-91f8-5750c48e75a6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:12.462211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-da8131a4-3734-4aaf-bce4-7344a9d69555 req-ad7a8c44-172f-460e-91f8-5750c48e75a6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:12.462704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-da8131a4-3734-4aaf-bce4-7344a9d69555 req-ad7a8c44-172f-460e-91f8-5750c48e75a6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:12.491272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-da8131a4-3734-4aaf-bce4-7344a9d69555 req-ad7a8c44-172f-460e-91f8-5750c48e75a6 service nova] Creating event network-vif-plugged:639245c3-5c84-4b1d-9ce5-c58e18538a2f for instance 0573f649-4c81-4de9-9e9f-1652427fdc78 on nch2-master-1 Oct 01 21:01:12.506243 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-da8131a4-3734-4aaf-bce4-7344a9d69555 req-ad7a8c44-172f-460e-91f8-5750c48e75a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086843 Oct 01 21:01:12.508354 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1502/2772] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:12.534059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-782855146", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "4f939274-1e9a-43b9-bf60-e54c963a636d"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:12.621308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] validate_networks() for [('4f939274-1e9a-43b9-bf60-e54c963a636d', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:01:13.487466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:01:13.488796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:01:13.489855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:01:13.490556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:01:13.491179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:01:13.504221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:13.504891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:13.505338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:13.506087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:13.506799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:13.507239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:13.552888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Getting quotas for project 9566fa9a44f94c4ea3081a1a2e658de0. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:01:13.559971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Getting quotas for user e84a109e337d450698e630acfb49f9a5 and project 9566fa9a44f94c4ea3081a1a2e658de0. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:01:13.606537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:01:13.610234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:01:13.661832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e119fcec-1791-43a3-b1e5-a76cdf3bd2d6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.149263 Oct 01 21:01:13.662903 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1503/2773] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:01:13.669660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:13.670524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:13.678349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:13.679102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:13.680103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:13.681019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:13.681838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:13.682896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:14.050588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:14.059214 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-52e401c6-2b1c-40cd-a538-1d6121d2589a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1327 microversion: 2.1 time: 0.394729 Oct 01 21:01:14.082778 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1504/2774] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:13 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1327 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:14.089791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:14.090315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:14.114130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:14.114693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:14.115141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:14.115874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:14.116510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:14.117126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:14.173774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:01:14.343677 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3eb85c95-1c80-4e6b-9ec8-474781b6fbb4 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "DELETE /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 204 len: 0 microversion: 2.1 time: 0.258907 Oct 01 21:01:14.345403 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1505/2775] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:14 2022] DELETE /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:01:14.355961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:14.357334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:14.366278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:14.367021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:14.367756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:14.368861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:14.370278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:14.371015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:14.636327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:14.648806 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-de9a2155-a422-4190-809e-164093fd33b8 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1333 microversion: 2.1 time: 0.299472 Oct 01 21:01:14.650740 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1506/2776] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:14 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1333 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:14.660113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:14.671893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:14.682964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:14.683991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:14.684728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:14.685948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:14.686758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:14.688263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:14.795995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:14.809095 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-439b6965-940c-4033-9d88-f49fd427ee15 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1221 microversion: 2.1 time: 0.157014 Oct 01 21:01:14.811521 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1507/2777] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:14 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:14.831373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:14.843598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:14.858138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:14.860992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:14.862971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:14.863870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:14.865023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:14.866485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:15.261851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:15.273398 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-25c20dc6-7c22-48c5-ad6c-9fd25410aa9f tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1682 microversion: 2.1 time: 0.460573 Oct 01 21:01:15.275126 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1508/2778] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:14 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1682 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:15.287127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39eac2dd-4015-44b9-90d1-77d034b11f74 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41736f38b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:15.375708 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-39eac2dd-4015-44b9-90d1-77d034b11f74 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/bb484433-9d38-4f7e-928d-075d914ba8e2" status: 200 len: 662 microversion: 2.1 time: 0.095292 Oct 01 21:01:15.376735 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1509/2779] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:01:15 2022] GET /compute/v2.1/images/bb484433-9d38-4f7e-928d-075d914ba8e2 => generated 662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:15.383346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7c6fee53-de82-4ac4-bcc9-06b9175d3299 req-bb47666d-b46c-4598-b241-206cdfab77fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1431fcc7-a23c-42aa-b324-44adc7bb8a68", "name": "network-vif-deleted", "tag": "917511ad-abce-4ae4-ba7b-d32b38483fb1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:15.401861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c6fee53-de82-4ac4-bcc9-06b9175d3299 req-bb47666d-b46c-4598-b241-206cdfab77fe service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:15.406979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c6fee53-de82-4ac4-bcc9-06b9175d3299 req-bb47666d-b46c-4598-b241-206cdfab77fe service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:15.407435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c6fee53-de82-4ac4-bcc9-06b9175d3299 req-bb47666d-b46c-4598-b241-206cdfab77fe service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:15.437153 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7c6fee53-de82-4ac4-bcc9-06b9175d3299 req-bb47666d-b46c-4598-b241-206cdfab77fe service nova] Creating event network-vif-deleted:917511ad-abce-4ae4-ba7b-d32b38483fb1 for instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 on nch2-master-1 Oct 01 21:01:15.442950 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7c6fee53-de82-4ac4-bcc9-06b9175d3299 req-bb47666d-b46c-4598-b241-206cdfab77fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064971 Oct 01 21:01:15.444042 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1510/2780] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:15.450294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:15.451339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:15.458286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:15.459027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:15.460560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:15.461660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:15.463481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:15.464088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:15.655626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:15.671624 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c1f2a48-71ab-428c-bb04-766f926ba77f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1327 microversion: 2.1 time: 0.225852 Oct 01 21:01:15.675210 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1511/2781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:15 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1327 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:15.694016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a03973a3-468e-4c18-98e2-43efd7a48792 req-4498c38b-197b-4ca1-b8bf-11ceab1fbc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f", "name": "network-vif-plugged", "status": "completed", "tag": "562f0599-c626-467d-9ffe-d7b89d07318c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:15.719175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a03973a3-468e-4c18-98e2-43efd7a48792 req-4498c38b-197b-4ca1-b8bf-11ceab1fbc0c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:15.719880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a03973a3-468e-4c18-98e2-43efd7a48792 req-4498c38b-197b-4ca1-b8bf-11ceab1fbc0c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:15.720470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a03973a3-468e-4c18-98e2-43efd7a48792 req-4498c38b-197b-4ca1-b8bf-11ceab1fbc0c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:15.734458 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a03973a3-468e-4c18-98e2-43efd7a48792 req-4498c38b-197b-4ca1-b8bf-11ceab1fbc0c service nova] Creating event network-vif-plugged:562f0599-c626-467d-9ffe-d7b89d07318c for instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f on nch1-master-1 Oct 01 21:01:15.742795 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a03973a3-468e-4c18-98e2-43efd7a48792 req-4498c38b-197b-4ca1-b8bf-11ceab1fbc0c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065058 Oct 01 21:01:15.743892 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1512/2782] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:15.751193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92c66d04-b945-47b9-b59e-72360c65f580 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172ff2e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:15.826654 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92c66d04-b945-47b9-b59e-72360c65f580 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/bb484433-9d38-4f7e-928d-075d914ba8e2" status: 200 len: 662 microversion: 2.1 time: 0.079575 Oct 01 21:01:15.827431 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1513/2783] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:01:15 2022] GET /compute/v2.1/images/bb484433-9d38-4f7e-928d-075d914ba8e2 => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:15.831787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:15.832515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:15.861301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:15.862146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:15.862998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:15.864040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:15.867106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:15.868328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:16.820739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:16.830067 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-394768d2-6bdd-49a5-98df-b34281459f98 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1668 microversion: 2.1 time: 1.001758 Oct 01 21:01:16.849709 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1514/2784] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:15 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1668 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:16.855759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:16.856744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:16.864641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:16.865463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:16.866150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:16.867146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:16.867833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:16.868755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:16.891687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:17.037332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:17.057359 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3cd4d486-52fc-4d00-af04-ea96c98057fb tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1287 microversion: 2.1 time: 0.206290 Oct 01 21:01:17.064947 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1515/2785] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:16 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1287 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:17.095695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:17.099681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:17.116705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:17.120618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:17.121101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:17.121878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:17.124422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:17.125032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:17.623367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:17.640292 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5e09d599-3058-4a4b-a925-ee5e3178ec41 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1682 microversion: 2.1 time: 0.570571 Oct 01 21:01:17.641596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1516/2786] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:17 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1682 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:17.652626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:17.653559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:17.667325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:17.668180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:17.673686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:17.674736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:17.675386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:17.676023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:18.092764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:18.105252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4fd4ca2e-f699-40c8-b6be-3dc77ceb7bc0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1508 microversion: 2.1 time: 0.461110 Oct 01 21:01:18.107707 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1517/2787] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:17 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1508 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:18.120006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c57950ac-efdf-4441-ab93-88e06493281a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:18.120529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c57950ac-efdf-4441-ab93-88e06493281a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:18.138604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c57950ac-efdf-4441-ab93-88e06493281a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:18.139139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c57950ac-efdf-4441-ab93-88e06493281a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:18.139588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c57950ac-efdf-4441-ab93-88e06493281a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:18.150854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c57950ac-efdf-4441-ab93-88e06493281a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:18.151406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c57950ac-efdf-4441-ab93-88e06493281a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:18.152045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c57950ac-efdf-4441-ab93-88e06493281a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:18.200663 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c57950ac-efdf-4441-ab93-88e06493281a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78/ips" status: 200 len: 179 microversion: 2.1 time: 0.090050 Oct 01 21:01:18.201605 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1518/2788] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:01:18 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78/ips => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:18.225293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1e0d554-ca77-4b86-9fc1-c25503d3935d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417c12e3a0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:18.331210 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1e0d554-ca77-4b86-9fc1-c25503d3935d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/b4e0f82a-ba81-4680-b297-134d038f2ca2" status: 200 len: 661 microversion: 2.1 time: 0.126701 Oct 01 21:01:18.334012 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1519/2789] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:01:18 2022] GET /compute/v2.1/images/b4e0f82a-ba81-4680-b297-134d038f2ca2 => generated 661 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:18.341887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:18.345798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:18.356787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:18.357775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:18.358373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:18.359280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:18.360085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:18.360802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:18.613159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:18.644903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0350d76f-58f2-40fa-8e00-ef7066eca142 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1275 microversion: 2.1 time: 0.309486 Oct 01 21:01:18.653361 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1520/2790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:18 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1275 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:18.674110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:18.675265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:18.696116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:18.697685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:18.698346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:18.699239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:18.699826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:18.700356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:19.264548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:19.280665 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6ae18100-1d66-480a-a24b-b058ea775b9c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1508 microversion: 2.1 time: 0.612693 Oct 01 21:01:19.285442 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1521/2791] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:18 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1508 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:19.299283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:19.301801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:19.324328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:19.325274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:19.325899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:19.328210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:19.330128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:19.330801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:19.392417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:01:19.578234 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c08e1437-c2ef-4915-b2d8-b3898dc6422a tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 204 len: 0 microversion: 2.1 time: 0.290443 Oct 01 21:01:19.579244 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1522/2792] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:19 2022] DELETE /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:01:19.586074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4ec21333-36f8-4119-a116-69b77c3e3336 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172f38160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:19.683235 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4ec21333-36f8-4119-a116-69b77c3e3336 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/b4e0f82a-ba81-4680-b297-134d038f2ca2" status: 200 len: 661 microversion: 2.1 time: 0.101846 Oct 01 21:01:19.685592 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1523/2793] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:01:19 2022] GET /compute/v2.1/images/b4e0f82a-ba81-4680-b297-134d038f2ca2 => generated 661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:19.720428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:19.721364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:19.736594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:19.738420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:19.740442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:19.745232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:19.746001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:19.746751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:19.975829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69002d46d4e54eadadf911ec3589d95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27e9cda0a6d47d4acdbadc890b996c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:20.002011 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3882da55-2f77-44e9-b75b-4ad83dd1fefe tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 200 len: 1615 microversion: 2.1 time: 0.291057 Oct 01 21:01:20.003155 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1524/2794] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:19 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 1615 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:20.011295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:20.012379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:20.030192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:20.031867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:20.032916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:20.033896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:20.034585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:20.036034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:20.114075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:01:20.317605 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9dd18ad8-bed1-4796-b0ac-915c24789180 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 204 len: 0 microversion: 2.1 time: 0.312138 Oct 01 21:01:20.318705 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1525/2795] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:20 2022] DELETE /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:01:20.324378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:20.325117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:20.333418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:20.333907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:20.334362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:20.335123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:20.335614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:20.336891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:21.164130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:21.173244 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a73764aa-2698-444e-8353-32e13140198f tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1674 microversion: 2.1 time: 0.853224 Oct 01 21:01:21.191598 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1526/2796] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:20 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1674 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:21.205014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:21.208363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:21.223597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:21.227392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:21.228136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:21.230746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:21.236578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:21.237140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:21.758837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:21.776523 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-56c61787-50c1-4f62-bc97-deba9b5c895a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1317 microversion: 2.1 time: 0.579534 Oct 01 21:01:21.777528 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1527/2797] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:21 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:21.787400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4f1e64dd-f9d4-4424-bdc6-842626da4d27 req-d2bbacf6-cbb0-4ac5-a26b-8813731eec0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ab1c5d-571f-4b9e-bfaf-c03add40162d", "name": "network-vif-deleted", "tag": "9de569b7-13dc-4354-80e1-b6de7aa370dd"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:21.813439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4f1e64dd-f9d4-4424-bdc6-842626da4d27 req-d2bbacf6-cbb0-4ac5-a26b-8813731eec0f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:21.815415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4f1e64dd-f9d4-4424-bdc6-842626da4d27 req-d2bbacf6-cbb0-4ac5-a26b-8813731eec0f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:21.815980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4f1e64dd-f9d4-4424-bdc6-842626da4d27 req-d2bbacf6-cbb0-4ac5-a26b-8813731eec0f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:21.853428 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4f1e64dd-f9d4-4424-bdc6-842626da4d27 req-d2bbacf6-cbb0-4ac5-a26b-8813731eec0f service nova] Creating event network-vif-deleted:9de569b7-13dc-4354-80e1-b6de7aa370dd for instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d on nch1-master-1 Oct 01 21:01:21.860245 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4f1e64dd-f9d4-4424-bdc6-842626da4d27 req-d2bbacf6-cbb0-4ac5-a26b-8813731eec0f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081165 Oct 01 21:01:21.861571 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1528/2798] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:21.870430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:21.877872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:21.888797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:21.892928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:21.895166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:21.899457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:21.900286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:21.901031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:22.893960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:22.980308 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-659de7a8-4515-4d66-ab5f-22e827007e4c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 200 len: 1514 microversion: 2.1 time: 1.115984 Oct 01 21:01:23.003855 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1529/2799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:21 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 1514 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:23.023992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:23.024617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] [instance: 89ab1c5d-571f-4b9e-bfaf-c03add40162d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:23.027834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:23.039023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:23.043946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:23.044599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:23.045671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:23.046293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:23.049226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:23.075254 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] HTTP exception thrown: Instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d could not be found. Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Request method failure captured: Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d HTTP/1.1 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKojmsi8hI5_m9NEduYgzMK5lz5aY4-jIObRh2Qx2edwLSpQzi3WCvnOmrCm7oPKrQLcCPpHRwhngN22asFTvc1D5dufdAjDg6fsTiWFEqrN_tEqXwRBNw5YBtetQxNSFqZHHbOQiESZJAUOTrssZh_zKI70Yid6Qxc1De7WZ6Hequ0 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d27e9cda0a6d47d4acdbadc890b996c9 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesAdminNegativeTest-1221345461 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d27e9cda0a6d47d4acdbadc890b996c9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d27e9cda0a6d47d4acdbadc890b996c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d27e9cda0a6d47d4acdbadc890b996c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d27e9cda0a6d47d4acdbadc890b996c9"}]}] Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesAdminNegativeTest-1221345461 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d27e9cda0a6d47d4acdbadc890b996c9 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1221345461 Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesAdminNegativeTest-1221345461-project Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 69002d46d4e54eadadf911ec3589d95c Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesAdminNegativeTest-1221345461-project Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d could not be found. Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '89ab1c5d-571f-4b9e-bfaf-c03add40162d'} Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d could not be found. Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d could not be found. Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:23.083495 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d could not be found. Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Returning 404 to user: Instance 89ab1c5d-571f-4b9e-bfaf-c03add40162d could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3c8c8332-6076-4ad3-a872-265d42c79e34 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d" status: 404 len: 111 microversion: 2.1 time: 0.077961 Oct 01 21:01:23.089535 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1530/2800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:23 2022] GET /compute/v2.1/servers/89ab1c5d-571f-4b9e-bfaf-c03add40162d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:23.103705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbeb9e75-7c71-445b-adb1-dee8452d5a4f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417c2f7670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:23.162441 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cbeb9e75-7c71-445b-adb1-dee8452d5a4f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/9fa7f5b1-1dbd-4296-b884-1379163128fd" status: 200 len: 662 microversion: 2.1 time: 0.071919 Oct 01 21:01:23.164045 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1531/2801] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:01:23 2022] GET /compute/v2.1/images/9fa7f5b1-1dbd-4296-b884-1379163128fd => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:23.171904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:23.172738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:23.180419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:23.181109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:23.181726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:23.183029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:23.184004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:23.184678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:23.525936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ade3ba047d348a387e8e4077072b90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04cc84345d874fc69776490bea69d81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:23.528490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:23.540312 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f7f94e1-e93d-4777-9bb6-30a72fdd7959 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 200 len: 1611 microversion: 2.1 time: 0.374445 Oct 01 21:01:23.544551 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1532/2802] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:23 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 1611 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:23.559227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-822a5413-9d82-4410-a0b6-de700c225aed req-22c9811c-1c40-46b9-8fd1-9be73e07caf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0573f649-4c81-4de9-9e9f-1652427fdc78", "name": "network-vif-deleted", "tag": "36e4bd2e-1b66-4ec4-9986-2730d0b29af0"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:23.602236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-822a5413-9d82-4410-a0b6-de700c225aed req-22c9811c-1c40-46b9-8fd1-9be73e07caf0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:23.604345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-822a5413-9d82-4410-a0b6-de700c225aed req-22c9811c-1c40-46b9-8fd1-9be73e07caf0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:23.604829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-822a5413-9d82-4410-a0b6-de700c225aed req-22c9811c-1c40-46b9-8fd1-9be73e07caf0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:23.639390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:23.646216 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-822a5413-9d82-4410-a0b6-de700c225aed req-22c9811c-1c40-46b9-8fd1-9be73e07caf0 service nova] Creating event network-vif-deleted:36e4bd2e-1b66-4ec4-9986-2730d0b29af0 for instance 0573f649-4c81-4de9-9e9f-1652427fdc78 on nch2-master-1 Oct 01 21:01:23.654159 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-822a5413-9d82-4410-a0b6-de700c225aed req-22c9811c-1c40-46b9-8fd1-9be73e07caf0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107789 Oct 01 21:01:23.655500 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1533/2803] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:23.671064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:23.671962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:23.683286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:23.685330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:23.686125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:23.687385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:23.688010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:23.688711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:23.695376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:24.206251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:24.222043 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc7f6be9-7e60-4648-a0e3-a64e30dc1b24 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1317 microversion: 2.1 time: 0.564448 Oct 01 21:01:24.235706 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1534/2804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:23 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:24.247657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f22d18b-a28f-46ba-a6c8-78216d41a023 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] Calling method '.version_select at 0x7f4172ff2160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:24.287923 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f22d18b-a28f-46ba-a6c8-78216d41a023 tempest-VolumesAdminNegativeTest-1221345461 tempest-VolumesAdminNegativeTest-1221345461-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176311408" status: 202 len: 0 microversion: 2.1 time: 0.050769 Oct 01 21:01:24.294998 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1535/2805] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 21:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176311408 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:01:24.305513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-40d23202-b96b-442c-bd74-9806ee76292c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4173126280>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:24.393920 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-40d23202-b96b-442c-bd74-9806ee76292c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/9fa7f5b1-1dbd-4296-b884-1379163128fd" status: 200 len: 662 microversion: 2.1 time: 0.096876 Oct 01 21:01:24.394549 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1536/2806] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:01:24 2022] GET /compute/v2.1/images/9fa7f5b1-1dbd-4296-b884-1379163128fd => generated 662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:24.409050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-21627af7-8c47-4d4d-a348-e5d73b2f7367 req-013d6dab-1c73-4845-bddb-6f5fdc3a0148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9", "tag": "36b56aa4-2e1a-4da6-b0c0-3bcfb88786eb"}, {"server_uuid": "eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f", "name": "network-vif-deleted", "tag": "562f0599-c626-467d-9ffe-d7b89d07318c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:24.434039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-21627af7-8c47-4d4d-a348-e5d73b2f7367 req-013d6dab-1c73-4845-bddb-6f5fdc3a0148 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:24.434548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-21627af7-8c47-4d4d-a348-e5d73b2f7367 req-013d6dab-1c73-4845-bddb-6f5fdc3a0148 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:24.434992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-21627af7-8c47-4d4d-a348-e5d73b2f7367 req-013d6dab-1c73-4845-bddb-6f5fdc3a0148 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:24.450603 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-21627af7-8c47-4d4d-a348-e5d73b2f7367 req-013d6dab-1c73-4845-bddb-6f5fdc3a0148 service nova] Creating event network-changed:36b56aa4-2e1a-4da6-b0c0-3bcfb88786eb for instance 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 on nch1-master-1 Oct 01 21:01:24.451304 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-21627af7-8c47-4d4d-a348-e5d73b2f7367 req-013d6dab-1c73-4845-bddb-6f5fdc3a0148 service nova] Creating event network-vif-deleted:562f0599-c626-467d-9ffe-d7b89d07318c for instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f on nch1-master-1 Oct 01 21:01:24.457998 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-21627af7-8c47-4d4d-a348-e5d73b2f7367 req-013d6dab-1c73-4845-bddb-6f5fdc3a0148 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.062266 Oct 01 21:01:24.458730 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1537/2807] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:24.464962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:24.465680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:24.473332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:24.473846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:24.474289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:24.475121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:24.475575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:24.476117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:24.494139 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f HTTP/1.1 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f'} Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:24.495777 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:24.502689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:24.502689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:24.502689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:24.502689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:24.502689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:01:24.502689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:24.502689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:24.502689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3816a7fd-4b1a-4f54-a84c-64de9f7ceea7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 404 len: 111 microversion: 2.1 time: 0.037344 Oct 01 21:01:24.502689 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1538/2808] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:24 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:24.507044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9b025013-4dcb-452a-9522-a3a2c7c2ded8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '.version_select at 0x7f4172ff2f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:24.540623 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9b025013-4dcb-452a-9522-a3a2c7c2ded8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-key-223602886" status: 202 len: 0 microversion: 2.1 time: 0.037549 Oct 01 21:01:24.548503 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1539/2809] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Oct 1 21:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-223602886 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:01:24.849699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1277016517", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:24.928940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] validate_networks() for [('30c87a4d-5441-4402-9b75-f56c93c32865', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:01:25.628429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:01:25.629296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:01:25.629975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:01:25.630450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:01:25.630945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:01:25.645892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:25.646398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:25.646881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:25.647627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:25.651218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:25.651508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:25.689762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Getting quotas for project 10fefee3d6a6430682316cd94b859f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:01:25.698984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Getting quotas for user 6bda28994cb14f92b014a147a7e74476 and project 10fefee3d6a6430682316cd94b859f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:01:25.722257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:01:25.725191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:01:25.789792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35e871db-53d6-4eb2-bea2-d86845a68d34 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.239496 Oct 01 21:01:25.790745 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1540/2810] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:01:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:01:25.797562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:25.799226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:25.813396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:25.814195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:25.814865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:25.815756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:25.816372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:25.816958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:25.840560 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] HTTP exception thrown: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Request method failure captured: Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 HTTP/1.1 Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKo_RflcOM_9qmFJjmuAFqHXkIDYu_iPHNwYrFgNclP1ThBdrd7vS4ivqUJ8-ZYUpnTH6MtcnoGTTKNHRdQ5DXwvZ6_V4og9trShmN6rmcucIkz-dew9EpML7a9z97sqXj0BaI5ujDPp6UctW6VUjVSt6oub-2OG4_UrLnKX5-JxCAU Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04cc84345d874fc69776490bea69d81a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04cc84345d874fc69776490bea69d81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}] Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ade3ba047d348a387e8e4077072b90a Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0573f649-4c81-4de9-9e9f-1652427fdc78'} Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:25.842450 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:25.848198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:25.848198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:25.848198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:25.848198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:25.848198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:25.848198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:25.848198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:25.850398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Returning 404 to user: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:25.851444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c5471c4-d4b5-4386-b882-be9e0bd865ce tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 404 len: 111 microversion: 2.1 time: 0.059460 Oct 01 21:01:25.855671 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1541/2811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:25 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:25.861093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1308044598", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:25.932823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:01:27.404564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:01:27.405945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:01:27.406677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:01:27.407256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:01:27.409629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:01:27.434928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:27.435768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:27.436396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:27.449030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:27.452032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:27.452692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:27.512962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Getting quotas for project 600066b2cda643488c4a2965d5b20661. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:01:27.527303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Getting quotas for user 779cdf8245f7483881c218306e3a76cb and project 600066b2cda643488c4a2965d5b20661. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:01:27.573763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:01:27.581103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:01:27.715674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c3722db-941b-49c2-b446-85de3dce3513 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858522 Oct 01 21:01:27.716808 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1542/2812] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:01:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:01:27.722382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-874661326", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "9417f59c-8d13-4179-a6ee-0176ac73cf1c"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:27.888427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] validate_networks() for [('9417f59c-8d13-4179-a6ee-0176ac73cf1c', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:01:29.361162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:01:29.362074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:01:29.362615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:01:29.363290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:01:29.363990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:01:29.392944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:29.393452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:29.394235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:29.395179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:29.395827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:29.396449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:29.444733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:01:29.460248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for user 775ff9091a794faaacc05a37550c8a72 and project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:01:29.482474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:01:29.484920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:01:29.545564 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-70cc9068-6b0b-47ac-9b7c-b8effa134947 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827381 Oct 01 21:01:29.546293 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1543/2813] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:01:29.565110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:29.565794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:29.583258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:29.583811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:29.584208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:29.584952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:29.585413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:29.585880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:30.143381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:30.172977 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-112c4f8a-e9bf-4f5a-8f56-16440b521733 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1317 microversion: 2.1 time: 0.621680 Oct 01 21:01:30.175444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1544/2814] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:29 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:30.198016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-41a8655d-a850-47a7-8ac1-e4534bbca750 req-1cd9c837-6269-4ddc-a9cc-ead13fc15d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0573f649-4c81-4de9-9e9f-1652427fdc78", "name": "network-vif-deleted", "tag": "639245c3-5c84-4b1d-9ce5-c58e18538a2f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:30.231507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-41a8655d-a850-47a7-8ac1-e4534bbca750 req-1cd9c837-6269-4ddc-a9cc-ead13fc15d38 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:30.237081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-41a8655d-a850-47a7-8ac1-e4534bbca750 req-1cd9c837-6269-4ddc-a9cc-ead13fc15d38 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:30.239180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-41a8655d-a850-47a7-8ac1-e4534bbca750 req-1cd9c837-6269-4ddc-a9cc-ead13fc15d38 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:30.286456 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-41a8655d-a850-47a7-8ac1-e4534bbca750 req-1cd9c837-6269-4ddc-a9cc-ead13fc15d38 service nova] Creating event network-vif-deleted:639245c3-5c84-4b1d-9ce5-c58e18538a2f for instance 0573f649-4c81-4de9-9e9f-1652427fdc78 on nch2-master-1 Oct 01 21:01:30.300563 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-41a8655d-a850-47a7-8ac1-e4534bbca750 req-1cd9c837-6269-4ddc-a9cc-ead13fc15d38 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122735 Oct 01 21:01:30.301971 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1545/2815] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:30.310245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:30.311016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:30.327740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:30.335375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:30.336287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:30.336596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:30.337067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:30.338187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:31.022688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:31.031990 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-661034be-524e-4dfb-99b5-2a30b35fac6c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1322 microversion: 2.1 time: 0.727247 Oct 01 21:01:31.043307 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1546/2816] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:30 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1322 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:31.048456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:31.049189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:31.063352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:31.064102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:31.064734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:31.067357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:31.068017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:31.068644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:31.120607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:01:31.395186 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0374c27d-4482-43a8-b29f-e9f3a4d28e0f tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 204 len: 0 microversion: 2.1 time: 0.349764 Oct 01 21:01:31.396265 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1547/2817] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:31 2022] DELETE /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:01:31.404514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1025050817", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:31.488743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:01:32.094240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:01:32.096105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:01:32.096978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:01:32.098947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:01:32.099657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:01:32.117755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:32.120801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:32.121514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:32.123631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:32.125424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:32.126319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:32.169949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Getting quotas for project 600066b2cda643488c4a2965d5b20661. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:01:32.178923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Getting quotas for user 779cdf8245f7483881c218306e3a76cb and project 600066b2cda643488c4a2965d5b20661. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:01:32.203266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:01:32.206390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:01:32.300727 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21ded1cf-8b30-4a78-bda1-463c0c3cce21 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902910 Oct 01 21:01:32.305886 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1548/2818] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:01:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:01:32.315242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-42027bd9-c9b2-4ffa-9b30-a4dbdab67757 req-072bd48a-b783-46d6-bd57-59d18c035dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9", "name": "network-vif-plugged", "status": "completed", "tag": "36b56aa4-2e1a-4da6-b0c0-3bcfb88786eb"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:32.331442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:32.334188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-42027bd9-c9b2-4ffa-9b30-a4dbdab67757 req-072bd48a-b783-46d6-bd57-59d18c035dce service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:32.334961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-42027bd9-c9b2-4ffa-9b30-a4dbdab67757 req-072bd48a-b783-46d6-bd57-59d18c035dce service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:32.335514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-42027bd9-c9b2-4ffa-9b30-a4dbdab67757 req-072bd48a-b783-46d6-bd57-59d18c035dce service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:32.350757 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-42027bd9-c9b2-4ffa-9b30-a4dbdab67757 req-072bd48a-b783-46d6-bd57-59d18c035dce service nova] Creating event network-vif-plugged:36b56aa4-2e1a-4da6-b0c0-3bcfb88786eb for instance 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 on nch1-master-1 Oct 01 21:01:32.396443 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-42027bd9-c9b2-4ffa-9b30-a4dbdab67757 req-072bd48a-b783-46d6-bd57-59d18c035dce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085711 Oct 01 21:01:32.397758 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1549/2819] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:32.404545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:32.405602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:32.416344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:32.417185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:32.417859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:32.419081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:32.419782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:32.420453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:32.854084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:32.867928 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b49f737f-68e0-47ba-9c36-decea3f0a24c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 200 len: 1266 microversion: 2.1 time: 0.467633 Oct 01 21:01:32.869074 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1550/2820] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:32 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:32.886621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-835647768", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:33.024725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] validate_networks() for [('30c87a4d-5441-4402-9b75-f56c93c32865', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:01:35.503595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:01:35.504731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:01:35.505942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:01:35.506627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:01:35.507377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:01:35.525917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:35.526585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:35.527235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:35.528308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:35.528838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:35.529382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:35.552183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Getting quotas for project 10fefee3d6a6430682316cd94b859f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:01:35.579270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Getting quotas for user 6bda28994cb14f92b014a147a7e74476 and project 10fefee3d6a6430682316cd94b859f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:01:35.602239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:01:35.606321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:01:35.723212 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f9f144ee-7532-4091-a1e3-f25ce76bb0c5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.850417 Oct 01 21:01:35.728498 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1551/2821] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:01:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:01:35.751993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:35.752623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:35.767157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:35.769070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:35.770737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:35.773046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:35.775454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:35.776503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:36.062791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:36.072434 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-116489d8-1c5e-466f-96a9-49faa59a0109 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1508 microversion: 2.1 time: 0.324374 Oct 01 21:01:36.073006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1552/2822] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:35 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:36.091414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:36.092051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:36.108668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:36.110675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:36.111721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:36.112707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:36.113627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:36.114356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:36.260032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce758fa3950048549fbc375a80deb1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d32a0fa04648de8ec34b7937b36ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:36.292927 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d0be86ae-2279-468e-810c-c328192f9bc4 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 200 len: 1597 microversion: 2.1 time: 0.205975 Oct 01 21:01:36.306952 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1553/2823] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:36 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 1597 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:36.324075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:36.332212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:36.354553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:36.355079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:36.355625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:36.356464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:36.356968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:36.357482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:36.574815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:36.584699 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-53782b40-c741-496c-8b38-f9c3f1277f88 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1276 microversion: 2.1 time: 0.276108 Oct 01 21:01:36.601884 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1554/2824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:36 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:36.622388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-684062c0-56b4-403a-8c8b-ba19541519a1 req-6bb2ef94-12b0-4b8c-8975-aa2e3121ecbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30280ed1-e136-4729-8d11-bcec883bebd5", "tag": "4f2dd5ff-1c5e-4766-b573-59458dfe4990"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:36.662387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-684062c0-56b4-403a-8c8b-ba19541519a1 req-6bb2ef94-12b0-4b8c-8975-aa2e3121ecbd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:36.663933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-684062c0-56b4-403a-8c8b-ba19541519a1 req-6bb2ef94-12b0-4b8c-8975-aa2e3121ecbd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:36.664677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-684062c0-56b4-403a-8c8b-ba19541519a1 req-6bb2ef94-12b0-4b8c-8975-aa2e3121ecbd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:36.684786 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-684062c0-56b4-403a-8c8b-ba19541519a1 req-6bb2ef94-12b0-4b8c-8975-aa2e3121ecbd service nova] Creating event network-changed:4f2dd5ff-1c5e-4766-b573-59458dfe4990 for instance 30280ed1-e136-4729-8d11-bcec883bebd5 on nch2-master-1 Oct 01 21:01:36.691309 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-684062c0-56b4-403a-8c8b-ba19541519a1 req-6bb2ef94-12b0-4b8c-8975-aa2e3121ecbd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086078 Oct 01 21:01:36.693015 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1555/2825] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:36.709634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:36.712484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:36.721844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:36.722746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:36.723481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:36.724604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:36.725414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:36.726151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:36.750637 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] HTTP exception thrown: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Request method failure captured: Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 HTTP/1.1 Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKo_RflcOM_9qmFJjmuAFqHXkIDYu_iPHNwYrFgNclP1ThBdrd7vS4ivqUJ8-ZYUpnTH6MtcnoGTTKNHRdQ5DXwvZ6_V4og9trShmN6rmcucIkz-dew9EpML7a9z97sqXj0BaI5ujDPp6UctW6VUjVSt6oub-2OG4_UrLnKX5-JxCAU Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04cc84345d874fc69776490bea69d81a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04cc84345d874fc69776490bea69d81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}] Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ade3ba047d348a387e8e4077072b90a Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0573f649-4c81-4de9-9e9f-1652427fdc78'} Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:36.753114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:36.757589 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:36.759739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Returning 404 to user: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:36.761761 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-51c4f8cf-d252-4f2e-86b1-5ca5cfed35ff tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 404 len: 111 microversion: 2.1 time: 0.067055 Oct 01 21:01:36.763006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1556/2826] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:36 2022] DELETE /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:36.771269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:36.772348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:36.788701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:36.789992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:36.791302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:36.792030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:36.792524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:36.792950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:37.833669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:37.842364 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ccd516d-c76e-4ecd-9ff9-33f818d8789c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 200 len: 1308 microversion: 2.1 time: 1.078106 Oct 01 21:01:37.858913 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1557/2827] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:36 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 1308 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:37.863887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:37.877158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:37.884802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:37.885558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:37.886632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:37.887510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:37.888117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:37.888707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:38.144058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:38.153000 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5eb0d405-9a8f-4778-9be4-1acddb7c3db2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1273 microversion: 2.1 time: 0.292792 Oct 01 21:01:38.168166 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1558/2828] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:37 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1273 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:38.173495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:38.174122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:38.187418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:38.188136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:38.188757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:38.189627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:38.190259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:38.191113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:38.830671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:38.842717 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f4d1d50-ad8a-4f97-9b10-10a22a3b7216 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1508 microversion: 2.1 time: 0.673228 Oct 01 21:01:38.844635 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1559/2829] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:38 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1508 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:38.852052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:38.852990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 0573f649-4c81-4de9-9e9f-1652427fdc78] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:38.861139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:38.861736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:38.862246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:38.863071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:38.863621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:38.864313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:38.870817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:38.882272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] HTTP exception thrown: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Request method failure captured: Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 HTTP/1.1 Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKo_RflcOM_9qmFJjmuAFqHXkIDYu_iPHNwYrFgNclP1ThBdrd7vS4ivqUJ8-ZYUpnTH6MtcnoGTTKNHRdQ5DXwvZ6_V4og9trShmN6rmcucIkz-dew9EpML7a9z97sqXj0BaI5ujDPp6UctW6VUjVSt6oub-2OG4_UrLnKX5-JxCAU Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04cc84345d874fc69776490bea69d81a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04cc84345d874fc69776490bea69d81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}] Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ade3ba047d348a387e8e4077072b90a Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0573f649-4c81-4de9-9e9f-1652427fdc78'} Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:38.891004 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Returning 404 to user: Instance 0573f649-4c81-4de9-9e9f-1652427fdc78 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6d689f43-8a58-4947-a4b7-372e7ffccb76 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78" status: 404 len: 111 microversion: 2.1 time: 0.047111 Oct 01 21:01:38.895594 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1560/2830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:38 2022] GET /compute/v2.1/servers/0573f649-4c81-4de9-9e9f-1652427fdc78 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:38.904318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:38.905351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:38.922991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:38.923496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:38.923981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:38.924812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:38.925233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:38.925718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:39.107068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce758fa3950048549fbc375a80deb1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d32a0fa04648de8ec34b7937b36ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:39.123312 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-47008641-6450-4d65-962f-0fe8faa56a26 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 200 len: 1597 microversion: 2.1 time: 0.227075 Oct 01 21:01:39.136624 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1561/2831] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:38 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 1597 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:39.149163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:39.151880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:39.162231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:39.163477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:39.164357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:39.165951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:39.166896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:39.168027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:40.035759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:40.043632 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd39f24b-5bb2-403d-b5e7-ec44f2a1bc48 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1318 microversion: 2.1 time: 0.905473 Oct 01 21:01:40.048170 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1562/2832] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:39 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1318 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:40.076152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8f38d99d-6f8a-4024-b4cf-ad6c531913f2 req-d96505e4-080f-4179-b169-dbe43b837448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30280ed1-e136-4729-8d11-bcec883bebd5", "name": "network-vif-plugged", "status": "completed", "tag": "4f2dd5ff-1c5e-4766-b573-59458dfe4990"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:40.120957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8f38d99d-6f8a-4024-b4cf-ad6c531913f2 req-d96505e4-080f-4179-b169-dbe43b837448 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:40.121944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8f38d99d-6f8a-4024-b4cf-ad6c531913f2 req-d96505e4-080f-4179-b169-dbe43b837448 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:40.124086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8f38d99d-6f8a-4024-b4cf-ad6c531913f2 req-d96505e4-080f-4179-b169-dbe43b837448 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:40.168623 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8f38d99d-6f8a-4024-b4cf-ad6c531913f2 req-d96505e4-080f-4179-b169-dbe43b837448 service nova] Creating event network-vif-plugged:4f2dd5ff-1c5e-4766-b573-59458dfe4990 for instance 30280ed1-e136-4729-8d11-bcec883bebd5 on nch2-master-1 Oct 01 21:01:40.182025 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8f38d99d-6f8a-4024-b4cf-ad6c531913f2 req-d96505e4-080f-4179-b169-dbe43b837448 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131542 Oct 01 21:01:40.216914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1563/2833] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:40.235782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a7136e2a-21b3-48e7-821f-17e3133865d0 req-af71461a-b908-4b2d-898b-383ac76e4907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb9ea14-deab-4588-ade7-66aa910a3eb9", "tag": "beea046f-0dc7-4d4c-8922-c8b4a553c1ca"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:40.251701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a7136e2a-21b3-48e7-821f-17e3133865d0 req-af71461a-b908-4b2d-898b-383ac76e4907 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:40.252203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a7136e2a-21b3-48e7-821f-17e3133865d0 req-af71461a-b908-4b2d-898b-383ac76e4907 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:40.252652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a7136e2a-21b3-48e7-821f-17e3133865d0 req-af71461a-b908-4b2d-898b-383ac76e4907 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:40.267111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a7136e2a-21b3-48e7-821f-17e3133865d0 req-af71461a-b908-4b2d-898b-383ac76e4907 service nova] Creating event network-changed:beea046f-0dc7-4d4c-8922-c8b4a553c1ca for instance abb9ea14-deab-4588-ade7-66aa910a3eb9 on nch1-master-1 Oct 01 21:01:40.273032 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a7136e2a-21b3-48e7-821f-17e3133865d0 req-af71461a-b908-4b2d-898b-383ac76e4907 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054271 Oct 01 21:01:40.274000 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1564/2834] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:40.279965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-373c79de-f396-43ea-a80f-d64647020810 req-b4a7dd6a-af3d-4f9a-b2b6-247b76dae6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b8899d-c628-41cc-9c72-0687112c14d3", "tag": "fda1632d-01e6-4da9-86a2-31acfce88deb"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:40.292054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-373c79de-f396-43ea-a80f-d64647020810 req-b4a7dd6a-af3d-4f9a-b2b6-247b76dae6ff service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:40.292565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-373c79de-f396-43ea-a80f-d64647020810 req-b4a7dd6a-af3d-4f9a-b2b6-247b76dae6ff service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:40.293069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-373c79de-f396-43ea-a80f-d64647020810 req-b4a7dd6a-af3d-4f9a-b2b6-247b76dae6ff service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:40.305334 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-373c79de-f396-43ea-a80f-d64647020810 req-b4a7dd6a-af3d-4f9a-b2b6-247b76dae6ff service nova] Creating event network-changed:fda1632d-01e6-4da9-86a2-31acfce88deb for instance 90b8899d-c628-41cc-9c72-0687112c14d3 on nch2-master-1 Oct 01 21:01:40.311434 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-373c79de-f396-43ea-a80f-d64647020810 req-b4a7dd6a-af3d-4f9a-b2b6-247b76dae6ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035425 Oct 01 21:01:40.312365 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1565/2835] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:40.318181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-506ccd01-a8ed-4cde-b6d0-24ad4b47668a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:40.321768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-506ccd01-a8ed-4cde-b6d0-24ad4b47668a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:40.330520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-506ccd01-a8ed-4cde-b6d0-24ad4b47668a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:40.331034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-506ccd01-a8ed-4cde-b6d0-24ad4b47668a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:40.331491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-506ccd01-a8ed-4cde-b6d0-24ad4b47668a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:40.332224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-506ccd01-a8ed-4cde-b6d0-24ad4b47668a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:40.332697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-506ccd01-a8ed-4cde-b6d0-24ad4b47668a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:40.333136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-506ccd01-a8ed-4cde-b6d0-24ad4b47668a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:40.411811 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-506ccd01-a8ed-4cde-b6d0-24ad4b47668a tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "PUT /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1080 microversion: 2.1 time: 0.098127 Oct 01 21:01:40.426452 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1566/2836] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:01:40 2022] PUT /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1080 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:40.426452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:40.426452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:40.426452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:40.427412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:40.427523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:40.428261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:40.428736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:40.429245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:41.118639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:41.141419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-601f4533-fcfb-445f-90f9-578c8978d807 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 200 len: 1308 microversion: 2.1 time: 0.724960 Oct 01 21:01:41.144607 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1567/2837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:40 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 1308 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:41.151248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:41.152886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:41.173017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:41.174816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:41.175627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:41.177351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:41.178065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:41.178796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:41.217331 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] HTTP exception thrown: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Request method failure captured: Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 HTTP/1.1 Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKo_RflcOM_9qmFJjmuAFqHXkIDYu_iPHNwYrFgNclP1ThBdrd7vS4ivqUJ8-ZYUpnTH6MtcnoGTTKNHRdQ5DXwvZ6_V4og9trShmN6rmcucIkz-dew9EpML7a9z97sqXj0BaI5ujDPp6UctW6VUjVSt6oub-2OG4_UrLnKX5-JxCAU Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04cc84345d874fc69776490bea69d81a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04cc84345d874fc69776490bea69d81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}] Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ade3ba047d348a387e8e4077072b90a Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '143e0afb-b691-486b-a8a2-7832f2dbfdd4'} Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:41.220063 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:41.223984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.226431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Returning 404 to user: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:41.230131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ccf0a2e-0fed-40f7-8801-1606bb7d9920 tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "DELETE /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 404 len: 111 microversion: 2.1 time: 0.081034 Oct 01 21:01:41.231466 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1568/2838] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:41 2022] DELETE /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:41.244289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:41.246733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:41.280281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:41.281163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:41.281913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:41.284127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:41.285555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:41.287212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:41.825810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:41.860020 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f313454e-46ff-4de7-b9e6-52250367b124 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1321 microversion: 2.1 time: 0.627099 Oct 01 21:01:41.875245 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1569/2839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:41 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1321 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:41.882134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:41.882815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] [instance: 7c9b3856-21ac-48d1-bd95-e610b11f7280] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:41.891489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:41.892073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:41.892569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:41.893585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:41.893956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:41.894553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:41.910900 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] HTTP exception thrown: Instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 could not be found. Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Request method failure captured: Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 HTTP/1.1 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKprpkI3gJSFPWxTpLcTAKolxAQe5qHtkYfTwYm9qxNTbgQlVqMQj8uuUUzwjW0_ZIr9y8JQgh51cMpp5uyqUIVe2l3dYPoNRO2CLffT9UEtZh-SPKRdjpea1u24GT0Z8wFrFgz7I4SBJXL4XWIr08ZYeHnBnPhsU6zf2zYsOUv1xuY Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 91d32a0fa04648de8ec34b7937b36ef3 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestFqdnHostnames-1723833880 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91d32a0fa04648de8ec34b7937b36ef3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91d32a0fa04648de8ec34b7937b36ef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91d32a0fa04648de8ec34b7937b36ef3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91d32a0fa04648de8ec34b7937b36ef3"}]}] Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestFqdnHostnames-1723833880 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 91d32a0fa04648de8ec34b7937b36ef3 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1723833880 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestFqdnHostnames-1723833880-project Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: ce758fa3950048549fbc375a80deb1a7 Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestFqdnHostnames-1723833880-project Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 could not be found. Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7c9b3856-21ac-48d1-bd95-e610b11f7280'} Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 could not be found. Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 could not be found. Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:41.912811 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.919034 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:41.919034 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:41.919034 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:41.919034 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:41.919034 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:41.919034 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 could not be found. Oct 01 21:01:41.919034 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:41.919034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Returning 404 to user: Instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:41.919034 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cff362c0-78a2-42d4-b41f-c40a9897be43 tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280" status: 404 len: 111 microversion: 2.1 time: 0.040018 Oct 01 21:01:41.922185 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1570/2840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:41 2022] GET /compute/v2.1/servers/7c9b3856-21ac-48d1-bd95-e610b11f7280 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:41.926775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:41.927175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:41.936015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:41.936543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:41.937001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:41.937689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:41.938331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:41.938947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:42.537434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:42.546936 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc016680-d5e7-4160-bb34-7d50ec2e2792 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1506 microversion: 2.1 time: 0.624568 Oct 01 21:01:42.549670 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1571/2841] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:41 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:42.563489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:42.567128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:42.579426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:42.580263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:42.581145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:42.582056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:42.582736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:42.583353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:43.985735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:43.998133 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f364475e-04e9-4409-a980-f113ad210d97 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1318 microversion: 2.1 time: 1.439688 Oct 01 21:01:43.999188 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1572/2842] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:42 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1318 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:44.004869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:44.005829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] [instance: 143e0afb-b691-486b-a8a2-7832f2dbfdd4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:44.016324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:44.016925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:44.017472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:44.018259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:44.019245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:44.019841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:44.048359 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] HTTP exception thrown: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Request method failure captured: Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 HTTP/1.1 Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKo_RflcOM_9qmFJjmuAFqHXkIDYu_iPHNwYrFgNclP1ThBdrd7vS4ivqUJ8-ZYUpnTH6MtcnoGTTKNHRdQ5DXwvZ6_V4og9trShmN6rmcucIkz-dew9EpML7a9z97sqXj0BaI5ujDPp6UctW6VUjVSt6oub-2OG4_UrLnKX5-JxCAU Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04cc84345d874fc69776490bea69d81a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04cc84345d874fc69776490bea69d81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04cc84345d874fc69776490bea69d81a"}]}] Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 04cc84345d874fc69776490bea69d81a Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestMultiNic-1283043920 Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ade3ba047d348a387e8e4077072b90a Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestMultiNic-1283043920-project Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '143e0afb-b691-486b-a8a2-7832f2dbfdd4'} Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:44.050247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:44.055307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:44.055307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:44.055307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:44.055307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:44.055307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:44.055307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. Oct 01 21:01:44.055307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:44.055307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] Returning 404 to user: Instance 143e0afb-b691-486b-a8a2-7832f2dbfdd4 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:44.057483 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9f95e020-b14f-4f14-8ada-dc71e9d9ff0e tempest-ServersTestMultiNic-1283043920 tempest-ServersTestMultiNic-1283043920-project] 10.222.0.17 "GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4" status: 404 len: 111 microversion: 2.1 time: 0.056465 Oct 01 21:01:44.058345 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1573/2843] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:43 2022] GET /compute/v2.1/servers/143e0afb-b691-486b-a8a2-7832f2dbfdd4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:44.063771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb3e9b63-8b1e-45a6-97f0-aa34b5d248ef tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] Calling method '.version_select at 0x7f4172845280>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:44.095739 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb3e9b63-8b1e-45a6-97f0-aa34b5d248ef tempest-ServersTestFqdnHostnames-1723833880 tempest-ServersTestFqdnHostnames-1723833880-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-251023824" status: 202 len: 0 microversion: 2.1 time: 0.034399 Oct 01 21:01:44.098675 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1574/2844] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 21:01:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-251023824 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:01:44.106561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:44.107199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:44.113806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:44.114315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:44.114789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:44.115888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:44.116416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:44.117194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:44.603802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:44.612372 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ef4081b-d9c7-4bb6-a478-0094de06dc6c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 200 len: 1308 microversion: 2.1 time: 0.510232 Oct 01 21:01:44.613749 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1575/2845] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:44 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:44.619373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a0504ea5-02a5-407c-875a-441adc686623 req-173d6ef7-86e0-4352-8274-f32f5dbb5e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b8899d-c628-41cc-9c72-0687112c14d3", "name": "network-vif-plugged", "status": "completed", "tag": "fda1632d-01e6-4da9-86a2-31acfce88deb"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:44.634470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a0504ea5-02a5-407c-875a-441adc686623 req-173d6ef7-86e0-4352-8274-f32f5dbb5e3f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:44.635270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a0504ea5-02a5-407c-875a-441adc686623 req-173d6ef7-86e0-4352-8274-f32f5dbb5e3f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:44.635875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a0504ea5-02a5-407c-875a-441adc686623 req-173d6ef7-86e0-4352-8274-f32f5dbb5e3f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:44.650055 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a0504ea5-02a5-407c-875a-441adc686623 req-173d6ef7-86e0-4352-8274-f32f5dbb5e3f service nova] Creating event network-vif-plugged:fda1632d-01e6-4da9-86a2-31acfce88deb for instance 90b8899d-c628-41cc-9c72-0687112c14d3 on nch2-master-1 Oct 01 21:01:44.657085 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a0504ea5-02a5-407c-875a-441adc686623 req-173d6ef7-86e0-4352-8274-f32f5dbb5e3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041925 Oct 01 21:01:44.661314 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1576/2846] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:44.667754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2aca0403-8238-412c-9412-c51b56edc581 req-2c5468fa-16ff-4505-b2a6-ddc296253332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9b3856-21ac-48d1-bd95-e610b11f7280", "name": "network-vif-deleted", "tag": "b81ec050-cf8b-44df-9c94-bb394da5e2b4"}, {"name": "network-changed", "server_uuid": "d12ab455-2d67-4728-9293-bd843f39bedf", "tag": "8a94b425-9ca6-4166-8a17-467ca29d4cf8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:44.686758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2aca0403-8238-412c-9412-c51b56edc581 req-2c5468fa-16ff-4505-b2a6-ddc296253332 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:44.687681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2aca0403-8238-412c-9412-c51b56edc581 req-2c5468fa-16ff-4505-b2a6-ddc296253332 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:44.688315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2aca0403-8238-412c-9412-c51b56edc581 req-2c5468fa-16ff-4505-b2a6-ddc296253332 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:44.708041 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2aca0403-8238-412c-9412-c51b56edc581 req-2c5468fa-16ff-4505-b2a6-ddc296253332 service nova] Creating event network-vif-deleted:b81ec050-cf8b-44df-9c94-bb394da5e2b4 for instance 7c9b3856-21ac-48d1-bd95-e610b11f7280 on nch2-master-1 Oct 01 21:01:44.708573 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2aca0403-8238-412c-9412-c51b56edc581 req-2c5468fa-16ff-4505-b2a6-ddc296253332 service nova] Creating event network-changed:8a94b425-9ca6-4166-8a17-467ca29d4cf8 for instance d12ab455-2d67-4728-9293-bd843f39bedf on nch1-master-1 Oct 01 21:01:44.720604 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2aca0403-8238-412c-9412-c51b56edc581 req-2c5468fa-16ff-4505-b2a6-ddc296253332 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057635 Oct 01 21:01:44.721584 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1577/2847] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:44.741343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:44.742118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:44.751801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:44.752579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:44.753125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:44.754002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:44.755456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:44.756088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:45.297524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:45.318443 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c22d3262-6e96-4fbb-96e2-d2c895f44971 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1506 microversion: 2.1 time: 0.590277 Oct 01 21:01:45.320033 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1578/2848] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:44 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:45.326790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:45.328133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:45.336798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:45.337981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:45.339505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:45.341050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:45.341811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:45.344435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:45.544027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:45.592743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=30 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:45.995602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:46.006550 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dcfeb1a5-6cd7-4a82-89e3-f34a17b744f4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1321 microversion: 2.1 time: 0.685032 Oct 01 21:01:46.007477 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1579/2849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:45 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:46.016053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5066a948-6f5f-4e65-affb-8ab6348af696 req-2faf77c2-84d9-4c92-a0a6-07eea3b33d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0ecd67-d12c-4226-946f-ad9664f38e63", "tag": "3561d0f4-806f-4f37-9e89-bd72c7be656f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:46.034648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5066a948-6f5f-4e65-affb-8ab6348af696 req-2faf77c2-84d9-4c92-a0a6-07eea3b33d00 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:46.035658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5066a948-6f5f-4e65-affb-8ab6348af696 req-2faf77c2-84d9-4c92-a0a6-07eea3b33d00 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:46.036319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5066a948-6f5f-4e65-affb-8ab6348af696 req-2faf77c2-84d9-4c92-a0a6-07eea3b33d00 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:46.054928 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5066a948-6f5f-4e65-affb-8ab6348af696 req-2faf77c2-84d9-4c92-a0a6-07eea3b33d00 service nova] Creating event network-changed:3561d0f4-806f-4f37-9e89-bd72c7be656f for instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 on nch2-master-1 Oct 01 21:01:46.063965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5066a948-6f5f-4e65-affb-8ab6348af696 req-2faf77c2-84d9-4c92-a0a6-07eea3b33d00 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054219 Oct 01 21:01:46.070302 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1580/2850] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:46.080174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:46.081299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:46.090467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:46.091499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:46.092172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:46.093282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:46.094475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:46.095203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:47.027504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:47.041779 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75090e18-b536-4e0c-9d05-07c5aa48c779 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1318 microversion: 2.1 time: 0.967342 Oct 01 21:01:47.043342 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1581/2851] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:46 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1318 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:47.068712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-860ef8ae-1531-4880-90c3-c202c79a5fbe tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:47.073367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-860ef8ae-1531-4880-90c3-c202c79a5fbe tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:47.081107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-860ef8ae-1531-4880-90c3-c202c79a5fbe tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:47.081987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-860ef8ae-1531-4880-90c3-c202c79a5fbe tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:47.082624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-860ef8ae-1531-4880-90c3-c202c79a5fbe tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:47.083589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-860ef8ae-1531-4880-90c3-c202c79a5fbe tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:47.084207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-860ef8ae-1531-4880-90c3-c202c79a5fbe tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:47.084802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-860ef8ae-1531-4880-90c3-c202c79a5fbe tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:47.178678 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-860ef8ae-1531-4880-90c3-c202c79a5fbe tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "PUT /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1082 microversion: 2.1 time: 0.133665 Oct 01 21:01:47.181799 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1582/2852] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:01:47 2022] PUT /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1082 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:47.196637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:47.197301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:47.210286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:47.211383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:47.213308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:47.214343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:47.215140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:47.215794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:47.221158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:47.838338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:47.850870 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1439a037-d937-4059-b64f-6b70747c4995 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 200 len: 1489 microversion: 2.1 time: 0.666977 Oct 01 21:01:47.859926 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1583/2853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:47 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 1489 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:47.887486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8b6b8ea3-1d04-470c-9db0-ae90483ef5c0 req-78d74d29-f516-42f4-a771-1adc7aaf2a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb9ea14-deab-4588-ade7-66aa910a3eb9", "name": "network-vif-plugged", "status": "completed", "tag": "beea046f-0dc7-4d4c-8922-c8b4a553c1ca"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:47.919931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8b6b8ea3-1d04-470c-9db0-ae90483ef5c0 req-78d74d29-f516-42f4-a771-1adc7aaf2a0e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:47.922154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8b6b8ea3-1d04-470c-9db0-ae90483ef5c0 req-78d74d29-f516-42f4-a771-1adc7aaf2a0e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:47.922975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8b6b8ea3-1d04-470c-9db0-ae90483ef5c0 req-78d74d29-f516-42f4-a771-1adc7aaf2a0e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:47.964445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8b6b8ea3-1d04-470c-9db0-ae90483ef5c0 req-78d74d29-f516-42f4-a771-1adc7aaf2a0e service nova] Creating event network-vif-plugged:beea046f-0dc7-4d4c-8922-c8b4a553c1ca for instance abb9ea14-deab-4588-ade7-66aa910a3eb9 on nch1-master-1 Oct 01 21:01:47.979677 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8b6b8ea3-1d04-470c-9db0-ae90483ef5c0 req-78d74d29-f516-42f4-a771-1adc7aaf2a0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115900 Oct 01 21:01:47.980326 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1584/2854] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:47.993706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:47.994519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:48.003156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:48.004263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:48.004722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:48.007212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:48.008570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:48.009195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:48.487581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:48.500774 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-66673b03-8e60-479d-b333-a118e48ff192 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1321 microversion: 2.1 time: 0.516279 Oct 01 21:01:48.506843 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1585/2855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:47 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:48.512959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:48.517753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:48.531487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:48.532302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:48.533081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:48.533701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:48.534140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:48.534608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:49.020763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:49.039442 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-feb548a7-eda3-43cb-8303-bbf7bb60e2ee tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1508 microversion: 2.1 time: 0.530615 Oct 01 21:01:49.040566 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1586/2856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:48 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:49.045191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-874661326", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "9417f59c-8d13-4179-a6ee-0176ac73cf1c"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:49.174223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] validate_networks() for [('9417f59c-8d13-4179-a6ee-0176ac73cf1c', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:01:50.250453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:01:50.251213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:01:50.251736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:01:50.253082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:01:50.253529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:01:50.267070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:50.268173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:50.268635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:50.269803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:50.270471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:50.271265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:50.293157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:01:50.300664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for user 775ff9091a794faaacc05a37550c8a72 and project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:01:50.306849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:50.324082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:01:50.326887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:01:50.390625 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8cd72c0-04c1-45f8-a40d-2303052a19e6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348728 Oct 01 21:01:50.392210 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1587/2857] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:01:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:01:50.397775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:50.398652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:50.406851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:50.407568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:50.408341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:50.409224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:50.410579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:50.411180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:51.051166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:51.061410 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f55a3243-1b55-4116-83ff-528c8781a314 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1318 microversion: 2.1 time: 0.667762 Oct 01 21:01:51.062551 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1588/2858] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:50 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:51.073739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:51.075080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:51.086190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:51.087471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:51.088088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:51.089041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:51.089574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:51.090018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:51.298947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:51.314855 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-643b689f-77a9-44f1-891a-a32cf3ddf487 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1508 microversion: 2.1 time: 0.250914 Oct 01 21:01:51.316255 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1589/2859] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:51 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:51.321800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:51.322734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:51.328959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:51.329717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:51.330602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:51.331580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:51.332288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:51.333082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:51.506851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:51.520935 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-45e298fd-b66c-4978-b7b7-e94ab9d5f53c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1321 microversion: 2.1 time: 0.202224 Oct 01 21:01:51.524166 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1590/2860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:51 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:51.530695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b4cf955d-f72b-4deb-aade-822467aa0c3e req-a469a76e-3bf2-4754-8f48-a21b7749c9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0ecd67-d12c-4226-946f-ad9664f38e63", "name": "network-vif-plugged", "status": "completed", "tag": "3561d0f4-806f-4f37-9e89-bd72c7be656f"}, {"server_uuid": "d12ab455-2d67-4728-9293-bd843f39bedf", "name": "network-vif-plugged", "status": "completed", "tag": "8a94b425-9ca6-4166-8a17-467ca29d4cf8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:51.553933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b4cf955d-f72b-4deb-aade-822467aa0c3e req-a469a76e-3bf2-4754-8f48-a21b7749c9b9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:51.554438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b4cf955d-f72b-4deb-aade-822467aa0c3e req-a469a76e-3bf2-4754-8f48-a21b7749c9b9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:51.555712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b4cf955d-f72b-4deb-aade-822467aa0c3e req-a469a76e-3bf2-4754-8f48-a21b7749c9b9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:51.571885 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b4cf955d-f72b-4deb-aade-822467aa0c3e req-a469a76e-3bf2-4754-8f48-a21b7749c9b9 service nova] Creating event network-vif-plugged:3561d0f4-806f-4f37-9e89-bd72c7be656f for instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 on nch2-master-1 Oct 01 21:01:51.572596 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b4cf955d-f72b-4deb-aade-822467aa0c3e req-a469a76e-3bf2-4754-8f48-a21b7749c9b9 service nova] Creating event network-vif-plugged:8a94b425-9ca6-4166-8a17-467ca29d4cf8 for instance d12ab455-2d67-4728-9293-bd843f39bedf on nch1-master-1 Oct 01 21:01:51.596220 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b4cf955d-f72b-4deb-aade-822467aa0c3e req-a469a76e-3bf2-4754-8f48-a21b7749c9b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070319 Oct 01 21:01:51.599377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1591/2861] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:51.614245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:51.616336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:51.634591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:51.635378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:51.636113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:51.637013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:51.640973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:51.643680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:51.936902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:51.945145 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b0cb8cb-6552-4910-aa5a-5a1aedc903f8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1260 microversion: 2.1 time: 0.344119 Oct 01 21:01:51.945748 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1592/2862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:51 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1260 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:51.954860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:51.960677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:51.975343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:51.976547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:51.978614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:51.980501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:51.981398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:51.981998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:52.025062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:01:52.142071 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2bc2f266-3001-42e3-8795-f7538833e08b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 204 len: 0 microversion: 2.1 time: 0.195002 Oct 01 21:01:52.143334 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1593/2863] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:51 2022] DELETE /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:01:52.166840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:52.172896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:52.182947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:52.184004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:52.198741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:52.201006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:52.201948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:52.206078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:52.603000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:52.615316 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6c0e7186-76d6-4b5c-8403-6ce30a67b7fb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1318 microversion: 2.1 time: 0.470189 Oct 01 21:01:52.615848 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1594/2864] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:52 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:52.621174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:52.621671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:52.644165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:52.644656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:52.645264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:52.646138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:52.646783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:52.647440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:52.702200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:01:52.817705 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.compute.api [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Instance is already in deleting state, ignoring this request Oct 01 21:01:52.818606 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e345a782-6142-44a2-a417-2fd3acdfebcf tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 204 len: 0 microversion: 2.1 time: 0.201167 Oct 01 21:01:52.819496 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1595/2865] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:52 2022] DELETE /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:01:52.824730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:52.825351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:52.842175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:52.843219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:52.843859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:52.844871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:52.845561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:52.846151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:53.337528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:53.356846 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-525a29c7-cdae-459c-8845-783235057547 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1321 microversion: 2.1 time: 0.534849 Oct 01 21:01:53.358722 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1596/2866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:52 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:53.376002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:53.378104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:53.397234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:53.399590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:53.400247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:53.402454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:53.402967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:53.405189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:54.011559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:54.025758 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac426319-e242-4b49-8fba-ce4167528e07 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1514 microversion: 2.1 time: 0.665646 Oct 01 21:01:54.031025 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1597/2867] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:53 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1514 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:54.036729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:54.037575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:54.051443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:54.052198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:54.052834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:54.054318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:54.055718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:54.056419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:54.721044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:54.724968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:01:54.734117 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-73d9ec7d-bb01-48b1-afdd-7035602d53ff tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1266 microversion: 2.1 time: 0.701691 Oct 01 21:01:54.735908 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1598/2868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:54 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1266 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:54.764544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:54.765942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:54.776519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:54.777365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:54.778048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:54.779072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:54.779495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:54.780225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:55.677161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:55.688007 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3595ddd7-565f-46f2-b295-5eb65c89cbc7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1468 microversion: 2.1 time: 0.931410 Oct 01 21:01:55.691757 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1599/2869] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:54 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1468 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:55.702908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:55.703733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:55.717798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:55.718305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:55.722980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:55.726673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:55.727945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:55.728406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:56.824689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:56.840033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-72329aa0-76db-4a9d-8828-91c5755c11fb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1515 microversion: 2.1 time: 1.147109 Oct 01 21:01:56.840954 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1600/2870] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:55 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1515 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:56.855406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:56.856296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:56.874232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:56.874232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:56.874232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:56.874891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:56.875147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:56.878336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:57.120133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84a109e337d450698e630acfb49f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9566fa9a44f94c4ea3081a1a2e658de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:57.137695 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-28f4865c-c525-4500-9c4a-ab23edc2aab6 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 200 len: 1472 microversion: 2.1 time: 0.295389 Oct 01 21:01:57.140171 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1601/2871] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:56 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:57.148752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:57.149644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:57.158329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:57.159616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:57.160242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:57.161623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:57.162286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:57.163049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:57.624105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:57.638113 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-61525a20-6472-4f81-85a8-0d00e16967b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9" status: 200 len: 1468 microversion: 2.1 time: 0.496385 Oct 01 21:01:57.638772 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1602/2872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:57 2022] GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9 => generated 1468 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:57.666582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:57.667635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:57.675929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:57.676796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:57.677456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:57.678437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:57.679132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:57.680406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:58.061413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:58.071931 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-31773153-b74e-4864-a8de-13e3ba04ab0a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1308 microversion: 2.1 time: 0.431723 Oct 01 21:01:58.077933 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1603/2873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:57 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1308 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:58.087548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:58.101447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:58.108077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:58.108879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:58.109564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:58.110770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:58.111490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:58.112157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:58.137801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lazy-loading 'flavor' on Instance uuid 7e0ecd67-d12c-4226-946f-ad9664f38e63 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:01:58.265537 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f42f8326-2eee-498e-9cf7-2d901208c165 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63/action" status: 200 len: 32 microversion: 2.1 time: 0.185287 Oct 01 21:01:58.266872 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1604/2874] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:01:58 2022] POST /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:01:58.288091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3ab2cd36-6f08-422d-ac70-1459b7a422c5 req-46e3ab64-475e-44d3-8cc3-6f6c6c488012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9", "name": "network-vif-deleted", "tag": "36b56aa4-2e1a-4da6-b0c0-3bcfb88786eb"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:58.306746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3ab2cd36-6f08-422d-ac70-1459b7a422c5 req-46e3ab64-475e-44d3-8cc3-6f6c6c488012 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:58.307855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3ab2cd36-6f08-422d-ac70-1459b7a422c5 req-46e3ab64-475e-44d3-8cc3-6f6c6c488012 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:58.309190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3ab2cd36-6f08-422d-ac70-1459b7a422c5 req-46e3ab64-475e-44d3-8cc3-6f6c6c488012 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:58.355506 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3ab2cd36-6f08-422d-ac70-1459b7a422c5 req-46e3ab64-475e-44d3-8cc3-6f6c6c488012 service nova] Creating event network-vif-deleted:36b56aa4-2e1a-4da6-b0c0-3bcfb88786eb for instance 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 on nch1-master-1 Oct 01 21:01:58.361300 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3ab2cd36-6f08-422d-ac70-1459b7a422c5 req-46e3ab64-475e-44d3-8cc3-6f6c6c488012 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092436 Oct 01 21:01:58.362586 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1605/2875] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:01:58.376313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b3b4cbd-c822-4f63-b9aa-a46c37c0f34d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2014420497"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:01:58.378876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4b3b4cbd-c822-4f63-b9aa-a46c37c0f34d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:58.386351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b3b4cbd-c822-4f63-b9aa-a46c37c0f34d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:58.387101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b3b4cbd-c822-4f63-b9aa-a46c37c0f34d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:58.387348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b3b4cbd-c822-4f63-b9aa-a46c37c0f34d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:58.388061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b3b4cbd-c822-4f63-b9aa-a46c37c0f34d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:58.388703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b3b4cbd-c822-4f63-b9aa-a46c37c0f34d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:58.389297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b3b4cbd-c822-4f63-b9aa-a46c37c0f34d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:58.877918 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b3b4cbd-c822-4f63-b9aa-a46c37c0f34d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "POST /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.511225 Oct 01 21:01:58.890393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1606/2876] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:01:58 2022] POST /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 21:01:58.903603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:58.904838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:58.913969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:58.915722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:58.916171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:58.917123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:58.917929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:58.918807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:58.936080 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] HTTP exception thrown: Instance 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 could not be found. Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Request method failure captured: Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 HTTP/1.1 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoczlQy3VAWlihMnXou_YNByq_RP_0iqE3KPFhLZqubRVu5nM4hVmhYCzYSSxVvbaSm6uxPNizJPHHbjOJWSMbT-M0NvGUoeNvh53fUZ01sQJATDBmXfEJcjUxWRB1a0k6SM47-TbleHurM5t5Kqy1T24qKXC3-WZLJLirEiMoWguU Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9566fa9a44f94c4ea3081a1a2e658de0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}] Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e84a109e337d450698e630acfb49f9a5 Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 could not be found. Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9'} Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 could not be found. Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 could not be found. Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:58.938017 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:58.942607 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:58.942607 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:58.942607 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:58.942607 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:58.942607 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:58.942607 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 could not be found. Oct 01 21:01:58.942607 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:58.944951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Returning 404 to user: Instance 2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:58.946463 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a40cb81-6c27-4a70-b64f-f0ac81a8f1e9 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9" status: 404 len: 111 microversion: 2.1 time: 0.054545 Oct 01 21:01:58.949936 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1607/2877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:58 2022] GET /compute/v2.1/servers/2fa5eb95-8368-48c5-9dcb-20c0cdeaa3e9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:58.952856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:58.953481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:58.968605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:58.969206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:58.969749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:58.971810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:58.975347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:58.975803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:59.377621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:59.389010 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-90d9be7a-b165-427c-ad8a-d3cda70bc268 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 0.440615 Oct 01 21:01:59.389599 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1608/2878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:58 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:59.409730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0abd69bf-36c6-4555-a99c-df4e28aec5e6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417c1ebb80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:59.483781 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0abd69bf-36c6-4555-a99c-df4e28aec5e6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.092700 Oct 01 21:01:59.484829 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1609/2879] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:01:59 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:59.491908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:59.493064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:59.501171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:59.501681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:59.502130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:59.502904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:59.503372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:59.503960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:59.531351 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] HTTP exception thrown: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Request method failure captured: Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 HTTP/1.1 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoczlQy3VAWlihMnXou_YNByq_RP_0iqE3KPFhLZqubRVu5nM4hVmhYCzYSSxVvbaSm6uxPNizJPHHbjOJWSMbT-M0NvGUoeNvh53fUZ01sQJATDBmXfEJcjUxWRB1a0k6SM47-TbleHurM5t5Kqy1T24qKXC3-WZLJLirEiMoWguU Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9566fa9a44f94c4ea3081a1a2e658de0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}] Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e84a109e337d450698e630acfb49f9a5 Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1431fcc7-a23c-42aa-b324-44adc7bb8a68'} Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:59.533327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Returning 404 to user: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff4c6719-6328-411d-8bcd-c838f71ce310 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 404 len: 111 microversion: 2.1 time: 0.049063 Oct 01 21:01:59.537399 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1610/2880] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:59 2022] DELETE /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:59.542989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:59.543787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:59.551125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:59.551638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:59.553143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:59.553936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:59.554647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:59.555665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:59.863395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:01:59.874830 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a34b3f26-fcb4-4f72-93d6-34f90dad6279 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1308 microversion: 2.1 time: 0.335229 Oct 01 21:01:59.887652 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1611/2881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:59 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:01:59.896238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:59.896997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: 1431fcc7-a23c-42aa-b324-44adc7bb8a68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:59.904076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:59.905025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:59.905701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:59.906708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:59.907378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:59.907989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:59.930098 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] HTTP exception thrown: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Request method failure captured: Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 HTTP/1.1 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoczlQy3VAWlihMnXou_YNByq_RP_0iqE3KPFhLZqubRVu5nM4hVmhYCzYSSxVvbaSm6uxPNizJPHHbjOJWSMbT-M0NvGUoeNvh53fUZ01sQJATDBmXfEJcjUxWRB1a0k6SM47-TbleHurM5t5Kqy1T24qKXC3-WZLJLirEiMoWguU Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9566fa9a44f94c4ea3081a1a2e658de0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}] Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e84a109e337d450698e630acfb49f9a5 Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1431fcc7-a23c-42aa-b324-44adc7bb8a68'} Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:59.935476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Returning 404 to user: Instance 1431fcc7-a23c-42aa-b324-44adc7bb8a68 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2e373ca2-ec20-438a-a79d-8dfc0dcfb39b tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68" status: 404 len: 111 microversion: 2.1 time: 0.050051 Oct 01 21:01:59.942339 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1612/2882] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:59 2022] GET /compute/v2.1/servers/1431fcc7-a23c-42aa-b324-44adc7bb8a68 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:01:59.952014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:01:59.952837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:01:59.960433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:59.961868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:59.962585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:59.963844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:01:59.964588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:01:59.965417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:01:59.988868 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] HTTP exception thrown: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Request method failure captured: Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 HTTP/1.1 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoczlQy3VAWlihMnXou_YNByq_RP_0iqE3KPFhLZqubRVu5nM4hVmhYCzYSSxVvbaSm6uxPNizJPHHbjOJWSMbT-M0NvGUoeNvh53fUZ01sQJATDBmXfEJcjUxWRB1a0k6SM47-TbleHurM5t5Kqy1T24qKXC3-WZLJLirEiMoWguU Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9566fa9a44f94c4ea3081a1a2e658de0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}] Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e84a109e337d450698e630acfb49f9a5 Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46'} Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:01:59.990873 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Returning 404 to user: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:01:59.995155 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c1a35b76-34cb-4847-9fee-b9ee91947666 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 404 len: 111 microversion: 2.1 time: 0.050637 Oct 01 21:01:59.995965 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1613/2883] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:01:59 2022] DELETE /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:02:00.003857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:00.005146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] [instance: f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:00.014875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:00.015524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:00.016052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:00.017538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:00.018019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:00.018555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:00.059679 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] HTTP exception thrown: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Request method failure captured: Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 HTTP/1.1 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoczlQy3VAWlihMnXou_YNByq_RP_0iqE3KPFhLZqubRVu5nM4hVmhYCzYSSxVvbaSm6uxPNizJPHHbjOJWSMbT-M0NvGUoeNvh53fUZ01sQJATDBmXfEJcjUxWRB1a0k6SM47-TbleHurM5t5Kqy1T24qKXC3-WZLJLirEiMoWguU Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9566fa9a44f94c4ea3081a1a2e658de0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9566fa9a44f94c4ea3081a1a2e658de0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9566fa9a44f94c4ea3081a1a2e658de0"}]}] Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9566fa9a44f94c4ea3081a1a2e658de0 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1297257030 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e84a109e337d450698e630acfb49f9a5 Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerDiskConfigTestJSON-1297257030-project Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46'} Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:00.061358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] Returning 404 to user: Instance f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-44236bfa-f07a-4921-872f-c090f205fb66 tempest-ServerDiskConfigTestJSON-1297257030 tempest-ServerDiskConfigTestJSON-1297257030-project] 10.222.0.17 "GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46" status: 404 len: 111 microversion: 2.1 time: 0.063370 Oct 01 21:02:00.066172 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1614/2884] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:01:59 2022] GET /compute/v2.1/servers/f0c6afa8-d91d-4aa9-ba0e-a274d8b83e46 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:02:00.415632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:00.418011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:00.427321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:00.431622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:00.447425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:00.450135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:00.450649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:00.454385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:00.455091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:00.456389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:00.724264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:00.739932 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f25696df-ef3c-4b6a-93b6-b0516f386d38 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 0.329563 Oct 01 21:02:00.741416 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1615/2885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:00 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:00.753630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-78234646-dc92-4055-b97c-82f461f76f9b req-33157cba-83db-4c88-9270-3e3d27d5360b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a0d83c0-b37a-4973-84ee-07d7f3448dce", "tag": "951f468d-4da9-4460-9bcf-971bbbfe8776"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:00.779530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-78234646-dc92-4055-b97c-82f461f76f9b req-33157cba-83db-4c88-9270-3e3d27d5360b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:00.780239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-78234646-dc92-4055-b97c-82f461f76f9b req-33157cba-83db-4c88-9270-3e3d27d5360b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:00.780917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-78234646-dc92-4055-b97c-82f461f76f9b req-33157cba-83db-4c88-9270-3e3d27d5360b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:00.796741 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-78234646-dc92-4055-b97c-82f461f76f9b req-33157cba-83db-4c88-9270-3e3d27d5360b service nova] Creating event network-changed:951f468d-4da9-4460-9bcf-971bbbfe8776 for instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce on nch1-master-1 Oct 01 21:02:00.805252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-78234646-dc92-4055-b97c-82f461f76f9b req-33157cba-83db-4c88-9270-3e3d27d5360b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056503 Oct 01 21:02:00.806909 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1616/2886] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:00.813567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1859a672-ce95-4468-993a-a008416568b7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172847550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:00.916796 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1859a672-ce95-4468-993a-a008416568b7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.107896 Oct 01 21:02:00.919743 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1617/2887] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:00 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:00.932228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:00.933361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:00.941547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:00.942152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:00.942763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:00.943586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:00.944043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:00.944545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:01.290861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:01.300981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:01.309370 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cded9ad6-2d8d-4a48-8336-ad12a116d922 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1308 microversion: 2.1 time: 0.379511 Oct 01 21:02:01.311944 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1618/2888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:00 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:01.767567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:01.769076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:01.788213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:01.789843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:01.790647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:01.791759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:01.793410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:01.794076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:02.546808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:02.560290 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c5f51e94-5bce-4bb7-a5f5-8636785ea39a tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 0.797745 Oct 01 21:02:02.579858 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1619/2889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:01 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:02.596428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2700f15f-74e2-459b-ae79-ad88c2d5e688 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172fef160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:02.696938 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2700f15f-74e2-459b-ae79-ad88c2d5e688 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.115706 Oct 01 21:02:02.697567 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1620/2890] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:02 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:02.711705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:02.712626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:02.729669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:02.731783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:02.732311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:02.734724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:02.737158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:02.738577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:03.721805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:03.735091 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c3c0cb1-f3e3-4a3e-a727-76fd7f45e248 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1308 microversion: 2.1 time: 1.036049 Oct 01 21:02:03.739009 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1621/2891] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:02 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1308 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:03.749604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:03.751789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:03.780571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:03.781986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:03.784530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:03.787702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:03.790684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:03.791361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:04.627260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:04.645260 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5eb59bf4-2fcf-4f0f-af30-29eccf7d7f04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 0.902069 Oct 01 21:02:04.676666 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1622/2892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:03 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:04.693801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-10ad7b70-f47d-4326-af74-9071433284bc tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172f3e700>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:04.801718 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-10ad7b70-f47d-4326-af74-9071433284bc tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.119691 Oct 01 21:02:04.808528 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1623/2893] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:04 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:04.822393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-fab4bc94-0546-4148-bef8-725a65835ef2 req-0c835239-9a19-4f14-bb86-1d7edc4e5c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb9ea14-deab-4588-ade7-66aa910a3eb9", "name": "network-vif-plugged", "status": "completed", "tag": "beea046f-0dc7-4d4c-8922-c8b4a553c1ca"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:04.850479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fab4bc94-0546-4148-bef8-725a65835ef2 req-0c835239-9a19-4f14-bb86-1d7edc4e5c36 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:04.853322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fab4bc94-0546-4148-bef8-725a65835ef2 req-0c835239-9a19-4f14-bb86-1d7edc4e5c36 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:04.854096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fab4bc94-0546-4148-bef8-725a65835ef2 req-0c835239-9a19-4f14-bb86-1d7edc4e5c36 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:04.901033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-fab4bc94-0546-4148-bef8-725a65835ef2 req-0c835239-9a19-4f14-bb86-1d7edc4e5c36 service nova] Creating event network-vif-plugged:beea046f-0dc7-4d4c-8922-c8b4a553c1ca for instance abb9ea14-deab-4588-ade7-66aa910a3eb9 on nch1-master-1 Oct 01 21:02:04.916929 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-fab4bc94-0546-4148-bef8-725a65835ef2 req-0c835239-9a19-4f14-bb86-1d7edc4e5c36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102633 Oct 01 21:02:04.920343 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1624/2894] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:04.945684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:04.952558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:04.974787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:04.975869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:04.977051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:04.982028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:04.982922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:04.984172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:05.567039 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:02:05.567561 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:02:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:02:05.658153 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:02:05.658383 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:02:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:02:05.881403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:05.898309 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aaccebce-d91e-4aa1-9cda-ff980bbf3cea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1308 microversion: 2.1 time: 0.974490 Oct 01 21:02:05.917248 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1625/2895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:04 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1308 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:06.164515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a4780d2-cd88-4235-9a09-40b329bee503 tempest-FloatingIPDetailsNegativeTestJSON-1356472186 tempest-FloatingIPDetailsNegativeTestJSON-1356472186-project] Calling method '.version_select at 0x7f417285b280>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:06.470403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-0a4780d2-cd88-4235-9a09-40b329bee503 tempest-FloatingIPDetailsNegativeTestJSON-1356472186 tempest-FloatingIPDetailsNegativeTestJSON-1356472186-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b851e1ee-d577-4696-a06b-f337d759d539 could not be found", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:02:06.471151 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-0a4780d2-cd88-4235-9a09-40b329bee503 tempest-FloatingIPDetailsNegativeTestJSON-1356472186 tempest-FloatingIPDetailsNegativeTestJSON-1356472186-project] HTTP exception thrown: Floating IP not found for ID b851e1ee-d577-4696-a06b-f337d759d539 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a4780d2-cd88-4235-9a09-40b329bee503 tempest-FloatingIPDetailsNegativeTestJSON-1356472186 tempest-FloatingIPDetailsNegativeTestJSON-1356472186-project] Request method failure captured: Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-floating-ips/b851e1ee-d577-4696-a06b-f337d759d539 HTTP/1.1 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKrN4yqKp2HU2v2rFl0Bf0--YRWwKcLsSnSVU-1AbYWhJN3A0xunv8CYXfH-jo18-JexnpRms7nlWuZ1CPjVaQ0OjU47Ll-GY-FhDXftkNqZc6inbgPYhefjqpNv9dro3eHlwhimUwdAc91j9s9Qrf_Hz16tcB8yY9mMi_UQ-E689-s Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 4211ad493bf14dbd840457299d531cab Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1356472186 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4211ad493bf14dbd840457299d531cab", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4211ad493bf14dbd840457299d531cab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4211ad493bf14dbd840457299d531cab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4211ad493bf14dbd840457299d531cab"}]}] Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1356472186 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 4211ad493bf14dbd840457299d531cab Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1356472186 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1356472186-project Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: fcbbafa8ad2149cf8d9778badd73237c Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1356472186-project Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: exception: Floating IP not found for ID b851e1ee-d577-4696-a06b-f337d759d539 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'b851e1ee-d577-4696-a06b-f337d759d539'} Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:02:06.473107 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b851e1ee-d577-4696-a06b-f337d759d539 could not be found Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91099e49-3207-4407-aa92-7284adf1ca04'] Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b851e1ee-d577-4696-a06b-f337d759d539. Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b851e1ee-d577-4696-a06b-f337d759d539 Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b851e1ee-d577-4696-a06b-f337d759d539 Oct 01 21:02:06.478361 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:06.483445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a4780d2-cd88-4235-9a09-40b329bee503 tempest-FloatingIPDetailsNegativeTestJSON-1356472186 tempest-FloatingIPDetailsNegativeTestJSON-1356472186-project] Returning 404 to user: Floating IP not found for ID b851e1ee-d577-4696-a06b-f337d759d539 {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:02:06.483445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0a4780d2-cd88-4235-9a09-40b329bee503 tempest-FloatingIPDetailsNegativeTestJSON-1356472186 tempest-FloatingIPDetailsNegativeTestJSON-1356472186-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/b851e1ee-d577-4696-a06b-f337d759d539" status: 404 len: 111 microversion: 2.1 time: 0.563115 Oct 01 21:02:06.483445 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1626/2896] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 21:02:05 2022] GET /compute/v2.1/os-floating-ips/b851e1ee-d577-4696-a06b-f337d759d539 => generated 111 bytes in 565 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:02:06.490193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:06.502802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:06.521115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:06.521628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:06.522081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:06.522854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:06.523368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:06.523807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:07.889908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:07.902474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-adfcbfe2-5909-4367-aff4-a04dfa857826 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 1.417561 Oct 01 21:02:07.903722 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1627/2897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:06 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:07.909508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f9860680-a965-42cc-8ec5-4f4c657c27e0 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172867550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:08.006291 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f9860680-a965-42cc-8ec5-4f4c657c27e0 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.100770 Oct 01 21:02:08.007713 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1628/2898] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:07 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:08.015766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:08.016600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:08.026481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:08.027530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:08.028218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:08.029123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:08.030268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:08.030892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:09.876039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:09.907093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bab5998f-5d47-4a52-b82a-7899c53a6a00 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1308 microversion: 2.1 time: 1.881131 Oct 01 21:02:09.907770 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1629/2899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:08 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1308 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:09.924149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:09.925554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:09.950423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:09.951225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:09.952280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:09.953387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:09.953868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:09.954315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:10.483943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:10.493643 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49df4039-aec9-4887-bb6c-9cfd1822510f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 0.584385 Oct 01 21:02:10.500849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1630/2900] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:09 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:10.516628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f8acaad0-627c-4942-829e-fa24556b0903 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417303a9d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:10.610582 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f8acaad0-627c-4942-829e-fa24556b0903 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.106382 Oct 01 21:02:10.619562 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1631/2901] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:10 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:10.935926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:10.937821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:10.953766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:10.954330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:10.954807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:10.955559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:10.958167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:10.958650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:12.166013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:12.176644 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-130c0a85-25e3-4442-8513-d04f1e16a805 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1308 microversion: 2.1 time: 1.249991 Oct 01 21:02:12.177828 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1632/2902] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:10 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1308 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:12.184563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:12.185399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:12.200411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:12.201472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:12.202325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:12.203498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:12.204198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:12.204972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:13.641837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:13.652446 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4148d6f0-91cf-486b-b3c4-effd2ba8ce30 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 1.473148 Oct 01 21:02:13.667487 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1633/2903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:12 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:13.677646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1e5562bb-6dcb-4509-aec3-ef859bec94d8 req-e2be9cc6-7913-4ead-88a3-1e3ba787860c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0d83c0-b37a-4973-84ee-07d7f3448dce", "name": "network-vif-plugged", "status": "completed", "tag": "951f468d-4da9-4460-9bcf-971bbbfe8776"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:13.731434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1e5562bb-6dcb-4509-aec3-ef859bec94d8 req-e2be9cc6-7913-4ead-88a3-1e3ba787860c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:13.736155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1e5562bb-6dcb-4509-aec3-ef859bec94d8 req-e2be9cc6-7913-4ead-88a3-1e3ba787860c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:13.736920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1e5562bb-6dcb-4509-aec3-ef859bec94d8 req-e2be9cc6-7913-4ead-88a3-1e3ba787860c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:13.801872 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1e5562bb-6dcb-4509-aec3-ef859bec94d8 req-e2be9cc6-7913-4ead-88a3-1e3ba787860c service nova] Creating event network-vif-plugged:951f468d-4da9-4460-9bcf-971bbbfe8776 for instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce on nch1-master-1 Oct 01 21:02:13.816274 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1e5562bb-6dcb-4509-aec3-ef859bec94d8 req-e2be9cc6-7913-4ead-88a3-1e3ba787860c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144919 Oct 01 21:02:13.820647 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1634/2904] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:13.866393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-872a57c4-8b43-4cfb-a805-e7ec7e0208f4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41728dbe50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:13.994622 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-872a57c4-8b43-4cfb-a805-e7ec7e0208f4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.170944 Oct 01 21:02:13.995157 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1635/2905] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:13 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:14.002361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:14.003492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:14.012964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:14.016105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:14.016876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:14.017822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:14.018688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:14.019353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:14.862671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:14.872717 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-22365865-88b4-4b5f-b5b0-ff8a59dcbd4e tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1308 microversion: 2.1 time: 0.876319 Oct 01 21:02:14.875912 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1636/2906] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:13 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1308 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:14.887994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:14.888906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:14.902865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:14.906671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:14.909645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:14.910612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:14.914304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:14.914809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:15.781205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:15.817689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aa436a2e-8189-46cd-97f3-8b92f061e122 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 0.934836 Oct 01 21:02:15.823444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1637/2907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:14 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:15.837346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bafa59df-c588-4d32-9191-9433dfc364c6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417286b9d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:15.938857 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bafa59df-c588-4d32-9191-9433dfc364c6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.106384 Oct 01 21:02:15.939464 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1638/2908] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:15 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:15.944761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:15.945322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:15.964570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:15.965079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:15.965519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:15.966249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:15.966762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:15.967197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:17.607705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:17.627410 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc6ccd0c-3660-4788-8f30-b8c09be63027 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1308 microversion: 2.1 time: 1.685383 Oct 01 21:02:17.629969 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1639/2909] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:15 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1308 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:17.646020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:17.649120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:17.662847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:17.670317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:17.672487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:17.675721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:17.678523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:17.679948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:17.680925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:18.774879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:18.793132 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a240ed95-0bc3-4e29-b367-4ea50432fa9b tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 1.160870 Oct 01 21:02:18.793755 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1640/2910] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:17 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:18.857553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cae7a05f-2795-43b2-904f-310d18e5ef34 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172855d30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:18.979153 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cae7a05f-2795-43b2-904f-310d18e5ef34 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.165410 Oct 01 21:02:18.980467 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1641/2911] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:18 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:19.513631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2077423522", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:19.641480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] validate_networks() for [('d98999bf-5191-456b-971a-d9c9b2364d89', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:02:22.164351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:02:22.165567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:02:22.167948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:02:22.168564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:02:22.170991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:02:22.202214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:22.214186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:22.214894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:22.215935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:22.221742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:22.222479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:22.279368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Getting quotas for project 2c8d44c4bbfc44a297c82cda39868ddd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:22.295677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Getting quotas for user 5a92405f06244dfeba65a9cc22bdaa2e and project 2c8d44c4bbfc44a297c82cda39868ddd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:22.338043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:02:22.340721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:02:22.469689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-776642c7-3914-4fca-8d54-96af1a7bbf58 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.487916 Oct 01 21:02:22.481400 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1642/2912] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:02:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:02:22.493199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:22.496704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:22.514057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:22.516475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:22.516972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:22.517922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:22.519910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:22.520535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:23.989708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:23.996312 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-69c5bb9b-b102-4eed-9c0c-a0b7ffa396f6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1488 microversion: 2.1 time: 1.511686 Oct 01 21:02:23.996914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1643/2913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:22 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1488 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:24.037845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:24.051677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:24.073726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:24.074333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:24.074822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:24.075581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:24.076047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:24.076478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:24.565860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:24.575075 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1fa83385-d2a4-4bac-b0d1-9ebdd6236b5c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 0.577120 Oct 01 21:02:24.579673 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1644/2914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:23 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:24.586034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc6cc786-6b23-4336-acae-f14cf63143b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41730288b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:24.667725 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc6cc786-6b23-4336-acae-f14cf63143b3 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.086707 Oct 01 21:02:24.669128 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1645/2915] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:24 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:24.683060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:24.686473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:24.711812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:24.715266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:24.716109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:24.718445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:24.721618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:24.722445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:24.767504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:25.164351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:25.176248 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d6e0e76c-0a13-472e-a5ae-8ff78d08336f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1275 microversion: 2.1 time: 0.503437 Oct 01 21:02:25.181999 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1646/2916] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:24 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1275 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:25.330563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f4415c6-52e9-4482-89c6-b5f529900a11 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Action: 'create', calling method: .version_select at 0x7f417286a4c0>, body: {"keypair": {"name": "tempest-keypair-2144684518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMntmqUXHAIxmP6nMx81Fz9QRpI3/vKiKI5gQkEAWttz9C3hMXwCRj8uWDTdu3MR0CMghOkXaU1o6FlQM/NaiFc52GkMiVaNW0GEkAZRjzxasbhDkR/XVV+IM3FQ5C4TKw=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:25.368008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-0f4415c6-52e9-4482-89c6-b5f529900a11 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Getting quotas for project 4ae7982f0b4349c6ab1c445988ea4f9f. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:25.377517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-0f4415c6-52e9-4482-89c6-b5f529900a11 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Getting quotas for user 221b665fc7cb4758a6e35cc81c6a4d43 and project 4ae7982f0b4349c6ab1c445988ea4f9f. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:25.473051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f4415c6-52e9-4482-89c6-b5f529900a11 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.289603 Oct 01 21:02:25.473697 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1647/2917] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:02:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:25.482788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:25.483414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:25.526219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:25.530440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:25.532481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:25.535650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:25.537437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:25.538587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:26.029148 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:02:26.029922 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:02:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:02:26.715893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:26.726300 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6139997f-f813-4395-a01e-d64030e33763 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 200 len: 1489 microversion: 2.1 time: 1.250957 Oct 01 21:02:26.727573 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1648/2918] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:25 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 1489 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:26.733231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:26.734092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:26.740756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:26.742162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:26.742884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:26.743876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:26.744556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:26.745232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:27.576231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:27.594170 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f334e60f-c274-44c7-8ae8-9b2b03ba7806 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1521 microversion: 2.1 time: 0.865091 Oct 01 21:02:27.606180 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1649/2919] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:26 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1521 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:27.637376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4fa446b3-bee7-40c4-9cae-7bb274068d33 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172845040>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:27.774592 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4fa446b3-bee7-40c4-9cae-7bb274068d33 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1453 microversion: 2.1 time: 0.167030 Oct 01 21:02:27.776214 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1650/2920] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:27 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:27.795701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:27.801194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:27.831041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:27.836376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:27.841079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:27.842396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:27.852828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:27.854839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:28.396942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:28.414806 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76f978a3-f7de-4b9b-887b-62b60dcb1b8b tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1323 microversion: 2.1 time: 0.636746 Oct 01 21:02:28.423101 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1651/2921] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:27 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1323 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:28.435931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:28.450330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:28.463629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:28.468389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:28.470853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:28.473762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:28.475078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:28.477124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:28.915191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:28.966764 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cffb33bb-582e-47cb-b2b3-27a0b90ff876 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1488 microversion: 2.1 time: 0.542086 Oct 01 21:02:28.971987 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1652/2922] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:28 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1488 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:28.978956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:28.982278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:29.004265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:29.004770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:29.005220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:29.005947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:29.006412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:29.007390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:29.421485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:29.462609 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-101010a4-4791-47f7-9db0-ef34b11c2460 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1501 microversion: 2.1 time: 0.487332 Oct 01 21:02:29.463261 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1653/2923] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:28 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1501 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:29.496496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f39be4ce-268d-48c9-8f61-4cb4e286259c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417298a160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:29.610453 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f39be4ce-268d-48c9-8f61-4cb4e286259c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1462 microversion: 2.1 time: 0.145369 Oct 01 21:02:29.612264 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1654/2924] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:29 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1462 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:29.643326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:29.646036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:29.682757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:29.683546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:29.684615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:29.686209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:29.689972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:29.691635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:29.806370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:02:29.950317 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dd706736-fa6e-42e6-b48e-a4de5bdcc126 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 204 len: 0 microversion: 2.1 time: 0.334044 Oct 01 21:02:29.955155 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1655/2925] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:02:29 2022] DELETE /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:02:29.961322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:29.962410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:29.969960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:29.970737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:29.971376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:29.972300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:29.972931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:29.973521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:30.864397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:30.893973 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-04f0e18b-18a2-4b0c-a9cf-0a57117adff2 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1323 microversion: 2.1 time: 0.937189 Oct 01 21:02:30.895392 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1656/2926] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:29 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1323 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:30.901199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:30.903694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:30.911479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:30.912365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:30.913897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:30.915057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:30.915840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:30.917299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:31.477190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:31.491753 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-41e8c3e6-556f-4ca1-bde1-5864cbad9728 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1515 microversion: 2.1 time: 0.593853 Oct 01 21:02:31.493838 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1657/2927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:30 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1515 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:31.500617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dfb2f07d-aa33-4abd-a370-486e98e1d82a tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417284ea60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:31.567161 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dfb2f07d-aa33-4abd-a370-486e98e1d82a tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 200 len: 1462 microversion: 2.1 time: 0.071243 Oct 01 21:02:31.569700 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1658/2928] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:31 2022] GET /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 1462 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:31.575762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:31.576787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:31.588476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:31.589299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:31.590008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:31.591018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:31.591710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:31.592385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:32.150436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:32.163956 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bee2d837-ac90-4c7a-a2ee-ad47a6a2a461 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 200 len: 1494 microversion: 2.1 time: 0.592906 Oct 01 21:02:32.182293 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1659/2929] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:31 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 1494 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:32.190803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6394f8da-8ebf-45fe-9e44-1f38a1b5988d req-e609f797-1aed-4d5b-acd5-a090141a8d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63377103-ae63-4f66-a6b7-d6f4a2d8492e", "tag": "311ec718-8814-44c7-a006-cc05466167f1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:32.207167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6394f8da-8ebf-45fe-9e44-1f38a1b5988d req-e609f797-1aed-4d5b-acd5-a090141a8d1f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:32.213164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6394f8da-8ebf-45fe-9e44-1f38a1b5988d req-e609f797-1aed-4d5b-acd5-a090141a8d1f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:32.214171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6394f8da-8ebf-45fe-9e44-1f38a1b5988d req-e609f797-1aed-4d5b-acd5-a090141a8d1f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:32.228186 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6394f8da-8ebf-45fe-9e44-1f38a1b5988d req-e609f797-1aed-4d5b-acd5-a090141a8d1f service nova] Creating event network-changed:311ec718-8814-44c7-a006-cc05466167f1 for instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e on nch2-master-1 Oct 01 21:02:32.234110 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6394f8da-8ebf-45fe-9e44-1f38a1b5988d req-e609f797-1aed-4d5b-acd5-a090141a8d1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049973 Oct 01 21:02:32.235490 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1660/2930] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:32.242611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-def2746d-83ef-408a-9b18-333fa82d2d04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:32.246717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-def2746d-83ef-408a-9b18-333fa82d2d04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 006b13f4-8ebf-490b-819d-9de23e220ef6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:32.250903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:32.264182 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-def2746d-83ef-408a-9b18-333fa82d2d04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] HTTP exception thrown: Instance 006b13f4-8ebf-490b-819d-9de23e220ef6 could not be found. Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-def2746d-83ef-408a-9b18-333fa82d2d04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Request method failure captured: Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/006b13f4-8ebf-490b-819d-9de23e220ef6/action HTTP/1.1 Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 14 Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqkgfbc_8hDaJm-zKHvqTb6WWcCcwT0-Bfkvm8f894klqAsv6S6gceYSMqZE_iA9F1ar8j4XUgVkIuKhn9h8Rgo_aMUHe71Q6i1rgQeqhiP7Q24mua9fZcb3yfEC6hkQVWHSn1eqeodqqIny5w_VbZ67CSAF_63x-EWWDMDYONExeM Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10fefee3d6a6430682316cd94b859f1e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}] Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6bda28994cb14f92b014a147a7e74476 Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: {"rescue": {}} Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 006b13f4-8ebf-490b-819d-9de23e220ef6 could not be found. Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '006b13f4-8ebf-490b-819d-9de23e220ef6', 'body': {'rescue': {}}} Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006b13f4-8ebf-490b-819d-9de23e220ef6 could not be found. Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006b13f4-8ebf-490b-819d-9de23e220ef6 could not be found. Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:32.271916 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:32.278158 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:32.278158 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:32.278158 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:02:32.278158 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:02:32.278158 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006b13f4-8ebf-490b-819d-9de23e220ef6 could not be found. Oct 01 21:02:32.278158 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:32.278158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-def2746d-83ef-408a-9b18-333fa82d2d04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Returning 404 to user: Instance 006b13f4-8ebf-490b-819d-9de23e220ef6 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:02:32.278818 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-def2746d-83ef-408a-9b18-333fa82d2d04 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/006b13f4-8ebf-490b-819d-9de23e220ef6/action" status: 404 len: 111 microversion: 2.1 time: 0.040221 Oct 01 21:02:32.279749 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1661/2931] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:02:32 2022] POST /compute/v2.1/servers/006b13f4-8ebf-490b-819d-9de23e220ef6/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:02:32.291130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:32.295149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:32.316868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:32.317565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:32.320501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:32.321371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:32.322026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:32.322619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:32.706046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:32.715305 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5cdd2e70-0acf-4bed-8921-3c8b7144d66c tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9" status: 200 len: 1468 microversion: 2.1 time: 0.433178 Oct 01 21:02:32.716448 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1662/2932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:32 2022] GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9 => generated 1468 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:32.721290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0982732d-d1ab-499a-9a49-c392095da510 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Calling method '.version_select at 0x7f417284ea60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:32.800264 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0982732d-d1ab-499a-9a49-c392095da510 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7" status: 200 len: 637 microversion: 2.1 time: 0.082497 Oct 01 21:02:32.801003 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1663/2933] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:32 2022] GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7 => generated 637 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:32.801957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0982732d-d1ab-499a-9a49-c392095da510 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:32.802883 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0982732d-d1ab-499a-9a49-c392095da510 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001072 Oct 01 21:02:32.814953 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1664/2934] 10.222.0.17 () {56 vars in 886 bytes} [Sat Oct 1 21:02:32 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 01 21:02:32.821496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:32.822275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:32.839336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:32.840033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:32.840945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:32.841918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:32.842626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:32.843396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:33.220935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:33.252269 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f3c93ef-e450-4e83-9cd7-02902de5e014 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1323 microversion: 2.1 time: 0.434622 Oct 01 21:02:33.254662 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1665/2935] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:32 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:33.266823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-336997243", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "cf269234-f540-4e7e-89dc-09d308a547d4"}], "security_groups": [{"name": "tempest-securitygroup--2025525509"}], "key_name": "tempest-keypair-2144684518", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:33.433028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] validate_networks() for [('cf269234-f540-4e7e-89dc-09d308a547d4', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:02:34.093153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Getting quotas for project 4ae7982f0b4349c6ab1c445988ea4f9f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:34.099852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Getting quotas for user 221b665fc7cb4758a6e35cc81c6a4d43 and project 4ae7982f0b4349c6ab1c445988ea4f9f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:34.121333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:02:34.121932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:02:34.123501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:02:34.124211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:02:34.124799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:02:34.138881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:34.139684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:34.140286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:34.141228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:34.146074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:34.146798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:34.166195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Getting quotas for project 4ae7982f0b4349c6ab1c445988ea4f9f. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:34.171926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Getting quotas for user 221b665fc7cb4758a6e35cc81c6a4d43 and project 4ae7982f0b4349c6ab1c445988ea4f9f. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:34.188222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:02:34.190849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:02:34.248238 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6b8fdd8b-a831-446d-bd8b-7e21a62518e9 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.992049 Oct 01 21:02:34.249310 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1666/2936] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:02:33 2022] POST /compute/v2.1/servers => generated 407 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:02:34.257727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fcde49d6-d205-4489-a3c2-0376335b2bd1 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:34.258966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fcde49d6-d205-4489-a3c2-0376335b2bd1 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:34.267485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcde49d6-d205-4489-a3c2-0376335b2bd1 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:34.268220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcde49d6-d205-4489-a3c2-0376335b2bd1 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:34.268839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcde49d6-d205-4489-a3c2-0376335b2bd1 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:34.270680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcde49d6-d205-4489-a3c2-0376335b2bd1 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:34.271743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcde49d6-d205-4489-a3c2-0376335b2bd1 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:34.273135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcde49d6-d205-4489-a3c2-0376335b2bd1 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:34.410879 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fcde49d6-d205-4489-a3c2-0376335b2bd1 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action" status: 202 len: 0 microversion: 2.1 time: 0.159626 Oct 01 21:02:34.412613 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1667/2937] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:02:34 2022] POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:02:34.432148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3026e568-59f7-4d61-a401-f08c6605c3a4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1576670096"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:34.436262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3026e568-59f7-4d61-a401-f08c6605c3a4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:34.455281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3026e568-59f7-4d61-a401-f08c6605c3a4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:34.455825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3026e568-59f7-4d61-a401-f08c6605c3a4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:34.456273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3026e568-59f7-4d61-a401-f08c6605c3a4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:34.457136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3026e568-59f7-4d61-a401-f08c6605c3a4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:34.457596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3026e568-59f7-4d61-a401-f08c6605c3a4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:34.458027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3026e568-59f7-4d61-a401-f08c6605c3a4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:34.567823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:34.905106 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3026e568-59f7-4d61-a401-f08c6605c3a4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "POST /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf/action" status: 202 len: 0 microversion: 2.1 time: 0.472800 Oct 01 21:02:34.911367 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1668/2938] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:02:34 2022] POST /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 21:02:34.933477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4dc6971-3337-4d7f-b366-0de79ee07142 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Action: 'update_all', calling method: .version_select at 0x7f41728769d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:35.092029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b4dc6971-3337-4d7f-b366-0de79ee07142 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:35.100714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:35.108093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b4dc6971-3337-4d7f-b366-0de79ee07142 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for user 6246e90f7e1b4fb39f6ed6a90cb67d61 and project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:35.705977 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4dc6971-3337-4d7f-b366-0de79ee07142 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.791682 Oct 01 21:02:35.706966 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1669/2939] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:02:34 2022] PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 61 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:35.712689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cb909cbc-8693-4772-bce8-6d53494f22e7 req-ca0cc779-5af3-44b6-bf81-2bc7d0e3a983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0d83c0-b37a-4973-84ee-07d7f3448dce", "name": "network-vif-deleted", "tag": "951f468d-4da9-4460-9bcf-971bbbfe8776"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:35.739031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cb909cbc-8693-4772-bce8-6d53494f22e7 req-ca0cc779-5af3-44b6-bf81-2bc7d0e3a983 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:35.739725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cb909cbc-8693-4772-bce8-6d53494f22e7 req-ca0cc779-5af3-44b6-bf81-2bc7d0e3a983 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:35.740336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cb909cbc-8693-4772-bce8-6d53494f22e7 req-ca0cc779-5af3-44b6-bf81-2bc7d0e3a983 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:35.768480 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cb909cbc-8693-4772-bce8-6d53494f22e7 req-ca0cc779-5af3-44b6-bf81-2bc7d0e3a983 service nova] Creating event network-vif-deleted:951f468d-4da9-4460-9bcf-971bbbfe8776 for instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce on nch1-master-1 Oct 01 21:02:35.784358 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cb909cbc-8693-4772-bce8-6d53494f22e7 req-ca0cc779-5af3-44b6-bf81-2bc7d0e3a983 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075781 Oct 01 21:02:35.785119 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1670/2940] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:35.790772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:35.791431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:35.804269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:35.804774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:35.805224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:35.805944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:35.806407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:35.807122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:35.851563 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce HTTP/1.1 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '8a0d83c0-b37a-4973-84ee-07d7f3448dce'} Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:35.853261 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:35.859469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:35.859469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:35.859469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:02:35.859469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:02:35.859469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:02:35.859469 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:35.859469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:02:35.859469 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d65f1462-6f69-4ca7-ac7c-81e299ae2b3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 404 len: 111 microversion: 2.1 time: 0.068344 Oct 01 21:02:35.861521 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1671/2941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:35 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:02:35.882124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:35.884109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:35.901311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:35.901945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:35.902338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:35.903176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:35.903644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:35.904154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:36.133153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:36.165643 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-794bf926-ca3d-4fc8-a76e-cf3f09458f0d tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1321 microversion: 2.1 time: 0.302232 Oct 01 21:02:36.166981 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1672/2942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:35 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:36.175170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:36.181803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:36.192217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:36.196288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:36.197031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:36.198516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:36.199269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:36.200181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:36.714104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:36.730813 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a7076ce3-60b1-480f-801c-0d90d5d25afa tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1323 microversion: 2.1 time: 0.561778 Oct 01 21:02:36.734671 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1673/2943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:36 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1323 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:36.761433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b9d07520-ca00-42bc-868f-b72612165b0d req-dade38a1-cb8f-4e2f-8254-6b30b362f038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb9ea14-deab-4588-ade7-66aa910a3eb9", "name": "network-vif-unplugged", "status": "completed", "tag": "beea046f-0dc7-4d4c-8922-c8b4a553c1ca"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:36.793366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b9d07520-ca00-42bc-868f-b72612165b0d req-dade38a1-cb8f-4e2f-8254-6b30b362f038 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:36.794700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b9d07520-ca00-42bc-868f-b72612165b0d req-dade38a1-cb8f-4e2f-8254-6b30b362f038 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:36.795161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b9d07520-ca00-42bc-868f-b72612165b0d req-dade38a1-cb8f-4e2f-8254-6b30b362f038 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:36.815967 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b9d07520-ca00-42bc-868f-b72612165b0d req-dade38a1-cb8f-4e2f-8254-6b30b362f038 service nova] Creating event network-vif-unplugged:beea046f-0dc7-4d4c-8922-c8b4a553c1ca for instance abb9ea14-deab-4588-ade7-66aa910a3eb9 on nch1-master-1 Oct 01 21:02:36.825668 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b9d07520-ca00-42bc-868f-b72612165b0d req-dade38a1-cb8f-4e2f-8254-6b30b362f038 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088073 Oct 01 21:02:36.827104 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1674/2944] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:36.835405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:36.836429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:36.845707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:36.846695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:36.847388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:36.848438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:36.855165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:36.856169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:37.698290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:37.709739 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1989e9a8-8b70-447d-a94a-1bc3ac529de8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1500 microversion: 2.1 time: 0.880527 Oct 01 21:02:37.710799 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1675/2945] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:36 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1500 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:37.727518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ffb66318-bbfc-4a0d-97d6-34a8b62365f5 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417298a670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:37.792160 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ffb66318-bbfc-4a0d-97d6-34a8b62365f5 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.078645 Oct 01 21:02:37.794084 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1676/2946] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:37 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:37.812592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2ce5780-740f-4b12-883d-1dd67481cd18 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Calling method '.version_select at 0x7f4172876820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:38.175984 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a2ce5780-740f-4b12-883d-1dd67481cd18 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "DELETE /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.374013 Oct 01 21:02:38.177141 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1677/2947] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Oct 1 21:02:37 2022] DELETE /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata/os_version => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:02:38.184674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:38.187847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:38.216320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:38.216838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:38.217702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:38.218580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:38.219094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:38.219614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:38.258796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:02:38.405319 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d63ba8a5-c5b1-4f38-bc23-70c4c45b85e9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 204 len: 0 microversion: 2.1 time: 0.226431 Oct 01 21:02:38.406129 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1678/2948] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:02:38 2022] DELETE /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:02:38.412193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:38.413535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:38.420897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:38.420897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:38.420897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:38.421338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:38.421692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:38.422123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:38.518431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:38.527983 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f1350fa1-37c3-4a98-a5c3-8adbc158d034 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1327 microversion: 2.1 time: 0.119816 Oct 01 21:02:38.539580 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1679/2949] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:38 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:38.546976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:38.549815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:38.557211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:38.558421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:38.559183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:38.559755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:38.560240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:38.560687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:38.589289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lazy-loading 'flavor' on Instance uuid 30280ed1-e136-4729-8d11-bcec883bebd5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:02:38.607445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] HTTP exception thrown: Cannot 'rescue' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state paused Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Request method failure captured: Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action HTTP/1.1 Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 14 Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqkgfbc_8hDaJm-zKHvqTb6WWcCcwT0-Bfkvm8f894klqAsv6S6gceYSMqZE_iA9F1ar8j4XUgVkIuKhn9h8Rgo_aMUHe71Q6i1rgQeqhiP7Q24mua9fZcb3yfEC6hkQVWHSn1eqeodqqIny5w_VbZ67CSAF_63x-EWWDMDYONExeM Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10fefee3d6a6430682316cd94b859f1e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}] Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6bda28994cb14f92b014a147a7e74476 Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: {"rescue": {}} Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'rescue' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state paused Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '30280ed1-e136-4729-8d11-bcec883bebd5', 'body': {'rescue': {}}} Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30280ed1-e136-4729-8d11-bcec883bebd5 in vm_state paused. Cannot rescue while the instance is in this state. Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state paused Oct 01 21:02:38.609477 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state paused Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Returning 409 to user: Cannot 'rescue' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state paused {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-973e66c5-2a8f-4c37-8228-b6f0eee7eadd tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action" status: 409 len: 144 microversion: 2.1 time: 0.070035 Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1680/2950] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:02:38 2022] POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action => generated 144 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:02:38.619385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:38.622181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:38.628227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:38.628753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:38.629203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:38.630216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:38.630734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:38.631701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:39.084491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:39.094028 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8c35c58b-5db8-4fc9-b73e-f3dcfb286df1 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1323 microversion: 2.1 time: 0.480995 Oct 01 21:02:39.094631 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1681/2951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:38 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1323 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:39.100127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-52a171a3-7109-4ac8-ac53-7fb6a286acfc tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Calling method '.version_select at 0x7f417286ad30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:39.164642 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-52a171a3-7109-4ac8-ac53-7fb6a286acfc tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 37 microversion: 2.1 time: 0.068536 Oct 01 21:02:39.165518 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1682/2952] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 21:02:39 2022] GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 37 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:39.171019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:39.171995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:39.180647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:39.181371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:39.182559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:39.183554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:39.184323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:39.185056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:39.836236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:39.860185 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4f7980b-52b6-4f98-bf20-f86ccbc77644 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 200 len: 1495 microversion: 2.1 time: 0.693323 Oct 01 21:02:39.860811 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1683/2953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:39 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 1495 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:39.866795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e17ee777-7a8f-465f-b95f-20662a867cdc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:39.873631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e17ee777-7a8f-465f-b95f-20662a867cdc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:39.893725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e17ee777-7a8f-465f-b95f-20662a867cdc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:39.896355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e17ee777-7a8f-465f-b95f-20662a867cdc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:39.897654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e17ee777-7a8f-465f-b95f-20662a867cdc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:39.901726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e17ee777-7a8f-465f-b95f-20662a867cdc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:39.902573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e17ee777-7a8f-465f-b95f-20662a867cdc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:39.906661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e17ee777-7a8f-465f-b95f-20662a867cdc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:40.128326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e17ee777-7a8f-465f-b95f-20662a867cdc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action" status: 202 len: 0 microversion: 2.1 time: 0.265775 Oct 01 21:02:40.132232 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1684/2954] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:02:39 2022] POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:02:40.137854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15304b5c-e4b0-4187-944d-ff3ac0f36c57 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417285bee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:40.220970 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15304b5c-e4b0-4187-944d-ff3ac0f36c57 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.087213 Oct 01 21:02:40.222052 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1685/2955] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:40 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:40.227655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5a56263b-a369-4cf3-ab20-df555c0fc850 req-1d6344cc-ac49-4d11-8a1f-df2700512852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63377103-ae63-4f66-a6b7-d6f4a2d8492e", "name": "network-vif-plugged", "status": "completed", "tag": "311ec718-8814-44c7-a006-cc05466167f1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:40.239024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a56263b-a369-4cf3-ab20-df555c0fc850 req-1d6344cc-ac49-4d11-8a1f-df2700512852 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:40.248146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a56263b-a369-4cf3-ab20-df555c0fc850 req-1d6344cc-ac49-4d11-8a1f-df2700512852 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:40.248826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5a56263b-a369-4cf3-ab20-df555c0fc850 req-1d6344cc-ac49-4d11-8a1f-df2700512852 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:40.272773 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5a56263b-a369-4cf3-ab20-df555c0fc850 req-1d6344cc-ac49-4d11-8a1f-df2700512852 service nova] Creating event network-vif-plugged:311ec718-8814-44c7-a006-cc05466167f1 for instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e on nch2-master-1 Oct 01 21:02:40.279098 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5a56263b-a369-4cf3-ab20-df555c0fc850 req-1d6344cc-ac49-4d11-8a1f-df2700512852 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055553 Oct 01 21:02:40.279838 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1686/2956] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:40.304588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f470aa4-1c5b-43e3-9754-f87a0c71357f tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Action: 'update_all', calling method: .version_select at 0x7f41728761f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:40.463713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6f470aa4-1c5b-43e3-9754-f87a0c71357f tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:40.474126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6f470aa4-1c5b-43e3-9754-f87a0c71357f tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for user 6246e90f7e1b4fb39f6ed6a90cb67d61 and project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:41.020823 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f470aa4-1c5b-43e3-9754-f87a0c71357f tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.739414 Oct 01 21:02:41.021423 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1687/2957] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:02:40 2022] PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 61 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:41.029396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:41.032773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:41.060022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:41.060544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:41.063396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:41.067288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:41.069550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:41.070160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:41.749769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:41.767737 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75094c30-551d-48e0-a9e7-76e84b9fbde7 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1395 microversion: 2.1 time: 0.743227 Oct 01 21:02:41.769349 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1688/2958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:41 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1395 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:41.778018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:41.778807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:41.796820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:41.797536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:41.799283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:41.807505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:41.808336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:41.809006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:42.281858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:42.300289 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3312df8f-07c4-48db-aa45-af999b4dd158 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1323 microversion: 2.1 time: 0.526823 Oct 01 21:02:42.302684 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1689/2959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:41 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1323 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:42.322256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:42.324733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:42.350280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:42.354411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:42.355477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:42.357124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:42.358219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:42.358907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:42.401008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:42.838361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:42.854385 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-637021ac-5d13-4370-85b5-8538e1c13a76 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1515 microversion: 2.1 time: 0.543894 Oct 01 21:02:42.881821 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1690/2960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:42 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1515 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:42.890464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:42.894222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:42.910045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:42.910880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:42.912723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:42.913776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:42.918958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:42.919730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:42.999288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:43.003004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:43.004188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:43.005221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lazy-loading 'fault' on Instance uuid 90b8899d-c628-41cc-9c72-0687112c14d3 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:02:43.135260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:43.147150 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-119270fb-e480-40ee-b3b3-2208934e0fd9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 200 len: 1298 microversion: 2.1 time: 0.261396 Oct 01 21:02:43.150801 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1691/2961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:42 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 1298 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:43.179353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-201ef605-1728-47db-9e1f-f15e4a0cca3b tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Calling method '.version_select at 0x7f417281a670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:43.240214 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-201ef605-1728-47db-9e1f-f15e4a0cca3b tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.070811 Oct 01 21:02:43.241577 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1692/2962] 10.222.0.17 () {58 vars in 1290 bytes} [Sat Oct 1 21:02:43 2022] GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata/os_distro => generated 33 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:43.249692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac168978-4fa4-4c99-8cdc-e8646ccafd35 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417284ed30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:43.308314 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac168978-4fa4-4c99-8cdc-e8646ccafd35 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.065391 Oct 01 21:02:43.309682 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1693/2963] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:43 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:43.335162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-74eb1352-7027-44e1-ac76-9f4641a46052 req-385dc375-a435-4c4c-8c91-1419723919c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b8899d-c628-41cc-9c72-0687112c14d3", "name": "network-vif-deleted", "tag": "fda1632d-01e6-4da9-86a2-31acfce88deb"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:43.357638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-74eb1352-7027-44e1-ac76-9f4641a46052 req-385dc375-a435-4c4c-8c91-1419723919c7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:43.358270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-74eb1352-7027-44e1-ac76-9f4641a46052 req-385dc375-a435-4c4c-8c91-1419723919c7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:43.358868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-74eb1352-7027-44e1-ac76-9f4641a46052 req-385dc375-a435-4c4c-8c91-1419723919c7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:43.392542 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-74eb1352-7027-44e1-ac76-9f4641a46052 req-385dc375-a435-4c4c-8c91-1419723919c7 service nova] Creating event network-vif-deleted:fda1632d-01e6-4da9-86a2-31acfce88deb for instance 90b8899d-c628-41cc-9c72-0687112c14d3 on nch2-master-1 Oct 01 21:02:43.403769 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-74eb1352-7027-44e1-ac76-9f4641a46052 req-385dc375-a435-4c4c-8c91-1419723919c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092600 Oct 01 21:02:43.405201 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1694/2964] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:43.411471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e3123a73-146f-401e-b9aa-14e7957914f5 req-1485da62-4584-4790-b22e-c467446a427b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9254b8-cb84-4fee-a58e-e9e32ac600cb", "tag": "fdaa80d8-f655-4ba4-aec6-6acb2bbfcd0e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:43.426511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e3123a73-146f-401e-b9aa-14e7957914f5 req-1485da62-4584-4790-b22e-c467446a427b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:43.427333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e3123a73-146f-401e-b9aa-14e7957914f5 req-1485da62-4584-4790-b22e-c467446a427b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:43.428664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e3123a73-146f-401e-b9aa-14e7957914f5 req-1485da62-4584-4790-b22e-c467446a427b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:43.444292 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e3123a73-146f-401e-b9aa-14e7957914f5 req-1485da62-4584-4790-b22e-c467446a427b service nova] Creating event network-changed:fdaa80d8-f655-4ba4-aec6-6acb2bbfcd0e for instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb on nch1-master-1 Oct 01 21:02:43.451403 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e3123a73-146f-401e-b9aa-14e7957914f5 req-1485da62-4584-4790-b22e-c467446a427b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044213 Oct 01 21:02:43.453006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1695/2965] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:43.458799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6d18a931-02f8-4ec8-9bbf-05560b6a6bd8 req-c0192ae1-39a9-4afc-98d9-0a6bebdac6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12ab455-2d67-4728-9293-bd843f39bedf", "name": "network-vif-plugged", "status": "completed", "tag": "8a94b425-9ca6-4166-8a17-467ca29d4cf8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:43.474436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6d18a931-02f8-4ec8-9bbf-05560b6a6bd8 req-c0192ae1-39a9-4afc-98d9-0a6bebdac6ec service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:43.475517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6d18a931-02f8-4ec8-9bbf-05560b6a6bd8 req-c0192ae1-39a9-4afc-98d9-0a6bebdac6ec service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:43.476314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6d18a931-02f8-4ec8-9bbf-05560b6a6bd8 req-c0192ae1-39a9-4afc-98d9-0a6bebdac6ec service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:43.494829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6d18a931-02f8-4ec8-9bbf-05560b6a6bd8 req-c0192ae1-39a9-4afc-98d9-0a6bebdac6ec service nova] Creating event network-vif-plugged:8a94b425-9ca6-4166-8a17-467ca29d4cf8 for instance d12ab455-2d67-4728-9293-bd843f39bedf on nch1-master-1 Oct 01 21:02:43.500319 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6d18a931-02f8-4ec8-9bbf-05560b6a6bd8 req-c0192ae1-39a9-4afc-98d9-0a6bebdac6ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045803 Oct 01 21:02:43.501874 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1696/2966] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:43.511129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:43.515838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:43.523174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:43.525445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:43.525445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:43.525445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:43.526014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:43.526571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:43.873952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:43.886073 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2f28be4-dc01-4b0f-ad43-1c86806e8666 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1395 microversion: 2.1 time: 0.380440 Oct 01 21:02:43.888072 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1697/2967] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:43 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1395 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:43.900460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb744e25-8f02-4a7a-935d-e0bd85facea3 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Action: 'update_all', calling method: .version_select at 0x7f417285b9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:44.005579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eb744e25-8f02-4a7a-935d-e0bd85facea3 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:44.050195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eb744e25-8f02-4a7a-935d-e0bd85facea3 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for user 6246e90f7e1b4fb39f6ed6a90cb67d61 and project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:44.156553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:44.378609 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb744e25-8f02-4a7a-935d-e0bd85facea3 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.482476 Oct 01 21:02:44.379244 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1698/2968] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:02:43 2022] PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 61 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:44.388044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:44.391581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:44.426550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:44.428092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:44.429550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:44.432210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:44.434310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:44.435914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:44.984331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:44.994904 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2658d241-3a1c-41d3-a5e0-95b4bf5289e4 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1517 microversion: 2.1 time: 0.614531 Oct 01 21:02:45.000776 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1699/2969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:44 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1517 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:45.008295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:45.014909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:45.036176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:45.037218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:45.038389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:45.049252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:45.049989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:45.050690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:45.070799 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 HTTP/1.1 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '90b8899d-c628-41cc-9c72-0687112c14d3'} Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:45.072844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:02:45.078422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:02:45.078422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:02:45.078422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:02:45.078422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:02:45.078422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:02:45.078422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:02:45.080298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:02:45.081396 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d9fbda29-a62a-411d-867f-b912698acaf4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 404 len: 111 microversion: 2.1 time: 0.079315 Oct 01 21:02:45.082206 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1700/2970] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:45 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:02:45.103067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9e85570a-1973-4300-881b-42d9fc068c32 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417281a670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:45.179100 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9e85570a-1973-4300-881b-42d9fc068c32 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.095541 Oct 01 21:02:45.190099 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1701/2971] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:45 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:45.199162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1fed5257-956e-47a4-9d50-a5662d9d8c22 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Calling method '.version_select at 0x7f4172810430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:45.255290 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1fed5257-956e-47a4-9d50-a5662d9d8c22 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.063457 Oct 01 21:02:45.256689 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1702/2972] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 21:02:45 2022] GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 61 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:45.269829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:45.275383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:45.289300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:45.290071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:45.290775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:45.291702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:45.292334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:45.292957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:45.333591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lazy-loading 'flavor' on Instance uuid 30280ed1-e136-4729-8d11-bcec883bebd5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:02:45.496671 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9e56bee5-f48d-4ba9-a45e-6cd80287f338 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action" status: 200 len: 32 microversion: 2.1 time: 0.238380 Oct 01 21:02:45.497583 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1703/2973] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:02:45 2022] POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action => generated 32 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:45.510846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:45.513303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:45.537285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:45.538331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:45.540876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:45.542647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:45.545052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:45.545845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:46.192181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:46.203602 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a74c241-9b34-42fb-aa80-acfb9ef72f93 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1395 microversion: 2.1 time: 0.703824 Oct 01 21:02:46.207057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1704/2974] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:45 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1395 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:46.216033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:46.225839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:46.241937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:46.244124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:46.247204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:46.251937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:46.253093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:46.253809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:46.296044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lazy-loading 'flavor' on Instance uuid 63377103-ae63-4f66-a6b7-d6f4a2d8492e {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:02:46.413476 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dae5cbb3-8c9c-4d21-a393-268edf7cffa9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action" status: 200 len: 32 microversion: 2.1 time: 0.204665 Oct 01 21:02:46.414833 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1705/2975] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:02:46 2022] POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action => generated 32 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:46.424637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bdfeb24e-9348-4c17-a54e-397621126022 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Action: 'update_all', calling method: .version_select at 0x7f417281d5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:46.525987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-bdfeb24e-9348-4c17-a54e-397621126022 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:46.543594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-bdfeb24e-9348-4c17-a54e-397621126022 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for user 6246e90f7e1b4fb39f6ed6a90cb67d61 and project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:46.943408 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bdfeb24e-9348-4c17-a54e-397621126022 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.525738 Oct 01 21:02:46.944606 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1706/2976] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:02:46 2022] PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 61 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:46.952357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-475378058", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "9417f59c-8d13-4179-a6ee-0176ac73cf1c"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:47.013628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] validate_networks() for [('9417f59c-8d13-4179-a6ee-0176ac73cf1c', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:02:47.704857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:02:47.705439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:02:47.705910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:02:47.706326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:02:47.706936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:02:47.721970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:47.723838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:47.725083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:47.726656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:47.727371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:47.728028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:47.754521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:47.761432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for user 775ff9091a794faaacc05a37550c8a72 and project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:47.775384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:47.776843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:02:47.779810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:02:47.857267 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8185d972-c4be-41db-bcb7-0306f67947b2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912145 Oct 01 21:02:47.858863 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1707/2977] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:02:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:02:47.874755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:47.878871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:47.900408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:47.900921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:47.901371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:47.906095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:47.906766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:47.907718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:48.185467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:48.207275 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a3f4dbb-d704-46a9-a82a-89230d471c90 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.337299 Oct 01 21:02:48.211766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1708/2978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:47 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:48.218921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71d21fc0-7c4f-4ef1-b864-35cc0af2d19b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4173126790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:48.316281 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71d21fc0-7c4f-4ef1-b864-35cc0af2d19b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.101378 Oct 01 21:02:48.316281 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1709/2979] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:48 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:48.334585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:48.335553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:48.345804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:48.346481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:48.346840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:48.347568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:48.348036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:48.348472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:48.558323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:48.568917 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.250833 Oct 01 21:02:48.569706 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1710/2980] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:48 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:48.585234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:48.590782 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9df02396-d219-4341-af5d-776c5d388749 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002827 Oct 01 21:02:48.591263 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1711/2981] 10.222.0.17 () {56 vars in 886 bytes} [Sat Oct 1 21:02:48 2022] GET /compute/ => generated 377 bytes in 21 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 01 21:02:48.596584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad9d8ff5-a1e3-4a02-922f-83c64c28c634 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Action: 'update_all', calling method: .version_select at 0x7f4172810af0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:48.695574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-ad9d8ff5-a1e3-4a02-922f-83c64c28c634 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:48.701966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-ad9d8ff5-a1e3-4a02-922f-83c64c28c634 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for user 6246e90f7e1b4fb39f6ed6a90cb67d61 and project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:49.265351 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad9d8ff5-a1e3-4a02-922f-83c64c28c634 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 64 microversion: 2.1 time: 0.672315 Oct 01 21:02:49.268129 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1712/2982] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:02:48 2022] PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 64 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:49.279193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:49.280856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:49.293725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:49.297873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:49.298347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:49.299580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:49.301740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:49.302361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:49.623151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:49.639609 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c873b2b2-3761-4bb3-b12c-dca182ba8fb6 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1395 microversion: 2.1 time: 0.370124 Oct 01 21:02:49.640217 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1713/2983] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:49 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1395 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:49.647015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:49.652703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:49.668250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:49.670797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:49.673497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:49.675414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:49.678272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:49.680774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:49.923306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:49.928654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:49.940198 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dfd38fef-f4c7-458c-b8b2-b50ed4d60587 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1260 microversion: 2.1 time: 0.298723 Oct 01 21:02:49.941722 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1714/2984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:49 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:49.950025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cc677771-2e2b-47e3-9f87-e967057a2f6a req-2547c746-4690-4880-b326-11d537ed253c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9254b8-cb84-4fee-a58e-e9e32ac600cb", "name": "network-vif-plugged", "status": "completed", "tag": "fdaa80d8-f655-4ba4-aec6-6acb2bbfcd0e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:49.976969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cc677771-2e2b-47e3-9f87-e967057a2f6a req-2547c746-4690-4880-b326-11d537ed253c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:49.977607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cc677771-2e2b-47e3-9f87-e967057a2f6a req-2547c746-4690-4880-b326-11d537ed253c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:49.978059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cc677771-2e2b-47e3-9f87-e967057a2f6a req-2547c746-4690-4880-b326-11d537ed253c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:49.993784 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cc677771-2e2b-47e3-9f87-e967057a2f6a req-2547c746-4690-4880-b326-11d537ed253c service nova] Creating event network-vif-plugged:fdaa80d8-f655-4ba4-aec6-6acb2bbfcd0e for instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb on nch1-master-1 Oct 01 21:02:50.018904 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cc677771-2e2b-47e3-9f87-e967057a2f6a req-2547c746-4690-4880-b326-11d537ed253c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075421 Oct 01 21:02:50.019845 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1715/2985] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:50.026212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:50.026954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:50.051111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:50.051620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:50.067261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:50.068076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:50.068583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:50.069025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:50.294974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:50.303593 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1365803b-168f-480b-b3b9-b17c29b56cc2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.282528 Oct 01 21:02:50.304188 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1716/2986] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:50 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:50.319133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-acb2039f-7050-4f73-b015-bd45652a35dc tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Calling method '.version_select at 0x7f4172fef160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:50.416539 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-acb2039f-7050-4f73-b015-bd45652a35dc tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 64 microversion: 2.1 time: 0.107420 Oct 01 21:02:50.417001 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1717/2987] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 21:02:50 2022] GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 64 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:50.449442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4fe317fd-540b-43bd-a109-8837b5e3bfbf tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172878160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:50.551434 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4fe317fd-540b-43bd-a109-8837b5e3bfbf tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.133364 Oct 01 21:02:50.552040 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1718/2988] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:50 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:50.584731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:50.586644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:50.613643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:50.616394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:50.617771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:50.619850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:50.622173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:50.624226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:50.960742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:50.972468 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2599b4a-547b-42fc-9721-b1488fc47cd7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.409996 Oct 01 21:02:50.973079 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1719/2989] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:50 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:50.978964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-335cebea-2228-4338-b2cb-6c14a4e06a3b tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Action: 'update_all', calling method: .version_select at 0x7f41728761f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:51.081580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=47 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:51.086909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-335cebea-2228-4338-b2cb-6c14a4e06a3b tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:51.104172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-335cebea-2228-4338-b2cb-6c14a4e06a3b tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for user 6246e90f7e1b4fb39f6ed6a90cb67d61 and project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:51.798565 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-335cebea-2228-4338-b2cb-6c14a4e06a3b tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.823209 Oct 01 21:02:51.805618 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1720/2990] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:02:50 2022] PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 61 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:51.814853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:51.817599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:51.826332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:51.827208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:51.828491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:51.829444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:51.830129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:51.831756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:52.154010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:52.163792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1967da44-cf1c-4fe0-ba27-5dd579ca187c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1576 microversion: 2.1 time: 0.356174 Oct 01 21:02:52.167323 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1721/2991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:51 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1576 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:52.174226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:52.175059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:52.192541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:52.193630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:52.194257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:52.195482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:52.196863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:52.197558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:52.484243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:52.508377 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6788cfb2-c798-4692-824b-46934d7c9ca2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1308 microversion: 2.1 time: 0.337303 Oct 01 21:02:52.522516 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1722/2992] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:52 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:52.522516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:52.524635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:52.540527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:52.541304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:52.543407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:52.544449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:52.545156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:52.545909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:52.814787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:52.829389 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7aad2b16-f7fb-41ef-8cd1-8183eefc3ff7 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.318146 Oct 01 21:02:52.848713 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1723/2993] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:52 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:52.858069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-50100f28-c918-40b9-8009-cebdbbdda77b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417281a1f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:52.972884 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-50100f28-c918-40b9-8009-cebdbbdda77b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.121424 Oct 01 21:02:52.974906 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1724/2994] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:52 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:52.980156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b203a2ff-56aa-4836-9ffe-dba83fddea6c tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Action: 'update', calling method: .version_select at 0x7f417282a940>, body: {"meta": {"os_version": "alt"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:53.089193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b203a2ff-56aa-4836-9ffe-dba83fddea6c tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:53.095537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b203a2ff-56aa-4836-9ffe-dba83fddea6c tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for user 6246e90f7e1b4fb39f6ed6a90cb67d61 and project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:53.579677 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b203a2ff-56aa-4836-9ffe-dba83fddea6c tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.603348 Oct 01 21:02:53.580849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1725/2995] 10.222.0.17 () {60 vars in 1313 bytes} [Sat Oct 1 21:02:52 2022] PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata/os_version => generated 31 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:53.589810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:53.592881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:53.601345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:53.602271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:53.603154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:53.604747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:53.607354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:53.608032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:53.878028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:53.890873 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-27914ad8-dc2e-4695-a791-126030aec4a3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.308868 Oct 01 21:02:53.891725 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1726/2996] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:53 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:53.897706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-778a365a-c6ad-4ebc-b158-02c50b396e4a tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:53.898671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-778a365a-c6ad-4ebc-b158-02c50b396e4a tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:53.907480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-778a365a-c6ad-4ebc-b158-02c50b396e4a tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:53.908346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-778a365a-c6ad-4ebc-b158-02c50b396e4a tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:53.908813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-778a365a-c6ad-4ebc-b158-02c50b396e4a tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:53.909560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-778a365a-c6ad-4ebc-b158-02c50b396e4a tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:53.910029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-778a365a-c6ad-4ebc-b158-02c50b396e4a tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:53.911151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-778a365a-c6ad-4ebc-b158-02c50b396e4a tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:54.025271 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-778a365a-c6ad-4ebc-b158-02c50b396e4a tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132104 Oct 01 21:02:54.033536 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1727/2997] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:02:53 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:54.039582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-f9d2bf71-c13b-4889-85bf-db6a3f85a869 req-09fee1db-52b7-4664-8388-f80518e8b0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15685bb1-262f-4ba0-b343-a3385faad097", "tag": "a62829f7-abfe-4662-8a30-ef7ef0b8ca1b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:54.070538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f9d2bf71-c13b-4889-85bf-db6a3f85a869 req-09fee1db-52b7-4664-8388-f80518e8b0b6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:54.071371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f9d2bf71-c13b-4889-85bf-db6a3f85a869 req-09fee1db-52b7-4664-8388-f80518e8b0b6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:54.071976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f9d2bf71-c13b-4889-85bf-db6a3f85a869 req-09fee1db-52b7-4664-8388-f80518e8b0b6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:54.087448 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-f9d2bf71-c13b-4889-85bf-db6a3f85a869 req-09fee1db-52b7-4664-8388-f80518e8b0b6 service nova] Creating event network-changed:a62829f7-abfe-4662-8a30-ef7ef0b8ca1b for instance 15685bb1-262f-4ba0-b343-a3385faad097 on nch2-master-1 Oct 01 21:02:54.093793 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-f9d2bf71-c13b-4889-85bf-db6a3f85a869 req-09fee1db-52b7-4664-8388-f80518e8b0b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058183 Oct 01 21:02:54.094976 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1728/2998] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:54.102443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:54.103447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:54.112060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:54.113687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:54.114563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:54.115810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:54.116863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:54.117535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:54.516680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:54.541386 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bb069017-f9d1-49bd-9234-3c2af0718fdc tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1308 microversion: 2.1 time: 0.444949 Oct 01 21:02:54.542006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1729/2999] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:54 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:54.565298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3bede3cd-3fdb-46a6-af35-7b69dde49bd7 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Calling method '.version_select at 0x7f417282a9d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:54.638237 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3bede3cd-3fdb-46a6-af35-7b69dde49bd7 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 58 microversion: 2.1 time: 0.084895 Oct 01 21:02:54.644132 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1730/3000] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 21:02:54 2022] GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 58 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:54.645635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:54.648434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:54.661612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:54.671192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:54.671765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:54.672535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:54.673028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:54.673462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:55.022133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:55.033934 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62f440a1-1c73-42c7-9882-43fc16966aed tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.392733 Oct 01 21:02:55.036470 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1731/3001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:54 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:55.044208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-620df534-dc22-489b-ad69-fd6b185704ab tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41728105e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:55.128765 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-620df534-dc22-489b-ad69-fd6b185704ab tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.088295 Oct 01 21:02:55.129456 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1732/3002] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:55 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:55.138143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92afb64e-b1c2-493c-8639-46a1bb318ce3 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Action: 'update_all', calling method: .version_select at 0x7f4172824700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:55.228715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-92afb64e-b1c2-493c-8639-46a1bb318ce3 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:55.237578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-92afb64e-b1c2-493c-8639-46a1bb318ce3 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for user 6246e90f7e1b4fb39f6ed6a90cb67d61 and project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:55.773689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92afb64e-b1c2-493c-8639-46a1bb318ce3 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.642964 Oct 01 21:02:55.774849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1733/3003] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:02:55 2022] PUT /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 61 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:55.787939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:55.788742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:55.803616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:55.804114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:55.808714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:55.809965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:55.812356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:55.813013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:56.536290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:56.557091 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b6f3f03a-0517-4904-b38e-4426440462fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.780696 Oct 01 21:02:56.557827 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1734/3004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:55 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:56.565533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:56.566447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:56.590676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:56.591303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:56.592022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:56.592954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:56.594711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:56.596190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:56.907513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:56.918250 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-90efb833-3ca8-4057-ad3a-c5f643d725e4 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1308 microversion: 2.1 time: 0.356308 Oct 01 21:02:56.918977 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1735/3005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:56 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:56.929038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a61fae67-0174-4a96-a784-722497f5a480 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Action: 'create', calling method: .version_select at 0x7f41728258b0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:57.031685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a61fae67-0174-4a96-a784-722497f5a480 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:02:57.037978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a61fae67-0174-4a96-a784-722497f5a480 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Getting quotas for user 6246e90f7e1b4fb39f6ed6a90cb67d61 and project 1c3bf48f17ec49c8abbaa9eec9a4f93f. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:02:57.438445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a61fae67-0174-4a96-a784-722497f5a480 tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "POST /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 85 microversion: 2.1 time: 0.517238 Oct 01 21:02:57.439388 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1736/3006] 10.222.0.17 () {60 vars in 1281 bytes} [Sat Oct 1 21:02:56 2022] POST /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 85 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:57.445352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:57.447690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:57.454635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:57.462717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:57.463587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:57.468349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:57.469164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:57.469838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:57.743102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:57.746390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:57.753922 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a823d6be-2c9e-4574-b744-48f8b5464825 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.313369 Oct 01 21:02:57.759205 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1737/3007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:57 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:57.766099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33aa0c7f-5814-4df5-882c-b14902ec60cd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172824c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:57.854541 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-33aa0c7f-5814-4df5-882c-b14902ec60cd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.093739 Oct 01 21:02:57.855950 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1738/3008] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:57 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:57.862284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:57.875102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:57.885122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:57.885625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:57.891270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:57.893999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:57.894520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:57.898354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:58.219602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:58.239231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1fc3a4a4-e988-4794-8a89-34ca58e29538 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1576 microversion: 2.1 time: 0.380597 Oct 01 21:02:58.240427 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1739/3009] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:57 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1576 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:58.261987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-99f74c6f-0431-4a55-8f07-5059a546d08f req-11bc8863-c9d3-4909-b520-bd32cd4e2ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9254b8-cb84-4fee-a58e-e9e32ac600cb", "tag": "fdaa80d8-f655-4ba4-aec6-6acb2bbfcd0e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:58.274806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-99f74c6f-0431-4a55-8f07-5059a546d08f req-11bc8863-c9d3-4909-b520-bd32cd4e2ba9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:58.275614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-99f74c6f-0431-4a55-8f07-5059a546d08f req-11bc8863-c9d3-4909-b520-bd32cd4e2ba9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:58.276231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-99f74c6f-0431-4a55-8f07-5059a546d08f req-11bc8863-c9d3-4909-b520-bd32cd4e2ba9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:58.291616 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-99f74c6f-0431-4a55-8f07-5059a546d08f req-11bc8863-c9d3-4909-b520-bd32cd4e2ba9 service nova] Creating event network-changed:fdaa80d8-f655-4ba4-aec6-6acb2bbfcd0e for instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb on nch1-master-1 Oct 01 21:02:58.297346 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-99f74c6f-0431-4a55-8f07-5059a546d08f req-11bc8863-c9d3-4909-b520-bd32cd4e2ba9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053837 Oct 01 21:02:58.298938 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1740/3010] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:58.321750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4c36099-d04a-4712-99a6-0b2b0c28bfbe tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] Calling method '.version_select at 0x7f4172824af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:58.413461 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a4c36099-d04a-4712-99a6-0b2b0c28bfbe tempest-ImagesMetadataTestJSON-1629708024 tempest-ImagesMetadataTestJSON-1629708024-project] 10.222.0.17 "GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata" status: 200 len: 85 microversion: 2.1 time: 0.113106 Oct 01 21:02:58.415327 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1741/3011] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Oct 1 21:02:58 2022] GET /compute/v2.1/images/7651e17b-87b3-48aa-8605-2cfc4581b8f7/metadata => generated 85 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:02:58.429188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:58.437957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:58.451887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:58.454474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:58.455139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:58.456374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:58.457035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:58.457660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:58.876115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:58.885656 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fcd18fdd-44d4-45f9-b4dc-5193b5a7fc2f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.468246 Oct 01 21:02:58.886259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1742/3012] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:58 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:58.899419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:58.900419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:58.920562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:58.921349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:58.921956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:58.923537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:58.923758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:58.924351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:59.253827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:59.263171 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d57049a-3608-4d84-826d-63ed88b25a2c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1308 microversion: 2.1 time: 0.373597 Oct 01 21:02:59.282838 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1743/3013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:58 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:59.293760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1d92e166-3e77-4090-b953-008ad9c6c06b req-31d039d7-1746-46f6-b3be-027c09ef3b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15685bb1-262f-4ba0-b343-a3385faad097", "name": "network-vif-plugged", "status": "completed", "tag": "a62829f7-abfe-4662-8a30-ef7ef0b8ca1b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:02:59.320085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d92e166-3e77-4090-b953-008ad9c6c06b req-31d039d7-1746-46f6-b3be-027c09ef3b91 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:59.320973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d92e166-3e77-4090-b953-008ad9c6c06b req-31d039d7-1746-46f6-b3be-027c09ef3b91 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:59.321665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d92e166-3e77-4090-b953-008ad9c6c06b req-31d039d7-1746-46f6-b3be-027c09ef3b91 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:59.345858 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1d92e166-3e77-4090-b953-008ad9c6c06b req-31d039d7-1746-46f6-b3be-027c09ef3b91 service nova] Creating event network-vif-plugged:a62829f7-abfe-4662-8a30-ef7ef0b8ca1b for instance 15685bb1-262f-4ba0-b343-a3385faad097 on nch2-master-1 Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1d92e166-3e77-4090-b953-008ad9c6c06b req-31d039d7-1746-46f6-b3be-027c09ef3b91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076741 Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1744/3014] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:02:59.397156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:02:59.447674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:02:59.857399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:02:59.869677 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4ae7f66b-654f-4533-9bf8-f268918fec8d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.506560 Oct 01 21:02:59.886519 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1745/3015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:02:59 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:02:59.894133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a38de486-961a-4e4e-8379-8110bddabe77 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172824c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:00.009258 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a38de486-961a-4e4e-8379-8110bddabe77 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1453 microversion: 2.1 time: 0.132131 Oct 01 21:03:00.010183 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1746/3016] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:02:59 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:00.020194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:00.021405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:00.037458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:00.037984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:00.038445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:00.039225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:00.042690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:00.046390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:00.371818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:00.386038 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f675f867-1b7b-4936-a4e0-a06b424dd4ea tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.374764 Oct 01 21:03:00.386666 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1747/3017] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:00 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:00.392107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:00.392732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:00.421467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:00.428673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:00.429522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:00.433251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:00.433477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:00.433930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:00.746833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:00.755247 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f9743ad-4644-455d-89bf-a7f6f75dcd6f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1308 microversion: 2.1 time: 0.367116 Oct 01 21:03:00.756159 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1748/3018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:00 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:00.904531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:00.906529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:00.917938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:00.919702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:00.926939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:00.928397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:00.929926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:00.931682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:01.309945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:01.321840 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0bc5b2eb-a876-4951-8bdf-c5e9a729a379 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.423283 Oct 01 21:03:01.322748 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1749/3019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:00 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:03:01.327829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b700112-291f-4c26-acc0-aff5c09e5025 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172825f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:01.399626 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8b700112-291f-4c26-acc0-aff5c09e5025 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1462 microversion: 2.1 time: 0.075830 Oct 01 21:03:01.406782 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1750/3020] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:01 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1462 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:01.412865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:01.413804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:01.416897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:01.420563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:01.421279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:01.421623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:01.422328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:01.422812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:01.423440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:01.584837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:01.598983 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-12915c0c-cba3-4b5a-906a-b3abc82f986c tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.190813 Oct 01 21:03:01.600800 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1751/3021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:01 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:03:01.607192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c9cab74-1bfa-4d67-af03-58fd04d94fef tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41728245e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:01.705845 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8c9cab74-1bfa-4d67-af03-58fd04d94fef tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 200 len: 1462 microversion: 2.1 time: 0.100878 Oct 01 21:03:01.707607 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1752/3022] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:01 2022] GET /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 1462 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:01.724937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:01.726932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:01.737552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:01.738442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:01.739357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:01.740669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:01.741327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:01.743577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:01.910197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:01.926051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-03c4666b-b9dc-4563-b176-8af8ade3f17d tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1468 microversion: 2.1 time: 0.208164 Oct 01 21:03:01.926970 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1753/3023] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:01 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1468 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:01.950597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:01.951241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:01.957672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:01.958044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:01.958552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:01.959253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:01.959739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:01.960139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:02.108494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:02.118025 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a112fa91-4f1b-4af1-95c0-441c3f603d23 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1488 microversion: 2.1 time: 0.177242 Oct 01 21:03:02.118938 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1754/3024] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:01 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1488 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:02.129461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa4c5faf-6bc8-48ac-9908-a66683eee5e4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2085687818"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:02.132266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fa4c5faf-6bc8-48ac-9908-a66683eee5e4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:02.138477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa4c5faf-6bc8-48ac-9908-a66683eee5e4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:02.139001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa4c5faf-6bc8-48ac-9908-a66683eee5e4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:02.139457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa4c5faf-6bc8-48ac-9908-a66683eee5e4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:02.140165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa4c5faf-6bc8-48ac-9908-a66683eee5e4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:02.140631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa4c5faf-6bc8-48ac-9908-a66683eee5e4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:02.141063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa4c5faf-6bc8-48ac-9908-a66683eee5e4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:02.384805 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa4c5faf-6bc8-48ac-9908-a66683eee5e4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "POST /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.264396 Oct 01 21:03:02.387339 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1755/3025] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:03:02 2022] POST /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 21:03:02.393416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3132491-4afa-400f-882e-dfcf2dc20ef2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:02.397005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a3132491-4afa-400f-882e-dfcf2dc20ef2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:02.403801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3132491-4afa-400f-882e-dfcf2dc20ef2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:02.404370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3132491-4afa-400f-882e-dfcf2dc20ef2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:02.405075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3132491-4afa-400f-882e-dfcf2dc20ef2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:02.406000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3132491-4afa-400f-882e-dfcf2dc20ef2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:02.406595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3132491-4afa-400f-882e-dfcf2dc20ef2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:02.407166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3132491-4afa-400f-882e-dfcf2dc20ef2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:02.487464 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a3132491-4afa-400f-882e-dfcf2dc20ef2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "PUT /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1083 microversion: 2.1 time: 0.098449 Oct 01 21:03:02.488131 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1756/3026] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:03:02 2022] PUT /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1083 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:02.503457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:02.504234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:02.513643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:02.514573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:02.515297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:02.516045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:02.516516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:02.516984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:02.684360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:02.697559 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f50857c5-a626-419d-92d7-7bac91e76edb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.201819 Oct 01 21:03:02.698565 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1757/3027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:02 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:02.702931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-458b0775-16f1-414d-b264-849ab90a048f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172837f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:02.756158 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-458b0775-16f1-414d-b264-849ab90a048f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.056738 Oct 01 21:03:02.756893 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1758/3028] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:02 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:02.769345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:02.770149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:02.779138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:02.779884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:02.780881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:02.781503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:02.782175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:02.782777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:02.986409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:02.993357 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-389797c1-34ad-4b08-b925-1d115eb873b1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1509 microversion: 2.1 time: 0.235610 Oct 01 21:03:02.994471 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1759/3029] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:02 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:03.011404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:03.012038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:03.028100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:03.029020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:03.029758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:03.034878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:03.035946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:03.036679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:03.247639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:03.257900 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-afc90200-5ba8-421a-a3f0-057760daa87f tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.262178 Oct 01 21:03:03.267658 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1760/3030] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:02 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:03.279653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:03.280612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:03.287523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:03.288305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:03.288819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:03.289713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:03.290372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:03.291062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:03.447478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:03.456451 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-318cbc7f-d8e6-4168-ba73-b0046c1b3bb9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1509 microversion: 2.1 time: 0.180615 Oct 01 21:03:03.466531 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1761/3031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:03 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:03.490067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:03.490897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:03.499130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:03.500137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:03.500798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:03.501655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:03.502248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:03.503856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:03.535166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:03:03.609371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:03.698805 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aae92975-f0f9-49e7-9f25-0a9082a43c52 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 204 len: 0 microversion: 2.1 time: 0.213776 Oct 01 21:03:03.700272 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1762/3032] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:03:03 2022] DELETE /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 21:03:03.718995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:03.721633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:03.743794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:03.744635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:03.745370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:03.749013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:03.749734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:03.751029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:04.094843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:04.116219 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0207172b-f157-4e3d-8525-b25c22a8e4ae tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1515 microversion: 2.1 time: 0.410143 Oct 01 21:03:04.119165 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1763/3033] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:03 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:04.127098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:04.128292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:04.140186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:04.141929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:04.143387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:04.144407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:04.145337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:04.146221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:04.532439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:04.544614 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85742364-224b-4b45-b726-47983f03ff43 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.423600 Oct 01 21:03:04.556508 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1764/3034] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:04 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:04.556508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-169d1206-27d3-44f2-842d-6959e149fd2b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172837a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:04.609426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-169d1206-27d3-44f2-842d-6959e149fd2b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.062752 Oct 01 21:03:04.610368 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1765/3035] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:04 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:04.615897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:04.616388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:04.622695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:04.623205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:04.623659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:04.625050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:04.625528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:04.626549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:04.933564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:04.989154 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b0f3ec4-e911-400c-8a5e-3915d6e62ce7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.377456 Oct 01 21:03:05.002653 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1766/3036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:04 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:05.141923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:05.144302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:05.169169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:05.170296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:05.172079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:05.175127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:05.176741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:05.179781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:06.150715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:06.162782 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7665a437-e3e8-43ff-bafa-a3c7ab01ddf8 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 200 len: 1515 microversion: 2.1 time: 1.026419 Oct 01 21:03:06.163445 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1767/3037] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:05 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 1515 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:03:06.175500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:06.176424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:06.188767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:06.191216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:06.191868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:06.193442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:06.194089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:06.194737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:06.611738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:06.621217 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-46aa3a26-6b96-4d65-b3ee-f3c7879b8911 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.456653 Oct 01 21:03:06.639037 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1768/3038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:06 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:06.649530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af1827a9-4189-4610-99f7-7ce0fa1a5f0a tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417278b550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:06.748141 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-af1827a9-4189-4610-99f7-7ce0fa1a5f0a tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.122610 Oct 01 21:03:06.750769 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1769/3039] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:06 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:06.762717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ddf4d262-d62a-45bb-822d-efe6dc01bb18 req-37379a2c-c9b6-4356-872b-76018eea9968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15685bb1-262f-4ba0-b343-a3385faad097", "name": "network-vif-deleted", "tag": "a62829f7-abfe-4662-8a30-ef7ef0b8ca1b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:06.789309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ddf4d262-d62a-45bb-822d-efe6dc01bb18 req-37379a2c-c9b6-4356-872b-76018eea9968 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:06.790642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ddf4d262-d62a-45bb-822d-efe6dc01bb18 req-37379a2c-c9b6-4356-872b-76018eea9968 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:06.792557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ddf4d262-d62a-45bb-822d-efe6dc01bb18 req-37379a2c-c9b6-4356-872b-76018eea9968 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:06.820935 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ddf4d262-d62a-45bb-822d-efe6dc01bb18 req-37379a2c-c9b6-4356-872b-76018eea9968 service nova] Creating event network-vif-deleted:a62829f7-abfe-4662-8a30-ef7ef0b8ca1b for instance 15685bb1-262f-4ba0-b343-a3385faad097 on nch2-master-1 Oct 01 21:03:06.833103 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ddf4d262-d62a-45bb-822d-efe6dc01bb18 req-37379a2c-c9b6-4356-872b-76018eea9968 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079610 Oct 01 21:03:06.834921 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1770/3040] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:06.844266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:06.845722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:06.862447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:06.865756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:06.867283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:06.872117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:06.874026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:06.875235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:07.055151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=15 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:07.348505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:07.357587 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2bd12d44-eea2-4b9b-9276-66f335ec7e73 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.518917 Oct 01 21:03:07.369261 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1771/3041] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:06 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:07.383349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6fabe4c1-2668-4250-ab7b-24aca528be96 req-7b542ec7-5085-49ba-b752-0355af4bc103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12ab455-2d67-4728-9293-bd843f39bedf", "name": "network-vif-unplugged", "status": "completed", "tag": "8a94b425-9ca6-4166-8a17-467ca29d4cf8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:07.401167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6fabe4c1-2668-4250-ab7b-24aca528be96 req-7b542ec7-5085-49ba-b752-0355af4bc103 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:07.401923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6fabe4c1-2668-4250-ab7b-24aca528be96 req-7b542ec7-5085-49ba-b752-0355af4bc103 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:07.402663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6fabe4c1-2668-4250-ab7b-24aca528be96 req-7b542ec7-5085-49ba-b752-0355af4bc103 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:07.433237 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6fabe4c1-2668-4250-ab7b-24aca528be96 req-7b542ec7-5085-49ba-b752-0355af4bc103 service nova] Creating event network-vif-unplugged:8a94b425-9ca6-4166-8a17-467ca29d4cf8 for instance d12ab455-2d67-4728-9293-bd843f39bedf on nch1-master-1 Oct 01 21:03:07.450466 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6fabe4c1-2668-4250-ab7b-24aca528be96 req-7b542ec7-5085-49ba-b752-0355af4bc103 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079385 Oct 01 21:03:07.451558 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1772/3042] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:07.458792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:07.463896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:07.486915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:07.487583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:07.488138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:07.488977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:07.489609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:07.490240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:07.518616 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 HTTP/1.1 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '15685bb1-262f-4ba0-b343-a3385faad097'} Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:07.523114 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:07.528122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:07.528122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:07.528122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:03:07.528122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:03:07.528122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:03:07.528122 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:07.528122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:03:07.531375 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-09811bac-ffa5-4c87-812a-264bfb9e2d14 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 404 len: 111 microversion: 2.1 time: 0.078545 Oct 01 21:03:07.542850 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1773/3043] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:07 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:03:07.657746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:07.658525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:07.676099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:07.676798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:07.677354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:07.678191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:07.687304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:07.687942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:08.086257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:08.099990 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ddab1e3-c508-4a0f-832d-c8342a65414f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.443661 Oct 01 21:03:08.101424 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1774/3044] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:07 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:03:08.113198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c379c0c9-da83-4b78-ad51-04ea11ff32f5 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172f3e700>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:08.209352 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c379c0c9-da83-4b78-ad51-04ea11ff32f5 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.105397 Oct 01 21:03:08.213242 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1775/3045] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:08 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:08.224687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-317299331", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "9417f59c-8d13-4179-a6ee-0176ac73cf1c"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:08.352185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] validate_networks() for [('9417f59c-8d13-4179-a6ee-0176ac73cf1c', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:03:09.614213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:03:09.616146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:03:09.616956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:03:09.617548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:03:09.618142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:03:09.639129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:09.640639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:09.644156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:09.645216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:09.648570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:09.657136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:09.717081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:03:09.740277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Getting quotas for user 775ff9091a794faaacc05a37550c8a72 and project bea57d3c53f74e3ea78e9e4bc790c434. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:03:09.796041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:03:09.798801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:03:09.897170 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62a63c84-d94e-45ae-a868-2cc93a4e2b32 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682760 Oct 01 21:03:09.906700 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1776/3046] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:03:09.914231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:09.919268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:09.939732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:09.940623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:09.941289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:09.942276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:09.943484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:09.944128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:10.483267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:10.493831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29d204a8-c5de-4946-b1ff-43e9969b3817 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.585647 Oct 01 21:03:10.513111 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1777/3047] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:09 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:10.542195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:10.554899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:10.569803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:10.570426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:10.572458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:10.573363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:10.575252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:10.575825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:11.064627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:11.083859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07d2f8a9-d832-461b-9283-5ebae7e212f8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.566234 Oct 01 21:03:11.084524 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1778/3048] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:10 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:11.103883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7334d1f-664a-452c-9705-4a9aeb820a6e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172795820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:11.278213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7334d1f-664a-452c-9705-4a9aeb820a6e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.179555 Oct 01 21:03:11.278982 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1779/3049] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:11 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:11.287786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:11.288477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:11.297483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:11.298352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:11.311759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:11.313917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:11.314928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:11.315524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:11.520144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:11.534029 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8dac431-e398-4756-a577-bcfbaebf2783 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1212 microversion: 2.1 time: 0.250769 Oct 01 21:03:11.535404 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1780/3050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:11 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1212 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:11.549970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:11.552515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:11.575237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:11.575770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:11.576219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:11.585343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:11.585845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:11.586290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:12.323830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:12.348728 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5e4d2b7a-2e01-4a3b-a7f7-4ebd894ea0fe tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 0.805221 Oct 01 21:03:12.353365 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1781/3051] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:11 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:12.364777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:12.367721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:12.383480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:12.384892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:12.386653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:12.387936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:12.390096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:12.390828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:12.724557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:12.736786 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bba153cc-b94c-4bb2-b23c-66ebae34093f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.378397 Oct 01 21:03:12.741787 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1782/3052] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:12 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:12.762990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ca0c212-40c0-430b-baed-a4f969d0713a tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417278b3a0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:12.855988 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ca0c212-40c0-430b-baed-a4f969d0713a tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.112647 Oct 01 21:03:12.856588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1783/3053] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:12 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:12.881079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:12.885972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:12.911102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:12.914380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:12.916578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:12.919370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:12.923013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:12.925476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:13.285307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:13.300891 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3c2dd0f2-793f-4009-8e5f-c2ee8baa4d33 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1266 microversion: 2.1 time: 0.442743 Oct 01 21:03:13.303321 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1784/3054] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:12 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1266 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:13.403442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:13.411592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:13.490445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:13.490921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:13.491370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:13.493416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:13.502331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:13.503392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:14.947820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:14.966417 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4cdc6a8f-614a-4c5e-8cfd-92201ff23363 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1523 microversion: 2.1 time: 1.593219 Oct 01 21:03:15.002954 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1785/3055] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:13 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1523 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:15.030939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ec6ecfa2-a989-4bcd-9d4c-85e6533605ea req-9beeb5c4-496a-4096-88d9-f99f125332ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb9ea14-deab-4588-ade7-66aa910a3eb9", "name": "network-vif-plugged", "status": "completed", "tag": "beea046f-0dc7-4d4c-8922-c8b4a553c1ca"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:15.068266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ec6ecfa2-a989-4bcd-9d4c-85e6533605ea req-9beeb5c4-496a-4096-88d9-f99f125332ab service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:15.068836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ec6ecfa2-a989-4bcd-9d4c-85e6533605ea req-9beeb5c4-496a-4096-88d9-f99f125332ab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:15.069297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ec6ecfa2-a989-4bcd-9d4c-85e6533605ea req-9beeb5c4-496a-4096-88d9-f99f125332ab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:15.100091 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ec6ecfa2-a989-4bcd-9d4c-85e6533605ea req-9beeb5c4-496a-4096-88d9-f99f125332ab service nova] Creating event network-vif-plugged:beea046f-0dc7-4d4c-8922-c8b4a553c1ca for instance abb9ea14-deab-4588-ade7-66aa910a3eb9 on nch1-master-1 Oct 01 21:03:15.112440 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ec6ecfa2-a989-4bcd-9d4c-85e6533605ea req-9beeb5c4-496a-4096-88d9-f99f125332ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107782 Oct 01 21:03:15.114816 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1786/3056] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:15.127160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:15.128187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:15.142645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:15.143393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:15.149778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:15.150835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:15.151470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:15.152106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:15.210282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:15.466262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:15.478993 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b04b3267-6da0-4db6-a52e-66187a1e8129 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.358841 Oct 01 21:03:15.479710 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1787/3057] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:15 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:15.504169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f0a3812-e320-4aa4-ba35-9695675050f9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172796940>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:15.743620 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f0a3812-e320-4aa4-ba35-9695675050f9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.246837 Oct 01 21:03:15.745197 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1788/3058] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:15 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:15.754357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:15.763451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:15.778342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:15.778981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:15.779342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:15.780064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:15.780523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:15.780966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:16.182345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:16.194426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-52a902e8-aa5d-4ec7-8e65-c0d70093509f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1308 microversion: 2.1 time: 0.447692 Oct 01 21:03:16.194982 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1789/3059] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:15 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:16.615131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1180564325", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "12dd7e60-a7cd-466f-a786-9ebf24caa716"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:16.725612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] validate_networks() for [('12dd7e60-a7cd-466f-a786-9ebf24caa716', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:03:17.458510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:03:17.459146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:03:17.459489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:03:17.459908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:03:17.460445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:03:17.477399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:17.477900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:17.485122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:17.486247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:17.486787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:17.487532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:17.528995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Getting quotas for project 99e8daf9de4d4fa395b7eee86d33a5f5. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:03:17.544386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Getting quotas for user aa4fbb28c9de4089870d91cf52dac8ea and project 99e8daf9de4d4fa395b7eee86d33a5f5. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:03:17.581732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:03:17.590828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:03:17.692228 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-673a3227-1ba6-4aa7-95fe-9febdc9bf9ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495984 Oct 01 21:03:17.693444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1790/3060] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:03:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:03:17.719080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:17.722969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:17.757299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:17.758103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:17.775203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:17.779415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:17.780607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:17.782000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:18.796689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:18.836971 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-025c9e8d-37a0-4144-8d42-96d7a61cb8b9 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1503 microversion: 2.1 time: 1.142118 Oct 01 21:03:18.837578 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1791/3061] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:17 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1503 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:18.853321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:18.853962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:18.861149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:18.870835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:18.871962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:18.879328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:18.880796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:18.881512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:18.882146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:19.174774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:19.186027 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-779df366-024f-49d6-a6a0-d25987381532 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.341444 Oct 01 21:03:19.187580 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1792/3062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:18 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:19.214023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca8c670a-648b-4569-8541-31d512e645f0 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41727a33a0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:19.349127 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca8c670a-648b-4569-8541-31d512e645f0 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.157241 Oct 01 21:03:19.359274 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1793/3063] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:19 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:19.365454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:19.366448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:19.396912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:19.397881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:19.398669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:19.399726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:19.400400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:19.401940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:19.751011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:19.764051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc4ef63b-4f4a-4eb9-a674-3c094952e578 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1308 microversion: 2.1 time: 0.401666 Oct 01 21:03:19.765676 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1794/3064] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:19 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:19.781972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:19.782478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:19.791938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:19.795975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:19.804400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:19.805910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:19.807250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:19.808042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:19.933753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:19.945571 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f69ee39d-068d-49ef-a136-fb770879a60b tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1277 microversion: 2.1 time: 0.177542 Oct 01 21:03:19.946378 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1795/3065] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:19 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:19.961795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6f0f6201-c231-4d5d-aea5-c82b8a66dd79 req-4338a3c3-8a41-4fc7-aa6e-e151ee9356eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997cf849-72aa-4471-96db-ef813c9f0df3", "tag": "0db6a596-65c3-426a-ae29-eeca8d55f329"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:19.993557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6f0f6201-c231-4d5d-aea5-c82b8a66dd79 req-4338a3c3-8a41-4fc7-aa6e-e151ee9356eb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:19.994460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6f0f6201-c231-4d5d-aea5-c82b8a66dd79 req-4338a3c3-8a41-4fc7-aa6e-e151ee9356eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:19.995098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6f0f6201-c231-4d5d-aea5-c82b8a66dd79 req-4338a3c3-8a41-4fc7-aa6e-e151ee9356eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:20.036722 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6f0f6201-c231-4d5d-aea5-c82b8a66dd79 req-4338a3c3-8a41-4fc7-aa6e-e151ee9356eb service nova] Creating event network-changed:0db6a596-65c3-426a-ae29-eeca8d55f329 for instance 997cf849-72aa-4471-96db-ef813c9f0df3 on nch2-master-1 Oct 01 21:03:20.068634 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6f0f6201-c231-4d5d-aea5-c82b8a66dd79 req-4338a3c3-8a41-4fc7-aa6e-e151ee9356eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118462 Oct 01 21:03:20.070160 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1796/3066] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:20.089357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9ccc4a4-e477-44ab-a302-32697a55dda7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Action: 'create', calling method: .version_select at 0x7f41727951f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-722656940", "description": "tempest-description-932425649"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:20.357484 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9ccc4a4-e477-44ab-a302-32697a55dda7 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.285350 Oct 01 21:03:20.358586 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1797/3067] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:03:20 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:20.363578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:20.364857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:20.380822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:20.383761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:20.384635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:20.386780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:20.387318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:20.387733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:21.201433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:21.233665 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c71343d4-41ae-4366-bcec-7483b649b4c0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1501 microversion: 2.1 time: 0.873750 Oct 01 21:03:21.236703 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1798/3068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:20 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1501 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:21.261851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e8b877c1-9b9c-433b-b6fd-ebead16798e6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41728550d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:21.373103 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e8b877c1-9b9c-433b-b6fd-ebead16798e6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.124086 Oct 01 21:03:21.374299 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1799/3069] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:21 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:21.381347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-722656940"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:21.382150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:21.402213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:21.406352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:21.407424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:21.409834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:21.410587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:21.412117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:21.807213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.network.security_group_api [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Adding security group 4d8b8559-c8f2-4ce7-89d1-dde1216ae429 to port 311ec718-8814-44c7-a006-cc05466167f1 Oct 01 21:03:22.994838 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e6b4f0c0-2237-449c-9d52-a75607bd912a tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action" status: 202 len: 0 microversion: 2.1 time: 1.617622 Oct 01 21:03:22.996070 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1800/3070] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:03:21 2022] POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action => generated 0 bytes in 1621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:03:23.028231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:23.033548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:23.072068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:23.080199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:23.082448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:23.089652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:23.094371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:23.101688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:23.772352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:23.798811 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4469a1b2-2bd0-4cdb-ac2c-5d4da8899a87 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1308 microversion: 2.1 time: 0.790260 Oct 01 21:03:23.803385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1801/3071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:23 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1308 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:23.821573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:23.823059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:23.834166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:23.836933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:23.837553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:23.838474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:23.841709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:23.842921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:24.329120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:24.350344 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d763f870-1240-418b-bf9a-c489f2c2911f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1325 microversion: 2.1 time: 0.545581 Oct 01 21:03:24.381800 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1802/3072] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:23 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1325 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:24.392144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d75ab76e-9835-456b-8a91-4e4c433fd49b"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:24.396998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:24.415186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:24.416242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:24.416865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:24.417767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:24.418406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:24.419052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:24.487852 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] HTTP exception thrown: Cannot 'attach_volume' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state rescued Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Request method failure captured: Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/os-volume_attachments HTTP/1.1 Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 74 Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqkgfbc_8hDaJm-zKHvqTb6WWcCcwT0-Bfkvm8f894klqAsv6S6gceYSMqZE_iA9F1ar8j4XUgVkIuKhn9h8Rgo_aMUHe71Q6i1rgQeqhiP7Q24mua9fZcb3yfEC6hkQVWHSn1eqeodqqIny5w_VbZ67CSAF_63x-EWWDMDYONExeM Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10fefee3d6a6430682316cd94b859f1e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}] Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6bda28994cb14f92b014a147a7e74476 Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: {"volumeAttachment": {"volumeId": "d75ab76e-9835-456b-8a91-4e4c433fd49b"}} Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'attach_volume' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state rescued Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': '30280ed1-e136-4729-8d11-bcec883bebd5', 'body': {'volumeAttachment': {'volumeId': 'd75ab76e-9835-456b-8a91-4e4c433fd49b'}}} Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30280ed1-e136-4729-8d11-bcec883bebd5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 01 21:03:24.493089 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state rescued Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state rescued Oct 01 21:03:24.498170 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:24.505299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Returning 409 to user: Cannot 'attach_volume' instance 30280ed1-e136-4729-8d11-bcec883bebd5 while it is in vm_state rescued {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:03:24.506364 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-109811f9-778b-4382-95d8-fe0ee66a8418 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.123046 Oct 01 21:03:24.510949 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1803/3073] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:03:24 2022] POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/os-volume_attachments => generated 152 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:03:24.516675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-736b35ca-56b9-4721-9c76-44d868249ecb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417282ad30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:24.610683 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-736b35ca-56b9-4721-9c76-44d868249ecb tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.098236 Oct 01 21:03:24.619039 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1804/3074] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:24 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:24.620298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-722656940"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:24.620852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:24.642745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:24.643285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:24.643753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:24.644509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:24.645519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:24.645965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:25.078878 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.network.security_group_api [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Removing security group 4d8b8559-c8f2-4ce7-89d1-dde1216ae429 from port 311ec718-8814-44c7-a006-cc05466167f1 Oct 01 21:03:25.745210 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d9d0502-23b4-42ec-ae67-79536c13b3c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action" status: 202 len: 0 microversion: 2.1 time: 1.131071 Oct 01 21:03:25.746228 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1805/3075] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:03:24 2022] POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:03:25.752451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-509dc55e-3af3-467a-be6f-14781aa4684c req-1db2f5c6-d898-43ca-bb68-cb2bf39094ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63377103-ae63-4f66-a6b7-d6f4a2d8492e", "tag": "311ec718-8814-44c7-a006-cc05466167f1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:25.789683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-509dc55e-3af3-467a-be6f-14781aa4684c req-1db2f5c6-d898-43ca-bb68-cb2bf39094ce service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:25.791424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-509dc55e-3af3-467a-be6f-14781aa4684c req-1db2f5c6-d898-43ca-bb68-cb2bf39094ce service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:25.792093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-509dc55e-3af3-467a-be6f-14781aa4684c req-1db2f5c6-d898-43ca-bb68-cb2bf39094ce service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:25.835283 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-509dc55e-3af3-467a-be6f-14781aa4684c req-1db2f5c6-d898-43ca-bb68-cb2bf39094ce service nova] Creating event network-changed:311ec718-8814-44c7-a006-cc05466167f1 for instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e on nch2-master-1 Oct 01 21:03:25.848485 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-509dc55e-3af3-467a-be6f-14781aa4684c req-1db2f5c6-d898-43ca-bb68-cb2bf39094ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100186 Oct 01 21:03:25.849582 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1806/3076] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:25.857256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-be84f0ec-73cd-471b-9be1-9acaf7ebafd4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:25.858261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-be84f0ec-73cd-471b-9be1-9acaf7ebafd4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:25.872940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be84f0ec-73cd-471b-9be1-9acaf7ebafd4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:25.873748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be84f0ec-73cd-471b-9be1-9acaf7ebafd4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:25.874567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be84f0ec-73cd-471b-9be1-9acaf7ebafd4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:25.875803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be84f0ec-73cd-471b-9be1-9acaf7ebafd4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:25.876481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be84f0ec-73cd-471b-9be1-9acaf7ebafd4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:25.878287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be84f0ec-73cd-471b-9be1-9acaf7ebafd4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:26.028780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-be84f0ec-73cd-471b-9be1-9acaf7ebafd4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action" status: 202 len: 0 microversion: 2.1 time: 0.177596 Oct 01 21:03:26.030086 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1807/3077] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:03:25 2022] POST /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:03:26.039730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e7f77f07-fb76-493a-ae06-c519cdc89557 req-b7a0a666-4bdb-45f0-945d-ddd57fcbf2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997cf849-72aa-4471-96db-ef813c9f0df3", "name": "network-vif-plugged", "status": "completed", "tag": "0db6a596-65c3-426a-ae29-eeca8d55f329"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:26.069329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e7f77f07-fb76-493a-ae06-c519cdc89557 req-b7a0a666-4bdb-45f0-945d-ddd57fcbf2ea service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:26.070306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e7f77f07-fb76-493a-ae06-c519cdc89557 req-b7a0a666-4bdb-45f0-945d-ddd57fcbf2ea service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:26.071662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e7f77f07-fb76-493a-ae06-c519cdc89557 req-b7a0a666-4bdb-45f0-945d-ddd57fcbf2ea service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:26.090072 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e7f77f07-fb76-493a-ae06-c519cdc89557 req-b7a0a666-4bdb-45f0-945d-ddd57fcbf2ea service nova] Creating event network-vif-plugged:0db6a596-65c3-426a-ae29-eeca8d55f329 for instance 997cf849-72aa-4471-96db-ef813c9f0df3 on nch2-master-1 Oct 01 21:03:26.095648 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e7f77f07-fb76-493a-ae06-c519cdc89557 req-b7a0a666-4bdb-45f0-945d-ddd57fcbf2ea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063861 Oct 01 21:03:26.096978 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1808/3078] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:26.104318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:26.105469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:26.113138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:26.114599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:26.115245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:26.116146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:26.117145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:26.117756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:26.413077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:26.422736 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dbba3f32-43e0-490f-a53a-1508bc8bc50f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1308 microversion: 2.1 time: 0.323777 Oct 01 21:03:26.424046 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1809/3079] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:26 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1308 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:26.432086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:26.439348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:26.454277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:26.454808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:26.455254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:26.455969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:26.456427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:26.456855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:26.982976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:26.992292 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94068602-2b58-47ee-924a-367210272f57 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1325 microversion: 2.1 time: 0.566898 Oct 01 21:03:26.994226 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1810/3080] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:26 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:26.999299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-11edd44f-425d-4929-a129-5f560e79bbd2 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417278b5e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:27.079286 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-11edd44f-425d-4929-a129-5f560e79bbd2 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.083265 Oct 01 21:03:27.080670 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1811/3081] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:26 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:27.087353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c09e80f6-10a0-4886-8579-7a969b7d0296 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Action: 'create', calling method: .version_select at 0x7f417283e1f0>, body: {"pool": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:27.503562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:27.563746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:29.220526 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c09e80f6-10a0-4886-8579-7a969b7d0296 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.138175 Oct 01 21:03:29.221922 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1812/3082] 10.222.0.17 () {60 vars in 1170 bytes} [Sat Oct 1 21:03:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:29.228261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:29.228873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:29.237082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:29.237798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:29.238578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:29.239457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:29.240889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:29.241629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:29.420587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:29.424221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:29.431790 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d18ace7b-ac44-4aa8-83bf-7fc688cd2937 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1509 microversion: 2.1 time: 0.207940 Oct 01 21:03:29.433091 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1813/3083] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:29 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:29.438782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:29.440733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:29.460233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:29.462860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:29.463657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:29.466807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:29.467605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:29.469258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:29.718878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:29.728881 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b3946f99-7484-49a5-8c6f-41ae51f073a2 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1488 microversion: 2.1 time: 0.294478 Oct 01 21:03:29.729479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1814/3084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:29 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1488 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:29.734587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a5df46ca-bee4-4c61-97fa-db9afdd1e414 req-8d16c3b6-866c-4363-aed9-7b7a7c8634cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd16675-4ce4-4099-9ced-c2b32cd97e85", "tag": "a86ec246-7e6b-4660-bcb3-54272db2c2bf"}, {"name": "network-changed", "server_uuid": "63377103-ae63-4f66-a6b7-d6f4a2d8492e", "tag": "311ec718-8814-44c7-a006-cc05466167f1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:29.748640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a5df46ca-bee4-4c61-97fa-db9afdd1e414 req-8d16c3b6-866c-4363-aed9-7b7a7c8634cf service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:29.750195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a5df46ca-bee4-4c61-97fa-db9afdd1e414 req-8d16c3b6-866c-4363-aed9-7b7a7c8634cf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:29.750866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a5df46ca-bee4-4c61-97fa-db9afdd1e414 req-8d16c3b6-866c-4363-aed9-7b7a7c8634cf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:29.768850 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a5df46ca-bee4-4c61-97fa-db9afdd1e414 req-8d16c3b6-866c-4363-aed9-7b7a7c8634cf service nova] Creating event network-changed:a86ec246-7e6b-4660-bcb3-54272db2c2bf for instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 on nch1-master-1 Oct 01 21:03:29.769808 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a5df46ca-bee4-4c61-97fa-db9afdd1e414 req-8d16c3b6-866c-4363-aed9-7b7a7c8634cf service nova] Creating event network-changed:311ec718-8814-44c7-a006-cc05466167f1 for instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e on nch2-master-1 Oct 01 21:03:29.827121 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a5df46ca-bee4-4c61-97fa-db9afdd1e414 req-8d16c3b6-866c-4363-aed9-7b7a7c8634cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096322 Oct 01 21:03:29.831552 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1815/3085] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:29.849848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:29.851276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:29.859221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:29.859988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:29.860883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:29.861847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:29.862785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:29.864945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:30.129321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:30.142564 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-de061d8d-468f-4ba1-9648-74f7b4bcbcb5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1325 microversion: 2.1 time: 0.295320 Oct 01 21:03:30.161259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1816/3086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:29 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:30.179919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7bfda22-c02d-4923-934a-02c314bebb51 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41728553a0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:30.273704 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d7bfda22-c02d-4923-934a-02c314bebb51 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1453 microversion: 2.1 time: 0.110125 Oct 01 21:03:30.274466 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1817/3087] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:30 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:30.287337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.154"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:30.295004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:30.312034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:30.312550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:30.313212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:30.313954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:30.314637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:30.315075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:30.372834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "refresh_cache-63377103-ae63-4f66-a6b7-d6f4a2d8492e" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 21:03:30.373256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquired lock "refresh_cache-63377103-ae63-4f66-a6b7-d6f4a2d8492e" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 21:03:32.913369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Building network info cache for instance {{(pid=140438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 21:03:33.896298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Updating instance_info_cache with network_info: [{"id": "311ec718-8814-44c7-a006-cc05466167f1", "address": "fa:16:3e:b7:4c:77", "network": {"id": "d98999bf-5191-456b-971a-d9c9b2364d89", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-153946029-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c8d44c4bbfc44a297c82cda39868ddd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap311ec718-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 21:03:33.923018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Releasing lock "refresh_cache-63377103-ae63-4f66-a6b7-d6f4a2d8492e" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 21:03:33.924090 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a2ea2c7a-3485-4fc5-94be-238e289d614d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action" status: 202 len: 0 microversion: 2.1 time: 3.648307 Oct 01 21:03:33.925027 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1818/3088] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:03:30 2022] POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action => generated 0 bytes in 3650 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 01 21:03:33.935633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-714cbef2-f646-4b01-8105-83b6a095003f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1497421515"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:33.938377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-714cbef2-f646-4b01-8105-83b6a095003f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:33.955609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-714cbef2-f646-4b01-8105-83b6a095003f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:33.956112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-714cbef2-f646-4b01-8105-83b6a095003f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:33.956551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-714cbef2-f646-4b01-8105-83b6a095003f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:33.957791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-714cbef2-f646-4b01-8105-83b6a095003f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:33.983252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-714cbef2-f646-4b01-8105-83b6a095003f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:33.983845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-714cbef2-f646-4b01-8105-83b6a095003f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:34.062826 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-714cbef2-f646-4b01-8105-83b6a095003f tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "PUT /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1074 microversion: 2.1 time: 0.136234 Oct 01 21:03:34.063489 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1819/3089] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:03:33 2022] PUT /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1074 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:34.068176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:34.068806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:34.075023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:34.075798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:34.076445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:34.077500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:34.078204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:34.078861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:34.334373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:34.348849 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9f15acd8-d464-4289-a5f4-0d8ddf92b7a3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1515 microversion: 2.1 time: 0.284136 Oct 01 21:03:34.350094 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1820/3090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:34 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1515 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:34.356236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b1ff2c39-1f4e-42cb-83c9-d89637e5d99d req-024a8716-47bf-4db3-b7e7-132d583d627c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd16675-4ce4-4099-9ced-c2b32cd97e85", "name": "network-vif-plugged", "status": "completed", "tag": "a86ec246-7e6b-4660-bcb3-54272db2c2bf"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:34.367492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b1ff2c39-1f4e-42cb-83c9-d89637e5d99d req-024a8716-47bf-4db3-b7e7-132d583d627c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:34.368059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b1ff2c39-1f4e-42cb-83c9-d89637e5d99d req-024a8716-47bf-4db3-b7e7-132d583d627c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:34.368576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b1ff2c39-1f4e-42cb-83c9-d89637e5d99d req-024a8716-47bf-4db3-b7e7-132d583d627c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:34.401955 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b1ff2c39-1f4e-42cb-83c9-d89637e5d99d req-024a8716-47bf-4db3-b7e7-132d583d627c service nova] Creating event network-vif-plugged:a86ec246-7e6b-4660-bcb3-54272db2c2bf for instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 on nch1-master-1 Oct 01 21:03:34.417401 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b1ff2c39-1f4e-42cb-83c9-d89637e5d99d req-024a8716-47bf-4db3-b7e7-132d583d627c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064717 Oct 01 21:03:34.417769 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1821/3091] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:34.424655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:34.425896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:34.436121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:34.436865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:34.437674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:34.438631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:34.439258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:34.440759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:34.807525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:34.817252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-91ff7d3a-bb25-4f7e-85e3-d26da43aa912 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1325 microversion: 2.1 time: 0.397609 Oct 01 21:03:34.818130 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1822/3092] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:34 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1325 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:34.841955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b9a37447-cff9-4347-ab97-64179a36d5a1 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172795d30>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:34.917886 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b9a37447-cff9-4347-ab97-64179a36d5a1 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1462 microversion: 2.1 time: 0.079681 Oct 01 21:03:34.919100 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1823/3093] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:34 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1462 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:34.930540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:34.937036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:34.938350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Searching by: {'deleted': False, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 21:03:34.944182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:34.944968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:34.945872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:34.946871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:34.947596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:34.948290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:35.004454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 21:03:35.071240 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9301325b-fa51-4e1f-91f1-e5d2dbe91a6c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.150831 Oct 01 21:03:35.072524 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1824/3094] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 21:03:34 2022] GET /compute/v2.1/servers => generated 333 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:35.082571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-064c49fe-cb4c-45f2-bc78-c99571e1651e req-e531711e-84bc-408c-8146-d00094c0a101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63377103-ae63-4f66-a6b7-d6f4a2d8492e", "tag": "311ec718-8814-44c7-a006-cc05466167f1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:35.099910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-064c49fe-cb4c-45f2-bc78-c99571e1651e req-e531711e-84bc-408c-8146-d00094c0a101 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:35.100720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-064c49fe-cb4c-45f2-bc78-c99571e1651e req-e531711e-84bc-408c-8146-d00094c0a101 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:35.101404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-064c49fe-cb4c-45f2-bc78-c99571e1651e req-e531711e-84bc-408c-8146-d00094c0a101 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:35.120383 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-064c49fe-cb4c-45f2-bc78-c99571e1651e req-e531711e-84bc-408c-8146-d00094c0a101 service nova] Creating event network-changed:311ec718-8814-44c7-a006-cc05466167f1 for instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e on nch2-master-1 Oct 01 21:03:35.127020 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-064c49fe-cb4c-45f2-bc78-c99571e1651e req-e531711e-84bc-408c-8146-d00094c0a101 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051849 Oct 01 21:03:35.132822 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1825/3095] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:35.157323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.154"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:35.357749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:35.366294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:35.367088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:35.367538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:35.368295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:35.368763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:35.369199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:35.777390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "refresh_cache-63377103-ae63-4f66-a6b7-d6f4a2d8492e" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 21:03:35.777801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquired lock "refresh_cache-63377103-ae63-4f66-a6b7-d6f4a2d8492e" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 21:03:36.750857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Building network info cache for instance {{(pid=140438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 01 21:03:37.371105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Updating instance_info_cache with network_info: [{"id": "311ec718-8814-44c7-a006-cc05466167f1", "address": "fa:16:3e:b7:4c:77", "network": {"id": "d98999bf-5191-456b-971a-d9c9b2364d89", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-153946029-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c8d44c4bbfc44a297c82cda39868ddd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap311ec718-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 21:03:37.385931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Releasing lock "refresh_cache-63377103-ae63-4f66-a6b7-d6f4a2d8492e" {{(pid=140438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 21:03:37.387482 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-461ba8fa-5dad-4070-b16a-f80614cb084e tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action" status: 202 len: 0 microversion: 2.1 time: 2.252987 Oct 01 21:03:37.388240 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1826/3096] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:03:35 2022] POST /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e/action => generated 0 bytes in 2255 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 01 21:03:37.394986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:37.395953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:37.402740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:37.404047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:37.404731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:37.405627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:37.406314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:37.406941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:37.553679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:37.562999 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98831cda-b23d-4f87-8aa3-693f6c017f3d tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1500 microversion: 2.1 time: 0.173461 Oct 01 21:03:37.564437 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1827/3097] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:37 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1500 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:37.569677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32ffb80d-2294-4061-a558-ba60d5a0b4a1 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417281d4c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:37.617645 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-32ffb80d-2294-4061-a558-ba60d5a0b4a1 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 200 len: 1462 microversion: 2.1 time: 0.052004 Oct 01 21:03:37.618448 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1828/3098] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:37 2022] GET /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 1462 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:37.623142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:37.627898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:37.629335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Searching by: {'deleted': False, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 21:03:37.635253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:37.635880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:37.636338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:37.637090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:37.637557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:37.638024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:37.665272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 21:03:37.708224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:37.716702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:37.718219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:37.718976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:38.238556 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c5bcc4b3-842f-4fa3-a3e7-6d942298367b tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.618834 Oct 01 21:03:38.240387 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1829/3099] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 21:03:37 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:38.264431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:38.265076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:38.281900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:38.282411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:38.282889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:38.284006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:38.284481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:38.292974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:38.481080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:38.497438 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-13ad97cb-c619-498a-a910-9344d2b76395 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1523 microversion: 2.1 time: 0.255235 Oct 01 21:03:38.506288 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1830/3100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:38 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:38.514258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7cefafd9-6299-4ec0-9950-4e1ad3af54c6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'create', calling method: .version_select at 0x7f417279d5e0>, body: {"keypair": {"name": "tempest-keypair-1657777837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQksYz0uFDLi2/r+aae0xB89P/QBXQ+r8j6N6VWKdP0utsOqpB8cwTVLTUCFpLGC5xj3msVNHee7ZeZbFZamhd5fLaNLDbK3fwAHPQOu2HJGc1pKFQPvdabRR9h5mWxGA=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:38.541597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7cefafd9-6299-4ec0-9950-4e1ad3af54c6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Getting quotas for project 10fefee3d6a6430682316cd94b859f1e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:03:38.547871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7cefafd9-6299-4ec0-9950-4e1ad3af54c6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Getting quotas for user 6bda28994cb14f92b014a147a7e74476 and project 10fefee3d6a6430682316cd94b859f1e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:03:38.578474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7cefafd9-6299-4ec0-9950-4e1ad3af54c6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070043 Oct 01 21:03:38.579552 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1831/3101] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:03:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:38.592357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-f69f6613-ebba-4b2e-b863-04faece6dfad req-2d605ffd-dfc5-4615-81b5-245ba6103269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63377103-ae63-4f66-a6b7-d6f4a2d8492e", "tag": "311ec718-8814-44c7-a006-cc05466167f1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:38.606684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f69f6613-ebba-4b2e-b863-04faece6dfad req-2d605ffd-dfc5-4615-81b5-245ba6103269 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:38.614345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f69f6613-ebba-4b2e-b863-04faece6dfad req-2d605ffd-dfc5-4615-81b5-245ba6103269 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:38.627895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f69f6613-ebba-4b2e-b863-04faece6dfad req-2d605ffd-dfc5-4615-81b5-245ba6103269 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:38.644986 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-f69f6613-ebba-4b2e-b863-04faece6dfad req-2d605ffd-dfc5-4615-81b5-245ba6103269 service nova] Creating event network-changed:311ec718-8814-44c7-a006-cc05466167f1 for instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e on nch2-master-1 Oct 01 21:03:38.651741 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-f69f6613-ebba-4b2e-b863-04faece6dfad req-2d605ffd-dfc5-4615-81b5-245ba6103269 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062867 Oct 01 21:03:38.652611 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1832/3102] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:38.658593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af436e87-8feb-4933-a5fb-11827d15f0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '.version_select at 0x7f4172761700>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:39.755109 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-af436e87-8feb-4933-a5fb-11827d15f0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/7bd47c98-4103-4b0b-a518-163c924e484c" status: 202 len: 0 microversion: 2.1 time: 1.100875 Oct 01 21:03:39.760501 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1833/3103] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 21:03:38 2022] DELETE /compute/v2.1/os-floating-ips/7bd47c98-4103-4b0b-a518-163c924e484c => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:03:39.766912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:39.768232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:39.776211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:39.777020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:39.777683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:39.778650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:39.779357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:39.780036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:39.940471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:39.945660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:39.953024 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-039af4f0-bf59-445d-be6d-3ef5b5fb7f7a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1500 microversion: 2.1 time: 0.191320 Oct 01 21:03:39.953990 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1834/3104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:39 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1500 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:39.959149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:39.959966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:39.967510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:39.968406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:39.969010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:39.969904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:39.970558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:39.971213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:40.137938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:40.148333 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f6558ef-7b2d-4b8f-97fa-50e9dcdb7ff7 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9" status: 200 len: 1468 microversion: 2.1 time: 0.192796 Oct 01 21:03:40.148916 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1835/3105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:39 2022] GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9 => generated 1468 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:40.153811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-74716f73-f6b4-496a-b7d3-48d97eb1c906 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:40.162057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-74716f73-f6b4-496a-b7d3-48d97eb1c906 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011987 Oct 01 21:03:40.162923 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1836/3106] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 21:03:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:40.167752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:40.168581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:40.176210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:40.176956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:40.177943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:40.178853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:40.179565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:40.180711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:40.337442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:40.350438 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e93d0833-743b-42ad-8b25-e2adc919579d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1523 microversion: 2.1 time: 0.185973 Oct 01 21:03:40.351229 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1837/3107] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:40 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:40.367390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3e961f0a-95fc-4f93-a3d8-854534cea668 req-26cb3510-e2e1-480f-a9fa-e0159bc5fa33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb9ea14-deab-4588-ade7-66aa910a3eb9", "name": "network-vif-unplugged", "status": "completed", "tag": "beea046f-0dc7-4d4c-8922-c8b4a553c1ca"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:40.381701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3e961f0a-95fc-4f93-a3d8-854534cea668 req-26cb3510-e2e1-480f-a9fa-e0159bc5fa33 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:40.382327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3e961f0a-95fc-4f93-a3d8-854534cea668 req-26cb3510-e2e1-480f-a9fa-e0159bc5fa33 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:40.382964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3e961f0a-95fc-4f93-a3d8-854534cea668 req-26cb3510-e2e1-480f-a9fa-e0159bc5fa33 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:40.396067 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3e961f0a-95fc-4f93-a3d8-854534cea668 req-26cb3510-e2e1-480f-a9fa-e0159bc5fa33 service nova] Creating event network-vif-unplugged:beea046f-0dc7-4d4c-8922-c8b4a553c1ca for instance abb9ea14-deab-4588-ade7-66aa910a3eb9 on nch1-master-1 Oct 01 21:03:40.400926 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3e961f0a-95fc-4f93-a3d8-854534cea668 req-26cb3510-e2e1-480f-a9fa-e0159bc5fa33 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048225 Oct 01 21:03:40.401543 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1838/3108] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:40.406870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1fb78571-e405-4b4a-9305-5d024c308bdf tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '.version_select at 0x7f4172796dc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:40.683923 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1fb78571-e405-4b4a-9305-5d024c308bdf tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/4d8b8559-c8f2-4ce7-89d1-dde1216ae429" status: 202 len: 0 microversion: 2.1 time: 0.280867 Oct 01 21:03:40.685295 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1839/3109] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:03:40 2022] DELETE /compute/v2.1/os-security-groups/4d8b8559-c8f2-4ce7-89d1-dde1216ae429 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:03:40.693845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1d114af-7770-45e8-9545-c5eee0cbf5db tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:40.711904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1d114af-7770-45e8-9545-c5eee0cbf5db tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:40.712455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1d114af-7770-45e8-9545-c5eee0cbf5db tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:40.712900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1d114af-7770-45e8-9545-c5eee0cbf5db tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:40.748996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d1d114af-7770-45e8-9545-c5eee0cbf5db tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Going to try to stop instance {{(pid=140438) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 21:03:40.821904 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1d114af-7770-45e8-9545-c5eee0cbf5db tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3/action" status: 202 len: 0 microversion: 2.1 time: 0.127385 Oct 01 21:03:40.834208 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1840/3110] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:03:40 2022] POST /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:03:40.840680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-47762d91-4b8a-4e4c-823e-3aa13acd06f6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172795940>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:40.973761 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-47762d91-4b8a-4e4c-823e-3aa13acd06f6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images?changes-since=2022-10-01T21%3A01%3A20Z" status: 200 len: 1904 microversion: 2.1 time: 0.137510 Oct 01 21:03:40.974223 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1841/3111] 10.222.0.17 () {58 vars in 1199 bytes} [Sat Oct 1 21:03:40 2022] GET /compute/v2.1/images?changes-since=2022-10-01T21%3A01%3A20Z => generated 1904 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:40.980947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a223ab85-1718-48bc-a871-8897c0c7dcd4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1485221124", "metadata": {"": ""}}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a223ab85-1718-48bc-a871-8897c0c7dcd4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action HTTP/1.1 Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 107 Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1485221124", "metadata": {"": ""}}} Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5fd16675-4ce4-4099-9ced-c2b32cd97e85', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1485221124', 'metadata': {'': ''}}}} Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'': ''} Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:03:40.985685 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a223ab85-1718-48bc-a871-8897c0c7dcd4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:03:40.991866 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a223ab85-1718-48bc-a871-8897c0c7dcd4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action" status: 400 len: 170 microversion: 2.1 time: 0.012093 Oct 01 21:03:40.993613 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1842/3112] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Oct 1 21:03:40 2022] POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action => generated 170 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:03:40.997901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:40.998539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:41.005092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.005590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.006050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:41.006776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.007238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.007663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:41.036835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:03:41.133208 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7d882d7-80b0-4d1d-8f4c-c97cdbc15ed0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 204 len: 0 microversion: 2.1 time: 0.139851 Oct 01 21:03:41.133811 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1843/3113] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:03:40 2022] DELETE /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:03:41.139363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:41.139957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:41.146513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.147024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.147476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:41.148195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.148657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.149278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:41.182549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:03:41.322059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:41.329836 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ca16410-70c4-4dbd-b61a-b39a1b15706d tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "DELETE /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 204 len: 0 microversion: 2.1 time: 0.193559 Oct 01 21:03:41.330941 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1844/3114] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:03:41 2022] DELETE /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:03:41.337870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:41.338685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:41.345526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.346046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.346508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:41.347253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.347716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.348142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:41.543598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:41.565440 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d62dde46-90ea-4520-8074-f9a77322d3f0 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1510 microversion: 2.1 time: 0.232750 Oct 01 21:03:41.576009 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1845/3115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:41 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:41.582323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb9f16b4-488a-4722-8738-4bf18728377b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4173ac2310>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:41.669429 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb9f16b4-488a-4722-8738-4bf18728377b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1348370597" status: 200 len: 485 microversion: 2.1 time: 0.091767 Oct 01 21:03:41.679345 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1846/3116] 10.222.0.17 () {58 vars in 1231 bytes} [Sat Oct 1 21:03:41 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1348370597 => generated 485 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:41.679345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:41.679345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:41.687123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.688554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.689102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:41.689918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.690465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.691517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:41.900651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:41.911270 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-00f23a16-6b73-4aa1-8e2b-4e6c651a9149 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1523 microversion: 2.1 time: 0.239653 Oct 01 21:03:41.926256 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1847/3117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:41 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:41.926256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:41.926256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:41.936806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.937441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.937838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:41.939848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:41.940603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:41.941106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:42.093837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:42.103539 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2306b5f2-5400-402e-b1c7-d2be9aab86a0 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1701 microversion: 2.1 time: 0.190219 Oct 01 21:03:42.104475 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1848/3118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:41 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1701 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:42.121081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:42.122038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:42.134782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:42.136028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:42.136491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:42.137212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:42.137677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:42.138110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:42.335613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:42.345682 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60b07bfc-9fe1-4c60-971e-ca804492b0c3 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1509 microversion: 2.1 time: 0.238930 Oct 01 21:03:42.347186 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1849/3119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:42 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:42.352256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a19d70bb-a088-456b-8ec7-1e4c2aac28d4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41727ec820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:42.443927 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a19d70bb-a088-456b-8ec7-1e4c2aac28d4 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images?server=abb9ea14-deab-4588-ade7-66aa910a3eb9" status: 200 len: 958 microversion: 2.1 time: 0.095605 Oct 01 21:03:42.444785 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1850/3120] 10.222.0.17 () {58 vars in 1209 bytes} [Sat Oct 1 21:03:42 2022] GET /compute/v2.1/images?server=abb9ea14-deab-4588-ade7-66aa910a3eb9 => generated 958 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:42.462661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1551763714", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30c87a4d-5441-4402-9b75-f56c93c32865"}], "security_groups": [{"name": "tempest-securitygroup--568141934"}], "key_name": "tempest-keypair-1657777837", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:42.606420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] validate_networks() for [('30c87a4d-5441-4402-9b75-f56c93c32865', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:03:43.608266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:03:43.611246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:03:43.612315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:03:43.612936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:03:43.614162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:03:43.626818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:43.627551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:43.628412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:43.629781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:43.630938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:43.631627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:43.657220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Getting quotas for project 10fefee3d6a6430682316cd94b859f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:03:43.665118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Getting quotas for user 6bda28994cb14f92b014a147a7e74476 and project 10fefee3d6a6430682316cd94b859f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:03:43.680132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:03:43.683585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:03:43.803046 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f88106d1-35e0-4543-a531-caee62763693 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.347773 Oct 01 21:03:43.805424 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1851/3121] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:03:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:03:43.830391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:43.834888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:43.842243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:43.844064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:43.844543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:43.845320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:43.850220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:43.850758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:44.299925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:44.314210 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ecd8cf63-5ca9-4108-8059-b73277c97910 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1523 microversion: 2.1 time: 0.507072 Oct 01 21:03:44.317133 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1852/3122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:43 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:44.346764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eefc3dae-168a-4c20-8ec4-bebce48f9e85 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41727459d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:44.468451 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eefc3dae-168a-4c20-8ec4-bebce48f9e85 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2Fd12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 485 microversion: 2.1 time: 0.129658 Oct 01 21:03:44.469049 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1853/3123] 10.222.0.17 () {58 vars in 1317 bytes} [Sat Oct 1 21:03:44 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2Fd12ab455-2d67-4728-9293-bd843f39bedf => generated 485 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:44.851526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:44.853102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:44.866456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:44.867422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:44.868147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:44.869851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:44.871109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:44.871785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:45.376261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:45.385690 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4a7c0ba-690e-409e-8f9f-a38ad2717c8c tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1510 microversion: 2.1 time: 0.915594 Oct 01 21:03:45.389103 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1854/3124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:44 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1510 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:45.419669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:45.422666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:45.444102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:45.444511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:45.444950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:45.450399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:45.451181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:45.452589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:45.498445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:45.517674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:45.518439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:45.519706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:45.520493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lazy-loading 'fault' on Instance uuid 5f9254b8-cb84-4fee-a58e-e9e32ac600cb {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:03:45.569185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b665fc7cb4758a6e35cc81c6a4d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7982f0b4349c6ab1c445988ea4f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:45.580924 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-96b2fc78-a1be-4964-ac67-9ce40c181587 tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 200 len: 1359 microversion: 2.1 time: 0.172965 Oct 01 21:03:45.582324 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1855/3125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:45 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:45.587460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:45.588257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:45.602144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:45.603058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:45.604628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:45.605607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:45.607170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:45.609234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:45.676844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:45.677668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:45.678388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:45.679146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lazy-loading 'fault' on Instance uuid 63377103-ae63-4f66-a6b7-d6f4a2d8492e {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:03:45.731925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a92405f06244dfeba65a9cc22bdaa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d44c4bbfc44a297c82cda39868ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:45.742962 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-42368702-01df-48d5-be9a-3765225d27af tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 200 len: 1313 microversion: 2.1 time: 0.159273 Oct 01 21:03:45.744201 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1856/3126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:45 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:45.751834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:45.752674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:45.773624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:45.774380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:45.777183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:45.778004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:45.778521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:45.778960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:45.905119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:45.918606 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ca9e570-312b-4b18-9554-1589e1d940f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1316 microversion: 2.1 time: 0.172992 Oct 01 21:03:45.919343 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1857/3127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:45 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:45.936043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d77b201a-4750-45db-8bdf-3100dc3d6b4f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-136343715", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d77b201a-4750-45db-8bdf-3100dc3d6b4f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action HTTP/1.1 Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 618 Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-136343715", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5fd16675-4ce4-4099-9ced-c2b32cd97e85', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-136343715', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:03:45.943113 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 01 21:03:45.946878 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:45.950867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d77b201a-4750-45db-8bdf-3100dc3d6b4f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:03:45.952213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d77b201a-4750-45db-8bdf-3100dc3d6b4f tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action" status: 400 len: 938 microversion: 2.1 time: 0.030763 Oct 01 21:03:45.953298 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1858/3128] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Oct 1 21:03:45 2022] POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action => generated 938 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:03:45.962009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0146465-331e-473d-8549-3045c6f23b8f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417278bf70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:46.027830 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0146465-331e-473d-8549-3045c6f23b8f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2Fd12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 485 microversion: 2.1 time: 0.073331 Oct 01 21:03:46.028872 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1859/3129] 10.222.0.17 () {58 vars in 1303 bytes} [Sat Oct 1 21:03:45 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2Fd12ab455-2d67-4728-9293-bd843f39bedf => generated 485 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:46.044246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-04c3663e-ad0e-48aa-a842-46de5be552a2 req-9fd7e4d0-e1eb-4083-a995-20a4ca143ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63377103-ae63-4f66-a6b7-d6f4a2d8492e", "name": "network-vif-deleted", "tag": "311ec718-8814-44c7-a006-cc05466167f1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:46.072581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-04c3663e-ad0e-48aa-a842-46de5be552a2 req-9fd7e4d0-e1eb-4083-a995-20a4ca143ec2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:46.073723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-04c3663e-ad0e-48aa-a842-46de5be552a2 req-9fd7e4d0-e1eb-4083-a995-20a4ca143ec2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:46.074182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-04c3663e-ad0e-48aa-a842-46de5be552a2 req-9fd7e4d0-e1eb-4083-a995-20a4ca143ec2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:46.091664 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-04c3663e-ad0e-48aa-a842-46de5be552a2 req-9fd7e4d0-e1eb-4083-a995-20a4ca143ec2 service nova] Creating event network-vif-deleted:311ec718-8814-44c7-a006-cc05466167f1 for instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e on nch2-master-1 Oct 01 21:03:46.097600 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-04c3663e-ad0e-48aa-a842-46de5be552a2 req-9fd7e4d0-e1eb-4083-a995-20a4ca143ec2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056629 Oct 01 21:03:46.098234 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1860/3130] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:46.104601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-287d14f3-72c1-479b-86a9-a0a4a00b72d7 req-6f08b9eb-8504-4a5e-bc86-7719b850d8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9254b8-cb84-4fee-a58e-e9e32ac600cb", "name": "network-vif-deleted", "tag": "fdaa80d8-f655-4ba4-aec6-6acb2bbfcd0e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:46.122550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-287d14f3-72c1-479b-86a9-a0a4a00b72d7 req-6f08b9eb-8504-4a5e-bc86-7719b850d8b4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:46.123050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-287d14f3-72c1-479b-86a9-a0a4a00b72d7 req-6f08b9eb-8504-4a5e-bc86-7719b850d8b4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:46.123507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-287d14f3-72c1-479b-86a9-a0a4a00b72d7 req-6f08b9eb-8504-4a5e-bc86-7719b850d8b4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:46.148137 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-287d14f3-72c1-479b-86a9-a0a4a00b72d7 req-6f08b9eb-8504-4a5e-bc86-7719b850d8b4 service nova] Creating event network-vif-deleted:fdaa80d8-f655-4ba4-aec6-6acb2bbfcd0e for instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb on nch1-master-1 Oct 01 21:03:46.171835 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-287d14f3-72c1-479b-86a9-a0a4a00b72d7 req-6f08b9eb-8504-4a5e-bc86-7719b850d8b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071611 Oct 01 21:03:46.176439 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1861/3131] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:46.216167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:46.216944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:46.249705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:46.250996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:46.255718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:46.258657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:46.259578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:46.263136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:46.560543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:46.571254 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd3d9ecd-72a5-401c-aca2-1336aa661f09 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1523 microversion: 2.1 time: 0.393497 Oct 01 21:03:46.571843 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1862/3132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:46 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:46.576972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1f4d11e1-0ce4-492d-9399-e0eea8d27f2e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417283e4c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:46.709793 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1f4d11e1-0ce4-492d-9399-e0eea8d27f2e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3282 microversion: 2.1 time: 0.136608 Oct 01 21:03:46.710950 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1863/3133] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 21:03:46 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3282 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:46.715935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:46.716758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:46.729083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:46.730408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:46.731070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:46.731963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:46.732596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:46.734076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:47.085977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:47.102134 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cac39a29-bdfa-4c96-9553-378a43af0b51 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1510 microversion: 2.1 time: 0.389945 Oct 01 21:03:47.102766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1864/3134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:46 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:47.111163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:47.111831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:47.134746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:47.135296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:47.136124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:47.137049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:47.137707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:47.141324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:47.352847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:47.362070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e5b2108-42f5-4613-b31f-7816b05665b3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1523 microversion: 2.1 time: 0.257954 Oct 01 21:03:47.363223 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1865/3135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:47 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:47.369854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:47.370744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] [instance: 5f9254b8-cb84-4fee-a58e-e9e32ac600cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:47.379840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:47.381571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:47.382089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:47.382920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:47.383968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:47.384756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:47.403980 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] HTTP exception thrown: Instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb could not be found. Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Request method failure captured: Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb HTTP/1.1 Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKreUV6-mIQ34YdFeo1sdurHdCafnDJryM5r1h62fx_pciAAEG8dUP69uR6qLUtzGhu2ziwnCLs-ZMGbBSwwRmp-8lnNIhJs9W7k1D77hBmPtTPsf60RPoCtBj7dTGAYlJVGjY6lBV_FcKvbKhyrfmvZwV_kTlUnBv0w39hoXM3439c Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 4ae7982f0b4349c6ab1c445988ea4f9f Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-1862300208 Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ae7982f0b4349c6ab1c445988ea4f9f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ae7982f0b4349c6ab1c445988ea4f9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ae7982f0b4349c6ab1c445988ea4f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ae7982f0b4349c6ab1c445988ea4f9f"}]}] Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-1862300208 Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 4ae7982f0b4349c6ab1c445988ea4f9f Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-1862300208 Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-1862300208-project Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 221b665fc7cb4758a6e35cc81c6a4d43 Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-1862300208-project Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb could not be found. Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5f9254b8-cb84-4fee-a58e-e9e32ac600cb'} Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb could not be found. Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb could not be found. Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:47.406332 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb could not be found. Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Returning 404 to user: Instance 5f9254b8-cb84-4fee-a58e-e9e32ac600cb could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-853640e5-6598-4714-ac06-a3f57dceec3c tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb" status: 404 len: 111 microversion: 2.1 time: 0.044064 Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1866/3136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:47 2022] GET /compute/v2.1/servers/5f9254b8-cb84-4fee-a58e-e9e32ac600cb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:03:47.415984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d9499907-87ae-49fd-bde1-6462ed3a3b8b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417271b790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:47.551925 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d9499907-87ae-49fd-bde1-6462ed3a3b8b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.141097 Oct 01 21:03:47.552515 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1867/3137] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 21:03:47 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:47.579469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:47.580111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] [instance: 63377103-ae63-4f66-a6b7-d6f4a2d8492e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:47.588806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:47.589315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:47.590077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:47.590916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:47.591895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:47.592580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:47.609864 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] HTTP exception thrown: Instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e could not be found. Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Request method failure captured: Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e HTTP/1.1 Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKrY-91rE9sjWC0YcDYkV_26znYME6I4ayq9pXBHwHk-g7njT6NznpBuDiNuvDmNzWCCDPxUrR9G-WIGdez85sKO-7AOyyv2234rdln8F8qFWB35jXRCqMrJt4kbkqdU4Zo6aEXqtTyKFblk7VGcZ0hF5GfjmsPmbnx7zWS8kL_Ash4 Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 2c8d44c4bbfc44a297c82cda39868ddd Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-460541753 Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c8d44c4bbfc44a297c82cda39868ddd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c8d44c4bbfc44a297c82cda39868ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c8d44c4bbfc44a297c82cda39868ddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c8d44c4bbfc44a297c82cda39868ddd"}]}] Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-460541753 Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 2c8d44c4bbfc44a297c82cda39868ddd Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-460541753 Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueTestJSONUnderV235-460541753-project Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 5a92405f06244dfeba65a9cc22bdaa2e Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-460541753-project Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e could not be found. Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '63377103-ae63-4f66-a6b7-d6f4a2d8492e'} Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e could not be found. Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e could not be found. Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.611527 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:47.617023 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.617023 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:47.617023 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:47.617023 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:47.617023 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:03:47.617023 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:03:47.617023 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e could not be found. Oct 01 21:03:47.617023 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.618744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] Returning 404 to user: Instance 63377103-ae63-4f66-a6b7-d6f4a2d8492e could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:03:47.619634 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d12deee0-d7ab-4f6a-b18a-1535deade281 tempest-ServerRescueTestJSONUnderV235-460541753 tempest-ServerRescueTestJSONUnderV235-460541753-project] 10.222.0.17 "GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e" status: 404 len: 111 microversion: 2.1 time: 0.046803 Oct 01 21:03:47.620255 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1868/3138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:47 2022] GET /compute/v2.1/servers/63377103-ae63-4f66-a6b7-d6f4a2d8492e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:03:47.629099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:47.629731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:47.635964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:47.636471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:47.636925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:47.637651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:47.638325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:47.638813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:47.911790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:47.923350 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6b24c75d-f8ac-4cd5-83ec-b311a8be7ac3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1371 microversion: 2.1 time: 0.298554 Oct 01 21:03:47.924264 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1869/3139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:47 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:47.929768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b0cae1d-2276-4e08-963d-e98326621940 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b0cae1d-2276-4e08-963d-e98326621940 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action HTTP/1.1 Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 285 Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5fd16675-4ce4-4099-9ced-c2b32cd97e85', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:47.934953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:03:47.938622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:47.943076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b0cae1d-2276-4e08-963d-e98326621940 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:03:47.944838 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5b0cae1d-2276-4e08-963d-e98326621940 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action" status: 400 len: 619 microversion: 2.1 time: 0.018216 Oct 01 21:03:47.945501 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1870/3140] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Oct 1 21:03:47 2022] POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:03:47.953715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-daa1f195-1a28-436c-8c5b-3cc7d46d54ae tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] Calling method '.version_select at 0x7f417279df70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:47.979046 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-daa1f195-1a28-436c-8c5b-3cc7d46d54ae tempest-ServersTestJSON-1862300208 tempest-ServersTestJSON-1862300208-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2144684518" status: 202 len: 0 microversion: 2.1 time: 0.028888 Oct 01 21:03:47.983667 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1871/3141] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 21:03:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2144684518 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:03:47.989999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aee24c53-6208-4686-8729-cf71c07310a6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4173fd6dc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:48.068592 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aee24c53-6208-4686-8729-cf71c07310a6 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.083371 Oct 01 21:03:48.069183 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1872/3142] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 21:03:47 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:48.074933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:48.078002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:48.088448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:48.089590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:48.090307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:48.091067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:48.092213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:48.092655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:48.319515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:48.331511 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-540497e0-85f7-4e31-b997-5a2e91c959de tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1523 microversion: 2.1 time: 0.260965 Oct 01 21:03:48.332390 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1873/3143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:48 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:48.360761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c0a5797-6d2c-411c-8687-f4eaaedcacc2 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417283ec10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:48.612962 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c0a5797-6d2c-411c-8687-f4eaaedcacc2 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/detail?changes-since=2022-10-01T21%3A01%3A13Z" status: 200 len: 6329 microversion: 2.1 time: 0.258123 Oct 01 21:03:48.613803 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1874/3144] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Oct 1 21:03:48 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-01T21%3A01%3A13Z => generated 6329 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:48.618390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:48.619749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:48.634937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:48.635717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:48.636256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:48.637691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:48.638342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:48.638810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:48.849348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:48.869297 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c73ea68f-2b9b-4944-b2d5-617ac6d7fdba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1510 microversion: 2.1 time: 0.253270 Oct 01 21:03:48.869913 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1875/3145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:48 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:48.878914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:48.879768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:48.887543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:48.888042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:48.888519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:48.889679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:48.890149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:48.890612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:49.097480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:49.110279 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6b2dd25c-87d6-4c10-bd12-c8b9e1dd6430 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1523 microversion: 2.1 time: 0.236836 Oct 01 21:03:49.114791 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1876/3146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:48 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:49.127565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b66c489d-7dc3-4e26-8d21-33d034181f96 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417271b790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:49.220625 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b66c489d-7dc3-4e26-8d21-33d034181f96 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1348370597" status: 200 len: 665 microversion: 2.1 time: 0.104369 Oct 01 21:03:49.233830 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1877/3147] 10.222.0.17 () {58 vars in 1252 bytes} [Sat Oct 1 21:03:49 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1348370597 => generated 665 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:49.240751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9f75c92c-9d7a-4842-9b1c-117963791c20 req-d1a7051b-6f64-4505-9fd0-9754a1279034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "681e3cb8-3fd1-41d6-8681-ee4f858ca452", "tag": "1840c72f-c980-4053-8e6e-8177499de115"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:49.253525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9f75c92c-9d7a-4842-9b1c-117963791c20 req-d1a7051b-6f64-4505-9fd0-9754a1279034 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:49.254026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9f75c92c-9d7a-4842-9b1c-117963791c20 req-d1a7051b-6f64-4505-9fd0-9754a1279034 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:49.254467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9f75c92c-9d7a-4842-9b1c-117963791c20 req-d1a7051b-6f64-4505-9fd0-9754a1279034 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:49.272202 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9f75c92c-9d7a-4842-9b1c-117963791c20 req-d1a7051b-6f64-4505-9fd0-9754a1279034 service nova] Creating event network-changed:1840c72f-c980-4053-8e6e-8177499de115 for instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 on nch2-master-1 Oct 01 21:03:49.281660 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9f75c92c-9d7a-4842-9b1c-117963791c20 req-d1a7051b-6f64-4505-9fd0-9754a1279034 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045494 Oct 01 21:03:49.283271 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1878/3148] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:49.291646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:49.292697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:49.301483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:49.302429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:49.303261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:49.304376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:49.305008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:49.305384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:49.567650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:49.576666 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-361e0009-34a1-47ae-bc5d-57f68f6543e9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1371 microversion: 2.1 time: 0.291808 Oct 01 21:03:49.577770 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1879/3149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:49 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:49.583522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a58ac0b-c5d7-4d4f-809f-632ce0c74a99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1630587063"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:49.586380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a58ac0b-c5d7-4d4f-809f-632ce0c74a99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:49.593882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a58ac0b-c5d7-4d4f-809f-632ce0c74a99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:49.594822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a58ac0b-c5d7-4d4f-809f-632ce0c74a99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:49.595524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a58ac0b-c5d7-4d4f-809f-632ce0c74a99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:49.596489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a58ac0b-c5d7-4d4f-809f-632ce0c74a99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:49.597477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a58ac0b-c5d7-4d4f-809f-632ce0c74a99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:49.598989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a58ac0b-c5d7-4d4f-809f-632ce0c74a99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:49.966598 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a58ac0b-c5d7-4d4f-809f-632ce0c74a99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action" status: 202 len: 0 microversion: 2.1 time: 0.386897 Oct 01 21:03:49.967783 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1880/3150] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:03:49 2022] POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 21:03:49.979649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29753aa8-f548-451c-8277-f5ead54f9b6f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41727ec820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:50.056707 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29753aa8-f548-451c-8277-f5ead54f9b6f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2Fd12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1465 microversion: 2.1 time: 0.087178 Oct 01 21:03:50.057316 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1881/3151] 10.222.0.17 () {58 vars in 1338 bytes} [Sat Oct 1 21:03:49 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2Fd12ab455-2d67-4728-9293-bd843f39bedf => generated 1465 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:50.074380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:50.075580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:50.084456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:50.085418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:50.085871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:50.087223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:50.087706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:50.088574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:50.266914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:50.278088 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a66758b1-a5bd-4786-ae46-138f97092c79 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1510 microversion: 2.1 time: 0.207165 Oct 01 21:03:50.279204 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1882/3152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:50 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:50.285478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-735058295"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:50.288677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:50.295368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:50.296117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:50.296571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:50.297870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:50.298379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:50.298881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:50.329534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:50.356579 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Cannot 'createImage' instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 while it is in task_state image_snapshot Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action HTTP/1.1 Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 84 Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-735058295"}} Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'createImage' instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 while it is in task_state image_snapshot Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5fd16675-4ce4-4099-9ced-c2b32cd97e85', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-735058295'}}} Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:03:50.360459 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 while it is in task_state image_snapshot Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 while it is in task_state image_snapshot Oct 01 21:03:50.365692 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:03:50.369161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 409 to user: Cannot 'createImage' instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 while it is in task_state image_snapshot {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:03:50.370245 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7cfd369d-891d-4ec5-8e0b-58d39a4a4df3 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action" status: 409 len: 159 microversion: 2.1 time: 0.089756 Oct 01 21:03:50.371425 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1883/3153] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:03:50 2022] POST /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85/action => generated 159 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:03:50.396968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb91f289-f937-4eff-94dd-6733d4d0ec25 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41727ecdc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:50.483143 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bb91f289-f937-4eff-94dd-6733d4d0ec25 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2Fd12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1465 microversion: 2.1 time: 0.110126 Oct 01 21:03:50.495322 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1884/3154] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Oct 1 21:03:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2Fd12ab455-2d67-4728-9293-bd843f39bedf => generated 1465 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:50.500452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c8c5afc3-7ce3-4abc-8540-b2425e9c3cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '.version_select at 0x7f41726c01f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:50.701769 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c8c5afc3-7ce3-4abc-8540-b2425e9c3cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/images/6bf12437-8b7a-48de-83a1-1a92800fe163" status: 204 len: 0 microversion: 2.1 time: 0.205057 Oct 01 21:03:50.702381 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1885/3155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:50 2022] DELETE /compute/v2.1/images/6bf12437-8b7a-48de-83a1-1a92800fe163 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:03:50.709575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c6ae66c7-376b-46e1-a90d-6cc57cc417bf tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41726c09d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:50.885070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c6ae66c7-376b-46e1-a90d-6cc57cc417bf tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7104 microversion: 2.1 time: 0.178483 Oct 01 21:03:50.898989 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1886/3156] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Oct 1 21:03:50 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7104 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:50.898989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:50.898989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:50.902002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:50.902958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:50.903413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:50.904139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:50.904608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:50.905047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:51.290191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:51.300822 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-497df11a-2c43-412b-88df-758b3ef0c207 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1371 microversion: 2.1 time: 0.413659 Oct 01 21:03:51.301546 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1887/3157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:50 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:51.313221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:51.315155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:51.330546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:51.332478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:51.333195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:51.337758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:51.338633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:51.339321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:51.608932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:51.621715 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29064623-bfab-4618-8a35-64b59e93d8a9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1541 microversion: 2.1 time: 0.315802 Oct 01 21:03:51.629469 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1888/3158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:51 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1541 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:51.635406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f22a1b76-5b68-485c-80c9-ae161853bb10 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417271b790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:51.730655 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f22a1b76-5b68-485c-80c9-ae161853bb10 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4371 microversion: 2.1 time: 0.099547 Oct 01 21:03:51.731475 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1889/3159] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Oct 1 21:03:51 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:51.746000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:51.746662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:51.753769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:51.766787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:51.767618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:51.769130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:51.769830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:51.770561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:52.145969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:52.160341 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a8de0021-421d-494f-be8d-a7f96e8b73ce tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1510 microversion: 2.1 time: 0.427280 Oct 01 21:03:52.162144 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1890/3160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:51 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:52.179649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62c01d40-f0be-463c-b8d5-251a3381d4d8 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41727a3c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:52.244220 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62c01d40-f0be-463c-b8d5-251a3381d4d8 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/90f3f35e-76ec-4c31-b581-329b315fe607" status: 200 len: 784 microversion: 2.1 time: 0.078564 Oct 01 21:03:52.244909 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1891/3161] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:03:52 2022] GET /compute/v2.1/images/90f3f35e-76ec-4c31-b581-329b315fe607 => generated 784 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:52.263637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7cee4f0d-4179-4bf9-ac8d-f01d8e01730f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41726c0a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:52.363756 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7cee4f0d-4179-4bf9-ac8d-f01d8e01730f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.104382 Oct 01 21:03:52.364796 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1892/3162] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 21:03:52 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:52.380766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:52.382946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:52.398781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:52.399485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:52.400370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:52.402381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:52.403231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:52.403885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:52.751152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:52.762756 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-353afbd2-7ea0-498b-98e3-3de11a10e7a5 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1371 microversion: 2.1 time: 0.396618 Oct 01 21:03:52.764011 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1893/3163] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:52 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1371 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:52.780952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c2660e3-668a-4b83-ac4b-b27f32cc2911 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417271baf0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:53.644123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:53.673228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:53.892213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c2660e3-668a-4b83-ac4b-b27f32cc2911 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "DELETE /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da" status: 204 len: 0 microversion: 2.1 time: 1.126773 Oct 01 21:03:53.892809 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1894/3164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:52 2022] DELETE /compute/v2.1/images/adc372f4-a3e8-447c-ba58-38c6be0dd2da => generated 0 bytes in 1128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:03:53.898643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:53.899518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:53.907004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:53.907502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:53.908169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:53.909070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:53.910250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:53.910719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:54.334649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:54.351965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-566311c2-44e7-4d10-b196-70f8915c73be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1523 microversion: 2.1 time: 0.458088 Oct 01 21:03:54.353485 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1895/3165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:53 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:54.397784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:54.406387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:54.427780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:54.428515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:54.429147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:54.430038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:54.431722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:54.432420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:54.903917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:54.922765 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca2e2e75-c873-4585-b27f-544fcc624e09 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1510 microversion: 2.1 time: 0.545981 Oct 01 21:03:54.926860 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1896/3166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:54 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1510 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:54.940009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:54.943109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:54.965001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:54.967145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:54.968213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:54.969334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:54.973794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:54.974260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:55.254839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:55.274614 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7883302a-1719-4f16-8a0d-c775a8b99dd6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1371 microversion: 2.1 time: 0.345166 Oct 01 21:03:55.276962 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1897/3167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:54 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1371 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:55.298334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc9c525d-9490-482e-ae06-45d7bbb0e230 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41726d4e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:56.247648 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc9c525d-9490-482e-ae06-45d7bbb0e230 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "DELETE /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201" status: 204 len: 0 microversion: 2.1 time: 0.966747 Oct 01 21:03:56.248651 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1898/3168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:55 2022] DELETE /compute/v2.1/images/5e76584f-c83d-4215-a7f9-bac43dfbe201 => generated 0 bytes in 971 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:03:56.254756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3ae73e25-1494-405f-a5ff-955f122d069b req-a458fa0e-10a0-44a1-a1d0-b69f510e9b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "681e3cb8-3fd1-41d6-8681-ee4f858ca452", "name": "network-vif-plugged", "status": "completed", "tag": "1840c72f-c980-4053-8e6e-8177499de115"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:56.276435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3ae73e25-1494-405f-a5ff-955f122d069b req-a458fa0e-10a0-44a1-a1d0-b69f510e9b83 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:56.277096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3ae73e25-1494-405f-a5ff-955f122d069b req-a458fa0e-10a0-44a1-a1d0-b69f510e9b83 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:56.277628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3ae73e25-1494-405f-a5ff-955f122d069b req-a458fa0e-10a0-44a1-a1d0-b69f510e9b83 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:56.293305 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3ae73e25-1494-405f-a5ff-955f122d069b req-a458fa0e-10a0-44a1-a1d0-b69f510e9b83 service nova] Creating event network-vif-plugged:1840c72f-c980-4053-8e6e-8177499de115 for instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 on nch2-master-1 Oct 01 21:03:56.308258 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3ae73e25-1494-405f-a5ff-955f122d069b req-a458fa0e-10a0-44a1-a1d0-b69f510e9b83 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058153 Oct 01 21:03:56.309178 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1899/3169] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:03:56.317005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:56.317898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:56.326043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:56.327020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:56.327432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:56.328379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:56.329070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:56.329717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:56.381867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:03:56.542138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:03:56.558761 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c5aab448-5fc9-446b-a324-c7298a70f646 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 204 len: 0 microversion: 2.1 time: 0.247565 Oct 01 21:03:56.560044 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1900/3170] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:03:56 2022] DELETE /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:03:56.575475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:56.576950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:56.587278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:56.588247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:56.588866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:56.591689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:56.593065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:56.594282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:57.327057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:57.339603 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a0d229f-07f9-43f7-972d-1085ff169a17 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1487 microversion: 2.1 time: 0.773823 Oct 01 21:03:57.340430 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1901/3171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:56 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1487 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:57.359030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a55fa3f4-b989-4b3b-ad50-8be3fc5bed41 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f417271b5e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:58.124942 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a55fa3f4-b989-4b3b-ad50-8be3fc5bed41 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "DELETE /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d" status: 204 len: 0 microversion: 2.1 time: 0.782647 Oct 01 21:03:58.125533 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1902/3172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:57 2022] DELETE /compute/v2.1/images/f68e1115-779e-4223-8680-240d5126a09d => generated 0 bytes in 784 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:03:58.130643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:58.131458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:58.145045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:58.145713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:58.146233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:58.147254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:58.148910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:58.150243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:58.534950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:58.549341 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fca60d76-764e-4099-a00a-842cd0ce1951 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1371 microversion: 2.1 time: 0.422479 Oct 01 21:03:58.562518 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1903/3173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:58 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:58.562518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:58.562518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:58.567159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:58.568059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:58.569370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:58.570238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:58.571516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:58.572170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:58.982581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:03:58.992174 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-08227953-8fd7-4223-8aa1-f2a9431d48c4 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 200 len: 1529 microversion: 2.1 time: 0.440144 Oct 01 21:03:59.008485 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1904/3174] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:03:58 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 1529 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:59.008485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-31c2a4a8-e09a-4038-a19e-7c7e52b315ea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-784023891"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:59.009701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-31c2a4a8-e09a-4038-a19e-7c7e52b315ea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:59.016914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31c2a4a8-e09a-4038-a19e-7c7e52b315ea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:59.017750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31c2a4a8-e09a-4038-a19e-7c7e52b315ea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:59.019075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31c2a4a8-e09a-4038-a19e-7c7e52b315ea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:59.020399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31c2a4a8-e09a-4038-a19e-7c7e52b315ea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:59.021131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31c2a4a8-e09a-4038-a19e-7c7e52b315ea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:59.021791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31c2a4a8-e09a-4038-a19e-7c7e52b315ea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:59.158306 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-31c2a4a8-e09a-4038-a19e-7c7e52b315ea tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "PUT /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1059 microversion: 2.1 time: 0.160714 Oct 01 21:03:59.177039 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1905/3175] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:03:58 2022] PUT /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1059 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:03:59.512376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-237760058", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": "none"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:03:59.615533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:03:59.616125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:03:59.616430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:03:59.616845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:03:59.617271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:03:59.629805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:59.630599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:59.631254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:59.632249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:59.632719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:59.633549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:59.657391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Getting quotas for project adf310503fa74abf83949a914e728693. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:03:59.662943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Getting quotas for user 6736b832e7034ce3b431b79af50095aa and project adf310503fa74abf83949a914e728693. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:03:59.675864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:03:59.678232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:03:59.773382 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc8ad4ed-b61d-49b5-9421-3d70a027fec6 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.595111 Oct 01 21:03:59.774877 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1906/3176] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 21:03:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 21:03:59.787174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:03:59.788899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:03:59.800647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:59.801483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:59.808205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:59.809294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:03:59.809650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:03:59.812559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:03:59.879278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:03:59.929065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:00.078216 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b1afd250-d7e3-44ff-96cf-4ca38b304032 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 204 len: 0 microversion: 2.1 time: 0.301376 Oct 01 21:04:00.079989 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1907/3177] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:03:59 2022] DELETE /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:00.092653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0866fed8-e52c-4284-8351-886bb651b66c req-7945556b-5031-49ff-a2b2-40ed0ca601aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd16675-4ce4-4099-9ced-c2b32cd97e85", "name": "network-vif-plugged", "status": "completed", "tag": "a86ec246-7e6b-4660-bcb3-54272db2c2bf"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:00.112963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0866fed8-e52c-4284-8351-886bb651b66c req-7945556b-5031-49ff-a2b2-40ed0ca601aa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.118824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0866fed8-e52c-4284-8351-886bb651b66c req-7945556b-5031-49ff-a2b2-40ed0ca601aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.119383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0866fed8-e52c-4284-8351-886bb651b66c req-7945556b-5031-49ff-a2b2-40ed0ca601aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:00.145823 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0866fed8-e52c-4284-8351-886bb651b66c req-7945556b-5031-49ff-a2b2-40ed0ca601aa service nova] Creating event network-vif-plugged:a86ec246-7e6b-4660-bcb3-54272db2c2bf for instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 on nch1-master-1 Oct 01 21:04:00.163513 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0866fed8-e52c-4284-8351-886bb651b66c req-7945556b-5031-49ff-a2b2-40ed0ca601aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067677 Oct 01 21:04:00.164862 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1908/3178] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:00.182397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8fc954eb-ce6b-4126-94ab-69c0a19ab455 req-e895cea8-8618-48cb-8a1d-dca84e701d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd16675-4ce4-4099-9ced-c2b32cd97e85", "name": "network-vif-deleted", "tag": "a86ec246-7e6b-4660-bcb3-54272db2c2bf"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:00.198011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8fc954eb-ce6b-4126-94ab-69c0a19ab455 req-e895cea8-8618-48cb-8a1d-dca84e701d27 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.198961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8fc954eb-ce6b-4126-94ab-69c0a19ab455 req-e895cea8-8618-48cb-8a1d-dca84e701d27 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.199628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8fc954eb-ce6b-4126-94ab-69c0a19ab455 req-e895cea8-8618-48cb-8a1d-dca84e701d27 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:00.217342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8fc954eb-ce6b-4126-94ab-69c0a19ab455 req-e895cea8-8618-48cb-8a1d-dca84e701d27 service nova] Creating event network-vif-deleted:a86ec246-7e6b-4660-bcb3-54272db2c2bf for instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 on nch1-master-1 Oct 01 21:04:00.224345 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8fc954eb-ce6b-4126-94ab-69c0a19ab455 req-e895cea8-8618-48cb-8a1d-dca84e701d27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057597 Oct 01 21:04:00.226142 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1909/3179] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:00.232723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:00.234129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:00.244343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.244924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.245675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:00.246975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.247553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.248056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:00.517024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:00.533474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-636db58b-d75a-4569-a141-1e8438093dd3 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1486 microversion: 2.1 time: 0.305022 Oct 01 21:04:00.535753 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1910/3180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:00 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1486 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:00.542208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:00.543353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:00.551374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.552262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.553174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:00.554998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.556233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.556902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:00.752484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:00.764617 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef7cf93e-1a03-4129-9dad-0175698973f6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1564 microversion: 2.1 time: 0.227237 Oct 01 21:04:00.765782 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1911/3181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:00 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1564 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:00.772888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:00.773881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:00.780650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.781435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.782163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:00.783122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.784529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.785416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:00.900945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:00.924374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:00.931512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:00.936083 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f3356c41-2f75-4f39-b4bf-9ea1de804af8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1281 microversion: 2.57 time: 0.168418 Oct 01 21:04:00.954531 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1912/3182] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:00 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:00.954531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:00.954531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:00.977536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.978050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.978518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:00.979238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:00.979699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:00.980132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:01.013537 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 HTTP/1.1 Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5fd16675-4ce4-4099-9ced-c2b32cd97e85'} Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:01.016857 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:01.022167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:01.022167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:01.022167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:01.022167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:01.022167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:01.022167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:01.022167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:04:01.022167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:01.022167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:01.024650 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a698bc6a-2504-4efa-8bcb-38add1255c14 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 404 len: 111 microversion: 2.1 time: 0.080760 Oct 01 21:04:01.026484 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1913/3183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:00 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:01.040775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:01.043639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:01.053478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:01.054217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:01.054847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:01.055984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:01.056770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:01.057765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:02.118636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:02.127850 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4553b5e0-eb2e-47f7-b8db-13b8317d1858 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1474 microversion: 2.1 time: 1.101460 Oct 01 21:04:02.128515 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1914/3184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:01 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1474 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:02.148887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:02.149786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:02.156442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:02.157035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:02.157553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:02.158357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:02.159519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:02.160029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:02.782236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:02.799145 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7eb843fe-c285-4d92-b1fd-d0a5b586babf tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1486 microversion: 2.1 time: 0.646558 Oct 01 21:04:02.800169 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1915/3185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:02 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1486 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:02.806128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d64f04d4-d81c-484a-b0f7-647c64c9aee3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:02.806678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d64f04d4-d81c-484a-b0f7-647c64c9aee3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:02.828787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d64f04d4-d81c-484a-b0f7-647c64c9aee3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:02.829334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d64f04d4-d81c-484a-b0f7-647c64c9aee3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:02.829833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d64f04d4-d81c-484a-b0f7-647c64c9aee3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:02.830676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d64f04d4-d81c-484a-b0f7-647c64c9aee3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:02.831740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d64f04d4-d81c-484a-b0f7-647c64c9aee3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:02.833209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d64f04d4-d81c-484a-b0f7-647c64c9aee3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:03.016159 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d64f04d4-d81c-484a-b0f7-647c64c9aee3 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.214295 Oct 01 21:04:03.017071 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1916/3186] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:04:02 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:03.024237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da180a15-239d-45a0-ac44-ba919e6a1489 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'create', calling method: .version_select at 0x7f41726c0550>, body: {"keypair": {"name": "tempest-keypair-711606469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuYF3vHWnjWRFZbaNLKO8GVDiAyNFScq5crKWYS6qry4zD+dYJbPRhtTPYOLe+3tMyGqWIuBTAb30jtGaGwaMZmy6WF2g/sNqDM4dx8eI2zbRwBCOlQJJCjJhlkl3mPdw=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:03.077823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-da180a15-239d-45a0-ac44-ba919e6a1489 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Getting quotas for project 99e8daf9de4d4fa395b7eee86d33a5f5. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:04:03.087665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-da180a15-239d-45a0-ac44-ba919e6a1489 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Getting quotas for user aa4fbb28c9de4089870d91cf52dac8ea and project 99e8daf9de4d4fa395b7eee86d33a5f5. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:04:03.146443 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da180a15-239d-45a0-ac44-ba919e6a1489 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128082 Oct 01 21:04:03.148107 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1917/3187] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:04:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:03.160230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:03.161143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:03.188352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:03.189369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:03.193538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:03.194640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:03.201381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:03.201952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:03.390789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:03.404342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:03.406147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:03.408311 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4ce251ce-ad43-410d-9b43-cc5dc1437fe8 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1335 microversion: 2.57 time: 0.258668 Oct 01 21:04:03.438967 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1918/3188] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:03 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1335 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:03.459217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:03.459931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:03.469666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:03.470638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:03.471435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:03.473053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:03.473879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:03.474924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:03.528842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:04:03.766314 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-67793c1d-820f-4e11-9d65-e059dbf781ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 204 len: 0 microversion: 2.1 time: 0.324689 Oct 01 21:04:03.767700 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1919/3189] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:03 2022] DELETE /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:03.781506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:03.782234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:03.799482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:03.800286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:03.802636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:03.803441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:03.803929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:03.804365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:04.061611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:04.073305 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-258977a4-cd06-4f53-9897-ea1d0e58635e tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 200 len: 1432 microversion: 2.1 time: 0.303088 Oct 01 21:04:04.074638 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1920/3190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:03 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 1432 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:04.079911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ba5d1a3c-3b6d-4c66-b3b3-f7c3c33f207f req-697cc55e-0da8-4f25-ba63-7562c614a2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12ab455-2d67-4728-9293-bd843f39bedf", "name": "network-vif-deleted", "tag": "8a94b425-9ca6-4166-8a17-467ca29d4cf8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:04.092395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ba5d1a3c-3b6d-4c66-b3b3-f7c3c33f207f req-697cc55e-0da8-4f25-ba63-7562c614a2b6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:04.093292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ba5d1a3c-3b6d-4c66-b3b3-f7c3c33f207f req-697cc55e-0da8-4f25-ba63-7562c614a2b6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:04.093932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ba5d1a3c-3b6d-4c66-b3b3-f7c3c33f207f req-697cc55e-0da8-4f25-ba63-7562c614a2b6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:04.106839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ba5d1a3c-3b6d-4c66-b3b3-f7c3c33f207f req-697cc55e-0da8-4f25-ba63-7562c614a2b6 service nova] Creating event network-vif-deleted:8a94b425-9ca6-4166-8a17-467ca29d4cf8 for instance d12ab455-2d67-4728-9293-bd843f39bedf on nch1-master-1 Oct 01 21:04:04.115348 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ba5d1a3c-3b6d-4c66-b3b3-f7c3c33f207f req-697cc55e-0da8-4f25-ba63-7562c614a2b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039168 Oct 01 21:04:04.117635 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1921/3191] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:04.125092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:04.126425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:04.136625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:04.137538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:04.138558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:04.140700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:04.141424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:04.142740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:04.927810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:04.943548 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f46ae0a-4c9f-493e-a390-9e3b018cbc1a tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1492 microversion: 2.1 time: 0.821846 Oct 01 21:04:04.944214 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1922/3192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:04 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1492 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:04.957644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:04.960373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:04.977533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:04.978068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:04.981436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:04.983114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:04.984859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:04.985451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:05.245024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:05.256913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:05.258388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:05.259755 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac1b1aef-2705-4034-998f-8e48f5e88628 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1356 microversion: 2.57 time: 0.312052 Oct 01 21:04:05.260639 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1923/3193] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:04 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1356 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:05.279765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:05.281745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: d12ab455-2d67-4728-9293-bd843f39bedf] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:05.292680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:05.293192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:05.293639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:05.294356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:05.294843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:05.298391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:05.325396 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] HTTP exception thrown: Instance d12ab455-2d67-4728-9293-bd843f39bedf could not be found. Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Request method failure captured: Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf HTTP/1.1 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqYR32lQdSoiNXolh6GCoCSDv6qUX8LsVxg258Zo8ZMXZFuFGvK4Yaht5hdq52Ob0by8_4wWIIPpS0J6Jj0Twy7SA8rom34-_tNIwkiVoK1dVuxQVPKI0BcgSNbeaaKcp-SuKdFOt_c6NxOlETJzUe5XIzGXogQc3ua-jljmPI4xf0 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 600066b2cda643488c4a2965d5b20661 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListImageFiltersTestJSON-493145562 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_600066b2cda643488c4a2965d5b20661", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/600066b2cda643488c4a2965d5b20661"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/600066b2cda643488c4a2965d5b20661"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/600066b2cda643488c4a2965d5b20661"}]}] Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListImageFiltersTestJSON-493145562 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 600066b2cda643488c4a2965d5b20661 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-493145562 Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListImageFiltersTestJSON-493145562-project Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 779cdf8245f7483881c218306e3a76cb Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListImageFiltersTestJSON-493145562-project Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance d12ab455-2d67-4728-9293-bd843f39bedf could not be found. Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd12ab455-2d67-4728-9293-bd843f39bedf'} Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d12ab455-2d67-4728-9293-bd843f39bedf could not be found. Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d12ab455-2d67-4728-9293-bd843f39bedf could not be found. Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:05.328754 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:05.333307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:05.333307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:05.333307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:05.333307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:05.333307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:05.333307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d12ab455-2d67-4728-9293-bd843f39bedf could not be found. Oct 01 21:04:05.333307 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:05.336183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Returning 404 to user: Instance d12ab455-2d67-4728-9293-bd843f39bedf could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:05.337447 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cdd3d1b5-6822-4030-953e-2203ed4e6b47 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf" status: 404 len: 111 microversion: 2.1 time: 0.075749 Oct 01 21:04:05.340527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1924/3194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:05 2022] GET /compute/v2.1/servers/d12ab455-2d67-4728-9293-bd843f39bedf => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:05.346133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:05.350641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:05.367066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:05.367958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:05.368591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:05.369829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:05.370476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:05.371580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:05.458761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:04:05.459247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:04:05.459732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:04:05.460146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:04:05.460559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:04:05.470539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:05.543323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:05.560164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:05.562752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:05.565549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:05.566523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:05.568789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:05.569386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:05.615105 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-895cb73b-e01a-4022-8f66-b6e0086c5d2b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "POST /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9/action" status: 202 len: 1137 microversion: 2.57 time: 0.272824 Oct 01 21:04:05.616216 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1925/3195] 10.222.0.17 () {62 vars in 1320 bytes} [Sat Oct 1 21:04:05 2022] POST /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9/action => generated 1137 bytes in 275 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 01 21:04:05.621815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:05.622457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:05.630787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:05.635111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:05.635860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:05.636745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:05.637913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:05.638436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:05.940037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:04:06.090799 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-efb1a572-e917-468e-b0db-7b43dc90436b tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "DELETE /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9" status: 204 len: 0 microversion: 2.1 time: 0.473107 Oct 01 21:04:06.094987 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1926/3196] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:05 2022] DELETE /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:06.105378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:06.110311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:06.121261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:06.127608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:06.128355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:06.128886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:06.131478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:06.132470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:06.132921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:06.373547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:06.382550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:06.383932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:06.385158 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8c80f4f-2820-4aed-ae77-0f0a55eef366 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.288753 Oct 01 21:04:06.385728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1927/3197] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:06 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:06.403021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-68ca0bf6-2c68-46d4-9a95-a7c4f2e517b7 req-ae3dca3f-9372-422e-abe3-287bd93ddcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "681e3cb8-3fd1-41d6-8681-ee4f858ca452", "tag": "1840c72f-c980-4053-8e6e-8177499de115"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:06.426964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-68ca0bf6-2c68-46d4-9a95-a7c4f2e517b7 req-ae3dca3f-9372-422e-abe3-287bd93ddcd6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:06.427475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-68ca0bf6-2c68-46d4-9a95-a7c4f2e517b7 req-ae3dca3f-9372-422e-abe3-287bd93ddcd6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:06.427923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-68ca0bf6-2c68-46d4-9a95-a7c4f2e517b7 req-ae3dca3f-9372-422e-abe3-287bd93ddcd6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:06.452996 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-68ca0bf6-2c68-46d4-9a95-a7c4f2e517b7 req-ae3dca3f-9372-422e-abe3-287bd93ddcd6 service nova] Creating event network-changed:1840c72f-c980-4053-8e6e-8177499de115 for instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 on nch2-master-1 Oct 01 21:04:06.465418 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-68ca0bf6-2c68-46d4-9a95-a7c4f2e517b7 req-ae3dca3f-9372-422e-abe3-287bd93ddcd6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068925 Oct 01 21:04:06.467860 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1928/3198] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:06.501286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:06.502710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:06.513304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:06.513809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:06.514253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:06.515004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:06.515468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:06.515934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:07.096906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:07.108685 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9af78c6f-fd28-4024-b50c-7338cc8403d9 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 200 len: 1492 microversion: 2.1 time: 0.639594 Oct 01 21:04:07.109570 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1929/3199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:06 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 1492 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:07.114859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:07.115793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:07.145724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:07.149201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:07.151161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:07.153035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:07.154466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:07.155835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:07.665304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:07.674678 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e69b0cc0-8623-4159-b8b4-6a2b042277c9 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9" status: 200 len: 1474 microversion: 2.1 time: 0.563672 Oct 01 21:04:07.680761 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1930/3200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:07 2022] GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9 => generated 1474 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:07.689251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:07.703936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:07.727778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:07.730423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:07.732337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:07.736582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:07.737605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:07.739201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:08.431032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:08.442644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:08.445137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:08.452511 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23964718-7660-4fbe-bc0c-179426bbff7f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.765695 Oct 01 21:04:08.467237 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1931/3201] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:07 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:08.477752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:08.478860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:08.485897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:08.487261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:08.487872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:08.488759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:08.489390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:08.489987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:08.523904 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 HTTP/1.1 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '997cf849-72aa-4471-96db-ef813c9f0df3'} Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.525757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:08.531542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:08.531542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:08.531542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:08.531542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:08.531542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.531542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.531542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:08.531542 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a3d2b326-b226-411b-81a4-41fe32b623fd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 404 len: 111 microversion: 2.1 time: 0.060360 Oct 01 21:04:08.535590 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1932/3202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:08 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:08.548840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:08.550024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:08.556456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:08.556955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:08.557394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:08.558107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:08.558589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:08.559022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:08.574010 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 HTTP/1.1 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '997cf849-72aa-4471-96db-ef813c9f0df3'} Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:08.575628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1030adc-4728-4ddd-a561-8f2a1c667d73 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 404 len: 111 microversion: 2.1 time: 0.032450 Oct 01 21:04:08.580093 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1933/3203] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:08 2022] DELETE /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:04:08.582811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1147535404", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:08.646277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] validate_networks() for [('12dd7e60-a7cd-466f-a786-9ebf24caa716', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:04:09.643979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:10.017205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:04:10.017969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:04:10.018715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:04:10.019370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:04:10.020005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:04:10.030516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:10.031274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:10.031959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:10.032968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:10.034382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:10.035089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:10.062615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Getting quotas for project 99e8daf9de4d4fa395b7eee86d33a5f5. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:04:10.071196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Getting quotas for user aa4fbb28c9de4089870d91cf52dac8ea and project 99e8daf9de4d4fa395b7eee86d33a5f5. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:04:10.086627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:04:10.089145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:04:10.148013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-be276fc0-ceb5-428f-81c0-3241ad84452a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.569260 Oct 01 21:04:10.149279 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1934/3204] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:04:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:04:10.154864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:10.156028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 997cf849-72aa-4471-96db-ef813c9f0df3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:10.167572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:10.168573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:10.169232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:10.171006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:10.171852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:10.172669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:10.206130 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 HTTP/1.1 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '997cf849-72aa-4471-96db-ef813c9f0df3'} Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:10.208299 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:10.214325 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:10.214325 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:10.214325 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:10.214325 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:10.214325 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. Oct 01 21:04:10.214325 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:10.214325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 997cf849-72aa-4471-96db-ef813c9f0df3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:10.214325 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ee15da3f-732c-482a-aefe-5640c7cd0eb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3" status: 404 len: 111 microversion: 2.1 time: 0.060718 Oct 01 21:04:10.217702 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1935/3205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:10 2022] GET /compute/v2.1/servers/997cf849-72aa-4471-96db-ef813c9f0df3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:10.226358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-54d95837-6f8d-42f2-aa9e-a12540184da0 req-c61ca7e0-eb85-47b9-981f-fc7da73a05a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997cf849-72aa-4471-96db-ef813c9f0df3", "name": "network-vif-deleted", "tag": "0db6a596-65c3-426a-ae29-eeca8d55f329"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:10.240843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-54d95837-6f8d-42f2-aa9e-a12540184da0 req-c61ca7e0-eb85-47b9-981f-fc7da73a05a2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:10.241586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-54d95837-6f8d-42f2-aa9e-a12540184da0 req-c61ca7e0-eb85-47b9-981f-fc7da73a05a2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:10.242541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-54d95837-6f8d-42f2-aa9e-a12540184da0 req-c61ca7e0-eb85-47b9-981f-fc7da73a05a2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:10.257308 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-54d95837-6f8d-42f2-aa9e-a12540184da0 req-c61ca7e0-eb85-47b9-981f-fc7da73a05a2 service nova] Creating event network-vif-deleted:0db6a596-65c3-426a-ae29-eeca8d55f329 for instance 997cf849-72aa-4471-96db-ef813c9f0df3 on nch2-master-1 Oct 01 21:04:10.269086 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-54d95837-6f8d-42f2-aa9e-a12540184da0 req-c61ca7e0-eb85-47b9-981f-fc7da73a05a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049584 Oct 01 21:04:10.269673 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1936/3206] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:10.276850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:10.277570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:10.285464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:10.286560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:10.287005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:10.287735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:10.288203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:10.288643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:10.427247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779cdf8245f7483881c218306e3a76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600066b2cda643488c4a2965d5b20661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:10.441518 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb7ca34f-3d29-4bdd-ba6e-b3bca030c8dd tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9" status: 200 len: 1432 microversion: 2.1 time: 0.168129 Oct 01 21:04:10.445261 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1937/3207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:10 2022] GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9 => generated 1432 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:10.461581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:10.464858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:10.480234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:10.486173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:10.488000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:10.489092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:10.490464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:10.491288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:10.711630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:10.735044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:10.737129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:10.738372 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba1115b8-74e8-4013-8d65-99a3d4f84ba9 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.291900 Oct 01 21:04:10.767359 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1938/3208] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:10 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:10.772453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad226afa-0253-4273-81cd-59337037c747 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:10.773291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad226afa-0253-4273-81cd-59337037c747 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:10.961921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ad226afa-0253-4273-81cd-59337037c747 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:10.970195 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad226afa-0253-4273-81cd-59337037c747 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1225 microversion: 2.1 time: 0.201521 Oct 01 21:04:10.971598 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1939/3209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:10 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:10.979923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:10.980437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:11.003963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.004510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.005981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.010856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.015482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.016313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.037239 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 HTTP/1.1 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '15685bb1-262f-4ba0-b343-a3385faad097'} Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:11.043424 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.048392 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.063516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:11.064445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1392f23b-c330-4bf7-8445-7828b6b15cb5 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 404 len: 111 microversion: 2.1 time: 0.091459 Oct 01 21:04:11.065786 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1940/3210] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:10 2022] DELETE /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:11.071752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-14fb664e-5f8c-4ed1-ba64-2b8a4a998e7f req-7b5de102-5873-45e9-abba-d9fe322fedb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb9ea14-deab-4588-ade7-66aa910a3eb9", "name": "network-vif-deleted", "tag": "beea046f-0dc7-4d4c-8922-c8b4a553c1ca"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:11.087424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-14fb664e-5f8c-4ed1-ba64-2b8a4a998e7f req-7b5de102-5873-45e9-abba-d9fe322fedb3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.087883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-14fb664e-5f8c-4ed1-ba64-2b8a4a998e7f req-7b5de102-5873-45e9-abba-d9fe322fedb3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.088330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-14fb664e-5f8c-4ed1-ba64-2b8a4a998e7f req-7b5de102-5873-45e9-abba-d9fe322fedb3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.117183 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-14fb664e-5f8c-4ed1-ba64-2b8a4a998e7f req-7b5de102-5873-45e9-abba-d9fe322fedb3 service nova] Creating event network-vif-deleted:beea046f-0dc7-4d4c-8922-c8b4a553c1ca for instance abb9ea14-deab-4588-ade7-66aa910a3eb9 on nch1-master-1 Oct 01 21:04:11.127218 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-14fb664e-5f8c-4ed1-ba64-2b8a4a998e7f req-7b5de102-5873-45e9-abba-d9fe322fedb3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060140 Oct 01 21:04:11.131887 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1941/3211] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:11.137515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:11.138284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 15685bb1-262f-4ba0-b343-a3385faad097] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:11.145033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.145546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.145994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.146764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.147229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.147857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.193271 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 HTTP/1.1 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '15685bb1-262f-4ba0-b343-a3385faad097'} Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.195345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.200708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.200708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.200708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:11.200708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:11.200708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. Oct 01 21:04:11.200708 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.200708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 15685bb1-262f-4ba0-b343-a3385faad097 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:11.200708 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2594d260-0159-4914-8fe5-b387724839eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097" status: 404 len: 111 microversion: 2.1 time: 0.066246 Oct 01 21:04:11.204596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1942/3212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:11 2022] GET /compute/v2.1/servers/15685bb1-262f-4ba0-b343-a3385faad097 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:11.210096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:11.210978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:11.218244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.218859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.219417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.220339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.221145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.221672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.237648 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce HTTP/1.1 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '8a0d83c0-b37a-4973-84ee-07d7f3448dce'} Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:11.239576 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.245243 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.247325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:11.248463 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-97dc2c40-5863-4be9-a825-9c018ddbd7ba tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 404 len: 111 microversion: 2.1 time: 0.042686 Oct 01 21:04:11.249527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1943/3213] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:11 2022] DELETE /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:11.259787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:11.260752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 8a0d83c0-b37a-4973-84ee-07d7f3448dce] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:11.269848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.270888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.271513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.273864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.274944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.277041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.301033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce HTTP/1.1 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '8a0d83c0-b37a-4973-84ee-07d7f3448dce'} Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.303535 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.309313 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.309313 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.309313 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:11.309313 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:11.309313 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. Oct 01 21:04:11.309313 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.311652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 8a0d83c0-b37a-4973-84ee-07d7f3448dce could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:11.313367 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3eb1b3cf-05e8-4134-8d2f-1706fa47cde6 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce" status: 404 len: 111 microversion: 2.1 time: 0.058885 Oct 01 21:04:11.315565 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1944/3214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:11 2022] GET /compute/v2.1/servers/8a0d83c0-b37a-4973-84ee-07d7f3448dce => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:04:11.327778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:11.328608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:11.337289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.338174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.338408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.339335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.339908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.340944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.358906 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 HTTP/1.1 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '90b8899d-c628-41cc-9c72-0687112c14d3'} Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:11.360489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a3772002-83dd-47b4-a4fa-d9d4294c2aad tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 404 len: 111 microversion: 2.1 time: 0.043515 Oct 01 21:04:11.366388 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1945/3215] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:11 2022] DELETE /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:11.372222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:11.373356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 90b8899d-c628-41cc-9c72-0687112c14d3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:11.381179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.381784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.382551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.384045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.384751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.385546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.414394 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 HTTP/1.1 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '90b8899d-c628-41cc-9c72-0687112c14d3'} Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.416165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.420680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.420680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.420680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:11.420680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:11.420680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. Oct 01 21:04:11.420680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.420680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 90b8899d-c628-41cc-9c72-0687112c14d3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:11.420680 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c7de56d-94c1-4d3b-9b0c-f45b83bfa1eb tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3" status: 404 len: 111 microversion: 2.1 time: 0.049465 Oct 01 21:04:11.420680 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1946/3216] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:11 2022] GET /compute/v2.1/servers/90b8899d-c628-41cc-9c72-0687112c14d3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:11.428846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:11.429552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:11.440651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.441701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.442226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.443261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.443795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.444439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.459635 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f HTTP/1.1 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f'} Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:11.463171 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eff6c110-18ee-4b28-81e0-d777533a99ca tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 404 len: 111 microversion: 2.1 time: 0.041613 Oct 01 21:04:11.469605 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1947/3217] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:11 2022] DELETE /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:11.471597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:11.472540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] [instance: abb9ea14-deab-4588-ade7-66aa910a3eb9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:11.480106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.480995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.481750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.482854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.483832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.484429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.504508 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] HTTP exception thrown: Instance abb9ea14-deab-4588-ade7-66aa910a3eb9 could not be found. Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Request method failure captured: Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9 HTTP/1.1 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqYR32lQdSoiNXolh6GCoCSDv6qUX8LsVxg258Zo8ZMXZFuFGvK4Yaht5hdq52Ob0by8_4wWIIPpS0J6Jj0Twy7SA8rom34-_tNIwkiVoK1dVuxQVPKI0BcgSNbeaaKcp-SuKdFOt_c6NxOlETJzUe5XIzGXogQc3ua-jljmPI4xf0 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 600066b2cda643488c4a2965d5b20661 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListImageFiltersTestJSON-493145562 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_600066b2cda643488c4a2965d5b20661", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/600066b2cda643488c4a2965d5b20661"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/600066b2cda643488c4a2965d5b20661"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/600066b2cda643488c4a2965d5b20661"}]}] Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListImageFiltersTestJSON-493145562 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 600066b2cda643488c4a2965d5b20661 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-493145562 Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListImageFiltersTestJSON-493145562-project Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 779cdf8245f7483881c218306e3a76cb Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListImageFiltersTestJSON-493145562-project Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance abb9ea14-deab-4588-ade7-66aa910a3eb9 could not be found. Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'abb9ea14-deab-4588-ade7-66aa910a3eb9'} Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb9ea14-deab-4588-ade7-66aa910a3eb9 could not be found. Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb9ea14-deab-4588-ade7-66aa910a3eb9 could not be found. Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.507076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.512126 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.512126 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.512126 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.512126 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:11.512126 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:11.512126 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb9ea14-deab-4588-ade7-66aa910a3eb9 could not be found. Oct 01 21:04:11.512126 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.514076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Returning 404 to user: Instance abb9ea14-deab-4588-ade7-66aa910a3eb9 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:11.515645 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d10c7d6e-8397-4ff3-9e7c-df973cf4af26 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9" status: 404 len: 111 microversion: 2.1 time: 0.047904 Oct 01 21:04:11.516639 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1948/3218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:11 2022] GET /compute/v2.1/servers/abb9ea14-deab-4588-ade7-66aa910a3eb9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:11.522154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:11.523084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:11.534409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.535290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.535932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.537409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:11.538323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:11.539529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:11.561921 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f HTTP/1.1 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f'} Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.564298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:11.569930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:11.569930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:11.569930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:11.569930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:11.569930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. Oct 01 21:04:11.569930 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:11.569930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:11.569930 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f925c8d5-a573-4b20-b2b5-8a9f6872cdda tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f" status: 404 len: 111 microversion: 2.1 time: 0.049868 Oct 01 21:04:11.570636 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1949/3219] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:11 2022] GET /compute/v2.1/servers/eb5bfc3b-3acb-40b6-a169-ccca28f7ff4f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:11.576488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d634056a-1af4-4670-b386-300a86fa8d77 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f4172745670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:12.169848 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d634056a-1af4-4670-b386-300a86fa8d77 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "DELETE /compute/v2.1/images/9fa7f5b1-1dbd-4296-b884-1379163128fd" status: 204 len: 0 microversion: 2.1 time: 0.598146 Oct 01 21:04:12.170560 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1950/3220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:11 2022] DELETE /compute/v2.1/images/9fa7f5b1-1dbd-4296-b884-1379163128fd => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:12.178790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:12.179358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:12.197234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:12.197750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:12.198822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:12.199765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:12.200773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:12.202363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:12.242802 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee HTTP/1.1 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a0dd6bea-3abb-4f96-8959-84a72945a1ee'} Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:12.244609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-46d78b1c-4274-4fb1-bdcd-f153cec04013 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 404 len: 111 microversion: 2.1 time: 0.075365 Oct 01 21:04:12.251069 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1951/3221] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:12 2022] DELETE /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:12.262174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:12.262831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:12.280612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:12.281119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:12.281569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:12.282290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:12.282784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:12.283217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:12.328178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:12.836093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:12.851853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:12.853731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:12.855191 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ae76f23-e2ac-4160-aac8-364abdaa068d tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.603259 Oct 01 21:04:12.878718 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1952/3222] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:12 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:12.885578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:12.886323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:12.895504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:12.896108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:12.896652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:12.897568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:12.898135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:12.899060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:13.037603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:13.059855 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3bcaf6d7-d49b-401c-8075-f9f83db4dd38 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1283 microversion: 2.1 time: 0.179840 Oct 01 21:04:13.060714 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1953/3223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:12 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:13.066828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df6aaba4-6393-4aac-b948-4d4da2da686f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41726d7c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:13.919173 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df6aaba4-6393-4aac-b948-4d4da2da686f tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "DELETE /compute/v2.1/images/b4e0f82a-ba81-4680-b297-134d038f2ca2" status: 204 len: 0 microversion: 2.1 time: 0.857053 Oct 01 21:04:13.919799 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1954/3224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:13 2022] DELETE /compute/v2.1/images/b4e0f82a-ba81-4680-b297-134d038f2ca2 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:13.930992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:13.932084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: a0dd6bea-3abb-4f96-8959-84a72945a1ee] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:13.947706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:13.948253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:13.949717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:13.950482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:13.950972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:13.954221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:13.980270 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee HTTP/1.1 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a0dd6bea-3abb-4f96-8959-84a72945a1ee'} Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:13.982181 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:13.986867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:13.986867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:13.986867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:13.986867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:13.986867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. Oct 01 21:04:13.986867 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:13.989113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance a0dd6bea-3abb-4f96-8959-84a72945a1ee could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:13.990194 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-163977c7-f144-48e5-a29f-e530d301e448 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee" status: 404 len: 111 microversion: 2.1 time: 0.064787 Oct 01 21:04:13.991407 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1955/3225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:13 2022] GET /compute/v2.1/servers/a0dd6bea-3abb-4f96-8959-84a72945a1ee => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:14.379021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1628042776", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "ef0b6107-8dc7-4b16-b2d9-47c7d1f58b6c"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:14.484046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] validate_networks() for [('ef0b6107-8dc7-4b16-b2d9-47c7d1f58b6c', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:04:15.576470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:04:15.577439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:04:15.577570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:04:15.578001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:04:15.578562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:04:15.603549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:15.608592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:15.609117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:15.613846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:15.616520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:15.620428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:15.707378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Getting quotas for project 99422a6e3b744bff964052dfddb678ef. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:04:15.723828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Getting quotas for user aad36d5e04a7453aba1e6d0b15d2d06f and project 99422a6e3b744bff964052dfddb678ef. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:04:15.747754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:04:15.750923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:04:15.824013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48994870-0de0-4442-8229-70b56a7499d2 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831179 Oct 01 21:04:15.825171 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1956/3226] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:04:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:04:15.830346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:15.831897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:15.840472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:15.841492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:15.842117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:15.843390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:15.844063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:15.844806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:16.040200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:16.054440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:16.056367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:16.057618 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-069d6d8f-509d-4545-b8a4-c799c394ce4c tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.231296 Oct 01 21:04:16.070186 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1957/3227] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:15 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:16.081998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7efcba5-32fe-4381-a5b9-987521294468 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] Calling method '.version_select at 0x7f41726d7e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:17.010230 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d7efcba5-32fe-4381-a5b9-987521294468 tempest-ListImageFiltersTestJSON-493145562 tempest-ListImageFiltersTestJSON-493145562-project] 10.222.0.17 "DELETE /compute/v2.1/images/bb484433-9d38-4f7e-928d-075d914ba8e2" status: 204 len: 0 microversion: 2.1 time: 0.936649 Oct 01 21:04:17.013949 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1958/3228] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:16 2022] DELETE /compute/v2.1/images/bb484433-9d38-4f7e-928d-075d914ba8e2 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:17.017730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:17.018244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:17.032408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:17.034869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:17.035460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:17.036203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:17.036672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:17.040095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:17.117346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:04:17.298581 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-899ab98b-1aa8-4635-8631-915a7ccff3e7 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 204 len: 0 microversion: 2.1 time: 0.284865 Oct 01 21:04:17.299941 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1959/3229] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:17 2022] DELETE /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:17.312661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:17.317619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:17.325548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:17.326315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:17.327215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:17.328277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:17.328908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:17.329507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:17.645442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:17.663299 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-42588365-a74c-4cdb-bd66-6464d9c77916 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1325 microversion: 2.1 time: 0.361676 Oct 01 21:04:17.666461 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1960/3230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:17 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1325 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:17.682594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-39e3b784-ad27-4eab-93de-a6a0350b6357 req-25da9216-628c-4106-b5b3-39b415111517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a4b134-fb30-4b7e-b206-6b5c6cd08334", "tag": "1d2f202e-1001-4a1c-8564-b41ca6b8aff6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:17.708973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-39e3b784-ad27-4eab-93de-a6a0350b6357 req-25da9216-628c-4106-b5b3-39b415111517 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:17.714840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-39e3b784-ad27-4eab-93de-a6a0350b6357 req-25da9216-628c-4106-b5b3-39b415111517 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:17.715645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-39e3b784-ad27-4eab-93de-a6a0350b6357 req-25da9216-628c-4106-b5b3-39b415111517 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:17.729720 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-39e3b784-ad27-4eab-93de-a6a0350b6357 req-25da9216-628c-4106-b5b3-39b415111517 service nova] Creating event network-changed:1d2f202e-1001-4a1c-8564-b41ca6b8aff6 for instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 on nch1-master-1 Oct 01 21:04:17.738144 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-39e3b784-ad27-4eab-93de-a6a0350b6357 req-25da9216-628c-4106-b5b3-39b415111517 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068572 Oct 01 21:04:17.739364 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1961/3231] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:17.746409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:17.747506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:17.755316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:17.757855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:17.758477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:17.760338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:17.761351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:17.762342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:17.762995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:17.902293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:17.937600 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f9dddc16-5610-4111-9c8f-d288e6691907 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1295 microversion: 2.1 time: 0.195983 Oct 01 21:04:17.941318 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1962/3232] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:17 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1295 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:17.959035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:17.959692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:17.973429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:17.973937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:17.974388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:17.975141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:17.975610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:17.976046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:18.115780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:18.126397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:18.128917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:18.130269 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3b0285c-d35b-495b-8fb7-865425a87c55 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.187364 Oct 01 21:04:18.131121 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1963/3233] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:17 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:18.136279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:18.138315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:18.148875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:18.149453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:18.149861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:18.150675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:18.151322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:18.151958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:18.643623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:18.655117 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f0df7441-855b-4b20-ac7b-da797648cdec tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1478 microversion: 2.1 time: 0.522328 Oct 01 21:04:18.656876 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1964/3234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:18 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1478 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:18.693793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:18.694447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:18.706331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:18.706866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:18.707317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:18.708043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:18.708504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:18.708939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:19.614445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:19.624251 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec23ebcd-2f77-4819-85ba-61db2be0a07a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1325 microversion: 2.1 time: 0.934984 Oct 01 21:04:19.630833 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1965/3235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:18 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1325 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:04:19.638198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:19.646708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:19.665102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:19.665998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:19.671149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:19.672272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:19.672983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:19.674805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:20.760418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:20.769517 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b088bf9c-e216-4fcd-8373-eb5f6dc8086c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1325 microversion: 2.1 time: 1.135497 Oct 01 21:04:20.774682 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1966/3236] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:19 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1325 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:20.779854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:20.787996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:20.803575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:20.804353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:20.805007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:20.806163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:20.809903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:20.810577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:21.067940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:21.080711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:21.086271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:21.088560 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c1974335-97bb-4964-bb0a-4678f324d72b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.312624 Oct 01 21:04:21.090057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1967/3237] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:20 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:21.097636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:21.098978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:21.106301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:21.107336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:21.108016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:21.109199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:21.109915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:21.110452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:21.273574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ff9091a794faaacc05a37550c8a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea57d3c53f74e3ea78e9e4bc790c434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:21.289587 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-89b7b35f-049c-46a0-a58a-cd5e44c43edd tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 200 len: 1436 microversion: 2.1 time: 0.195294 Oct 01 21:04:21.290744 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1968/3238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:21 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 1436 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:21.499832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-656886c9-d83c-4847-ab3a-ab220ce7ade6 req-e1f5e232-16ad-415a-aa1b-4fddd886152a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac62988-8fc6-4a29-a356-e193c6955625", "tag": "04bcf193-a8da-49db-930c-7a157d5ecd2e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:21.512169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-656886c9-d83c-4847-ab3a-ab220ce7ade6 req-e1f5e232-16ad-415a-aa1b-4fddd886152a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:21.512664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-656886c9-d83c-4847-ab3a-ab220ce7ade6 req-e1f5e232-16ad-415a-aa1b-4fddd886152a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:21.513101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-656886c9-d83c-4847-ab3a-ab220ce7ade6 req-e1f5e232-16ad-415a-aa1b-4fddd886152a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:21.529655 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-656886c9-d83c-4847-ab3a-ab220ce7ade6 req-e1f5e232-16ad-415a-aa1b-4fddd886152a service nova] Creating event network-changed:04bcf193-a8da-49db-930c-7a157d5ecd2e for instance 2ac62988-8fc6-4a29-a356-e193c6955625 on nch2-master-1 Oct 01 21:04:21.537004 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-656886c9-d83c-4847-ab3a-ab220ce7ade6 req-e1f5e232-16ad-415a-aa1b-4fddd886152a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243389 Oct 01 21:04:21.544966 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1969/3239] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:21.675624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b8383d4-2c4e-460d-b538-eefcc4ed93d3 tempest-AZV2TestJSON-501289687 tempest-AZV2TestJSON-501289687-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:21.677506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b8383d4-2c4e-460d-b538-eefcc4ed93d3 tempest-AZV2TestJSON-501289687 tempest-AZV2TestJSON-501289687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:21.677992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b8383d4-2c4e-460d-b538-eefcc4ed93d3 tempest-AZV2TestJSON-501289687 tempest-AZV2TestJSON-501289687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:21.678444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b8383d4-2c4e-460d-b538-eefcc4ed93d3 tempest-AZV2TestJSON-501289687 tempest-AZV2TestJSON-501289687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:21.680015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b8383d4-2c4e-460d-b538-eefcc4ed93d3 tempest-AZV2TestJSON-501289687 tempest-AZV2TestJSON-501289687-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:21.680015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b8383d4-2c4e-460d-b538-eefcc4ed93d3 tempest-AZV2TestJSON-501289687 tempest-AZV2TestJSON-501289687-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:21.680503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b8383d4-2c4e-460d-b538-eefcc4ed93d3 tempest-AZV2TestJSON-501289687 tempest-AZV2TestJSON-501289687-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:21.710942 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b8383d4-2c4e-460d-b538-eefcc4ed93d3 tempest-AZV2TestJSON-501289687 tempest-AZV2TestJSON-501289687-project] 10.222.0.17 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.164547 Oct 01 21:04:21.711935 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1970/3240] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Oct 1 21:04:21 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:04:21.720307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:21.722030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:21.729450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:21.730153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:21.730881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:21.732230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:21.732933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:21.733545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:22.032555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:22.041839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d977dc29-5158-416e-8eff-0438c984f316 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1325 microversion: 2.1 time: 0.328638 Oct 01 21:04:22.042456 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1971/3241] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:21 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1325 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:22.338058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-475029f3-45e0-4472-9026-f2314f98e1b5 req-f6bb13b3-1c59-45a3-b151-5013d135b2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a421824-9059-433a-b77f-6bf3ea622301", "name": "network-vif-deleted", "tag": "9304dc9e-52d8-4c39-a272-dd40574a2d6b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:22.349790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-475029f3-45e0-4472-9026-f2314f98e1b5 req-f6bb13b3-1c59-45a3-b151-5013d135b2c3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:22.350183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-475029f3-45e0-4472-9026-f2314f98e1b5 req-f6bb13b3-1c59-45a3-b151-5013d135b2c3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:22.350844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-475029f3-45e0-4472-9026-f2314f98e1b5 req-f6bb13b3-1c59-45a3-b151-5013d135b2c3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:22.366081 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-475029f3-45e0-4472-9026-f2314f98e1b5 req-f6bb13b3-1c59-45a3-b151-5013d135b2c3 service nova] Creating event network-vif-deleted:9304dc9e-52d8-4c39-a272-dd40574a2d6b for instance 7a421824-9059-433a-b77f-6bf3ea622301 on nch1-master-1 Oct 01 21:04:22.372186 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-475029f3-45e0-4472-9026-f2314f98e1b5 req-f6bb13b3-1c59-45a3-b151-5013d135b2c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328518 Oct 01 21:04:22.373505 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1972/3242] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:22.383665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:22.383665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:22.390245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:22.391620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:22.392347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:22.393418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:22.394146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:22.394941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:22.427926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:22.651768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:22.662281 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca243cf7-f069-4604-8b11-1877b1dfc473 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1325 microversion: 2.1 time: 0.287128 Oct 01 21:04:22.674937 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1973/3243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:22 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:22.684413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:22.685426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:22.693632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:22.694068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:22.694570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:22.695306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:22.695754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:22.696184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:22.853148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:22.864010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:22.865886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:22.868347 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60fc0d7a-10c5-4431-bee6-19e11d53a19f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.191737 Oct 01 21:04:22.870180 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1974/3244] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:22 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:22.892976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:22.894776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] [instance: 7a421824-9059-433a-b77f-6bf3ea622301] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:22.959264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:22.961792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:22.963233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:22.964318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:22.965131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:22.965964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:22.990415 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Instance 7a421824-9059-433a-b77f-6bf3ea622301 could not be found. Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 HTTP/1.1 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 7a421824-9059-433a-b77f-6bf3ea622301 could not be found. Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7a421824-9059-433a-b77f-6bf3ea622301'} Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a421824-9059-433a-b77f-6bf3ea622301 could not be found. Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a421824-9059-433a-b77f-6bf3ea622301 could not be found. Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:22.997688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:23.004014 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:23.004014 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:23.004014 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:23.004014 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:23.004014 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a421824-9059-433a-b77f-6bf3ea622301 could not be found. Oct 01 21:04:23.004014 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:23.007669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 404 to user: Instance 7a421824-9059-433a-b77f-6bf3ea622301 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:23.009274 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94412bf8-b363-424e-8e46-8f22548584f1 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301" status: 404 len: 111 microversion: 2.1 time: 0.137340 Oct 01 21:04:23.010359 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1975/3245] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:22 2022] GET /compute/v2.1/servers/7a421824-9059-433a-b77f-6bf3ea622301 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:23.066003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:23.067127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:23.078703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:23.079228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:23.079688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:23.080495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:23.086607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:23.095031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:23.447168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:23.456405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-915dbc58-2fee-45fa-8dd0-ff2c6912d37a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1325 microversion: 2.1 time: 0.394892 Oct 01 21:04:23.457859 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1976/3246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:23 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1325 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:23.644819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3f5c5968-9714-4325-ab10-57f9925379e2 req-9d1c635f-0189-4991-9ffd-0282ccda177c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a4b134-fb30-4b7e-b206-6b5c6cd08334", "name": "network-vif-plugged", "status": "completed", "tag": "1d2f202e-1001-4a1c-8564-b41ca6b8aff6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:23.656461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3f5c5968-9714-4325-ab10-57f9925379e2 req-9d1c635f-0189-4991-9ffd-0282ccda177c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:23.657208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3f5c5968-9714-4325-ab10-57f9925379e2 req-9d1c635f-0189-4991-9ffd-0282ccda177c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:23.658665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3f5c5968-9714-4325-ab10-57f9925379e2 req-9d1c635f-0189-4991-9ffd-0282ccda177c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:23.671258 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3f5c5968-9714-4325-ab10-57f9925379e2 req-9d1c635f-0189-4991-9ffd-0282ccda177c service nova] Creating event network-vif-plugged:1d2f202e-1001-4a1c-8564-b41ca6b8aff6 for instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 on nch1-master-1 Oct 01 21:04:23.677599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3f5c5968-9714-4325-ab10-57f9925379e2 req-9d1c635f-0189-4991-9ffd-0282ccda177c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217037 Oct 01 21:04:23.678855 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1977/3247] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:23.691467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:23.692657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:23.700076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:23.700930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:23.701620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:23.702797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:23.703501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:23.704312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:24.006483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:24.014657 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5e5da59e-884f-4b69-88e1-24a557605f45 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1325 microversion: 2.1 time: 0.327943 Oct 01 21:04:24.019664 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1978/3248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:23 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1325 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:24.039983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:24.040883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:24.048263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:24.049778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:24.051065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:24.051925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:24.052421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:24.059065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:24.185369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:24.197713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:24.200111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:24.203861 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e3c10db-093c-4055-bef1-ea79fe1c26ed tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.177704 Oct 01 21:04:24.206317 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1979/3249] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:24 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:24.490139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:24.491310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:24.500858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:24.501357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:24.501842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:24.503047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:24.503518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:24.503955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:25.097960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:25.106351 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a7412880-ec1a-43d2-ac63-7e5ffb8e0bc8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1325 microversion: 2.1 time: 0.625172 Oct 01 21:04:25.109990 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1980/3250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:24 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1325 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:25.118747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:25.129346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:25.154098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:25.154916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:25.155574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:25.163119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:25.164833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:25.165511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:25.511742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:25.528262 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2428deab-b621-4a97-be88-b0b5f7832aaf tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1325 microversion: 2.1 time: 0.416048 Oct 01 21:04:25.541458 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1981/3251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:25 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1325 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:25.547824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:25.549344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:25.556425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:25.556933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:25.557495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:25.558565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:25.559206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:25.559646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:25.676979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:25.695057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:25.696864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:25.699149 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a4e2460d-1c63-4067-9b30-d352d2aeab85 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.156331 Oct 01 21:04:25.700401 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1982/3252] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:25 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:26.147819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:26.149435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:26.153246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=24 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:26.164858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:26.165567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:26.166304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:26.167482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:26.168098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:26.168695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:26.613698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:26.631239 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f903dd9-c87d-4f4c-9838-a6bc00159ef1 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1522 microversion: 2.1 time: 0.501592 Oct 01 21:04:26.642536 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1983/3253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:26 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:04:26.642536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:26.642536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:26.647336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:26.651134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:26.651784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:26.652706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:26.654415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:26.655281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:26.945704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:26.960253 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd8cb7f2-8f79-4a28-bd4d-706e92f5b617 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1325 microversion: 2.1 time: 0.325115 Oct 01 21:04:26.962118 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1984/3254] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:26 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:26.972583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:26.974233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:26.989602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:26.991411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:26.993482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:26.994558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:26.996005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:26.997583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:27.589769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:27.607633 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a95c71c-a084-4893-a1ca-6301fbe71384 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1522 microversion: 2.1 time: 0.643489 Oct 01 21:04:27.613507 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1985/3255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:26 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:27.635752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:27.641650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:27.658772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:27.663079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:27.664785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:27.665798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:27.667482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:27.668113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:27.847993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:27.856988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:27.858758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:27.860003 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8953a30-d75d-45c2-bd48-fd83cbe1be26 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.244690 Oct 01 21:04:27.860577 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1986/3256] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:27 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:27.865664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8788792d-9c1f-4d12-8731-0e0b3b1aa751 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1060395967"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:27.868108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8788792d-9c1f-4d12-8731-0e0b3b1aa751 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:27.874599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8788792d-9c1f-4d12-8731-0e0b3b1aa751 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:27.875103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8788792d-9c1f-4d12-8731-0e0b3b1aa751 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:27.875540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8788792d-9c1f-4d12-8731-0e0b3b1aa751 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:27.876241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8788792d-9c1f-4d12-8731-0e0b3b1aa751 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:27.876911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8788792d-9c1f-4d12-8731-0e0b3b1aa751 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:27.877343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8788792d-9c1f-4d12-8731-0e0b3b1aa751 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:28.110117 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8788792d-9c1f-4d12-8731-0e0b3b1aa751 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334/action" status: 202 len: 0 microversion: 2.1 time: 0.247872 Oct 01 21:04:28.112252 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1987/3257] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:04:27 2022] POST /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 21:04:28.118921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:28.119930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:28.127052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:28.127966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:28.128610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:28.129543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:28.130192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:28.130864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:28.767822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:28.778156 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c6ef1077-ae8d-4d96-bd2c-d2782d2eb56c tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1325 microversion: 2.1 time: 0.664305 Oct 01 21:04:28.799180 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1988/3258] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:28 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1325 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:28.806593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37d27063-7fb5-4d8c-a75b-985408d7e8ea tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '.version_select at 0x7f41726d7670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:28.996490 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37d27063-7fb5-4d8c-a75b-985408d7e8ea tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/images/f7fe0745-0bda-4ebc-b828-ee001024212a" status: 204 len: 0 microversion: 2.1 time: 0.195775 Oct 01 21:04:28.997230 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1989/3259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:28 2022] DELETE /compute/v2.1/images/f7fe0745-0bda-4ebc-b828-ee001024212a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:29.006715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-dffd8e46-67d6-4ffa-b782-817649e65023 req-64534c3f-07eb-45f5-8847-802b6332d654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac62988-8fc6-4a29-a356-e193c6955625", "name": "network-vif-plugged", "status": "completed", "tag": "04bcf193-a8da-49db-930c-7a157d5ecd2e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:29.025149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dffd8e46-67d6-4ffa-b782-817649e65023 req-64534c3f-07eb-45f5-8847-802b6332d654 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:29.026120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dffd8e46-67d6-4ffa-b782-817649e65023 req-64534c3f-07eb-45f5-8847-802b6332d654 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:29.026906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dffd8e46-67d6-4ffa-b782-817649e65023 req-64534c3f-07eb-45f5-8847-802b6332d654 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:29.043285 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-dffd8e46-67d6-4ffa-b782-817649e65023 req-64534c3f-07eb-45f5-8847-802b6332d654 service nova] Creating event network-vif-plugged:04bcf193-a8da-49db-930c-7a157d5ecd2e for instance 2ac62988-8fc6-4a29-a356-e193c6955625 on nch2-master-1 Oct 01 21:04:29.051600 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-dffd8e46-67d6-4ffa-b782-817649e65023 req-64534c3f-07eb-45f5-8847-802b6332d654 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052672 Oct 01 21:04:29.052581 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1990/3260] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:29.072457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:29.078225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:29.096070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:29.098017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:29.099038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:29.101250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:29.102478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:29.103205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:29.416236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:29.424182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:29.428115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:29.430909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:29.432584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc6d54c2-4457-49db-815f-246da193260f tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.377430 Oct 01 21:04:29.433724 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1991/3261] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:29 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:29.442000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68ecaf3a-74d5-49d8-b982-7a3ea99004d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '.version_select at 0x7f4172876dc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:29.478576 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-68ecaf3a-74d5-49d8-b982-7a3ea99004d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Image not found. Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68ecaf3a-74d5-49d8-b982-7a3ea99004d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/images/f7fe0745-0bda-4ebc-b828-ee001024212a HTTP/1.1 Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f7fe0745-0bda-4ebc-b828-ee001024212a'} Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f7fe0745-0bda-4ebc-b828-ee001024212a Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 21:04:29.481276 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f7fe0745-0bda-4ebc-b828-ee001024212a could not be found. Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68ecaf3a-74d5-49d8-b982-7a3ea99004d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68ecaf3a-74d5-49d8-b982-7a3ea99004d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/images/f7fe0745-0bda-4ebc-b828-ee001024212a" status: 404 len: 62 microversion: 2.1 time: 0.048260 Oct 01 21:04:29.487431 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1992/3262] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:04:29 2022] GET /compute/v2.1/images/f7fe0745-0bda-4ebc-b828-ee001024212a => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:04:29.494371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:29.495036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:29.504937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:29.505446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:29.505895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:29.506792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:29.507296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:29.507730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:29.944421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:29.959289 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b2a8785-3949-4e9e-b123-e782c71e86fa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1540 microversion: 2.1 time: 0.470064 Oct 01 21:04:29.960167 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1993/3263] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:29 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1540 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:29.972833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:29.973492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:29.983211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:29.983995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:29.984630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:29.986404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:29.987062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:29.987661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:30.529835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:30.542747 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c5e744fe-88a1-4a85-ba9d-64c8c509745a tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1325 microversion: 2.1 time: 0.580073 Oct 01 21:04:30.543586 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1994/3264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:29 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:30.564611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:30.565239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:30.571354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:30.571857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:30.572310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:30.573019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:30.573490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:30.573926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:30.672316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:30.681245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:30.682869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:30.684145 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fdcc86b-d6dd-462e-8855-031a9a27c7ac tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.124447 Oct 01 21:04:30.684790 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1995/3265] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:30 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:30.983310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:30.984042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:30.990684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:30.991236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:30.991827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:30.992680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:30.993719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:30.994189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:31.691281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:31.833115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:31.850727 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9b861437-42bb-48b3-8150-2aba26095e2d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1540 microversion: 2.1 time: 0.869348 Oct 01 21:04:31.851628 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1996/3266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:30 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1540 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:04:31.861850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:31.863192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:31.872648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:31.873991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:31.875132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:31.876186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:31.877169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:31.877863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:32.207721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:32.219333 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4e96fabc-dc12-4c56-9a59-784350672944 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1522 microversion: 2.1 time: 0.365596 Oct 01 21:04:32.222628 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1997/3267] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:31 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:32.230122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:32.235350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:32.254179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:32.255075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:32.255720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:32.256701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:32.257339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:32.257941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:32.376842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:32.396531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:32.399283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:32.400736 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8acff8a5-8166-41ce-9761-f9001fd1a0fa tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.174433 Oct 01 21:04:32.412085 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1998/3268] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:32 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:32.428556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:32.429740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:32.437543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:32.438365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:32.439762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:32.440740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:32.441523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:32.442149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:32.486439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] HTTP exception thrown: Action 999 not found Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Request method failure captured: Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625/os-instance-actions/999 HTTP/1.1 Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKtM_e347B5k3cCLtXFb29UmWijajtWHo0Uyf9EpYGwWbUsqJY66PtONJEu549qh90vVNoDAc-LxviaRILB20KsthyL4rluuLzd7eYkikDPFUGfcZc9wLi7N0b5qj-6PSyyZlQQ_X-ndsYPfazs46LO2GPscRSqh_grmooQX9I9zhrI Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99422a6e3b744bff964052dfddb678ef Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1984472967 Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99422a6e3b744bff964052dfddb678ef", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99422a6e3b744bff964052dfddb678ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99422a6e3b744bff964052dfddb678ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99422a6e3b744bff964052dfddb678ef"}]}] Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1984472967 Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99422a6e3b744bff964052dfddb678ef Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1984472967 Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-InstanceActionsNegativeTestJSON-1984472967-project Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aad36d5e04a7453aba1e6d0b15d2d06f Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1984472967-project Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: exception: Action 999 not found Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': '2ac62988-8fc6-4a29-a356-e193c6955625', 'id': '999'} Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 01 21:04:32.497381 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:32.504174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Returning 404 to user: Action 999 not found {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:32.506904 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba12e08c-cab7-4f59-b835-edad582e5905 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.083368 Oct 01 21:04:32.507690 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 1999/3269] 10.222.0.17 () {58 vars in 1308 bytes} [Sat Oct 1 21:04:32 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625/os-instance-actions/999 => generated 66 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:04:32.519775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-774acd95-a37b-4edd-93a4-265d21499950 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '.version_select at 0x7f41737fd9d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:32.520629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-774acd95-a37b-4edd-93a4-265d21499950 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 06c121f5-f245-4dc9-916d-33dfabfb4111] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:32.530813 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-774acd95-a37b-4edd-93a4-265d21499950 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] HTTP exception thrown: Instance 06c121f5-f245-4dc9-916d-33dfabfb4111 could not be found. Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-774acd95-a37b-4edd-93a4-265d21499950 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Request method failure captured: Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/06c121f5-f245-4dc9-916d-33dfabfb4111/os-instance-actions HTTP/1.1 Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKtM_e347B5k3cCLtXFb29UmWijajtWHo0Uyf9EpYGwWbUsqJY66PtONJEu549qh90vVNoDAc-LxviaRILB20KsthyL4rluuLzd7eYkikDPFUGfcZc9wLi7N0b5qj-6PSyyZlQQ_X-ndsYPfazs46LO2GPscRSqh_grmooQX9I9zhrI Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99422a6e3b744bff964052dfddb678ef Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1984472967 Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99422a6e3b744bff964052dfddb678ef", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99422a6e3b744bff964052dfddb678ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99422a6e3b744bff964052dfddb678ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99422a6e3b744bff964052dfddb678ef"}]}] Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1984472967 Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99422a6e3b744bff964052dfddb678ef Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1984472967 Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-InstanceActionsNegativeTestJSON-1984472967-project Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aad36d5e04a7453aba1e6d0b15d2d06f Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1984472967-project Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 06c121f5-f245-4dc9-916d-33dfabfb4111 could not be found. Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': '06c121f5-f245-4dc9-916d-33dfabfb4111'} Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c121f5-f245-4dc9-916d-33dfabfb4111 could not be found. Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:32.533209 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c121f5-f245-4dc9-916d-33dfabfb4111 could not be found. Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c121f5-f245-4dc9-916d-33dfabfb4111 could not be found. Oct 01 21:04:32.538601 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:32.547346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-774acd95-a37b-4edd-93a4-265d21499950 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Returning 404 to user: Instance 06c121f5-f245-4dc9-916d-33dfabfb4111 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:32.551084 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-774acd95-a37b-4edd-93a4-265d21499950 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/06c121f5-f245-4dc9-916d-33dfabfb4111/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.035967 Oct 01 21:04:32.558680 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2000/3270] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Oct 1 21:04:32 2022] GET /compute/v2.1/servers/06c121f5-f245-4dc9-916d-33dfabfb4111/os-instance-actions => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:32.569427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:32.571180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:32.593452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:32.596550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:32.597408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:32.599536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:32.601009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:32.602789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:32.684700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:04:32.889251 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a8726dcf-b3f6-4111-92b8-c42ebd79015f tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 204 len: 0 microversion: 2.1 time: 0.325891 Oct 01 21:04:32.890424 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2001/3271] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:32 2022] DELETE /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:32.906405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:32.909271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:32.928794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:32.929341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:32.931534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:32.934265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:32.934980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:32.948442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:33.289512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:33.300571 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26e191b3-bece-4033-a7f0-c5b85343bcae tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1522 microversion: 2.1 time: 0.408611 Oct 01 21:04:33.314981 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2002/3272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:32 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:33.324310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:33.326193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:33.334813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:33.335524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:33.335966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:33.336863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:33.337495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:33.338102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:33.570459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:33.581115 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-648f1b5b-35c9-48e5-bcc0-b96e7cbacec7 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1528 microversion: 2.1 time: 0.264465 Oct 01 21:04:33.583882 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2003/3273] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:33 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1528 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:33.886907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-abb807b1-61cd-490b-b875-52eaae9fb491 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Action: 'create', calling method: .version_select at 0x7f4172876ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-561882731"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:34.524969 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-abb807b1-61cd-490b-b875-52eaae9fb491 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.939250 Oct 01 21:04:34.526218 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2004/3274] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Oct 1 21:04:33 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 942 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 01 21:04:34.531537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:34.532133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:34.552767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:34.556259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:34.557199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:34.558682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:34.560685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:34.561347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:34.627309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:04:34.812373 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4eb1d3d-ed11-430f-a586-98c484eac564 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 204 len: 0 microversion: 2.1 time: 0.284259 Oct 01 21:04:34.817509 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2005/3275] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:04:34 2022] DELETE /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:04:34.836996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:34.839472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:34.865488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:34.866551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:34.870298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:34.888165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:34.888853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:34.889815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:35.018820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:35.037850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:35.039356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:35.041142 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6da90019-f299-440c-8e4b-4ce34bdb7675 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.222143 Oct 01 21:04:35.041735 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2006/3276] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:34 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:35.047907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0460b3f1-cf13-4993-98fd-82e5e90b1d85 req-a93e51b7-0ba0-4cfe-92ad-8640d9e94e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a4b134-fb30-4b7e-b206-6b5c6cd08334", "name": "network-vif-plugged", "status": "completed", "tag": "1d2f202e-1001-4a1c-8564-b41ca6b8aff6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:35.068915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0460b3f1-cf13-4993-98fd-82e5e90b1d85 req-a93e51b7-0ba0-4cfe-92ad-8640d9e94e54 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:35.069682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0460b3f1-cf13-4993-98fd-82e5e90b1d85 req-a93e51b7-0ba0-4cfe-92ad-8640d9e94e54 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:35.070434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0460b3f1-cf13-4993-98fd-82e5e90b1d85 req-a93e51b7-0ba0-4cfe-92ad-8640d9e94e54 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:35.089487 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0460b3f1-cf13-4993-98fd-82e5e90b1d85 req-a93e51b7-0ba0-4cfe-92ad-8640d9e94e54 service nova] Creating event network-vif-plugged:1d2f202e-1001-4a1c-8564-b41ca6b8aff6 for instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 on nch1-master-1 Oct 01 21:04:35.096833 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0460b3f1-cf13-4993-98fd-82e5e90b1d85 req-a93e51b7-0ba0-4cfe-92ad-8640d9e94e54 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051939 Oct 01 21:04:35.102140 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2007/3277] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:35.113388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e80f56f-8efa-4ae4-bd37-85a40cbc757b tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f417283e3a0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:35.198126 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e80f56f-8efa-4ae4-bd37-85a40cbc757b tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1" status: 200 len: 338 microversion: 2.1 time: 0.093046 Oct 01 21:04:35.198745 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2008/3278] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:04:35 2022] GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1 => generated 338 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:35.213774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:35.215973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:35.221131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:35.230771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:35.231394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:35.232642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:35.234917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:35.236980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:35.237894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:35.463860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad36d5e04a7453aba1e6d0b15d2d06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99422a6e3b744bff964052dfddb678ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:35.467758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:35.481278 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cfa25247-73e0-4cc6-b3f4-77a134c17c4d tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 200 len: 1486 microversion: 2.1 time: 0.277368 Oct 01 21:04:35.482137 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2009/3279] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:35 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 1486 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:35.492124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:35.492448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:35.508416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:35.509048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:35.509357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:35.510083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:35.514674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:35.515404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:35.992943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:36.006965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a892bc59-0f5d-473a-b8ed-102ee36e1e20 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1528 microversion: 2.1 time: 0.522481 Oct 01 21:04:36.010365 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2010/3280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:35 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1528 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:36.019042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19a08881-6ac7-4847-980a-ab2e5be5acbd tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Action: 'create', calling method: .version_select at 0x7f417281aee0>, body: {"snapshot": {"volume_id": "3155b986-3afe-4c50-83df-264e88b679e1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1567614186"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:36.405408 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19a08881-6ac7-4847-980a-ab2e5be5acbd tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.392755 Oct 01 21:04:36.416914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2011/3281] 10.222.0.17 () {60 vars in 1162 bytes} [Sat Oct 1 21:04:36 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:36.425065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-23262099-bd24-4c84-a62e-82180a3bc67b req-4056f250-c32f-4e48-b5e2-4cb7c25254c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac62988-8fc6-4a29-a356-e193c6955625", "name": "network-vif-deleted", "tag": "04bcf193-a8da-49db-930c-7a157d5ecd2e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:36.488169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-23262099-bd24-4c84-a62e-82180a3bc67b req-4056f250-c32f-4e48-b5e2-4cb7c25254c7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:36.492402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-23262099-bd24-4c84-a62e-82180a3bc67b req-4056f250-c32f-4e48-b5e2-4cb7c25254c7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:36.493157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-23262099-bd24-4c84-a62e-82180a3bc67b req-4056f250-c32f-4e48-b5e2-4cb7c25254c7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:36.513777 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-23262099-bd24-4c84-a62e-82180a3bc67b req-4056f250-c32f-4e48-b5e2-4cb7c25254c7 service nova] Creating event network-vif-deleted:04bcf193-a8da-49db-930c-7a157d5ecd2e for instance 2ac62988-8fc6-4a29-a356-e193c6955625 on nch2-master-1 Oct 01 21:04:36.531516 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-23262099-bd24-4c84-a62e-82180a3bc67b req-4056f250-c32f-4e48-b5e2-4cb7c25254c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117593 Oct 01 21:04:36.537041 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2012/3282] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:36.556129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:36.557660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:36.577663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:36.579585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:36.580106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:36.581429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:36.582172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:36.583319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:36.665004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:36.674742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:36.675816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:36.677500 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f31820d3-bbb5-47f5-9129-dc7539d8ac1b tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1365 microversion: 2.57 time: 0.139109 Oct 01 21:04:36.677999 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2013/3283] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:36 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1365 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:36.695624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5e695bd1-f31d-4e3b-9846-ef473e6354c4 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f4172745790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:36.756293 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5e695bd1-f31d-4e3b-9846-ef473e6354c4 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6" status: 200 len: 287 microversion: 2.1 time: 0.077028 Oct 01 21:04:36.763630 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2014/3284] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 21:04:36 2022] GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:36.764827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:36.765568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] [instance: 2ac62988-8fc6-4a29-a356-e193c6955625] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:36.773088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:36.773911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:36.774432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:36.775364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:36.775915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:36.776506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:36.793627 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] HTTP exception thrown: Instance 2ac62988-8fc6-4a29-a356-e193c6955625 could not be found. Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Request method failure captured: Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 HTTP/1.1 Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKtM_e347B5k3cCLtXFb29UmWijajtWHo0Uyf9EpYGwWbUsqJY66PtONJEu549qh90vVNoDAc-LxviaRILB20KsthyL4rluuLzd7eYkikDPFUGfcZc9wLi7N0b5qj-6PSyyZlQQ_X-ndsYPfazs46LO2GPscRSqh_grmooQX9I9zhrI Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99422a6e3b744bff964052dfddb678ef Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1984472967 Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99422a6e3b744bff964052dfddb678ef", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99422a6e3b744bff964052dfddb678ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99422a6e3b744bff964052dfddb678ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99422a6e3b744bff964052dfddb678ef"}]}] Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1984472967 Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99422a6e3b744bff964052dfddb678ef Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1984472967 Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-InstanceActionsNegativeTestJSON-1984472967-project Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aad36d5e04a7453aba1e6d0b15d2d06f Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1984472967-project Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 2ac62988-8fc6-4a29-a356-e193c6955625 could not be found. Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2ac62988-8fc6-4a29-a356-e193c6955625'} Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ac62988-8fc6-4a29-a356-e193c6955625 could not be found. Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ac62988-8fc6-4a29-a356-e193c6955625 could not be found. Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:36.795344 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ac62988-8fc6-4a29-a356-e193c6955625 could not be found. Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] Returning 404 to user: Instance 2ac62988-8fc6-4a29-a356-e193c6955625 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3bdd5a58-9362-46b0-ba3b-6e0cdac72e05 tempest-InstanceActionsNegativeTestJSON-1984472967 tempest-InstanceActionsNegativeTestJSON-1984472967-project] 10.222.0.17 "GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625" status: 404 len: 111 microversion: 2.1 time: 0.037295 Oct 01 21:04:36.799967 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2015/3285] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:36 2022] GET /compute/v2.1/servers/2ac62988-8fc6-4a29-a356-e193c6955625 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:36.802382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-db469634-0241-44cb-974e-55f10df50265 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f41728760d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:36.850884 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-db469634-0241-44cb-974e-55f10df50265 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.052227 Oct 01 21:04:36.852030 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2016/3286] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Oct 1 21:04:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:36.864214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-04e229e8-0d30-4641-a8b5-baa9e977f86a tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f41726d4c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:36.903696 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-04e229e8-0d30-4641-a8b5-baa9e977f86a tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6" status: 200 len: 287 microversion: 2.1 time: 0.043938 Oct 01 21:04:36.910728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2017/3287] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 21:04:36 2022] GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:37.041264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:37.041976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:37.056494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:37.059785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:37.062755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:37.065687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:37.066359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:37.070520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:37.670851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:37.689772 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4544ac7d-8ac4-44dd-9362-006d57c2f8aa tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1528 microversion: 2.1 time: 0.656891 Oct 01 21:04:37.691441 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2018/3288] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:37 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1528 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:37.706585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-22103731-2a0d-4e94-be2b-f1efcdffa8d5 req-f1f89ad0-18dd-4eb5-93af-7f9fb08e3bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a4b134-fb30-4b7e-b206-6b5c6cd08334", "name": "network-vif-unplugged", "status": "completed", "tag": "1d2f202e-1001-4a1c-8564-b41ca6b8aff6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:37.723741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-22103731-2a0d-4e94-be2b-f1efcdffa8d5 req-f1f89ad0-18dd-4eb5-93af-7f9fb08e3bcf service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:37.724470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-22103731-2a0d-4e94-be2b-f1efcdffa8d5 req-f1f89ad0-18dd-4eb5-93af-7f9fb08e3bcf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:37.725159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-22103731-2a0d-4e94-be2b-f1efcdffa8d5 req-f1f89ad0-18dd-4eb5-93af-7f9fb08e3bcf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:37.746026 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-22103731-2a0d-4e94-be2b-f1efcdffa8d5 req-f1f89ad0-18dd-4eb5-93af-7f9fb08e3bcf service nova] Creating event network-vif-unplugged:1d2f202e-1001-4a1c-8564-b41ca6b8aff6 for instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 on nch1-master-1 Oct 01 21:04:37.753093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-22103731-2a0d-4e94-be2b-f1efcdffa8d5 req-f1f89ad0-18dd-4eb5-93af-7f9fb08e3bcf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060262 Oct 01 21:04:37.754261 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2019/3289] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:37.761787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:37.762807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:37.770074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:37.770989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:37.771670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:37.772660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:37.773374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:37.774066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:38.239173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:38.249436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:38.251769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:38.254728 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1ebe7dcf-0440-4410-9ca1-41f9608cfa43 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1371 microversion: 2.57 time: 0.499037 Oct 01 21:04:38.255654 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2020/3290] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:37 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:38.279729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d726d9d-3132-42a2-ad92-1e0ef26376fc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1067c786-686b-41aa-b9ca-31ea24d10308"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:38.282916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d726d9d-3132-42a2-ad92-1e0ef26376fc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:38.302904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d726d9d-3132-42a2-ad92-1e0ef26376fc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:38.303519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d726d9d-3132-42a2-ad92-1e0ef26376fc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:38.304082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d726d9d-3132-42a2-ad92-1e0ef26376fc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:38.305628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d726d9d-3132-42a2-ad92-1e0ef26376fc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:38.306105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d726d9d-3132-42a2-ad92-1e0ef26376fc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:38.306562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d726d9d-3132-42a2-ad92-1e0ef26376fc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:38.840097 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d726d9d-3132-42a2-ad92-1e0ef26376fc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563857 Oct 01 21:04:38.846675 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2021/3291] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:04:38 2022] POST /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:38.893332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1836e610-6e28-4186-8a10-77b79e7bdd41 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f417282af70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:38.974755 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1836e610-6e28-4186-8a10-77b79e7bdd41 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6" status: 200 len: 288 microversion: 2.1 time: 0.130949 Oct 01 21:04:38.982557 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2022/3292] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 21:04:38 2022] GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6 => generated 288 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:38.988072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:38.989216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:38.998664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:39.011330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:39.012265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:39.013469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:39.013964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:39.014410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:39.257339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:39.270391 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c0a9bd2-412d-4f4e-add5-d0f508b7e3d5 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1486 microversion: 2.1 time: 0.286312 Oct 01 21:04:39.278953 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2023/3293] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:38 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1486 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:39.297024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85528416-4170-4ff9-8e75-7f6a7f6251a0 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f417282a550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:39.413377 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85528416-4170-4ff9-8e75-7f6a7f6251a0 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6" status: 202 len: 0 microversion: 2.1 time: 0.132638 Oct 01 21:04:39.415123 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2024/3294] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Oct 1 21:04:39 2022] DELETE /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:04:39.426947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5f7ea5ba-8c4d-44d1-9cc5-563559777f58 req-c07b9bc2-d42f-4fed-993e-fba441056b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a4b134-fb30-4b7e-b206-6b5c6cd08334", "name": "network-vif-deleted", "tag": "1d2f202e-1001-4a1c-8564-b41ca6b8aff6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:39.470153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5f7ea5ba-8c4d-44d1-9cc5-563559777f58 req-c07b9bc2-d42f-4fed-993e-fba441056b0a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:39.473107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5f7ea5ba-8c4d-44d1-9cc5-563559777f58 req-c07b9bc2-d42f-4fed-993e-fba441056b0a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:39.474076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5f7ea5ba-8c4d-44d1-9cc5-563559777f58 req-c07b9bc2-d42f-4fed-993e-fba441056b0a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:39.504720 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5f7ea5ba-8c4d-44d1-9cc5-563559777f58 req-c07b9bc2-d42f-4fed-993e-fba441056b0a service nova] Creating event network-vif-deleted:1d2f202e-1001-4a1c-8564-b41ca6b8aff6 for instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 on nch1-master-1 Oct 01 21:04:39.525626 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5f7ea5ba-8c4d-44d1-9cc5-563559777f58 req-c07b9bc2-d42f-4fed-993e-fba441056b0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098491 Oct 01 21:04:39.530911 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2025/3295] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:39.541378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:39.542690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:39.552884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:39.566693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:39.567117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:39.567920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:39.569648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:39.570841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:39.784194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:39.800746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:39.806857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:39.808210 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bcef007e-457f-4ccd-a04b-114d5c356838 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1371 microversion: 2.57 time: 0.274518 Oct 01 21:04:39.835077 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2026/3296] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:39 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:39.856209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-922a2dad-cecb-4a86-b98e-15ac769412f5 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f4172845160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:40.217919 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-922a2dad-cecb-4a86-b98e-15ac769412f5 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6" status: 200 len: 287 microversion: 2.1 time: 0.381483 Oct 01 21:04:40.219030 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2027/3297] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 21:04:39 2022] GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6 => generated 287 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:40.307449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:40.309210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:40.325843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:40.329860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:40.330794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:40.338321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:40.339128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:40.342921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:40.476876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:40.478589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:40.481833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:40.484041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lazy-loading 'fault' on Instance uuid 35a4b134-fb30-4b7e-b206-6b5c6cd08334 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:04:40.779716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:40.799120 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-56f19b5b-003e-4593-9de7-553d8aa3ea99 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 200 len: 1315 microversion: 2.1 time: 0.496664 Oct 01 21:04:40.801770 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2028/3298] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:40 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:40.841261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:40.841907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:40.858341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:40.861339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:40.863290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:40.865465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:40.866017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:40.867042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:41.117245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:41.134352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:41.143197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:41.144653 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2663d3b9-6b8e-4d51-810b-dda1a8858540 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1356 microversion: 2.57 time: 0.309110 Oct 01 21:04:41.145668 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2029/3299] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:40 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1356 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:04:41.195424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:41.196075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:41.212125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:41.212819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:41.217622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:41.222452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:41.226313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:41.227295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:41.275023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:04:41.442412 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0aced598-97d9-4ae7-8550-59e885ab08fd tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 204 len: 0 microversion: 2.57 time: 0.262789 Oct 01 21:04:41.444600 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2030/3300] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:04:41 2022] DELETE /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:04:41.462317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20f44544-0cf3-4c06-8f8c-e7cd28af9673 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f41728a5040>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:41.589498 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-20f44544-0cf3-4c06-8f8c-e7cd28af9673 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] HTTP exception thrown: Snapshot 5111d210-c9bc-4c91-8596-75901bb29ae6 could not be found. Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20f44544-0cf3-4c06-8f8c-e7cd28af9673 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Request method failure captured: Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6 HTTP/1.1 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKthp5pbK6EYgSHW-KQNBgeqEN2SNlefwXd7BmQr5kyYhVNt3relaswEoMSWM7Ll6h7eiCX8RSwOPuG8zru_TvekAHL6mzrtljkPBZCtZpsCV_sM35glIc0Q4JWfBtT9sgaL3B7JeSHeNBtMNSsLrxcmMOcJlMwvRioLM1NyfvmeGOk Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e8be683460bb4157824a7f999d0dd106 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e8be683460bb4157824a7f999d0dd106", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8be683460bb4157824a7f999d0dd106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e8be683460bb4157824a7f999d0dd106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8be683460bb4157824a7f999d0dd106"}]}] Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e8be683460bb4157824a7f999d0dd106 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesSnapshotsTestJSON-740423316-project Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 644bb91fc7d14468a59c399eb3df8473 Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740423316-project Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: exception: Snapshot 5111d210-c9bc-4c91-8596-75901bb29ae6 could not be found. Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5111d210-c9bc-4c91-8596-75901bb29ae6'} Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5111d210-c9bc-4c91-8596-75901bb29ae6 could not be found. (HTTP 404) (Request-ID: req-70159a3d-9a96-4d1e-ab5e-a19cbd3c72aa) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:04:41.597617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5111d210-c9bc-4c91-8596-75901bb29ae6 could not be found. Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5111d210-c9bc-4c91-8596-75901bb29ae6 could not be found. Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5111d210-c9bc-4c91-8596-75901bb29ae6 could not be found. Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20f44544-0cf3-4c06-8f8c-e7cd28af9673 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Returning 404 to user: Snapshot 5111d210-c9bc-4c91-8596-75901bb29ae6 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20f44544-0cf3-4c06-8f8c-e7cd28af9673 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6" status: 404 len: 111 microversion: 2.1 time: 0.152682 Oct 01 21:04:41.603750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2031/3301] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 21:04:41 2022] GET /compute/v2.1/os-snapshots/5111d210-c9bc-4c91-8596-75901bb29ae6 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:41.609427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:41.613687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:41.629581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:41.630128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:41.630626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:41.637500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:41.638751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:41.639248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:41.806631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:41.828061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:41.829747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6736b832e7034ce3b431b79af50095aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf310503fa74abf83949a914e728693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:41.835867 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5a3b539b-8759-4e1e-87b9-18efeb05f647 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 200 len: 1362 microversion: 2.57 time: 0.234222 Oct 01 21:04:41.836680 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2032/3302] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:41 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:04:41.871030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d165861-3550-4d0e-bbd5-f562e7e14cf4 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f4172845e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:42.049336 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d165861-3550-4d0e-bbd5-f562e7e14cf4 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1" status: 202 len: 0 microversion: 2.1 time: 0.182960 Oct 01 21:04:42.049942 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2033/3303] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:04:41 2022] DELETE /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:04:42.072530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:42.075973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:42.086171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:42.086717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:42.090778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:42.092307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:42.092805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:42.097935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:42.134884 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 HTTP/1.1 Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '35a4b134-fb30-4b7e-b206-6b5c6cd08334'} Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:42.136618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-954db0fc-e50d-4709-a0c7-80fda616b591 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 404 len: 111 microversion: 2.1 time: 0.084907 Oct 01 21:04:42.141909 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2034/3304] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:42 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:42.146531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-762c65dd-cb63-4ddd-9d2b-0110a9a8286d tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f417298ab80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:42.280566 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-762c65dd-cb63-4ddd-9d2b-0110a9a8286d tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1" status: 200 len: 337 microversion: 2.1 time: 0.140872 Oct 01 21:04:42.287474 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2035/3305] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:04:42 2022] GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1 => generated 337 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:42.443450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-708077087", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:42.629056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] validate_networks() for [('12dd7e60-a7cd-466f-a786-9ebf24caa716', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:04:44.776780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:04:44.777401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:04:44.777945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:04:44.778767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:04:44.779223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:04:44.790087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:44.791642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:44.792101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:44.792886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:44.793405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:44.793837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:44.833367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Getting quotas for project 99e8daf9de4d4fa395b7eee86d33a5f5. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:04:44.847651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Getting quotas for user aa4fbb28c9de4089870d91cf52dac8ea and project 99e8daf9de4d4fa395b7eee86d33a5f5. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:04:44.863786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:04:44.866465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:04:44.920326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da45f482-1330-40b9-8d17-b86b7e487cd2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.483090 Oct 01 21:04:44.921701 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2036/3306] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:04:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:04:44.927442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:44.931038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:44.938214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:44.939045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:44.939697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:44.940601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:44.941232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:44.941833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:44.966939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:44.972098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lazy-loading 'flavor' on Instance uuid 681e3cb8-3fd1-41d6-8681-ee4f858ca452 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:04:45.359022 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c6796285-bc59-41be-9178-a0237da86aca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/action" status: 200 len: 32 microversion: 2.1 time: 0.434619 Oct 01 21:04:45.380142 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2037/3307] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:04:44 2022] POST /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/action => generated 32 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:04:45.412005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:45.413888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] [instance: cfade094-4b63-47bd-8f02-08e9754478d9] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:45.428858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:45.429514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:45.430284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:45.446654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:45.447483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:45.448094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:45.484810 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] HTTP exception thrown: Instance cfade094-4b63-47bd-8f02-08e9754478d9 could not be found. Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Request method failure captured: Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 HTTP/1.1 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKs9l1l5orFrdU2r0tJFl3iguE5EL3V8t6d3H2tTZj_XZY1SApz9GNU706UT5m7H9_laBBAqmF5yr1f2zIIAYQX5gXs7CbbbasYaIwZcKcCCYkLaU0RDDBf-Jao0J6ECMph4DSEbOHzx9zM8_6iT8A8K5IWwJU2p298Qlno7U5Bpkq4 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.57 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: adf310503fa74abf83949a914e728693 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerShowV257Test-185829102 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adf310503fa74abf83949a914e728693", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adf310503fa74abf83949a914e728693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adf310503fa74abf83949a914e728693"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adf310503fa74abf83949a914e728693"}]}] Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerShowV257Test-185829102 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: adf310503fa74abf83949a914e728693 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerShowV257Test-185829102 Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerShowV257Test-185829102-project Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6736b832e7034ce3b431b79af50095aa Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerShowV257Test-185829102-project Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance cfade094-4b63-47bd-8f02-08e9754478d9 could not be found. Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'cfade094-4b63-47bd-8f02-08e9754478d9'} Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfade094-4b63-47bd-8f02-08e9754478d9 could not be found. Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfade094-4b63-47bd-8f02-08e9754478d9 could not be found. Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:45.488757 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.494663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:45.494663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:45.494663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:45.494663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:45.494663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:45.494663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfade094-4b63-47bd-8f02-08e9754478d9 could not be found. Oct 01 21:04:45.494663 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.497084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] Returning 404 to user: Instance cfade094-4b63-47bd-8f02-08e9754478d9 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:45.498158 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5780b35f-2677-4aee-b949-956d5ea16e64 tempest-ServerShowV257Test-185829102 tempest-ServerShowV257Test-185829102-project] 10.222.0.17 "GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9" status: 404 len: 111 microversion: 2.57 time: 0.115789 Oct 01 21:04:45.501566 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2038/3308] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:04:45 2022] GET /compute/v2.1/servers/cfade094-4b63-47bd-8f02-08e9754478d9 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:04:45.514229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8378aad7-402d-4927-ba8f-e205e71ed6b1 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f417284e8b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:45.587071 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-8378aad7-402d-4927-ba8f-e205e71ed6b1 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] HTTP exception thrown: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8378aad7-402d-4927-ba8f-e205e71ed6b1 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Request method failure captured: Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1 HTTP/1.1 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKthp5pbK6EYgSHW-KQNBgeqEN2SNlefwXd7BmQr5kyYhVNt3relaswEoMSWM7Ll6h7eiCX8RSwOPuG8zru_TvekAHL6mzrtljkPBZCtZpsCV_sM35glIc0Q4JWfBtT9sgaL3B7JeSHeNBtMNSsLrxcmMOcJlMwvRioLM1NyfvmeGOk Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e8be683460bb4157824a7f999d0dd106 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e8be683460bb4157824a7f999d0dd106", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8be683460bb4157824a7f999d0dd106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e8be683460bb4157824a7f999d0dd106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8be683460bb4157824a7f999d0dd106"}]}] Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e8be683460bb4157824a7f999d0dd106 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesSnapshotsTestJSON-740423316-project Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 644bb91fc7d14468a59c399eb3df8473 Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740423316-project Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: exception: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '3155b986-3afe-4c50-83df-264e88b679e1'} Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. (HTTP 404) (Request-ID: req-37014d32-e2ab-4a16-95a5-f2c40ff58704) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:04:45.589829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:45.594631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:45.599979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8378aad7-402d-4927-ba8f-e205e71ed6b1 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Returning 404 to user: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:45.601231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8378aad7-402d-4927-ba8f-e205e71ed6b1 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1" status: 404 len: 109 microversion: 2.1 time: 0.098535 Oct 01 21:04:45.602813 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2039/3309] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:04:45 2022] GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:45.614447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c4daedb-89c8-4a9d-9760-ed0d8ea4ac71 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:45.618234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c4daedb-89c8-4a9d-9760-ed0d8ea4ac71 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:45.741462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2c4daedb-89c8-4a9d-9760-ed0d8ea4ac71 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:45.765742 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c4daedb-89c8-4a9d-9760-ed0d8ea4ac71 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1224 microversion: 2.1 time: 0.161544 Oct 01 21:04:45.774654 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2040/3310] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:45 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1224 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:45.782463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:45.796794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:45.805296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:45.806088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:45.815220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:45.816362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:45.817148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:45.817854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:46.566044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:46.579445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a12f677-4a17-40a6-bfa7-7682ccac7af0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 0.803336 Oct 01 21:04:46.582220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2041/3311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:45 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:46.593352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e023f09-9caf-42ee-a7b4-f0aa4bbea7c7 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f417284e8b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:46.674154 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1e023f09-9caf-42ee-a7b4-f0aa4bbea7c7 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] HTTP exception thrown: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e023f09-9caf-42ee-a7b4-f0aa4bbea7c7 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Request method failure captured: Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1 HTTP/1.1 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKthp5pbK6EYgSHW-KQNBgeqEN2SNlefwXd7BmQr5kyYhVNt3relaswEoMSWM7Ll6h7eiCX8RSwOPuG8zru_TvekAHL6mzrtljkPBZCtZpsCV_sM35glIc0Q4JWfBtT9sgaL3B7JeSHeNBtMNSsLrxcmMOcJlMwvRioLM1NyfvmeGOk Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e8be683460bb4157824a7f999d0dd106 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e8be683460bb4157824a7f999d0dd106", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8be683460bb4157824a7f999d0dd106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e8be683460bb4157824a7f999d0dd106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8be683460bb4157824a7f999d0dd106"}]}] Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e8be683460bb4157824a7f999d0dd106 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesSnapshotsTestJSON-740423316-project Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 644bb91fc7d14468a59c399eb3df8473 Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740423316-project Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: exception: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '3155b986-3afe-4c50-83df-264e88b679e1'} Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. (HTTP 404) (Request-ID: req-72a2a33d-8f2d-44ac-8078-a3a78bf3d006) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:04:46.676234 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e023f09-9caf-42ee-a7b4-f0aa4bbea7c7 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Returning 404 to user: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e023f09-9caf-42ee-a7b4-f0aa4bbea7c7 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1" status: 404 len: 109 microversion: 2.1 time: 0.094079 Oct 01 21:04:46.681152 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2042/3312] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:04:46 2022] DELETE /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:46.691493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a25c383-89d0-46df-a644-e627f32c2e44 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Calling method '.version_select at 0x7f417282a280>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:46.752472 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3a25c383-89d0-46df-a644-e627f32c2e44 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] HTTP exception thrown: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a25c383-89d0-46df-a644-e627f32c2e44 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Request method failure captured: Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1 HTTP/1.1 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKthp5pbK6EYgSHW-KQNBgeqEN2SNlefwXd7BmQr5kyYhVNt3relaswEoMSWM7Ll6h7eiCX8RSwOPuG8zru_TvekAHL6mzrtljkPBZCtZpsCV_sM35glIc0Q4JWfBtT9sgaL3B7JeSHeNBtMNSsLrxcmMOcJlMwvRioLM1NyfvmeGOk Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e8be683460bb4157824a7f999d0dd106 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e8be683460bb4157824a7f999d0dd106", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8be683460bb4157824a7f999d0dd106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e8be683460bb4157824a7f999d0dd106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8be683460bb4157824a7f999d0dd106"}]}] Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e8be683460bb4157824a7f999d0dd106 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740423316 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesSnapshotsTestJSON-740423316-project Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 644bb91fc7d14468a59c399eb3df8473 Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740423316-project Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: exception: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '3155b986-3afe-4c50-83df-264e88b679e1'} Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. (HTTP 404) (Request-ID: req-cc58be7a-73d8-4542-a4a0-ba4914e773a4) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:04:46.754474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a25c383-89d0-46df-a644-e627f32c2e44 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] Returning 404 to user: Volume 3155b986-3afe-4c50-83df-264e88b679e1 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a25c383-89d0-46df-a644-e627f32c2e44 tempest-VolumesSnapshotsTestJSON-740423316 tempest-VolumesSnapshotsTestJSON-740423316-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1" status: 404 len: 109 microversion: 2.1 time: 0.073095 Oct 01 21:04:46.762179 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2043/3313] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:04:46 2022] GET /compute/v2.1/os-volumes/3155b986-3afe-4c50-83df-264e88b679e1 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:04:46.796574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:46.797228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:46.829593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:46.830091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:46.837296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:46.840784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:46.848611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:46.850281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:47.163292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:47.176119 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-59c422dc-c9ed-4f59-80c5-26735bba6e89 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1276 microversion: 2.1 time: 0.383388 Oct 01 21:04:47.179684 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2044/3314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:46 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:04:47.605614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:47.606311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:47.615070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:47.626942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:47.627653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:47.628577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:47.629224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:47.629843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:48.296992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:48.321492 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-81bb94d6-77a4-4f10-ac68-3cdf67b47302 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 0.718245 Oct 01 21:04:48.322451 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2045/3315] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:47 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:04:48.336751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:48.339168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:48.354892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:48.359642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:48.361333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:48.363755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:48.366449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:48.367339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:48.587130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:48.599444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-51879150-7e35-4d7f-b8a1-c4ed0f2f7769 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1282 microversion: 2.1 time: 0.275207 Oct 01 21:04:48.618054 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2046/3316] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:48 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:49.348655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:49.349927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:49.363309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:49.365015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:49.365777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:49.371047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:49.371776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:49.372399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:49.701914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:49.710755 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e02a747e-a8ad-4ba0-85e7-58773e754a60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 0.367040 Oct 01 21:04:49.716736 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2047/3317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:49 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:49.722311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:49.723083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:49.746162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:49.747024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:49.747656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:49.748558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:49.749195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:49.749844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:49.957374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:49.967707 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-072e08c4-5179-4768-bc49-392499270320 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1282 microversion: 2.1 time: 0.247487 Oct 01 21:04:49.968355 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2048/3318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:49 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1282 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:50.742331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:50.753758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:50.766377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:50.767265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:50.767992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:50.768944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:50.771775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:50.775305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:51.166574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:51.198450 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c6cc7c1-e893-42b7-83ba-9a602b150e60 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 0.464294 Oct 01 21:04:51.215007 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2049/3319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:50 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:04:51.482874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe2853f8-f387-483c-ba88-642832108f1f tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] Action: 'create', calling method: .version_select at 0x7f417281a700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-684926199", "metadata": {"Type": "work"}}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:52.005219 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe2853f8-f387-483c-ba88-642832108f1f tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.787333 Oct 01 21:04:52.005936 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2050/3320] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Oct 1 21:04:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 789 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 01 21:04:52.010887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:52.011563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:52.028325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:52.030649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:52.031314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:52.035745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:52.036550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:52.037167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:52.373808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:52.385507 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87ee344d-2b77-4e01-947a-77d7e0ab8287 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1324 microversion: 2.1 time: 0.378332 Oct 01 21:04:52.386795 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2051/3321] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:52 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:52.392891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-091e4101-c761-4980-9e09-ce28e2f6d725 req-83438f62-53a2-4c0c-b561-49a2cc88b329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94c0866-3505-4d45-ad56-43726b7b99ff", "tag": "e2646f05-af1f-4e07-8b42-3ed4246a0f1b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:52.406754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-091e4101-c761-4980-9e09-ce28e2f6d725 req-83438f62-53a2-4c0c-b561-49a2cc88b329 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:52.407699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-091e4101-c761-4980-9e09-ce28e2f6d725 req-83438f62-53a2-4c0c-b561-49a2cc88b329 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:52.408306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-091e4101-c761-4980-9e09-ce28e2f6d725 req-83438f62-53a2-4c0c-b561-49a2cc88b329 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:52.421952 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-091e4101-c761-4980-9e09-ce28e2f6d725 req-83438f62-53a2-4c0c-b561-49a2cc88b329 service nova] Creating event network-changed:e2646f05-af1f-4e07-8b42-3ed4246a0f1b for instance a94c0866-3505-4d45-ad56-43726b7b99ff on nch1-master-1 Oct 01 21:04:52.428229 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-091e4101-c761-4980-9e09-ce28e2f6d725 req-83438f62-53a2-4c0c-b561-49a2cc88b329 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039793 Oct 01 21:04:52.429016 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2052/3322] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:52.435209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca2cb7e6-fb4c-4142-8403-07cc466cd663 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] Calling method '.version_select at 0x7f41728f6e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:52.511410 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca2cb7e6-fb4c-4142-8403-07cc466cd663 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94" status: 200 len: 346 microversion: 2.1 time: 0.081329 Oct 01 21:04:52.511997 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2053/3323] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:04:52 2022] GET /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94 => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:52.517287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:52.518441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:52.525707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:52.526359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:52.526946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:52.527775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:52.528495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:52.529009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:52.689547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:52.701619 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-097b1ba1-7a9e-4cec-a627-8000d7f02145 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 0.188167 Oct 01 21:04:52.721433 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2054/3324] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:52 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:52.730784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2593a2c5-04f3-4018-838e-ed5ce82fed49 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] Calling method '.version_select at 0x7f41728f6ee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:52.786002 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2593a2c5-04f3-4018-838e-ed5ce82fed49 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94" status: 200 len: 346 microversion: 2.1 time: 0.062704 Oct 01 21:04:52.786649 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2055/3325] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:04:52 2022] GET /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:52.801709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37796524-c63d-4f8f-99c2-61e1955e61a8 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] Calling method '.version_select at 0x7f41737fdf70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:52.979217 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37796524-c63d-4f8f-99c2-61e1955e61a8 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94" status: 202 len: 0 microversion: 2.1 time: 0.182539 Oct 01 21:04:52.980080 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2056/3326] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:04:52 2022] DELETE /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:04:52.993211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f0b91e7-bdaa-4d86-9474-01eedf619829 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] Calling method '.version_select at 0x7f41727a3c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:53.113003 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f0b91e7-bdaa-4d86-9474-01eedf619829 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94" status: 200 len: 345 microversion: 2.1 time: 0.127491 Oct 01 21:04:53.113601 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2057/3327] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:04:52 2022] GET /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94 => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:04:53.416032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:53.421060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:53.465662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:53.466319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:53.467126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:53.470530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:53.474394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:53.475326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:53.948577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:53.986558 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5948c46a-7fb5-435a-b930-9033674b021d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1324 microversion: 2.1 time: 0.580769 Oct 01 21:04:53.987421 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2058/3328] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:53 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1324 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:04:54.006731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:54.007774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:54.015065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:54.016862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:54.017492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:54.018418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:54.019073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:54.019673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:54.641613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:54.656275 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aa2294ad-8f3f-4c0f-9a35-a78c554edeac tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 0.659757 Oct 01 21:04:54.657475 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2059/3329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:53 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:54.662641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4680035b-d533-4881-a043-22ca43975a62 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] Calling method '.version_select at 0x7f41726d44c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:54.728868 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-4680035b-d533-4881-a043-22ca43975a62 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] HTTP exception thrown: Volume 8679355b-edc3-4fe0-ad65-ecd888d68e94 could not be found. Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4680035b-d533-4881-a043-22ca43975a62 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] Request method failure captured: Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94 HTTP/1.1 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKtyG2zW7JySeuE-xoVPXHsTBsmQlRwhb4ISMkMP3175BVdgF3Khm4oOUh7imZk7ILUHlLAR6kbu_X-eVXubDxgqNqne-_xok8G5VUjK-oEMJtybFGLtiDicb189BPpU2LpPc7krdVMmnAAFo32Esu2o--B0l7kW1sN6iMj1bmXF42M Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 3196d4aa5c2040a2b114b8b21352e4c2 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesGetTestJSON-2063573397 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3196d4aa5c2040a2b114b8b21352e4c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3196d4aa5c2040a2b114b8b21352e4c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3196d4aa5c2040a2b114b8b21352e4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3196d4aa5c2040a2b114b8b21352e4c2"}]}] Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesGetTestJSON-2063573397 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 3196d4aa5c2040a2b114b8b21352e4c2 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesGetTestJSON-2063573397 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesGetTestJSON-2063573397-project Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d042705af4284cca8741304d690ae343 Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesGetTestJSON-2063573397-project Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: exception: Volume 8679355b-edc3-4fe0-ad65-ecd888d68e94 could not be found. Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '8679355b-edc3-4fe0-ad65-ecd888d68e94'} Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8679355b-edc3-4fe0-ad65-ecd888d68e94 could not be found. (HTTP 404) (Request-ID: req-d6d84fa6-baf5-4cb6-824d-d91d08305feb) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:04:54.732606 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8679355b-edc3-4fe0-ad65-ecd888d68e94 could not be found. Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8679355b-edc3-4fe0-ad65-ecd888d68e94 could not be found. Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8679355b-edc3-4fe0-ad65-ecd888d68e94 could not be found. Oct 01 21:04:54.738280 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:54.742976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4680035b-d533-4881-a043-22ca43975a62 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] Returning 404 to user: Volume 8679355b-edc3-4fe0-ad65-ecd888d68e94 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:54.743442 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4680035b-d533-4881-a043-22ca43975a62 tempest-VolumesGetTestJSON-2063573397 tempest-VolumesGetTestJSON-2063573397-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94" status: 404 len: 109 microversion: 2.1 time: 0.084467 Oct 01 21:04:54.744191 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2060/3330] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:04:54 2022] GET /compute/v2.1/os-volumes/8679355b-edc3-4fe0-ad65-ecd888d68e94 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:04:55.008743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:55.013933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:55.014953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:55.054432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:55.055939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:55.057421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:55.067242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:55.068092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:55.068980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:55.763663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:56.291787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:56.308185 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85b79c74-4b29-471e-b6d8-b6afba31cb24 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1324 microversion: 2.1 time: 1.300942 Oct 01 21:04:56.310410 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2061/3331] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:55 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1324 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:04:56.325594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:56.326850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:56.355909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:56.356742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:56.358679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:56.359771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:56.362988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:56.363866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:56.841599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:56.851877 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0542f7a-d015-4055-a330-629e4c54d3d8 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 0.536683 Oct 01 21:04:56.857304 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2062/3332] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:56 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:57.338436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:57.339309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:57.352535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:57.357596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:57.358143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:57.366406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:57.367184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:57.367638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:57.441712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:58.002021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:58.038132 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0c82460c-9fd7-4716-bd24-97d93b172c6c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1324 microversion: 2.1 time: 0.704458 Oct 01 21:04:58.038760 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2063/3333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:57 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1324 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:58.053941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:58.079638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:58.118880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:58.125485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:58.133577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:58.133836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:58.134334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:58.134859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:58.731123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:58.754176 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-289c3fd4-12c9-405f-9b1a-e34bc53f465c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 0.697159 Oct 01 21:04:58.757000 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2064/3334] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:58 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:04:59.064866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:59.065824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:59.083932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:59.084442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:59.093442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:59.097468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:59.098046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:59.106122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:59.550643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:04:59.587235 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad73a753-b710-4e02-b61f-6b8b3982f2be tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1324 microversion: 2.1 time: 0.523808 Oct 01 21:04:59.591266 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2065/3335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:59 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1324 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:04:59.785456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-56421d8b-b106-4727-ad00-1e95673fade8 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Action: 'create', calling method: .version_select at 0x7f41728f6160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1699005513", "metadata": {"Type": "work"}}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-56421d8b-b106-4727-ad00-1e95673fade8 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Request method failure captured: Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 122 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt70ymQ6kieZX0r29LA6Lz1DjUrqOL69XceTPrzfln7yHJjQTVdi2K7MZRkZomBdNexg8EwKKurG-JfgFHlpnqhXC8Wej43d4HxUcUYELR3cjmmJ6XspJzlVQBdbs2oCce9kN5qIgmJddZhppgTtiu90g5P2WYIUomcMTK4qXsuh8M Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a797000ad5944ca096f1bb8db8051537", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}] Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesNegativeTest-996300741 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesNegativeTest-996300741-project Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 334a9101cc534dbc91272b95ab8b70f0 Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesNegativeTest-996300741-project Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1699005513", "metadata": {"Type": "work"}}} Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1699005513', 'metadata': {'Type': 'work'}}}} Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '#$%' Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:04:59.815422 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 01 21:04:59.823598 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:04:59.836045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-56421d8b-b106-4727-ad00-1e95673fade8 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:04:59.841484 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-56421d8b-b106-4727-ad00-1e95673fade8 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.239343 Oct 01 21:04:59.844039 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2066/3336] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Oct 1 21:04:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:04:59.863551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:04:59.864547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:04:59.876585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:04:59.879926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:59.881300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:59.882017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:04:59.883127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:04:59.883937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:04:59.885183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:00.268836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:00.284048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-27a04438-ce9f-42d7-a283-f6afb811d80c tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 0.437119 Oct 01 21:05:00.288732 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2067/3337] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:04:59 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:00.293845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32a19f5f-7b74-4c4c-b9f1-4c0ae3919849 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Action: 'create', calling method: .version_select at 0x7f417282a700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1496506129", "metadata": {"Type": "work"}}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32a19f5f-7b74-4c4c-b9f1-4c0ae3919849 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Request method failure captured: Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 120 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt70ymQ6kieZX0r29LA6Lz1DjUrqOL69XceTPrzfln7yHJjQTVdi2K7MZRkZomBdNexg8EwKKurG-JfgFHlpnqhXC8Wej43d4HxUcUYELR3cjmmJ6XspJzlVQBdbs2oCce9kN5qIgmJddZhppgTtiu90g5P2WYIUomcMTK4qXsuh8M Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a797000ad5944ca096f1bb8db8051537", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}] Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 334a9101cc534dbc91272b95ab8b70f0 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1496506129", "metadata": {"Type": "work"}}} Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1496506129', 'metadata': {'Type': 'work'}}}} Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '0' Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:05:00.307050 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32a19f5f-7b74-4c4c-b9f1-4c0ae3919849 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:00.312440 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-32a19f5f-7b74-4c4c-b9f1-4c0ae3919849 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018599 Oct 01 21:05:00.319888 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2068/3338] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Oct 1 21:05:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:05:00.323328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2efe504a-b026-4208-bd4f-8522d1bfd415 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Action: 'create', calling method: .version_select at 0x7f4172ed04c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1860012568", "metadata": {"Type": "work"}}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2efe504a-b026-4208-bd4f-8522d1bfd415 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Request method failure captured: Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 119 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt70ymQ6kieZX0r29LA6Lz1DjUrqOL69XceTPrzfln7yHJjQTVdi2K7MZRkZomBdNexg8EwKKurG-JfgFHlpnqhXC8Wej43d4HxUcUYELR3cjmmJ6XspJzlVQBdbs2oCce9kN5qIgmJddZhppgTtiu90g5P2WYIUomcMTK4qXsuh8M Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a797000ad5944ca096f1bb8db8051537", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}] Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 334a9101cc534dbc91272b95ab8b70f0 Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1860012568", "metadata": {"Type": "work"}}} Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1860012568', 'metadata': {'Type': 'work'}}}} Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '' Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:05:00.370415 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2efe504a-b026-4208-bd4f-8522d1bfd415 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2efe504a-b026-4208-bd4f-8522d1bfd415 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.052971 Oct 01 21:05:00.378024 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2069/3339] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Oct 1 21:05:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 01 21:05:00.393607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5eb64f84-e0f2-4713-85e9-36a2c636c9a0 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Calling method '.version_select at 0x7f41727ecc10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:00.494097 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5eb64f84-e0f2-4713-85e9-36a2c636c9a0 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] HTTP exception thrown: Volume tempest-invalid-91246100 could not be found. Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5eb64f84-e0f2-4713-85e9-36a2c636c9a0 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Request method failure captured: Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-91246100 HTTP/1.1 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt70ymQ6kieZX0r29LA6Lz1DjUrqOL69XceTPrzfln7yHJjQTVdi2K7MZRkZomBdNexg8EwKKurG-JfgFHlpnqhXC8Wej43d4HxUcUYELR3cjmmJ6XspJzlVQBdbs2oCce9kN5qIgmJddZhppgTtiu90g5P2WYIUomcMTK4qXsuh8M Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a797000ad5944ca096f1bb8db8051537", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}] Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 334a9101cc534dbc91272b95ab8b70f0 Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: exception: Volume tempest-invalid-91246100 could not be found. Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'tempest-invalid-91246100'} Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-91246100 could not be found. (HTTP 404) (Request-ID: req-fed3be5c-d2b3-4cf1-9782-7eeee220c6c1) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:05:00.495743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-91246100 could not be found. Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-91246100 could not be found. Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-91246100 could not be found. Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5eb64f84-e0f2-4713-85e9-36a2c636c9a0 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Returning 404 to user: Volume tempest-invalid-91246100 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5eb64f84-e0f2-4713-85e9-36a2c636c9a0 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-91246100" status: 404 len: 97 microversion: 2.1 time: 0.112379 Oct 01 21:05:00.509201 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2070/3340] 10.222.0.17 () {58 vars in 1212 bytes} [Sat Oct 1 21:05:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-91246100 => generated 97 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:05:00.521900 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-450946fb-72b0-44f1-99c3-68ee76c08612 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003910 Oct 01 21:05:00.521900 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2071/3341] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Oct 1 21:05:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 01 21:05:00.525295 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-941c09c4-2b5b-4f02-af3b-061b59c4b330 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006148 Oct 01 21:05:00.532066 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2072/3342] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 21:05:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 01 21:05:00.538294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf075ec9-8348-437f-bbf5-aa551ea5c998 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Calling method '.version_select at 0x7f4172745700>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:00.633590 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-cf075ec9-8348-437f-bbf5-aa551ea5c998 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] HTTP exception thrown: Volume ebd17232-7550-4404-9c4a-89187024c82c could not be found. Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf075ec9-8348-437f-bbf5-aa551ea5c998 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Request method failure captured: Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-volumes/ebd17232-7550-4404-9c4a-89187024c82c HTTP/1.1 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt70ymQ6kieZX0r29LA6Lz1DjUrqOL69XceTPrzfln7yHJjQTVdi2K7MZRkZomBdNexg8EwKKurG-JfgFHlpnqhXC8Wej43d4HxUcUYELR3cjmmJ6XspJzlVQBdbs2oCce9kN5qIgmJddZhppgTtiu90g5P2WYIUomcMTK4qXsuh8M Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a797000ad5944ca096f1bb8db8051537", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}] Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 334a9101cc534dbc91272b95ab8b70f0 Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: exception: Volume ebd17232-7550-4404-9c4a-89187024c82c could not be found. Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'ebd17232-7550-4404-9c4a-89187024c82c'} Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ebd17232-7550-4404-9c4a-89187024c82c could not be found. (HTTP 404) (Request-ID: req-2054fba0-58cb-4291-a477-2563c8621093) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:05:00.635617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ebd17232-7550-4404-9c4a-89187024c82c could not be found. Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ebd17232-7550-4404-9c4a-89187024c82c could not be found. Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ebd17232-7550-4404-9c4a-89187024c82c could not be found. Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:00.641260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf075ec9-8348-437f-bbf5-aa551ea5c998 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Returning 404 to user: Volume ebd17232-7550-4404-9c4a-89187024c82c could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:00.649779 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf075ec9-8348-437f-bbf5-aa551ea5c998 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/ebd17232-7550-4404-9c4a-89187024c82c" status: 404 len: 109 microversion: 2.1 time: 0.115288 Oct 01 21:05:00.656265 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2073/3343] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:05:00 2022] DELETE /compute/v2.1/os-volumes/ebd17232-7550-4404-9c4a-89187024c82c => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:05:00.674781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:00.676045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:00.694211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:00.695710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:00.696349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:00.697657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:00.700142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:00.701405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:01.291045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:01.308423 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-55492cd5-3fec-471e-9955-5666648ab6ba tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1324 microversion: 2.1 time: 0.655125 Oct 01 21:05:01.328052 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2074/3344] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:00 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1324 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:01.350573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da8e9b13-2827-40a0-be56-4df112b120a6 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Calling method '.version_select at 0x7f4172ed00d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:01.453612 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-da8e9b13-2827-40a0-be56-4df112b120a6 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] HTTP exception thrown: Volume 2cb21910-59b2-4c18-8378-817410e7d688 could not be found. Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da8e9b13-2827-40a0-be56-4df112b120a6 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Request method failure captured: Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-volumes/2cb21910-59b2-4c18-8378-817410e7d688 HTTP/1.1 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt70ymQ6kieZX0r29LA6Lz1DjUrqOL69XceTPrzfln7yHJjQTVdi2K7MZRkZomBdNexg8EwKKurG-JfgFHlpnqhXC8Wej43d4HxUcUYELR3cjmmJ6XspJzlVQBdbs2oCce9kN5qIgmJddZhppgTtiu90g5P2WYIUomcMTK4qXsuh8M Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a797000ad5944ca096f1bb8db8051537", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a797000ad5944ca096f1bb8db8051537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a797000ad5944ca096f1bb8db8051537"}]}] Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a797000ad5944ca096f1bb8db8051537 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesNegativeTest-996300741 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 334a9101cc534dbc91272b95ab8b70f0 Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesNegativeTest-996300741-project Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: exception: Volume 2cb21910-59b2-4c18-8378-817410e7d688 could not be found. Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2cb21910-59b2-4c18-8378-817410e7d688'} Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2cb21910-59b2-4c18-8378-817410e7d688 could not be found. (HTTP 404) (Request-ID: req-b14abef9-d5a6-4db4-87d1-a43000495856) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 21:05:01.470086 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2cb21910-59b2-4c18-8378-817410e7d688 could not be found. Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2cb21910-59b2-4c18-8378-817410e7d688 could not be found. Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2cb21910-59b2-4c18-8378-817410e7d688 could not be found. Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da8e9b13-2827-40a0-be56-4df112b120a6 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] Returning 404 to user: Volume 2cb21910-59b2-4c18-8378-817410e7d688 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da8e9b13-2827-40a0-be56-4df112b120a6 tempest-VolumesNegativeTest-996300741 tempest-VolumesNegativeTest-996300741-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2cb21910-59b2-4c18-8378-817410e7d688" status: 404 len: 109 microversion: 2.1 time: 0.127118 Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2075/3345] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:05:01 2022] GET /compute/v2.1/os-volumes/2cb21910-59b2-4c18-8378-817410e7d688 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:01.476786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:01.484221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:01.484221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:01.484221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:01.484221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:01.484221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:01.495108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:02.848361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:02.877869 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c55cf6d-c3cf-47f2-8318-c48ee4193bb6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1735 microversion: 2.1 time: 1.411206 Oct 01 21:05:02.880830 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2076/3346] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:01 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1735 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:02.914930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:02.916014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:02.934109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:02.940195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:02.941418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:02.947214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:02.949170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:02.957551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:03.468843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:03.497194 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b6277968-10bd-4c2d-b251-ddd7ea43045d tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1324 microversion: 2.1 time: 0.613226 Oct 01 21:05:03.498662 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2077/3347] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:02 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:03.532484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b1956e63-9029-4137-be8b-07c921d37d44 req-d48ef912-1cf1-4917-8d21-d22e945a27bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94c0866-3505-4d45-ad56-43726b7b99ff", "name": "network-vif-plugged", "status": "completed", "tag": "e2646f05-af1f-4e07-8b42-3ed4246a0f1b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:03.550387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b1956e63-9029-4137-be8b-07c921d37d44 req-d48ef912-1cf1-4917-8d21-d22e945a27bd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:03.550947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b1956e63-9029-4137-be8b-07c921d37d44 req-d48ef912-1cf1-4917-8d21-d22e945a27bd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:03.551759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b1956e63-9029-4137-be8b-07c921d37d44 req-d48ef912-1cf1-4917-8d21-d22e945a27bd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:03.571263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b1956e63-9029-4137-be8b-07c921d37d44 req-d48ef912-1cf1-4917-8d21-d22e945a27bd service nova] Creating event network-vif-plugged:e2646f05-af1f-4e07-8b42-3ed4246a0f1b for instance a94c0866-3505-4d45-ad56-43726b7b99ff on nch1-master-1 Oct 01 21:05:03.605069 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b1956e63-9029-4137-be8b-07c921d37d44 req-d48ef912-1cf1-4917-8d21-d22e945a27bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102560 Oct 01 21:05:03.624057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2078/3348] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:03.869348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1052516036", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:03.996951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] validate_networks() for [('a5c86243-7722-488d-b90b-df7ddabb6bde', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:05:05.291020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:05:05.292089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:05:05.292783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:05:05.293393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:05:05.295065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:05:05.324142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:05.326757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:05.327286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:05.328125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:05.331331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:05.331786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:05.394078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Getting quotas for project 6c0ad82595344eb4a1122d294faf15b2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:05:05.416501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Getting quotas for user 6d63c633112e49d091421c84cea3422b and project 6c0ad82595344eb4a1122d294faf15b2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:05:05.454322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:05:05.459492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:05:05.615192 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8df095c8-50eb-4936-80e7-50126053900e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.983401 Oct 01 21:05:05.622463 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2079/3349] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:05:05.627537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:05.628161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:05.652431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:05.654910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:05.655593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:05.658547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:05.659617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:05.662762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:06.461037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:06.481731 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ffc8b25c-8df8-4538-b5c9-5c08818391ea tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1715 microversion: 2.1 time: 0.852353 Oct 01 21:05:06.482396 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2080/3350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:05 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1715 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:06.503032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:06.503790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:06.524742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:06.525293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:06.526042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:06.526527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:06.527008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:06.527736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:07.147175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:07.180032 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0cdaf9b0-46ea-411d-8d39-16106ba29cdc tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1521 microversion: 2.1 time: 0.676236 Oct 01 21:05:07.185171 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2081/3351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:06 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1521 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:07.204656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:07.207404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:07.231421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:07.235098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:07.241008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:07.242596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:07.245537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:07.246263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:07.549358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:07.577570 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-276b3fe1-142c-4bc8-a2e1-0639b3ee5179 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1269 microversion: 2.1 time: 0.390411 Oct 01 21:05:07.580165 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2082/3352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:07 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1269 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:08.313816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-705098258", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "04ec5af5-ae0a-4bb5-9bc2-96d5829d2e0e"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:08.426680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] validate_networks() for [('04ec5af5-ae0a-4bb5-9bc2-96d5829d2e0e', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:05:09.146181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:05:09.147268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:05:09.148029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:05:09.148771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:05:09.149592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:05:09.166936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:09.167898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:09.168698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:09.170840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:09.172387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:09.173090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:09.204752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Getting quotas for project 8ea6424dd45e48ad93390e398a6fc926. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:05:09.222175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Getting quotas for user 46c6f0cba68e41eab2d90bac5fba9442 and project 8ea6424dd45e48ad93390e398a6fc926. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:05:09.247663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:05:09.250878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:05:09.371253 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-830b372e-f581-4c35-843f-1580276c86ea tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.788076 Oct 01 21:05:09.380423 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2083/3353] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 21:05:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 21:05:09.402286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:09.415711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:09.427542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:09.429297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:09.430649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:09.432249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:09.433693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:09.434451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:09.623638 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] HTTP exception thrown: Cannot 'detach_volume' instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 while it is in vm_state rescued Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Request method failure captured: Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments/1067c786-686b-41aa-b9ca-31ea24d10308 HTTP/1.1 Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqkgfbc_8hDaJm-zKHvqTb6WWcCcwT0-Bfkvm8f894klqAsv6S6gceYSMqZE_iA9F1ar8j4XUgVkIuKhn9h8Rgo_aMUHe71Q6i1rgQeqhiP7Q24mua9fZcb3yfEC6hkQVWHSn1eqeodqqIny5w_VbZ67CSAF_63x-EWWDMDYONExeM Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10fefee3d6a6430682316cd94b859f1e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}] Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6bda28994cb14f92b014a147a7e74476 Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'detach_volume' instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 while it is in vm_state rescued Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': '681e3cb8-3fd1-41d6-8681-ee4f858ca452', 'id': '1067c786-686b-41aa-b9ca-31ea24d10308'} Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 while it is in vm_state rescued Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:09.626446 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:09.631163 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:09.631163 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:09.631163 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:09.631163 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:09.631163 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 while it is in vm_state rescued Oct 01 21:05:09.631163 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:09.631163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Returning 409 to user: Cannot 'detach_volume' instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 while it is in vm_state rescued {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:09.633672 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d01cb853-923d-4920-a8a3-1843d8902fc6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments/1067c786-686b-41aa-b9ca-31ea24d10308" status: 409 len: 152 microversion: 2.1 time: 0.251266 Oct 01 21:05:09.634278 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2084/3354] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:05:09 2022] DELETE /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments/1067c786-686b-41aa-b9ca-31ea24d10308 => generated 152 bytes in 253 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:05:09.642154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:09.642700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:09.653471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:09.654146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:09.654654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:09.655481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:09.656095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:09.675842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:09.736853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:05:09.927636 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c476651-e250-45b0-ab9f-d81f1a14323a tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 204 len: 0 microversion: 2.1 time: 0.290614 Oct 01 21:05:09.932191 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2085/3355] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:05:09 2022] DELETE /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:05:09.939329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:09.949101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:09.962161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:09.964940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:09.965584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:09.972978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:09.973825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:09.974563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:10.063164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:10.075297 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bca7b184-5fa0-448c-b70f-2b455250f58f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1275 microversion: 2.1 time: 0.141346 Oct 01 21:05:10.076179 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2086/3356] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:09 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:10.082321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0cdd590f-0d15-4577-9b32-d7caace32d29 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:10.083230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0cdd590f-0d15-4577-9b32-d7caace32d29 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:10.215284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0cdd590f-0d15-4577-9b32-d7caace32d29 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:10.228238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0cdd590f-0d15-4577-9b32-d7caace32d29 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:10.231956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0cdd590f-0d15-4577-9b32-d7caace32d29 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:10.236568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0cdd590f-0d15-4577-9b32-d7caace32d29 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1261 microversion: 2.26 time: 0.159044 Oct 01 21:05:10.240708 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2087/3357] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:10 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:10.254225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f93e38d-f53b-4a48-b61f-ae67cf56d4d9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:10.255142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8f93e38d-f53b-4a48-b61f-ae67cf56d4d9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:10.273484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f93e38d-f53b-4a48-b61f-ae67cf56d4d9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:10.277684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f93e38d-f53b-4a48-b61f-ae67cf56d4d9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:10.280514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f93e38d-f53b-4a48-b61f-ae67cf56d4d9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:10.282233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f93e38d-f53b-4a48-b61f-ae67cf56d4d9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:10.282878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f93e38d-f53b-4a48-b61f-ae67cf56d4d9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:10.284059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f93e38d-f53b-4a48-b61f-ae67cf56d4d9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:10.394108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:10.459452 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8f93e38d-f53b-4a48-b61f-ae67cf56d4d9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/action" status: 202 len: 0 microversion: 2.1 time: 0.214933 Oct 01 21:05:10.460639 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2088/3358] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:05:10 2022] POST /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:05:10.474260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:10.475450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:10.494570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:10.495104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:10.502639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:10.503642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:10.504131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:10.504575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:10.784013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:10.793423 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8d5786ac-5420-4a7d-938d-ff362b6f970c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1527 microversion: 2.1 time: 0.330850 Oct 01 21:05:10.809142 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2089/3359] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:10 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1527 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:10.809142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:10.809142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:10.828921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:10.829765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:10.830141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:10.832710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:10.833302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:10.833843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:11.482027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:11.491141 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ecb70652-fddb-487c-92f1-3e3c5f9b5320 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1723 microversion: 2.1 time: 0.691315 Oct 01 21:05:11.502563 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2090/3360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:10 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1723 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:11.510400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:11.511059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:11.527997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:11.528932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:11.532220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:11.534770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:11.535327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:11.535791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:11.683275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:11.698936 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ff154ba-c651-4b55-897a-be97d40bc221 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1275 microversion: 2.1 time: 0.194888 Oct 01 21:05:11.700138 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2091/3361] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:11 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:11.709623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:11.711420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:11.729609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:11.730378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:11.731085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:11.731994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:11.735008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:11.738272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:11.929190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:11.938531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:11.947372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:11.948607 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-916704bb-9088-42a1-919d-d855765443cf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1313 microversion: 2.26 time: 0.247342 Oct 01 21:05:11.949208 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2092/3362] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:11 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:11.963927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:11.964801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:11.981222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:11.982008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:11.982708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:11.983619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:11.984297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:11.985851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:12.933243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbb28c9de4089870d91cf52dac8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e8daf9de4d4fa395b7eee86d33a5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:12.949353 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98202b94-59fa-4407-847d-b4055d7ebfc9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 200 len: 1527 microversion: 2.1 time: 0.996208 Oct 01 21:05:12.950068 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2093/3363] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:11 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 1527 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:12.963002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:12.963819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:12.974377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:12.975170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:12.975932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:12.976860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:12.977491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:12.979636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:14.032176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:14.058970 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34eea1c5-5c92-4ca3-bffb-9f79ec97ad53 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1723 microversion: 2.1 time: 1.089379 Oct 01 21:05:14.062708 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2094/3364] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:12 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1723 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:14.068063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:14.077658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:14.104335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:14.106593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:14.108663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:14.110943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:14.112155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:14.119857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:14.787360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:14.802413 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a6ea7d8e-8b8a-463c-aff7-94df91f2cb7c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1317 microversion: 2.1 time: 0.736036 Oct 01 21:05:14.820140 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2095/3365] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:14 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1317 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:14.828028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:14.828924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:14.836859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:14.837654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:14.838275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:14.839440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:14.840373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:14.841417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:15.120955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:15.134107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:15.136883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:15.143357 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e55235c9-a16c-42fb-879d-7c9a1c91aebf tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1319 microversion: 2.26 time: 0.321364 Oct 01 21:05:15.144226 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2096/3366] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:14 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:15.173162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2b38f21a-60f1-401a-9800-9562b50e221f req-1847e7c8-b518-4bd4-adbc-21b3534d72eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94c0866-3505-4d45-ad56-43726b7b99ff", "name": "network-vif-deleted", "tag": "e2646f05-af1f-4e07-8b42-3ed4246a0f1b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:15.199656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2b38f21a-60f1-401a-9800-9562b50e221f req-1847e7c8-b518-4bd4-adbc-21b3534d72eb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:15.200148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2b38f21a-60f1-401a-9800-9562b50e221f req-1847e7c8-b518-4bd4-adbc-21b3534d72eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:15.200752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2b38f21a-60f1-401a-9800-9562b50e221f req-1847e7c8-b518-4bd4-adbc-21b3534d72eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:15.225314 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2b38f21a-60f1-401a-9800-9562b50e221f req-1847e7c8-b518-4bd4-adbc-21b3534d72eb service nova] Creating event network-vif-deleted:e2646f05-af1f-4e07-8b42-3ed4246a0f1b for instance a94c0866-3505-4d45-ad56-43726b7b99ff on nch1-master-1 Oct 01 21:05:15.240415 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2b38f21a-60f1-401a-9800-9562b50e221f req-1847e7c8-b518-4bd4-adbc-21b3534d72eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083632 Oct 01 21:05:15.241564 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2097/3367] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:15.252576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:15.253657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: a94c0866-3505-4d45-ad56-43726b7b99ff] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:15.268980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:15.269786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:15.270419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:15.278591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:15.279520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:15.280459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:15.331460 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Instance a94c0866-3505-4d45-ad56-43726b7b99ff could not be found. Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff HTTP/1.1 Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance a94c0866-3505-4d45-ad56-43726b7b99ff could not be found. Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a94c0866-3505-4d45-ad56-43726b7b99ff'} Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a94c0866-3505-4d45-ad56-43726b7b99ff could not be found. Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a94c0866-3505-4d45-ad56-43726b7b99ff could not be found. Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:15.339850 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:15.346083 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:15.346083 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:15.346083 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:15.346083 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:15.346083 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:15.346083 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:15.346083 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a94c0866-3505-4d45-ad56-43726b7b99ff could not be found. Oct 01 21:05:15.346083 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:15.357226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Instance a94c0866-3505-4d45-ad56-43726b7b99ff could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:15.361488 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c93479d5-95c0-40d7-abb0-c9aa6abd4725 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff" status: 404 len: 111 microversion: 2.1 time: 0.118547 Oct 01 21:05:15.370644 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2098/3368] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:15 2022] GET /compute/v2.1/servers/a94c0866-3505-4d45-ad56-43726b7b99ff => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:05:15.398174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:15.415377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:15.435935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:15.436675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:15.437332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:15.438233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:15.440932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:15.442518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:15.946957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:15.964337 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f5fa81d-9cfe-4dbd-93e5-90d42d567529 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1729 microversion: 2.1 time: 0.591055 Oct 01 21:05:15.965094 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2099/3369] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:15 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1729 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:15.983367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da6e6e50-f4d6-44ab-adef-0d12a0914188 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Action: 'create', calling method: .version_select at 0x7f4172845940>, body: {"keypair": {"name": "tempest-keypair-156004127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5TWv1ydaGl8lbMYqacizNGwxc8e4xGzDRx21fd9VQv0Hh7xNW1Bgm3mPxItDnozRqX1aFyNFE0nop4B2OGBnnSxLtc7+yBZYKiN+NHyf/LrGGS3OG4ivz1U0VKD+csQQ=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:16.024543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-da6e6e50-f4d6-44ab-adef-0d12a0914188 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Getting quotas for project 0bf01814edfe46d5b1dd62f42c2fa45d. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:05:16.037343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-da6e6e50-f4d6-44ab-adef-0d12a0914188 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Getting quotas for user 9b5f90f4ec8b4b5cb4b64a2b99ca9beb and project 0bf01814edfe46d5b1dd62f42c2fa45d. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:05:16.113500 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da6e6e50-f4d6-44ab-adef-0d12a0914188 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.145836 Oct 01 21:05:16.114156 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2100/3370] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Oct 1 21:05:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 01 21:05:16.128338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9fa8c436-a511-4784-a55d-8700f428e4d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '.version_select at 0x7f4172f380d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:16.169477 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-9fa8c436-a511-4784-a55d-8700f428e4d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Image not found. Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9fa8c436-a511-4784-a55d-8700f428e4d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/images/f7fe0745-0bda-4ebc-b828-ee001024212a HTTP/1.1 Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f7fe0745-0bda-4ebc-b828-ee001024212a'} Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f7fe0745-0bda-4ebc-b828-ee001024212a to delete Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f7fe0745-0bda-4ebc-b828-ee001024212a could not be found. Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:16.174268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 21:05:16.180622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:16.186415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9fa8c436-a511-4784-a55d-8700f428e4d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:16.187639 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9fa8c436-a511-4784-a55d-8700f428e4d2 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/images/f7fe0745-0bda-4ebc-b828-ee001024212a" status: 404 len: 62 microversion: 2.1 time: 0.070286 Oct 01 21:05:16.195458 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2101/3371] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:16 2022] DELETE /compute/v2.1/images/f7fe0745-0bda-4ebc-b828-ee001024212a => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:05:16.219419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:16.222748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:16.241685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:16.248677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:16.249484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:16.250131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:16.254272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:16.255025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:16.255943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:16.709762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:16.720096 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aade82ac-9aa2-46d6-8a82-2b3344e7e45d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1317 microversion: 2.1 time: 0.523469 Oct 01 21:05:16.723771 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2102/3372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:16 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:16.745142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48a53894-a4cd-4f08-a3a9-5be4bc7efbeb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:16.747110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-48a53894-a4cd-4f08-a3a9-5be4bc7efbeb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:16.765290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a53894-a4cd-4f08-a3a9-5be4bc7efbeb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:16.768124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a53894-a4cd-4f08-a3a9-5be4bc7efbeb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:16.768711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a53894-a4cd-4f08-a3a9-5be4bc7efbeb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:16.769564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a53894-a4cd-4f08-a3a9-5be4bc7efbeb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:16.771998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a53894-a4cd-4f08-a3a9-5be4bc7efbeb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:16.772757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a53894-a4cd-4f08-a3a9-5be4bc7efbeb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:17.768005 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48a53894-a4cd-4f08-a3a9-5be4bc7efbeb tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.038914 Oct 01 21:05:17.776963 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2103/3373] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:05:16 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-interface => generated 284 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:17.783115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:17.784775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:17.801481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:17.802281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:17.803576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:17.806066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:17.807436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:17.811290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:18.209444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:18.229674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:18.233504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:18.237197 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-78bd5cfb-76b5-453b-8bf9-7b7a929fda65 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1361 microversion: 2.26 time: 0.459221 Oct 01 21:05:18.239810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2104/3374] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:17 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:18.252835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:18.255376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:18.279572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:18.281766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:18.283444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:18.284454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:18.286789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:18.306937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:18.365785 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 HTTP/1.1 Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '35a4b134-fb30-4b7e-b206-6b5c6cd08334'} Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:05:18.371328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:18.376496 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:18.384337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:18.387171 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e6a5b826-42bd-46a9-ae68-ededb98f2b4c tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 404 len: 111 microversion: 2.1 time: 0.144924 Oct 01 21:05:18.390679 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2105/3375] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:05:18 2022] DELETE /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:05:18.410003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-fb0e8995-b4fd-4c58-8c14-5d9e3621662b req-0683f005-baf9-47b8-a4e3-2733dac14a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bdeea1a-94c5-4666-b874-01634b5b5cd8", "tag": "e91fadf8-47e8-4e70-9ac2-c2c6258d58be"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:18.439718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fb0e8995-b4fd-4c58-8c14-5d9e3621662b req-0683f005-baf9-47b8-a4e3-2733dac14a55 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:18.440663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fb0e8995-b4fd-4c58-8c14-5d9e3621662b req-0683f005-baf9-47b8-a4e3-2733dac14a55 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:18.441676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fb0e8995-b4fd-4c58-8c14-5d9e3621662b req-0683f005-baf9-47b8-a4e3-2733dac14a55 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:18.497968 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-fb0e8995-b4fd-4c58-8c14-5d9e3621662b req-0683f005-baf9-47b8-a4e3-2733dac14a55 service nova] Creating event network-changed:e91fadf8-47e8-4e70-9ac2-c2c6258d58be for instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 on nch2-master-1 Oct 01 21:05:18.506846 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-fb0e8995-b4fd-4c58-8c14-5d9e3621662b req-0683f005-baf9-47b8-a4e3-2733dac14a55 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113362 Oct 01 21:05:18.509019 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2106/3376] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:18.522729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:18.524265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:18.535189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:18.536334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:18.536800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:18.537736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:18.539343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:18.540043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:18.914373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:18.927144 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bca29eb8-aa64-4a38-ba20-7244cfcfd12b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1317 microversion: 2.1 time: 0.409813 Oct 01 21:05:18.943530 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2107/3377] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:18 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:18.974576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:18.975453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 35a4b134-fb30-4b7e-b206-6b5c6cd08334] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:18.989645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:18.990978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:18.991755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:18.992878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:18.994382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:18.995284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:19.025633 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 HTTP/1.1 Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '35a4b134-fb30-4b7e-b206-6b5c6cd08334'} Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:19.029872 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:19.038760 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:19.038760 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:19.038760 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:19.038760 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:19.038760 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:19.038760 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:19.038760 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. Oct 01 21:05:19.038760 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:19.041223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Instance 35a4b134-fb30-4b7e-b206-6b5c6cd08334 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:19.042299 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8a04415f-46ab-4df4-bd41-f017bce27eb9 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334" status: 404 len: 111 microversion: 2.1 time: 0.083492 Oct 01 21:05:19.043102 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2108/3378] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:18 2022] GET /compute/v2.1/servers/35a4b134-fb30-4b7e-b206-6b5c6cd08334 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:05:19.049587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-fda07ca0-21e6-40da-835a-49e1106dc93b req-5c300229-cf04-4586-9495-ecf2a78c1bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ffa29a-9ad6-441a-b912-fe443341c6c2", "tag": "284e4f92-fe9a-4d4a-b691-3f57138f8f3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:19.064811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fda07ca0-21e6-40da-835a-49e1106dc93b req-5c300229-cf04-4586-9495-ecf2a78c1bc2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:19.065303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fda07ca0-21e6-40da-835a-49e1106dc93b req-5c300229-cf04-4586-9495-ecf2a78c1bc2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:19.065742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fda07ca0-21e6-40da-835a-49e1106dc93b req-5c300229-cf04-4586-9495-ecf2a78c1bc2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:19.081234 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-fda07ca0-21e6-40da-835a-49e1106dc93b req-5c300229-cf04-4586-9495-ecf2a78c1bc2 service nova] Creating event network-changed:284e4f92-fe9a-4d4a-b691-3f57138f8f3b for instance a9ffa29a-9ad6-441a-b912-fe443341c6c2 on nch1-master-1 Oct 01 21:05:19.087227 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-fda07ca0-21e6-40da-835a-49e1106dc93b req-5c300229-cf04-4586-9495-ecf2a78c1bc2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042689 Oct 01 21:05:19.087833 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2109/3379] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:19.095099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4fcacbcd-09c1-4879-afba-bc84b3338ada tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '.version_select at 0x7f41728f6f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:19.117691 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4fcacbcd-09c1-4879-afba-bc84b3338ada tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-711606469" status: 202 len: 0 microversion: 2.1 time: 0.028343 Oct 01 21:05:19.118432 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2110/3380] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 21:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-711606469 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:05:19.266745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:19.267492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:19.270462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:19.284602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:19.285118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:19.285565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:19.286285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:19.286776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:19.287207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:19.751095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:19.782685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:19.785812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:19.787845 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a620a80f-07a2-4a0a-bad9-4b4b42c55c94 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1361 microversion: 2.26 time: 0.525107 Oct 01 21:05:19.789005 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2111/3381] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:19 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1361 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:05:19.959034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:19.960888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:19.972380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:19.973495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:19.974339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:19.975426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:19.976112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:19.980407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:19.987400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:20.380289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:20.394866 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cafb3fdb-a3d8-4c1a-bc88-1f13a3068ff7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1317 microversion: 2.1 time: 0.439784 Oct 01 21:05:20.395834 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2112/3382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:19 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:20.821401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:20.822282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:20.830930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:20.831841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:20.832479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:20.833609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:20.834336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:20.835025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:21.321538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:21.347619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:21.356127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:21.360439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-be244f77-cc16-4be8-a6d1-939f30fb95bc tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1361 microversion: 2.26 time: 0.541454 Oct 01 21:05:21.364050 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2113/3383] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:20 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1361 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:05:21.425165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:21.426165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:21.441193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:21.443022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:21.443896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:21.445200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:21.445888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:21.446515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:21.934071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:21.946392 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-414a851c-2f5e-48b1-a78f-7c75d6ca4b37 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1317 microversion: 2.1 time: 0.526613 Oct 01 21:05:21.963977 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2114/3384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:21 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:05:21.978230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4868628-21e5-4a3c-97da-3fcd42d70249 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '.version_select at 0x7f4172fef160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:22.050338 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b4868628-21e5-4a3c-97da-3fcd42d70249 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Image not found. Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4868628-21e5-4a3c-97da-3fcd42d70249 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/images/6bf12437-8b7a-48de-83a1-1a92800fe163 HTTP/1.1 Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '6bf12437-8b7a-48de-83a1-1a92800fe163'} Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6bf12437-8b7a-48de-83a1-1a92800fe163 to delete Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6bf12437-8b7a-48de-83a1-1a92800fe163 could not be found. Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:22.052883 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4868628-21e5-4a3c-97da-3fcd42d70249 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4868628-21e5-4a3c-97da-3fcd42d70249 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/images/6bf12437-8b7a-48de-83a1-1a92800fe163" status: 404 len: 62 microversion: 2.1 time: 0.088192 Oct 01 21:05:22.058778 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2115/3385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:21 2022] DELETE /compute/v2.1/images/6bf12437-8b7a-48de-83a1-1a92800fe163 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:05:22.065956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e9c7f650-6fb6-4e29-bd50-fe9c1057eff7 req-e095db0e-ff3a-42ec-81d9-e5d80ebbf4fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "681e3cb8-3fd1-41d6-8681-ee4f858ca452", "tag": "1840c72f-c980-4053-8e6e-8177499de115"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:22.079884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e9c7f650-6fb6-4e29-bd50-fe9c1057eff7 req-e095db0e-ff3a-42ec-81d9-e5d80ebbf4fa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:22.080651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e9c7f650-6fb6-4e29-bd50-fe9c1057eff7 req-e095db0e-ff3a-42ec-81d9-e5d80ebbf4fa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:22.081355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e9c7f650-6fb6-4e29-bd50-fe9c1057eff7 req-e095db0e-ff3a-42ec-81d9-e5d80ebbf4fa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:22.095408 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e9c7f650-6fb6-4e29-bd50-fe9c1057eff7 req-e095db0e-ff3a-42ec-81d9-e5d80ebbf4fa service nova] Creating event network-changed:1840c72f-c980-4053-8e6e-8177499de115 for instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 on nch2-master-1 Oct 01 21:05:22.106332 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e9c7f650-6fb6-4e29-bd50-fe9c1057eff7 req-e095db0e-ff3a-42ec-81d9-e5d80ebbf4fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049437 Oct 01 21:05:22.113597 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2116/3386] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:22.120647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:22.122098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:22.140950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:22.142390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:22.143515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:22.144523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:22.145524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:22.146190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 HTTP/1.1 Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5fd16675-4ce4-4099-9ced-c2b32cd97e85'} Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:05:22.170409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:22.176140 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-921b48a8-175d-4bfd-bedb-013c664779b8 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 404 len: 111 microversion: 2.1 time: 0.055241 Oct 01 21:05:22.178598 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2117/3387] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:05:22 2022] DELETE /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:05:22.184718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-571417504", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9fd0f2e6-f6d3-44ee-9ad9-472f088b243b"}, {"port": "533ea925-dedd-4f5f-a365-4706cb3420d1", "tag": "port-1"}, {"port": "82e99bc6-f268-4fdd-8550-c975a4937b54", "tag": "port-2"}, {"uuid": "33650633-6ad0-4d4d-93b3-b13e1d48cda0", "tag": "net-1"}, {"uuid": "33650633-6ad0-4d4d-93b3-b13e1d48cda0"}, {"uuid": "949c3e04-bcd1-45a5-943c-401344ec4f14", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "949c3e04-bcd1-45a5-943c-401344ec4f14", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "10008470-ec42-45af-91f0-d055c3127e46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "191e827c-2032-49f3-ba21-01dce9c29e11", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5f3eb6ba-d61b-4c3c-8018-5709f993e46d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1970268609"}], "key_name": "tempest-keypair-156004127", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:22.369853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] validate_networks() for [('9fd0f2e6-f6d3-44ee-9ad9-472f088b243b', None, None, None, None, None), (None, None, '533ea925-dedd-4f5f-a365-4706cb3420d1', None, None, None), (None, None, '82e99bc6-f268-4fdd-8550-c975a4937b54', None, None, None), ('33650633-6ad0-4d4d-93b3-b13e1d48cda0', None, None, None, None, None), ('33650633-6ad0-4d4d-93b3-b13e1d48cda0', None, None, None, None, None), ('949c3e04-bcd1-45a5-943c-401344ec4f14', '10.2.2.100', None, None, None, None), ('949c3e04-bcd1-45a5-943c-401344ec4f14', '10.2.2.200', None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:05:25.253600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:05:25.254374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:05:25.254978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:05:25.255348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:05:25.256878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:05:25.286933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:25.290386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:25.291061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:25.292211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:25.292746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:25.293333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:25.340733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Getting quotas for project 0bf01814edfe46d5b1dd62f42c2fa45d. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:05:25.354248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Getting quotas for user 9b5f90f4ec8b4b5cb4b64a2b99ca9beb and project 0bf01814edfe46d5b1dd62f42c2fa45d. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:05:25.561766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:05:25.566458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='10008470-ec42-45af-91f0-d055c3127e46',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='191e827c-2032-49f3-ba21-01dce9c29e11',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f3eb6ba-d61b-4c3c-8018-5709f993e46d',volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:05:25.584663 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:05:25.585216 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:05:25.668888 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:05:25.668888 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:05:26.036780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dd1befc7-4b1e-44fd-a183-5b3f138023c2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 3.856867 Oct 01 21:05:26.037761 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2118/3388] 10.222.0.17 () {62 vars in 1189 bytes} [Sat Oct 1 21:05:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 3858 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 21:05:26.053709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:26.054353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] [instance: 5fd16675-4ce4-4099-9ced-c2b32cd97e85] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:26.073545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:26.074773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:26.075573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:26.078656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:26.079609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:26.080248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:26.102908 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] HTTP exception thrown: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Request method failure captured: Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 HTTP/1.1 Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKsT0gqV3N0eAhja4Z8BtFeXoj7Nsjof4YJHvEF5bHj3gKF3wLMTySWIcT1te1WxA-twCunNnCbBo-T8hAzIyMtmdMa_LmkJSBdCnWOVNlaCif_CG24jpKUgrI7RAaSe_y5Um9uMMO_cEupw9c5jnvn12j0XS83ePlhp7yVIDQXhn7g Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99e8daf9de4d4fa395b7eee86d33a5f5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99e8daf9de4d4fa395b7eee86d33a5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99e8daf9de4d4fa395b7eee86d33a5f5"}]}] Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 99e8daf9de4d4fa395b7eee86d33a5f5 Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299 Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: aa4fbb28c9de4089870d91cf52dac8ea Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1759675299-project Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5fd16675-4ce4-4099-9ced-c2b32cd97e85'} Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:26.105774 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] Returning 404 to user: Instance 5fd16675-4ce4-4099-9ced-c2b32cd97e85 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c421fe0-515e-4dc2-b628-66157c148238 tempest-ImagesOneServerNegativeTestJSON-1759675299 tempest-ImagesOneServerNegativeTestJSON-1759675299-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85" status: 404 len: 111 microversion: 2.1 time: 0.069249 Oct 01 21:05:26.112212 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2119/3389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:26 2022] GET /compute/v2.1/servers/5fd16675-4ce4-4099-9ced-c2b32cd97e85 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:05:26.127010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:26.127975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:26.138678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:26.139446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:26.140270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:26.141232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:26.142521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:26.143154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:26.814526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:26.835160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:26.837180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:26.843262 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6fda904e-fe8d-4b44-8219-049ff322b844 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1361 microversion: 2.26 time: 0.726916 Oct 01 21:05:26.858825 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2120/3390] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:26 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1361 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:26.858825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:26.858825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:26.875871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:26.881082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:26.887553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:26.890383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:26.893036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:26.893502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:27.271420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:27.284942 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c76a8c8-4c9e-4400-ab65-c21db4b88a6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1317 microversion: 2.1 time: 0.438694 Oct 01 21:05:27.287944 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2121/3391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:26 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:27.314013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1ced508d-78b7-4176-baba-6ed1eb535329 req-b22500d0-3835-4672-a914-b2f7df54f2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "681e3cb8-3fd1-41d6-8681-ee4f858ca452", "tag": "1840c72f-c980-4053-8e6e-8177499de115"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:27.341895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1ced508d-78b7-4176-baba-6ed1eb535329 req-b22500d0-3835-4672-a914-b2f7df54f2ce service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:27.346588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1ced508d-78b7-4176-baba-6ed1eb535329 req-b22500d0-3835-4672-a914-b2f7df54f2ce service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:27.347245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1ced508d-78b7-4176-baba-6ed1eb535329 req-b22500d0-3835-4672-a914-b2f7df54f2ce service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:27.375439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1ced508d-78b7-4176-baba-6ed1eb535329 req-b22500d0-3835-4672-a914-b2f7df54f2ce service nova] Creating event network-changed:1840c72f-c980-4053-8e6e-8177499de115 for instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 on nch2-master-1 Oct 01 21:05:27.381420 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1ced508d-78b7-4176-baba-6ed1eb535329 req-b22500d0-3835-4672-a914-b2f7df54f2ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091443 Oct 01 21:05:27.389385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2122/3392] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:27.402019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9e900a53-0d1b-446c-8bcd-be1094e6dc62 req-0ea295df-7c5a-495d-ac79-3a32ccaf087c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdeea1a-94c5-4666-b874-01634b5b5cd8", "name": "network-vif-plugged", "status": "completed", "tag": "e91fadf8-47e8-4e70-9ac2-c2c6258d58be"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:27.441204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9e900a53-0d1b-446c-8bcd-be1094e6dc62 req-0ea295df-7c5a-495d-ac79-3a32ccaf087c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:27.444669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9e900a53-0d1b-446c-8bcd-be1094e6dc62 req-0ea295df-7c5a-495d-ac79-3a32ccaf087c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:27.447410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9e900a53-0d1b-446c-8bcd-be1094e6dc62 req-0ea295df-7c5a-495d-ac79-3a32ccaf087c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:27.480809 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9e900a53-0d1b-446c-8bcd-be1094e6dc62 req-0ea295df-7c5a-495d-ac79-3a32ccaf087c service nova] Creating event network-vif-plugged:e91fadf8-47e8-4e70-9ac2-c2c6258d58be for instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 on nch2-master-1 Oct 01 21:05:27.495513 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9e900a53-0d1b-446c-8bcd-be1094e6dc62 req-0ea295df-7c5a-495d-ac79-3a32ccaf087c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101127 Oct 01 21:05:27.497669 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2123/3393] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:27.531967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:27.534910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:27.547128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:27.566787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:27.567478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:27.568329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:27.568948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:27.570717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:27.713463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:27.730934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:27.736226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:27.738799 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-db717163-b399-46cd-8c37-bd185d2fbd09 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1526 microversion: 2.32 time: 0.238874 Oct 01 21:05:27.741730 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2124/3394] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:27 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1526 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:27.875314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:27.877279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:27.895308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:27.897240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:27.899283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:27.900851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:27.902450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:27.904696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:28.282431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:28.291350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:28.293652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:28.294974 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23a3b98c-9c88-4530-a096-9c8e1ef1337e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1361 microversion: 2.26 time: 0.425624 Oct 01 21:05:28.306820 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2125/3395] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:27 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1361 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:05:28.324837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:28.326202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:28.333616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:28.334558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:28.335227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:28.336170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:28.336847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:28.337857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:29.185394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:29.199387 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f77cebb1-c26f-4389-aa8b-b490f228ec2c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1317 microversion: 2.1 time: 0.883261 Oct 01 21:05:29.219411 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2126/3396] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:28 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1317 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:29.225602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:29.226653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:29.234271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:29.235015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:29.235633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:29.236540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:29.237174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:29.237767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:29.387394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:29.404677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:29.409458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:29.413034 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f8635c1-f7a0-4ffa-9204-37ea45436545 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1592 microversion: 2.32 time: 0.189899 Oct 01 21:05:29.414042 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2127/3397] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:29 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1592 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:29.422871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:29.423747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:29.441775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:29.443371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:29.444195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:29.446724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:29.448161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:29.450451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:29.893171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:29.903136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:29.910653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:29.913139 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4577575-1716-4c34-ab18-704b6ccfeb5d tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1361 microversion: 2.26 time: 0.495812 Oct 01 21:05:29.913722 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2128/3398] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:29 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1361 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:29.932070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-f40b3e1f-3234-4977-bb23-3f18de5b0951 req-d0808e81-a4da-48ff-80ce-4880097858dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ffa29a-9ad6-441a-b912-fe443341c6c2", "name": "network-vif-plugged", "status": "completed", "tag": "284e4f92-fe9a-4d4a-b691-3f57138f8f3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:29.952902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f40b3e1f-3234-4977-bb23-3f18de5b0951 req-d0808e81-a4da-48ff-80ce-4880097858dd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:29.953428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f40b3e1f-3234-4977-bb23-3f18de5b0951 req-d0808e81-a4da-48ff-80ce-4880097858dd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:29.953918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f40b3e1f-3234-4977-bb23-3f18de5b0951 req-d0808e81-a4da-48ff-80ce-4880097858dd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:29.981600 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-f40b3e1f-3234-4977-bb23-3f18de5b0951 req-d0808e81-a4da-48ff-80ce-4880097858dd service nova] Creating event network-vif-plugged:284e4f92-fe9a-4d4a-b691-3f57138f8f3b for instance a9ffa29a-9ad6-441a-b912-fe443341c6c2 on nch1-master-1 Oct 01 21:05:29.995578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-f40b3e1f-3234-4977-bb23-3f18de5b0951 req-d0808e81-a4da-48ff-80ce-4880097858dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076582 Oct 01 21:05:29.996858 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2129/3399] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:30.230129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:30.232168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:30.242767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:30.243940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:30.245316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:30.246247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:30.247070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:30.247686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:30.562832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:30.611714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-173ca359-c25b-4784-a536-ae2fad22ab32 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.384146 Oct 01 21:05:30.615057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2130/3400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:30 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:30.621510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:30.636404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:30.666143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:30.666990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:30.667522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:30.674951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:30.675478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:30.676018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:30.940143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:30.965131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:30.974607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:30.978423 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da1068b0-62f1-458a-9d7a-ca70bca324da tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1592 microversion: 2.32 time: 0.360802 Oct 01 21:05:30.985758 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2131/3401] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:30 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1592 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:30.993871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:30.994854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:31.016042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:31.021146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:31.021620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:31.026849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:31.027495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:31.027966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:31.623577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:31.644124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:31.645857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:31.648379 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-036af800-0803-4f9f-bcd6-31d425b7c9fd tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1361 microversion: 2.26 time: 0.661299 Oct 01 21:05:31.648976 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2132/3402] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:30 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1361 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:31.661405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1847583601", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:31.796945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] validate_networks() for [('a5c86243-7722-488d-b90b-df7ddabb6bde', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:05:33.356579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:05:33.357151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:05:33.359017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:05:33.359519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:05:33.360049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:05:33.373018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=25 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:33.385699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:33.387619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:33.391002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:33.393303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:33.393915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:33.395127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:33.500637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Getting quotas for project 6c0ad82595344eb4a1122d294faf15b2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:05:33.509250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Getting quotas for user 6d63c633112e49d091421c84cea3422b and project 6c0ad82595344eb4a1122d294faf15b2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:05:33.551484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:05:33.559967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:05:33.624011 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aaac292f-4e43-4521-bb92-2239c269361a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973655 Oct 01 21:05:33.625592 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2133/3403] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:05:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:05:33.633938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:33.635747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:33.647094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:33.648566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:33.649447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:33.650720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:33.651400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:33.652173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:34.323074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:34.348309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:34.349776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:34.351131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3e6d36f1-e448-4ff9-ad1b-7ad2596aab60 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1660 microversion: 2.32 time: 0.723608 Oct 01 21:05:34.351772 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2134/3404] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:33 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1660 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:34.356584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:34.362828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:34.373121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:34.383152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:34.383748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:34.384769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:34.385521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:34.386215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:34.392170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:34.966566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:34.984476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:34.987960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:34.990258 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-70aa68bb-6dd5-4fb8-960a-8d63ba7b02a9 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1546 microversion: 2.26 time: 0.637300 Oct 01 21:05:34.994595 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2135/3405] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:34 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1546 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:35.018740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:35.019953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:35.030868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.031766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.032412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.034198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.034980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.035620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.181337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:35.193086 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5727a8d7-8a49-4897-a11c-6ea47767db9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1269 microversion: 2.1 time: 0.189278 Oct 01 21:05:35.195380 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2136/3406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:35 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:35.204904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f4172fefa60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:35.213057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:35.222092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.223078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.224139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.225115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:35.236138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.237095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.238212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.239518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.241172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.243189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.300570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.301345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.301996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.321000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.321714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.322296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.363262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:35.386460 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b6f1fe83-010b-4e3d-b2d8-62e9eacd1682 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-651433640" status: 201 len: 0 microversion: 2.26 time: 0.188363 Oct 01 21:05:35.390770 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2137/3407] 10.222.0.17 () {62 vars in 1377 bytes} [Sat Oct 1 21:05:35 2022] PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-651433640 => generated 0 bytes in 194 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 01 21:05:35.396604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:35.397547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:35.405544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.406368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.407001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.407730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.408841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.409432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.725125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:35.739748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:35.741557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:35.744068 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-efe81091-5f36-40b2-9b11-d0f3c02d8310 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1707 microversion: 2.32 time: 0.351256 Oct 01 21:05:35.746139 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2138/3408] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:35 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1707 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:35.754508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ab776b4-e259-4b7e-9553-2030d6627353 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f4173028670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:35.763422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ab776b4-e259-4b7e-9553-2030d6627353 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.764130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ab776b4-e259-4b7e-9553-2030d6627353 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.765478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ab776b4-e259-4b7e-9553-2030d6627353 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.782615 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ab776b4-e259-4b7e-9553-2030d6627353 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-651433640" status: 204 len: 0 microversion: 2.26 time: 0.034155 Oct 01 21:05:35.783446 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2139/3409] 10.222.0.17 () {60 vars in 1358 bytes} [Sat Oct 1 21:05:35 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-651433640 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:05:35.794250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f4173028f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:35.807754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.808595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.809227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.809910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:35.817454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.818231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.819059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.820061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.820861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.821484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.852346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.853386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.854028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.878143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:35.903529 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-32656d89-db86-4328-bb17-1f9219e7ee16 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.115497 Oct 01 21:05:35.904594 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2140/3410] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Oct 1 21:05:35 2022] DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:05:35.918954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-69bcd352-6d75-41b9-85c7-16c4706fb705 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f41728f6dc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:35.932642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69bcd352-6d75-41b9-85c7-16c4706fb705 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.933482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69bcd352-6d75-41b9-85c7-16c4706fb705 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.934054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69bcd352-6d75-41b9-85c7-16c4706fb705 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.948979 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-69bcd352-6d75-41b9-85c7-16c4706fb705 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 200 len: 12 microversion: 2.26 time: 0.036303 Oct 01 21:05:35.950222 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2141/3411] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Oct 1 21:05:35 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 12 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:35.964268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f4172f38430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:35.980269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.980881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.981486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.982063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:35.989511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.990100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.990669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:35.991461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:35.992013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:35.992523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.067171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.067728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.068313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.088102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.090458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.091059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.130437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:36.174521 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-acb49ad8-7e0c-4ee9-83f5-b85ec678685c tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-503020519" status: 201 len: 0 microversion: 2.26 time: 0.216172 Oct 01 21:05:36.181298 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2142/3412] 10.222.0.17 () {62 vars in 1377 bytes} [Sat Oct 1 21:05:35 2022] PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-503020519 => generated 0 bytes in 223 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 01 21:05:36.192952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a8cf7f7-0eb6-41a6-9e06-4397f499d329 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f417c289940>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:36.201370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a8cf7f7-0eb6-41a6-9e06-4397f499d329 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.202721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a8cf7f7-0eb6-41a6-9e06-4397f499d329 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.203183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a8cf7f7-0eb6-41a6-9e06-4397f499d329 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.213895 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a8cf7f7-0eb6-41a6-9e06-4397f499d329 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 200 len: 35 microversion: 2.26 time: 0.031553 Oct 01 21:05:36.221044 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2143/3413] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Oct 1 21:05:36 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 35 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:36.229960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:36.230735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:36.247723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.248174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.249280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.250031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.250516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.250975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.495260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:36.504829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3abf51d0-0623-4e1e-9929-2bcffb48df42 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1275 microversion: 2.1 time: 0.282449 Oct 01 21:05:36.509096 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2144/3414] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:36 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1275 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:36.518762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f417c289e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:36.538849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.540785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.542601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.544403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:36.560236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.562258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.564533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.566059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.568988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.569690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.634741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.636616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.638460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.693018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:36.727227 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-006b859d-a291-4d31-ad7e-9121b0042b51 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-503020519" status: 204 len: 0 microversion: 2.26 time: 0.216345 Oct 01 21:05:36.730382 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2145/3415] 10.222.0.17 () {60 vars in 1361 bytes} [Sat Oct 1 21:05:36 2022] DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-503020519 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:05:36.745396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b08503ff-5767-43b9-9c9d-a1628f003bd0 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f41730289d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:36.762200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b08503ff-5767-43b9-9c9d-a1628f003bd0 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.762445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b08503ff-5767-43b9-9c9d-a1628f003bd0 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.767230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b08503ff-5767-43b9-9c9d-a1628f003bd0 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.802926 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b08503ff-5767-43b9-9c9d-a1628f003bd0 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 200 len: 12 microversion: 2.26 time: 0.056731 Oct 01 21:05:36.802926 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2146/3416] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Oct 1 21:05:36 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 12 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:36.808983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:36.818792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:36.828227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.830876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.831906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:36.832790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:36.836327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:36.836956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:37.280854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:37.298780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:37.300309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:37.301607 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5da502b9-c187-4b2c-81d5-40c769347581 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1742 microversion: 2.32 time: 0.501303 Oct 01 21:05:37.328766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2147/3417] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:36 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1742 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:37.338229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f41728f6f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:37.357376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:37.361079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:37.361462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:37.363301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:37.382628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:37.384762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:37.385541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:37.386312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:37.392858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:37.395163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:37.456462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:37.457195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:37.458785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:37.477619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:37.481413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:37.511568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-477fae5a-2df0-4fa6-a98a-d8f66d7c5559 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.180583 Oct 01 21:05:37.518214 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2148/3418] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Oct 1 21:05:37 2022] DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:05:38.172601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f5fb404-4aae-4dad-b379-b0d6708fa12f tempest-ListImageFiltersNegativeTestJSON-1063810440 tempest-ListImageFiltersNegativeTestJSON-1063810440-project] Calling method '.version_select at 0x7f4173028670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:38.214359 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-8f5fb404-4aae-4dad-b379-b0d6708fa12f tempest-ListImageFiltersNegativeTestJSON-1063810440 tempest-ListImageFiltersNegativeTestJSON-1063810440-project] HTTP exception thrown: Image not found. Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f5fb404-4aae-4dad-b379-b0d6708fa12f tempest-ListImageFiltersNegativeTestJSON-1063810440 tempest-ListImageFiltersNegativeTestJSON-1063810440-project] Request method failure captured: Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/images/012c58c9-5ff5-4f43-9243-e0bcc32a3190 HTTP/1.1 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKuhVOYqBcyKVZV8VFYl6qXYfGkCIYu6WhpclC8K_FVZjJr0FYc0q4Ta5BzPqd2S4LyBQ39rZga7PvkwdQigTb32GAqobweREZignZYg1yWjpbgl4AeonX9OKpdvNUz45Tfi180Eh-_ZuvvlbcH9PVV_CLkaaV_-njg0DcEnuijj0_0 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 79942f157bd4443bb422b629eea5b30f Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1063810440 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_79942f157bd4443bb422b629eea5b30f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/79942f157bd4443bb422b629eea5b30f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/79942f157bd4443bb422b629eea5b30f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/79942f157bd4443bb422b629eea5b30f"}]}] Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1063810440 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 79942f157bd4443bb422b629eea5b30f Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1063810440 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ListImageFiltersNegativeTestJSON-1063810440-project Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a4e3cd820f0e49cc969a94cb48422e42 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1063810440-project Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: exception: Image not found. Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '012c58c9-5ff5-4f43-9243-e0bcc32a3190'} Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 012c58c9-5ff5-4f43-9243-e0bcc32a3190 Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 01 21:05:38.216981 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 012c58c9-5ff5-4f43-9243-e0bcc32a3190 could not be found. Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f5fb404-4aae-4dad-b379-b0d6708fa12f tempest-ListImageFiltersNegativeTestJSON-1063810440 tempest-ListImageFiltersNegativeTestJSON-1063810440-project] Returning 404 to user: Image not found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8f5fb404-4aae-4dad-b379-b0d6708fa12f tempest-ListImageFiltersNegativeTestJSON-1063810440 tempest-ListImageFiltersNegativeTestJSON-1063810440-project] 10.222.0.17 "GET /compute/v2.1/images/012c58c9-5ff5-4f43-9243-e0bcc32a3190" status: 404 len: 62 microversion: 2.1 time: 0.699010 Oct 01 21:05:38.220260 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2149/3419] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:05:37 2022] GET /compute/v2.1/images/012c58c9-5ff5-4f43-9243-e0bcc32a3190 => generated 62 bytes in 701 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:05:38.233717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f417282a1f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:38.265122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:38.265122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:38.265417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:38.265886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:38.301552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:38.301977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:38.302427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:38.310781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:38.312852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:38.313318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:38.417004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:38.427500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:38.429167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:38.471333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:38.472181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:38.472934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:38.502894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:38.526795 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37620869-c310-4fd8-8fc9-327c777cb444 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-284842801" status: 201 len: 0 microversion: 2.26 time: 0.305667 Oct 01 21:05:38.528818 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2150/3420] 10.222.0.17 () {62 vars in 1377 bytes} [Sat Oct 1 21:05:38 2022] PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-284842801 => generated 0 bytes in 308 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 01 21:05:38.541310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:38.542134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:38.551917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:38.554076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:38.555846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:38.557594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:38.558333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:38.559811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:38.835567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:38.846831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-66878e53-3442-4af8-950c-c7e7844d05bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1317 microversion: 2.1 time: 0.315655 Oct 01 21:05:38.849613 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2151/3421] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:38 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:38.863913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:38.864986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:38.880027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:38.880611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:38.881751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:38.882478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:38.883384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:38.883964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.206859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:39.223867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:39.225474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:39.228238 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d8d2661b-b766-454f-b449-2099e5164915 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1789 microversion: 2.32 time: 0.375728 Oct 01 21:05:39.231043 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2152/3422] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:38 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1789 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:39.237785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f417298ab80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:39.261572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.262145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.262512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.267480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:39.297832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.298176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.299550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.302949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.302949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.303829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.365629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.366138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.376684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.390375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.393787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.394245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.462083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:39.525602 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34c44573-1bbd-49ae-9d00-e6b09945b289 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-674439204" status: 201 len: 0 microversion: 2.26 time: 0.291450 Oct 01 21:05:39.528573 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2153/3423] 10.222.0.17 () {62 vars in 1377 bytes} [Sat Oct 1 21:05:39 2022] PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-674439204 => generated 0 bytes in 297 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 01 21:05:39.536563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f41728db310>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:39.565231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.566230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.568754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.571438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:39.585516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.586418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.587181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.592592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.593615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.595035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.644852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.645530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.646163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.670674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:39.692706 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e2cfb77-a13f-40b0-b6e5-da1b5f2d990e tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.159904 Oct 01 21:05:39.694051 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2154/3424] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Oct 1 21:05:39 2022] DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:05:39.705533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d132e16c-027d-4f6c-a1a3-e56ee038ea27 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f417c2f74c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:39.734228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d132e16c-027d-4f6c-a1a3-e56ee038ea27 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.734776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d132e16c-027d-4f6c-a1a3-e56ee038ea27 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.735227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d132e16c-027d-4f6c-a1a3-e56ee038ea27 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.756680 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d132e16c-027d-4f6c-a1a3-e56ee038ea27 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 200 len: 12 microversion: 2.26 time: 0.055804 Oct 01 21:05:39.757360 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2155/3425] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Oct 1 21:05:39 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:05:39.769682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f417c2f7160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:39.789924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.791948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.792816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.795345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:39.809216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.814937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.815842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.816779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.817447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.818088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.910367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:39.919526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:39.920128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:39.969987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:40.033740 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ae59898-cdec-4061-bb8f-5e1883b18e6a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.268407 Oct 01 21:05:40.035376 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2156/3426] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Oct 1 21:05:39 2022] DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:05:40.044934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:40.050779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:40.065261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:40.072546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:40.073285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:40.074836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:40.078115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:40.078810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:40.505661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:40.518535 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6e99fa10-5677-4e05-bc5e-def20c3259df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1317 microversion: 2.1 time: 0.481723 Oct 01 21:05:40.519464 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2157/3427] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:40 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:40.530433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f417c2f7790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:40.555908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:40.565173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:40.565762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:40.567084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:40.582882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:40.583412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:40.587065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:40.588562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:40.589368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:40.590740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:40.660903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:40.662628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:40.663955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:40.686968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:40.688142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:40.688980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:40.746572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:40.785552 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd8303c2-d010-483f-b941-27b7281c8e04 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-31147768" status: 201 len: 0 microversion: 2.26 time: 0.261786 Oct 01 21:05:40.786578 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2158/3428] 10.222.0.17 () {62 vars in 1374 bytes} [Sat Oct 1 21:05:40 2022] PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-31147768 => generated 0 bytes in 263 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 01 21:05:40.791509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:40.792308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:40.817867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:40.819588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:40.823125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:40.849442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:40.850043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:40.850699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:41.344186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:41.349456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=88,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:41.368681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:41.374352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:41.376228 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-151b8232-2ced-4361-a21f-2c471ac6ba4c tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1836 microversion: 2.32 time: 0.588449 Oct 01 21:05:41.395882 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2159/3429] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:40 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1836 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:41.403750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-560ad398-8d6f-4659-b295-120ac3e658a5 req-e5f8eda0-5ac5-4525-a065-9bf34fda3f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2309b08-05db-4a69-9b23-76111e0ee07b", "tag": "a6a5a067-364e-4ff1-b1a1-979074ecc6b7"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:41.442661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-560ad398-8d6f-4659-b295-120ac3e658a5 req-e5f8eda0-5ac5-4525-a065-9bf34fda3f0d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:41.444989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-560ad398-8d6f-4659-b295-120ac3e658a5 req-e5f8eda0-5ac5-4525-a065-9bf34fda3f0d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:41.446756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-560ad398-8d6f-4659-b295-120ac3e658a5 req-e5f8eda0-5ac5-4525-a065-9bf34fda3f0d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:41.487231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-560ad398-8d6f-4659-b295-120ac3e658a5 req-e5f8eda0-5ac5-4525-a065-9bf34fda3f0d service nova] Creating event network-changed:a6a5a067-364e-4ff1-b1a1-979074ecc6b7 for instance d2309b08-05db-4a69-9b23-76111e0ee07b on nch2-master-1 Oct 01 21:05:41.497776 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-560ad398-8d6f-4659-b295-120ac3e658a5 req-e5f8eda0-5ac5-4525-a065-9bf34fda3f0d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099299 Oct 01 21:05:41.499427 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2160/3430] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:41.509509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f417c289a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:41.524235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:41.524738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:41.525489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:41.526240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:41.534437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:41.536389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:41.537835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:41.538919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:41.539710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:41.540353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:41.626416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:41.627124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:41.628977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:41.666077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:41.666726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:41.671111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:41.735856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:41.780790 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d282bfa5-44bb-4c0e-bc78-5d9ce415e644 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-1364332640" status: 201 len: 0 microversion: 2.26 time: 0.280000 Oct 01 21:05:41.786914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2161/3431] 10.222.0.17 () {62 vars in 1380 bytes} [Sat Oct 1 21:05:41 2022] PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags/tempest-tag-1364332640 => generated 0 bytes in 287 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 01 21:05:41.803825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:41.805356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:41.815830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:41.817115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:41.817919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:41.819099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:41.819703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:41.820255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.103990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:42.118237 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2db0bfa3-f690-4495-9cd0-c9732752ae1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1317 microversion: 2.1 time: 0.318437 Oct 01 21:05:42.119145 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2162/3432] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:41 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:42.124469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Action: 'update_all', calling method: .version_select at 0x7f417c2b3040>, body: {"tags": ["tempest-tag-833814241", "tempest-tag-1596444973"]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:42.156094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.161096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.163987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.171298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:42.178839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.179641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.180092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.180892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.181401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.181781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.219798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.220301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.221218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.253315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:42.278562 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dbdc668f-385a-42e0-b4de-f7aca98e087a tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 200 len: 61 microversion: 2.26 time: 0.157977 Oct 01 21:05:42.279968 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2163/3433] 10.222.0.17 () {62 vars in 1312 bytes} [Sat Oct 1 21:05:42 2022] PUT /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 61 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:42.285012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-bf108ac3-32cc-40a2-8f6e-72c41138bc1d req-07715711-ceb7-4912-b37f-cadb7a11c3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "tag": "2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:42.305674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bf108ac3-32cc-40a2-8f6e-72c41138bc1d req-07715711-ceb7-4912-b37f-cadb7a11c3a8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.306418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bf108ac3-32cc-40a2-8f6e-72c41138bc1d req-07715711-ceb7-4912-b37f-cadb7a11c3a8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.306666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bf108ac3-32cc-40a2-8f6e-72c41138bc1d req-07715711-ceb7-4912-b37f-cadb7a11c3a8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.323059 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-bf108ac3-32cc-40a2-8f6e-72c41138bc1d req-07715711-ceb7-4912-b37f-cadb7a11c3a8 service nova] Creating event network-changed:2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:05:42.333000 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-bf108ac3-32cc-40a2-8f6e-72c41138bc1d req-07715711-ceb7-4912-b37f-cadb7a11c3a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052281 Oct 01 21:05:42.335106 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2164/3434] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:42.342807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c96fd985-d98f-4fd6-b8b3-8cdd4be10f86 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f417c2f7790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:42.362995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96fd985-d98f-4fd6-b8b3-8cdd4be10f86 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.363894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96fd985-d98f-4fd6-b8b3-8cdd4be10f86 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.366310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c96fd985-d98f-4fd6-b8b3-8cdd4be10f86 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.394510 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c96fd985-d98f-4fd6-b8b3-8cdd4be10f86 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 200 len: 61 microversion: 2.26 time: 0.055635 Oct 01 21:05:42.395767 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2165/3435] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Oct 1 21:05:42 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 61 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:42.414839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '.version_select at 0x7f41728f6430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:42.433762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.434455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.437427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.438484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:42.456249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.458554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.463725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.465538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.468202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.468772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.560590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.563734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.567588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.620632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lazy-loading 'flavor' on Instance uuid a9ffa29a-9ad6-441a-b912-fe443341c6c2 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:42.660958 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f0923420-24af-441f-b42b-1894243af9c2 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.257020 Oct 01 21:05:42.661701 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2166/3436] 10.222.0.17 () {60 vars in 1295 bytes} [Sat Oct 1 21:05:42 2022] DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2/tags => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:05:42.674656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:42.675457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:42.685004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.685903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.687097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:42.688002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:42.688657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:42.689262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:43.464568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:43.535419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=5 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:43.824191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:43.842135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:43.848394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:43.851106 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1bfccb3-55d6-41b6-be68-0fac1ad90f22 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1836 microversion: 2.32 time: 1.187314 Oct 01 21:05:43.860090 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2167/3437] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:42 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1836 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:43.871200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:43.874848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:43.888202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:43.888714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:43.889716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:43.895342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:43.896102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:43.896562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:43.963174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:05:44.138703 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-97e14d70-80c6-452b-ab26-a1490b963c06 tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 204 len: 0 microversion: 2.26 time: 0.276839 Oct 01 21:05:44.141565 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2168/3438] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:05:43 2022] DELETE /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:05:44.154227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:44.155524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:44.162398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:44.164063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:44.165138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:44.166070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:44.167175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:44.167772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:44.650145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:44.660342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0c1c3e67-0ca8-4416-9472-3dd7e0fbfc85 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1317 microversion: 2.1 time: 0.516929 Oct 01 21:05:44.664160 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2169/3439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:44 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:45.176253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b47fb45f-003d-4010-9e4e-7e8226a5d4e5 tempest-ListImagesTestJSON-621029251 tempest-ListImagesTestJSON-621029251-project] Calling method '.version_select at 0x7f4173ab4430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:45.232631 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b47fb45f-003d-4010-9e4e-7e8226a5d4e5 tempest-ListImagesTestJSON-621029251 tempest-ListImagesTestJSON-621029251-project] 10.222.0.17 "GET /compute/v2.1/images/90f3f35e-76ec-4c31-b581-329b315fe607" status: 200 len: 784 microversion: 2.1 time: 0.565154 Oct 01 21:05:45.245407 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2170/3440] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Oct 1 21:05:44 2022] GET /compute/v2.1/images/90f3f35e-76ec-4c31-b581-329b315fe607 => generated 784 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:45.256464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:45.257460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:45.271711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:45.272459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:45.273089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:45.273995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:45.274671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:45.275371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:45.584019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:45.604062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:45.606077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46c6f0cba68e41eab2d90bac5fba9442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea6424dd45e48ad93390e398a6fc926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:45.608158 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5b29e6ed-d2ee-4870-af7f-ab2e4ef50ecb tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 200 len: 1552 microversion: 2.26 time: 0.360836 Oct 01 21:05:45.639770 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2171/3441] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:45 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 1552 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:45.652498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:45.655728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:45.671790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:45.672314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:45.672769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:45.673509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:45.676998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:45.677661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:46.049651 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:05:46.050058 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:05:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:05:46.700475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:46.714580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:46.716321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:46.717784 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-10cd6e1e-b462-4506-8f98-c590b7c681a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1857 microversion: 2.32 time: 1.076948 Oct 01 21:05:46.718905 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2172/3442] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:45 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1857 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:46.723872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ca31c9f1-8c64-4248-a1b8-6cac65335553 req-01adb6fc-cf76-418f-b5af-b1b6ed90a55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "tag": "533ea925-dedd-4f5f-a365-4706cb3420d1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:46.733170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:46.743812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ca31c9f1-8c64-4248-a1b8-6cac65335553 req-01adb6fc-cf76-418f-b5af-b1b6ed90a55c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:46.744877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ca31c9f1-8c64-4248-a1b8-6cac65335553 req-01adb6fc-cf76-418f-b5af-b1b6ed90a55c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:46.745701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ca31c9f1-8c64-4248-a1b8-6cac65335553 req-01adb6fc-cf76-418f-b5af-b1b6ed90a55c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:46.763710 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ca31c9f1-8c64-4248-a1b8-6cac65335553 req-01adb6fc-cf76-418f-b5af-b1b6ed90a55c service nova] Creating event network-changed:533ea925-dedd-4f5f-a365-4706cb3420d1 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:05:46.769811 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ca31c9f1-8c64-4248-a1b8-6cac65335553 req-01adb6fc-cf76-418f-b5af-b1b6ed90a55c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049394 Oct 01 21:05:46.770525 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2173/3443] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:46.776066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34faa93c-008d-4b1e-be4b-df837f842726 tempest-ListImagesTestJSON-621029251 tempest-ListImagesTestJSON-621029251-project] Calling method '.version_select at 0x7f4172fdeee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:46.869490 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34faa93c-008d-4b1e-be4b-df837f842726 tempest-ListImagesTestJSON-621029251 tempest-ListImagesTestJSON-621029251-project] 10.222.0.17 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.097370 Oct 01 21:05:46.870214 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2174/3444] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Oct 1 21:05:46 2022] GET /compute/v2.1/images => generated 445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:46.880163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:46.880904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:46.888097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:46.888591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:46.889253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:46.890250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:46.890896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:46.891325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:47.399454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:47.409030 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a869d545-b934-4fce-be0a-69b2434b134d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1317 microversion: 2.1 time: 0.537145 Oct 01 21:05:47.418602 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2175/3445] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:46 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:47.729806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1138660964", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "4063a80d-e929-4260-a61d-13112f8486a3"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:47.808198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] validate_networks() for [('4063a80d-e929-4260-a61d-13112f8486a3', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:05:49.080579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:05:49.081627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:05:49.082259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:05:49.082749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:05:49.083370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:05:49.093731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:49.094231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:49.094709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:49.095686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:49.096520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:49.097339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:49.106113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:49.127882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Getting quotas for project 3242ac5d0c3146b0bed8fd2f2e48584b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:05:49.134725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Getting quotas for user de8c90c2e17c4fb799678e81e57d9765 and project 3242ac5d0c3146b0bed8fd2f2e48584b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:05:49.150127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:05:49.152634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:05:49.242476 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8a99ce0e-96a0-4dfc-af43-f56cb168cc8b tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.822690 Oct 01 21:05:49.243176 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2176/3446] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:05:49.253487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:49.256563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] [instance: a9ffa29a-9ad6-441a-b912-fe443341c6c2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:49.263929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:49.290673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:49.298838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:49.300032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:49.301197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:49.303552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:49.346158 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] HTTP exception thrown: Instance a9ffa29a-9ad6-441a-b912-fe443341c6c2 could not be found. Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Request method failure captured: Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 HTTP/1.1 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKuB-uTgLwGlMxp9yEP7cgjcGsUi8tBBdJ_xMSQFTiywMhR0kpREoPZtdXk1h4SHGzAHoIPOxeVChkmVpI9ldz3VbmB4ubZmsn5BTM6-mEsxycBLZYd7KJe7v_g0CuhUB8R-Tnn-T5DPpionIqLICEt8m7ArgQv8h-tPGu9nhfLS2oY Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.26 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8ea6424dd45e48ad93390e398a6fc926 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerTagsTestJSON-1266535782 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "tempest-type-704232271", "name": "tempest-service-1231887591", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8ea6424dd45e48ad93390e398a6fc926", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8ea6424dd45e48ad93390e398a6fc926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8ea6424dd45e48ad93390e398a6fc926"}]}, {"type": "tempest-type-748091739", "name": "tempest-service-428922397", "endpoints": []}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8ea6424dd45e48ad93390e398a6fc926"}]}] Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerTagsTestJSON-1266535782 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8ea6424dd45e48ad93390e398a6fc926 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerTagsTestJSON-1266535782 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerTagsTestJSON-1266535782-project Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 46c6f0cba68e41eab2d90bac5fba9442 Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerTagsTestJSON-1266535782-project Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance a9ffa29a-9ad6-441a-b912-fe443341c6c2 could not be found. Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a9ffa29a-9ad6-441a-b912-fe443341c6c2'} Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ffa29a-9ad6-441a-b912-fe443341c6c2 could not be found. Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:05:49.348062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ffa29a-9ad6-441a-b912-fe443341c6c2 could not be found. Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ffa29a-9ad6-441a-b912-fe443341c6c2 could not be found. Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] Returning 404 to user: Instance a9ffa29a-9ad6-441a-b912-fe443341c6c2 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e62ba5aa-ba12-4c99-ba55-3e515d043c7f tempest-ServerTagsTestJSON-1266535782 tempest-ServerTagsTestJSON-1266535782-project] 10.222.0.17 "GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2" status: 404 len: 111 microversion: 2.26 time: 0.103662 Oct 01 21:05:49.352386 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2177/3447] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:49 2022] GET /compute/v2.1/servers/a9ffa29a-9ad6-441a-b912-fe443341c6c2 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:05:49.354623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1993deca-c104-463c-b30c-a94ed703f8ef tempest-ListImagesTestJSON-621029251 tempest-ListImagesTestJSON-621029251-project] Calling method '.version_select at 0x7f417c25aa60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:49.444596 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1993deca-c104-463c-b30c-a94ed703f8ef tempest-ListImagesTestJSON-621029251 tempest-ListImagesTestJSON-621029251-project] 10.222.0.17 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.090721 Oct 01 21:05:49.445387 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2178/3448] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 21:05:49 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:49.461197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:49.467809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:49.497721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:49.501259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:49.506186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:49.509364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:49.510882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:49.512311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:50.136894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:50.158131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:50.160417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:50.162005 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3d67fab-3d92-4486-81d9-0506001726f8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.713806 Oct 01 21:05:50.163076 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2179/3449] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:49 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:50.174831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:50.175674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:50.190882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:50.191426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:50.196097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:50.196877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:50.197512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:50.197952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:50.506668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:50.516381 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6e6f36c4-ef69-4df4-bc39-2d8c5768a3bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1317 microversion: 2.1 time: 0.349096 Oct 01 21:05:50.517553 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2180/3450] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:50 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:50.522732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ebdf9256-4976-437b-9bd3-787d7eae29c8 req-654790a2-c6de-4b34-94ed-87e5528b82e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2309b08-05db-4a69-9b23-76111e0ee07b", "name": "network-vif-plugged", "status": "completed", "tag": "a6a5a067-364e-4ff1-b1a1-979074ecc6b7"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:50.533324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ebdf9256-4976-437b-9bd3-787d7eae29c8 req-654790a2-c6de-4b34-94ed-87e5528b82e2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:50.534217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ebdf9256-4976-437b-9bd3-787d7eae29c8 req-654790a2-c6de-4b34-94ed-87e5528b82e2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:50.534865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ebdf9256-4976-437b-9bd3-787d7eae29c8 req-654790a2-c6de-4b34-94ed-87e5528b82e2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:50.549552 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ebdf9256-4976-437b-9bd3-787d7eae29c8 req-654790a2-c6de-4b34-94ed-87e5528b82e2 service nova] Creating event network-vif-plugged:a6a5a067-364e-4ff1-b1a1-979074ecc6b7 for instance d2309b08-05db-4a69-9b23-76111e0ee07b on nch2-master-1 Oct 01 21:05:50.555891 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ebdf9256-4976-437b-9bd3-787d7eae29c8 req-654790a2-c6de-4b34-94ed-87e5528b82e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037041 Oct 01 21:05:50.559194 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2181/3451] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:50.566522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c22efd2d-1899-4cce-9817-77e648431f9e req-89fda6a0-ae2b-40bf-afec-70b77c01a2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "tag": "82e99bc6-f268-4fdd-8550-c975a4937b54"}, {"server_uuid": "a9ffa29a-9ad6-441a-b912-fe443341c6c2", "name": "network-vif-deleted", "tag": "284e4f92-fe9a-4d4a-b691-3f57138f8f3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:50.585159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c22efd2d-1899-4cce-9817-77e648431f9e req-89fda6a0-ae2b-40bf-afec-70b77c01a2bf service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:50.586103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c22efd2d-1899-4cce-9817-77e648431f9e req-89fda6a0-ae2b-40bf-afec-70b77c01a2bf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:50.587294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c22efd2d-1899-4cce-9817-77e648431f9e req-89fda6a0-ae2b-40bf-afec-70b77c01a2bf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:50.612514 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c22efd2d-1899-4cce-9817-77e648431f9e req-89fda6a0-ae2b-40bf-afec-70b77c01a2bf service nova] Creating event network-changed:82e99bc6-f268-4fdd-8550-c975a4937b54 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:05:50.615547 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c22efd2d-1899-4cce-9817-77e648431f9e req-89fda6a0-ae2b-40bf-afec-70b77c01a2bf service nova] Creating event network-vif-deleted:284e4f92-fe9a-4d4a-b691-3f57138f8f3b for instance a9ffa29a-9ad6-441a-b912-fe443341c6c2 on nch1-master-1 Oct 01 21:05:50.637192 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c22efd2d-1899-4cce-9817-77e648431f9e req-89fda6a0-ae2b-40bf-afec-70b77c01a2bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.075029 Oct 01 21:05:50.641069 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2182/3452] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:50.651114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:50.654209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:50.668415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:50.670795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:50.671398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:50.676116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:50.676853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:50.678961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:51.034393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:51.054821 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84615547-d20f-48df-87d1-2a000ec196fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1211 microversion: 2.1 time: 0.411769 Oct 01 21:05:51.055557 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2183/3453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:50 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1211 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:51.195084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:51.195965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:51.207823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:51.210692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:51.211529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:51.213265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:51.214511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:51.216350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:52.459561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:52.492299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:52.496091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:52.501408 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0a3aa150-e39a-4698-80a6-1d783a42ab19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 1.310385 Oct 01 21:05:52.503439 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2184/3454] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:51 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:05:52.526345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:52.528404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:52.556408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:52.557445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:52.557907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:52.564162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:52.564758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:52.567588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:54.088458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:54.097185 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75655484-7ee8-4a33-aab8-56bc2bd9fe17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1506 microversion: 2.1 time: 1.591711 Oct 01 21:05:54.098535 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2185/3455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:52 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1506 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:54.103475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:54.104288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:54.112446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:54.115185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:54.115877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:54.116760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:54.119130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:54.119849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:54.715428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:54.734426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a945924d-cde9-4f32-b2ba-ca42d38a66fd tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1315 microversion: 2.1 time: 0.634526 Oct 01 21:05:54.736522 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2186/3456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:54 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:54.743551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ae6e6408-0ec9-4401-963b-2cd911f9e93e req-9e0d5a23-fd04-43c6-becf-ede41c8fc8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "tag": "ad134ac7-069e-4067-94cd-612e65d3dac2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:05:54.758766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ae6e6408-0ec9-4401-963b-2cd911f9e93e req-9e0d5a23-fd04-43c6-becf-ede41c8fc8a7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:54.759536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ae6e6408-0ec9-4401-963b-2cd911f9e93e req-9e0d5a23-fd04-43c6-becf-ede41c8fc8a7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:54.760429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ae6e6408-0ec9-4401-963b-2cd911f9e93e req-9e0d5a23-fd04-43c6-becf-ede41c8fc8a7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:54.782249 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ae6e6408-0ec9-4401-963b-2cd911f9e93e req-9e0d5a23-fd04-43c6-becf-ede41c8fc8a7 service nova] Creating event network-changed:ad134ac7-069e-4067-94cd-612e65d3dac2 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:05:54.791690 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ae6e6408-0ec9-4401-963b-2cd911f9e93e req-9e0d5a23-fd04-43c6-becf-ede41c8fc8a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051723 Oct 01 21:05:54.794176 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2187/3457] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:54.800627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:54.802322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:54.812811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:54.813554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:54.814216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:54.816506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:54.818817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:54.820027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:55.809085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:55.834879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:55.838926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:55.840720 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6aad9fcf-faad-44bd-ba4d-3e43a4cc588b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 1.044958 Oct 01 21:05:55.858233 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2188/3458] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:54 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:05:55.873601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:55.874450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:55.884277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:55.892945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:55.893793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:55.895004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:55.895689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:55.896448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:56.035337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lazy-loading 'services' on Instance uuid 681e3cb8-3fd1-41d6-8681-ee4f858ca452 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:05:56.140433 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9601990-1cb7-4d82-9935-bf03bc9262c4 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments/1067c786-686b-41aa-b9ca-31ea24d10308" status: 202 len: 0 microversion: 2.1 time: 0.279865 Oct 01 21:05:56.144881 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2189/3459] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:05:55 2022] DELETE /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments/1067c786-686b-41aa-b9ca-31ea24d10308 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:05:56.162943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:56.166474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:56.180372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:56.181116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:56.181757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:56.183284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:56.183967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:56.184697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:56.239611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:05:56.433643 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5dbf0590-c519-49fc-bc6c-aa950f4a42d8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 204 len: 0 microversion: 2.1 time: 0.277829 Oct 01 21:05:56.437842 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2190/3460] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:05:56 2022] DELETE /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:05:56.446445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:56.447620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:56.455778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:56.456716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:56.475007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:56.476884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:56.478017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:56.478588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:57.493994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:57.504109 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6b48f073-a0fa-4425-92ba-b97736f197a7 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1315 microversion: 2.1 time: 1.064485 Oct 01 21:05:57.506138 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2191/3461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:56 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1315 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:57.527354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-73c44610-3c95-4a4f-801e-bbf0caa4514d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:57.530596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-73c44610-3c95-4a4f-801e-bbf0caa4514d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:57.537747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73c44610-3c95-4a4f-801e-bbf0caa4514d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:57.538572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73c44610-3c95-4a4f-801e-bbf0caa4514d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:57.539167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73c44610-3c95-4a4f-801e-bbf0caa4514d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:57.540042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73c44610-3c95-4a4f-801e-bbf0caa4514d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:57.540649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73c44610-3c95-4a4f-801e-bbf0caa4514d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:57.541227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73c44610-3c95-4a4f-801e-bbf0caa4514d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:57.622790 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-73c44610-3c95-4a4f-801e-bbf0caa4514d tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099519 Oct 01 21:05:57.630315 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2192/3462] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:05:57 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:05:57.637642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:57.641991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:57.651759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:57.652484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:57.653003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:57.653836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:57.655018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:57.655615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:58.413229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:58.426176 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4c7243c6-a90c-4f48-938e-f273632ed138 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 200 len: 1512 microversion: 2.1 time: 0.794435 Oct 01 21:05:58.426986 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2193/3463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:05:57 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 1512 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:05:58.442770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:05:58.443615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:05:58.460336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:58.461064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:58.461505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:58.462386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:05:58.462870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:05:58.463478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:05:59.107375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:59.143402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:59.965469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:59.967962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:05:59.977045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:59.985888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:05:59.988250 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b996a8a-593d-4a29-9046-c282491a3fdd tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 1.560024 Oct 01 21:05:59.991235 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2194/3464] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:05:58 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:00.005732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-35e2e8e7-317d-4024-b44b-06623d10118b req-5e88d39d-0510-4d83-a1f3-43efe4de5c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "tag": "9107bd19-676f-4b6f-ab6d-ea79909a7672"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:00.027823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-35e2e8e7-317d-4024-b44b-06623d10118b req-5e88d39d-0510-4d83-a1f3-43efe4de5c54 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:00.028933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-35e2e8e7-317d-4024-b44b-06623d10118b req-5e88d39d-0510-4d83-a1f3-43efe4de5c54 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:00.029682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-35e2e8e7-317d-4024-b44b-06623d10118b req-5e88d39d-0510-4d83-a1f3-43efe4de5c54 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:00.043844 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-35e2e8e7-317d-4024-b44b-06623d10118b req-5e88d39d-0510-4d83-a1f3-43efe4de5c54 service nova] Creating event network-changed:9107bd19-676f-4b6f-ab6d-ea79909a7672 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:00.050888 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-35e2e8e7-317d-4024-b44b-06623d10118b req-5e88d39d-0510-4d83-a1f3-43efe4de5c54 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057381 Oct 01 21:06:00.051512 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2195/3465] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:00.059237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:00.060907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:00.067758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:00.068585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:00.069594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:00.070598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:00.071281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:00.071914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:01.119623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:01.128457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec258baa-db57-4fd8-a609-533d91722647 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1315 microversion: 2.1 time: 1.075395 Oct 01 21:06:01.129352 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2196/3466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:00 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1315 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:01.133951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aaee23ce-1264-43e0-9edf-6e1d8015e5b6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:01.136422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aaee23ce-1264-43e0-9edf-6e1d8015e5b6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:01.144050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaee23ce-1264-43e0-9edf-6e1d8015e5b6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:01.144709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaee23ce-1264-43e0-9edf-6e1d8015e5b6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:01.145182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaee23ce-1264-43e0-9edf-6e1d8015e5b6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:01.145934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaee23ce-1264-43e0-9edf-6e1d8015e5b6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:01.146422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaee23ce-1264-43e0-9edf-6e1d8015e5b6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:01.146901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaee23ce-1264-43e0-9edf-6e1d8015e5b6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:01.182946 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aaee23ce-1264-43e0-9edf-6e1d8015e5b6 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052613 Oct 01 21:06:01.191150 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2197/3467] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:06:01 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:06:01.201297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a1870268-ff4b-4df5-94ff-851fdb6e8297 req-d8f280a6-d921-45fc-b9fc-ab6e711ecb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2309b08-05db-4a69-9b23-76111e0ee07b", "name": "network-vif-deleted", "tag": "a6a5a067-364e-4ff1-b1a1-979074ecc6b7"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:01.218272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a1870268-ff4b-4df5-94ff-851fdb6e8297 req-d8f280a6-d921-45fc-b9fc-ab6e711ecb88 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:01.218795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a1870268-ff4b-4df5-94ff-851fdb6e8297 req-d8f280a6-d921-45fc-b9fc-ab6e711ecb88 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:01.227592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a1870268-ff4b-4df5-94ff-851fdb6e8297 req-d8f280a6-d921-45fc-b9fc-ab6e711ecb88 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:01.243048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a1870268-ff4b-4df5-94ff-851fdb6e8297 req-d8f280a6-d921-45fc-b9fc-ab6e711ecb88 service nova] Creating event network-vif-deleted:a6a5a067-364e-4ff1-b1a1-979074ecc6b7 for instance d2309b08-05db-4a69-9b23-76111e0ee07b on nch2-master-1 Oct 01 21:06:01.249929 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a1870268-ff4b-4df5-94ff-851fdb6e8297 req-d8f280a6-d921-45fc-b9fc-ab6e711ecb88 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056816 Oct 01 21:06:01.250896 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2198/3468] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:01.280341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:01.283329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:01.290375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:01.291531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:01.292204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:01.293176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:01.293879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:01.300291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:01.330948 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b HTTP/1.1 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd2309b08-05db-4a69-9b23-76111e0ee07b'} Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:01.332631 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0873fc69-7a28-4ded-8ee1-403ab223f8af tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 404 len: 111 microversion: 2.1 time: 0.082049 Oct 01 21:06:01.340281 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2199/3469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:01 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:06:01.349449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:01.350173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:01.356495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:01.357793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:01.358246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:01.359288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:01.359768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:01.360204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:02.429607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:02.458473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:02.464400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:02.469263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64239fc2-61c3-4568-b3f9-fe401420ee57 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 1.131406 Oct 01 21:06:02.470517 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2200/3470] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:01 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:02.479008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:02.486643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:02.504197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:02.504714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:02.506283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:02.507056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:02.507534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:02.511349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:02.556811 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] HTTP exception thrown: Cannot 'reboot' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Request method failure captured: Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63/action HTTP/1.1 Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 28 Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqkgfbc_8hDaJm-zKHvqTb6WWcCcwT0-Bfkvm8f894klqAsv6S6gceYSMqZE_iA9F1ar8j4XUgVkIuKhn9h8Rgo_aMUHe71Q6i1rgQeqhiP7Q24mua9fZcb3yfEC6hkQVWHSn1eqeodqqIny5w_VbZ67CSAF_63x-EWWDMDYONExeM Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10fefee3d6a6430682316cd94b859f1e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}] Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6bda28994cb14f92b014a147a7e74476 Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: {"reboot": {"type": "HARD"}} Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'reboot' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7e0ecd67-d12c-4226-946f-ad9664f38e63', 'body': {'reboot': {'type': 'HARD'}}} Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:06:02.560668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued Oct 01 21:06:02.563932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:02.566228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Returning 409 to user: Cannot 'reboot' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:02.567126 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f5ff8947-8ce5-46bf-9aea-74c40b4aa200 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63/action" status: 409 len: 145 microversion: 2.1 time: 0.095481 Oct 01 21:06:02.572133 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2201/3471] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:06:02 2022] POST /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63/action => generated 145 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:06:02.574242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:02.574911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:02.581939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:02.582430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:02.582913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:02.584062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:02.584062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:02.584477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:03.498339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:03.515294 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f5008f4-8e67-4108-b2f7-4291b8070a90 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.945696 Oct 01 21:06:03.517221 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2202/3472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:02 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:03.535731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:03.542944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:03.549793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:03.550300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:03.550782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:03.551500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:03.551962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:03.552394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:04.061786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:04.070381 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e88a2c42-b6b4-4da8-a32e-cf8eb334be0c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1315 microversion: 2.1 time: 0.551057 Oct 01 21:06:04.082916 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2203/3473] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:03 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:04.082916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c49e0591-34b7-4a6b-8735-29844de54b02 req-f19e877d-acab-468f-bbf6-a2179f71526e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54fe3bb9-900c-45d4-9a78-bc9385c8360f", "tag": "9097b4ab-0be9-4f9e-a0dd-de68a926b982"}, {"name": "network-changed", "server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "tag": "7c63803c-b52f-4b0f-83b4-c88b63b742db"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:04.103604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c49e0591-34b7-4a6b-8735-29844de54b02 req-f19e877d-acab-468f-bbf6-a2179f71526e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:04.104090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c49e0591-34b7-4a6b-8735-29844de54b02 req-f19e877d-acab-468f-bbf6-a2179f71526e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:04.104528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c49e0591-34b7-4a6b-8735-29844de54b02 req-f19e877d-acab-468f-bbf6-a2179f71526e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:04.133556 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c49e0591-34b7-4a6b-8735-29844de54b02 req-f19e877d-acab-468f-bbf6-a2179f71526e service nova] Creating event network-changed:9097b4ab-0be9-4f9e-a0dd-de68a926b982 for instance 54fe3bb9-900c-45d4-9a78-bc9385c8360f on nch1-master-1 Oct 01 21:06:04.134081 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c49e0591-34b7-4a6b-8735-29844de54b02 req-f19e877d-acab-468f-bbf6-a2179f71526e service nova] Creating event network-changed:7c63803c-b52f-4b0f-83b4-c88b63b742db for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:04.152217 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c49e0591-34b7-4a6b-8735-29844de54b02 req-f19e877d-acab-468f-bbf6-a2179f71526e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075377 Oct 01 21:06:04.152808 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2204/3474] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:04.164664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:04.168058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:04.177444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:04.178189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:04.178744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:04.179722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:04.180185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:04.180619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:04.208621 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] HTTP exception thrown: Cannot 'rebuild' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Request method failure captured: Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63/action HTTP/1.1 Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 65 Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqkgfbc_8hDaJm-zKHvqTb6WWcCcwT0-Bfkvm8f894klqAsv6S6gceYSMqZE_iA9F1ar8j4XUgVkIuKhn9h8Rgo_aMUHe71Q6i1rgQeqhiP7Q24mua9fZcb3yfEC6hkQVWHSn1eqeodqqIny5w_VbZ67CSAF_63x-EWWDMDYONExeM Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10fefee3d6a6430682316cd94b859f1e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}] Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6bda28994cb14f92b014a147a7e74476 Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'rebuild' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7e0ecd67-d12c-4226-946f-ad9664f38e63', 'body': {'rebuild': {'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607'}}} Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:04.210474 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued Oct 01 21:06:04.214689 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.217176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Returning 409 to user: Cannot 'rebuild' instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 while it is in vm_state rescued {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:04.218193 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2863938-00e0-4a41-8197-a43e93aa7712 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "POST /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63/action" status: 409 len: 146 microversion: 2.1 time: 0.063706 Oct 01 21:06:04.219336 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2205/3475] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:06:04 2022] POST /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63/action => generated 146 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:06:04.225709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:04.226634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:04.233824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:04.234578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:04.235191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:04.236065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:04.236824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:04.237505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:04.827370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:04.842793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:04.845876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:04.847425 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-25b9fd93-518b-49e3-8c5f-57256e2c0c70 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.626872 Oct 01 21:06:04.848525 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2206/3476] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:04 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:04.866788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5fe8e8ce-2403-4006-87d7-5a88190a7744 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5fe8e8ce-2403-4006-87d7-5a88190a7744 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 163 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": 12345, "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 12345 Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:06:04.875441 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 01 21:06:04.879860 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:04.882858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5fe8e8ce-2403-4006-87d7-5a88190a7744 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:04.883902 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5fe8e8ce-2403-4006-87d7-5a88190a7744 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.034205 Oct 01 21:06:04.884956 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2207/3477] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:04 2022] POST /compute/v2.1/servers => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:06:04.890419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:04.891323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:04.910169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:04.910943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:04.911537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:04.912451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:04.913333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:04.914045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:04.943791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:06:05.104621 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f95a659-55f1-4baa-961a-8d161224e599 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 204 len: 0 microversion: 2.1 time: 0.218220 Oct 01 21:06:05.106148 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2208/3478] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:06:04 2022] DELETE /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:06:05.119297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:05.120174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:05.127312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:05.128195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:05.128816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:05.129534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:05.130168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:05.131256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:05.718591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:05.727518 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76dbef68-3d85-4deb-97f9-3e37d072b602 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.619445 Oct 01 21:06:05.728124 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2209/3479] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:05 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:05.753323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:05.754231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:05.760887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:05.761619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:05.762289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:05.763233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:05.763845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:05.764419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:06.601892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:06.650411 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60970711-2d34-4801-82b7-9eb3e0723ab4 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1315 microversion: 2.1 time: 0.904426 Oct 01 21:06:06.662840 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2210/3480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:05 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:06.668298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:06.672431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:06.692460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:06.692972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:06.694906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:06.698588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:06.699258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:06.699855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:07.323554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:07.336093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-074700fd-4375-4a70-874a-9884ab5fa724 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1689 microversion: 2.1 time: 0.674109 Oct 01 21:06:07.336690 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2211/3481] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:06 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1689 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:07.353520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:07.354585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:07.367244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:07.370041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:07.370714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:07.371608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:07.373322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:07.373767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:07.734709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:07.743894 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ca9f41a-0b5c-48d1-ac0b-7f2ac296b10e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.400399 Oct 01 21:06:07.747785 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2212/3482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:07 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:07.798339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:07.803664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:07.816208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:07.839545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:07.840395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:07.844624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:07.849238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:07.851334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:07.851882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:08.787501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:08.801166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:08.806649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:08.819119 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec8162f8-7b7f-4082-ae77-243b67d4738d tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 1.034805 Oct 01 21:06:08.820910 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2213/3483] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:07 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:08.838765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e2fb43cd-ca80-4e69-b494-f43b9ee0a71b req-3217ebde-0118-404a-acae-4e7b2246f84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "tag": "fb0092f2-a3d1-47ee-9275-921730efb7ec"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:08.897970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e2fb43cd-ca80-4e69-b494-f43b9ee0a71b req-3217ebde-0118-404a-acae-4e7b2246f84c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:08.898716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e2fb43cd-ca80-4e69-b494-f43b9ee0a71b req-3217ebde-0118-404a-acae-4e7b2246f84c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:08.899174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e2fb43cd-ca80-4e69-b494-f43b9ee0a71b req-3217ebde-0118-404a-acae-4e7b2246f84c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:08.913741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:08.941452 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e2fb43cd-ca80-4e69-b494-f43b9ee0a71b req-3217ebde-0118-404a-acae-4e7b2246f84c service nova] Creating event network-changed:fb0092f2-a3d1-47ee-9275-921730efb7ec for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:08.956577 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e2fb43cd-ca80-4e69-b494-f43b9ee0a71b req-3217ebde-0118-404a-acae-4e7b2246f84c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129154 Oct 01 21:06:08.960712 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2214/3484] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:08.977021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:08.977919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:08.993829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:08.996355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:08.997020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:08.999119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:08.999759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:09.000498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:09.380974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:09.390978 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a8af7024-a94e-43bd-8f6e-d0320fd4b88d tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1315 microversion: 2.1 time: 0.427491 Oct 01 21:06:09.391575 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2215/3485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:08 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:09.413846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:09.414474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:09.449347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:09.449922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:09.450426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:09.451206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:09.451676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:09.452101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:09.913468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:09.941105 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5f897d51-3cc9-402b-ac3e-947b8f95b482 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1689 microversion: 2.1 time: 0.538623 Oct 01 21:06:09.942251 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2216/3486] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:09 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1689 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:09.959322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a32b19b5-7984-4c4b-9c7a-8d293feef372 req-7d0e90ad-b4ef-4f84-81ea-29330ef2098f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fe3bb9-900c-45d4-9a78-bc9385c8360f", "name": "network-vif-plugged", "status": "completed", "tag": "9097b4ab-0be9-4f9e-a0dd-de68a926b982"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:09.993229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a32b19b5-7984-4c4b-9c7a-8d293feef372 req-7d0e90ad-b4ef-4f84-81ea-29330ef2098f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:09.994769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a32b19b5-7984-4c4b-9c7a-8d293feef372 req-7d0e90ad-b4ef-4f84-81ea-29330ef2098f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:09.998196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a32b19b5-7984-4c4b-9c7a-8d293feef372 req-7d0e90ad-b4ef-4f84-81ea-29330ef2098f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:10.041682 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a32b19b5-7984-4c4b-9c7a-8d293feef372 req-7d0e90ad-b4ef-4f84-81ea-29330ef2098f service nova] Creating event network-vif-plugged:9097b4ab-0be9-4f9e-a0dd-de68a926b982 for instance 54fe3bb9-900c-45d4-9a78-bc9385c8360f on nch1-master-1 Oct 01 21:06:10.057430 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a32b19b5-7984-4c4b-9c7a-8d293feef372 req-7d0e90ad-b4ef-4f84-81ea-29330ef2098f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114366 Oct 01 21:06:10.058374 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2217/3487] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:10.077471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a32b19b5-7984-4c4b-9c7a-8d293feef372 req-7d0e90ad-b4ef-4f84-81ea-29330ef2098f service nova] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:10.080038 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a32b19b5-7984-4c4b-9c7a-8d293feef372 req-7d0e90ad-b4ef-4f84-81ea-29330ef2098f service nova] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.020508 Oct 01 21:06:10.080625 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2218/3488] 10.222.0.17 () {56 vars in 886 bytes} [Sat Oct 1 21:06:10 2022] GET /compute/ => generated 377 bytes in 22 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 01 21:06:10.087031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:10.088293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:10.098040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:10.110848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:10.111441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:10.114263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:10.115433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:10.116047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:10.705489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:10.719946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:10.724554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:10.729428 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.644919 Oct 01 21:06:10.730543 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2219/3489] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:10 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:10.732525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:10.733950 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf0b90d9-a135-4978-ac0a-6a63bdd45110 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002384 Oct 01 21:06:10.739248 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2220/3490] 10.222.0.17 () {54 vars in 1035 bytes} [Sat Oct 1 21:06:10 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 01 21:06:10.754484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94886138-7732-4dc0-8149-607d57d11047 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1143758004", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b4cffd31-a74b-413e-8ab4-983abfe9b5c2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:10.883062 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-94886138-7732-4dc0-8149-607d57d11047 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Block Device b4cffd31-a74b-413e-8ab4-983abfe9b5c2 is not bootable. Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94886138-7732-4dc0-8149-607d57d11047 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 358 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1143758004", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b4cffd31-a74b-413e-8ab4-983abfe9b5c2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: exception: Block Device b4cffd31-a74b-413e-8ab4-983abfe9b5c2 is not bootable. Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1143758004', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'b4cffd31-a74b-413e-8ab4-983abfe9b5c2'}], 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device b4cffd31-a74b-413e-8ab4-983abfe9b5c2 is not bootable. Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:10.895131 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device b4cffd31-a74b-413e-8ab4-983abfe9b5c2 is not bootable. Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device b4cffd31-a74b-413e-8ab4-983abfe9b5c2 is not bootable. Oct 01 21:06:10.900221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:10.908887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94886138-7732-4dc0-8149-607d57d11047 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Block Device b4cffd31-a74b-413e-8ab4-983abfe9b5c2 is not bootable. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:10.920157 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94886138-7732-4dc0-8149-607d57d11047 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.169369 Oct 01 21:06:10.922376 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2221/3491] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:06:10.938713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:10.939359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:10.956609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:10.957131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:10.957586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:10.960526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:10.961049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:10.961479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:11.241396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:11.254156 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1315 microversion: 2.1 time: 0.329702 Oct 01 21:06:11.255464 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2222/3492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:10 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:11.256927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:11.258047 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5eb866e2-46db-4bc9-9e8e-48cef83b35ae tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001405 Oct 01 21:06:11.260707 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2223/3493] 10.222.0.17 () {54 vars in 1041 bytes} [Sat Oct 1 21:06:11 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:11.271294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:11.272266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:11.280704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:11.281342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:11.282253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:11.283034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:11.283544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:11.284219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:11.554768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:11.566875 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-daf231f5-9369-4091-8fa8-f6861ce5bf26 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.304978 Oct 01 21:06:11.567947 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2224/3494] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:11 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:11.585108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:11.585732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:11.606858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:11.607364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:11.607806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:11.608552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:11.609187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:11.609685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:11.925682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:11.941518 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 200 len: 1689 microversion: 2.1 time: 0.367379 Oct 01 21:06:11.943865 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2225/3495] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:11 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 1689 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:11.944880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:11.946791 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7201760-ef67-44ce-b327-1df33b481ccc tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001108 Oct 01 21:06:11.947569 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2226/3496] 10.222.0.17 () {56 vars in 886 bytes} [Sat Oct 1 21:06:11 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 01 21:06:11.954117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:11.955298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:11.967406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:11.968185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:11.968899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:11.980958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:11.982471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:11.983683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:12.488674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:12.502084 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8aff069b-e9ab-42b6-a991-88a1f72deb3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.553088 Oct 01 21:06:12.503043 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2227/3497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:11 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:12.516145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:12.516795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:12.524964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:12.525980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:12.526608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:12.527499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:12.528131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:12.529266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:13.675397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:13.695273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:13.699261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:13.703571 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-225e60c8-0aab-4e86-a1a5-ad472d41fa19 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 1.196792 Oct 01 21:06:13.705063 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2228/3498] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:12 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:13.721401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:13.723659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:13.746290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:13.746887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:13.747870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:13.752037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:13.753384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:13.755737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:14.728511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:14.743144 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ece599d-714b-44f5-9714-7da0550fde34 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1503 microversion: 2.1 time: 1.033785 Oct 01 21:06:14.745510 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2229/3499] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:13 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1503 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:14.773455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-344d2685-4a98-4ea5-aaa6-0b228d146386 req-3a09e0c1-9d04-432f-87ca-20666436242c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "681e3cb8-3fd1-41d6-8681-ee4f858ca452", "name": "network-vif-deleted", "tag": "1840c72f-c980-4053-8e6e-8177499de115"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:14.795103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-344d2685-4a98-4ea5-aaa6-0b228d146386 req-3a09e0c1-9d04-432f-87ca-20666436242c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:14.796476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-344d2685-4a98-4ea5-aaa6-0b228d146386 req-3a09e0c1-9d04-432f-87ca-20666436242c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:14.798052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-344d2685-4a98-4ea5-aaa6-0b228d146386 req-3a09e0c1-9d04-432f-87ca-20666436242c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:14.824957 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-344d2685-4a98-4ea5-aaa6-0b228d146386 req-3a09e0c1-9d04-432f-87ca-20666436242c service nova] Creating event network-vif-deleted:1840c72f-c980-4053-8e6e-8177499de115 for instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 on nch2-master-1 Oct 01 21:06:14.833376 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-344d2685-4a98-4ea5-aaa6-0b228d146386 req-3a09e0c1-9d04-432f-87ca-20666436242c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070690 Oct 01 21:06:14.838663 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2230/3500] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:14.850648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:14.852821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 681e3cb8-3fd1-41d6-8681-ee4f858ca452] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:14.865807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:14.867603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:14.875367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:14.876616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:14.877400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:14.878184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:14.895762 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] HTTP exception thrown: Instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 could not be found. Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Request method failure captured: Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 HTTP/1.1 Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqkgfbc_8hDaJm-zKHvqTb6WWcCcwT0-Bfkvm8f894klqAsv6S6gceYSMqZE_iA9F1ar8j4XUgVkIuKhn9h8Rgo_aMUHe71Q6i1rgQeqhiP7Q24mua9fZcb3yfEC6hkQVWHSn1eqeodqqIny5w_VbZ67CSAF_63x-EWWDMDYONExeM Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10fefee3d6a6430682316cd94b859f1e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}] Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6bda28994cb14f92b014a147a7e74476 Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 could not be found. Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '681e3cb8-3fd1-41d6-8681-ee4f858ca452'} Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 could not be found. Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 could not be found. Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:14.898386 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:14.903579 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:14.903579 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:14.903579 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:14.903579 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:14.903579 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:14.903579 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:14.903579 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 could not be found. Oct 01 21:06:14.903579 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:14.907124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Returning 404 to user: Instance 681e3cb8-3fd1-41d6-8681-ee4f858ca452 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:14.908057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b154583a-1f04-476e-8668-6fac5903ffe2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452" status: 404 len: 111 microversion: 2.1 time: 0.067919 Oct 01 21:06:14.908661 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2231/3501] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:14 2022] GET /compute/v2.1/servers/681e3cb8-3fd1-41d6-8681-ee4f858ca452 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:06:15.470095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82434fe0-9a10-4baa-b20f-8051cd2e2004 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f417c18d430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1566802938", "description": "tempest-description-738905071"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:16.306676 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82434fe0-9a10-4baa-b20f-8051cd2e2004 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.395272 Oct 01 21:06:16.308212 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2232/3502] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:06:14 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:16.316793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1cad82c2-87c1-4107-be9a-84d923bc97ea tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1963210218", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "90f3f35e-76ec-4c31-b581-329b315fe607", "destination_type": "local"}, {"source_type": "volume", "uuid": "d8c8f504-1bc5-41c3-a943-9b0b432fa269", "destination_type": "invalid"}], "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1cad82c2-87c1-4107-be9a-84d923bc97ea tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 495 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1963210218", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "90f3f35e-76ec-4c31-b581-329b315fe607", "destination_type": "local"}, {"source_type": "volume", "uuid": "d8c8f504-1bc5-41c3-a943-9b0b432fa269", "destination_type": "invalid"}], "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1963210218', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '90f3f35e-76ec-4c31-b581-329b315fe607', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd8c8f504-1bc5-41c3-a943-9b0b432fa269', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'invalid' Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:16.327540 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:16.331454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1cad82c2-87c1-4107-be9a-84d923bc97ea tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:16.336551 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1cad82c2-87c1-4107-be9a-84d923bc97ea tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019438 Oct 01 21:06:16.338965 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2233/3503] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:16 2022] POST /compute/v2.1/servers => generated 155 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:06:16.351442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:16.353796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:16.374621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:16.375130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:16.375878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:16.376841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:16.377872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:16.378822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:16.749267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:16.765342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:16.767370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:16.768787 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c6abfe18-4eb8-4aa7-993e-703d03ce084b tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.428690 Oct 01 21:06:16.771278 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2234/3504] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:16 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:16.776864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:16.777713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:16.785219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:16.785992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:16.786627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:16.787573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:16.788376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:16.788959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:17.124739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:17.136502 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f95a843-4e11-4acb-aaf1-0f7f4289fed8 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1503 microversion: 2.1 time: 0.363818 Oct 01 21:06:17.141430 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2235/3505] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:16 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1503 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:17.157978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff9ed06b-8f72-4f81-b0fb-67304dfe6513 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '.version_select at 0x7f4172a9a310>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:17.205385 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff9ed06b-8f72-4f81-b0fb-67304dfe6513 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657777837" status: 202 len: 0 microversion: 2.1 time: 0.062438 Oct 01 21:06:17.210336 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2236/3506] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 21:06:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657777837 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:17.225810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a16dcffe-6ee2-4404-a986-b54a61aed558 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f4172b32d30>, body: {"security_group_rule": {"parent_group_id": "24e468e4-8b71-4bdd-b8bb-29a7ef4a3255", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:18.598773 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a16dcffe-6ee2-4404-a986-b54a61aed558 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.387394 Oct 01 21:06:18.599438 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2237/3507] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:06:17 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:18.604510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:18.605296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:18.621108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:18.621511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:18.622726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:18.623487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:18.623963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:18.628459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:18.871372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:18.893730 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bee7333c-f2ce-421a-88a8-ee5181cba78c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.293076 Oct 01 21:06:18.914998 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2238/3508] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:18 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:18.914998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:18.914998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:18.914998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:18.914998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:18.916768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:18.932982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:18.933664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:18.935220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:19.000778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lazy-loading 'flavor' on Instance uuid 54fe3bb9-900c-45d4-9a78-bc9385c8360f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:06:19.129840 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-41ea6f65-7ab5-4efc-bf1d-8f5f7a07b1db tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "POST /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f/action" status: 202 len: 0 microversion: 2.1 time: 0.226589 Oct 01 21:06:19.131353 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2239/3509] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:06:18 2022] POST /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:19.138065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:19.139430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:19.147564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:19.148225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:19.149290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:19.150344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:19.151180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:19.151903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:20.130091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:20.132984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:20.152133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:20.159027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:20.160266 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0d200fe7-88fc-4a32-8cf5-c992cadedef3 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 1.027451 Oct 01 21:06:20.161175 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2240/3510] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:19 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:20.166211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5cadbfac-d4f3-4252-8b43-b7101ee0ed67 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f4172aacb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1271330404", "description": "tempest-description-297494043"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:20.943518 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5cadbfac-d4f3-4252-8b43-b7101ee0ed67 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.780297 Oct 01 21:06:20.945320 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2241/3511] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:06:20 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:20.954876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:20.956732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:20.990289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:20.991700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:20.994022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:20.994924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:20.996835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:20.997531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:22.193877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:22.205177 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6bb7e30-84f8-45be-9ae3-5fa6cbdb8cff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 1.258406 Oct 01 21:06:22.206333 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2242/3512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:20 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:22.228554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:22.231280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:22.245170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:22.245823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:22.246273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:22.247722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:22.248334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:22.248774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:22.604965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:22.620933 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5b4d63c7-30b4-470d-8f97-8daa680696a3 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1494 microversion: 2.1 time: 0.410959 Oct 01 21:06:22.623212 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2243/3513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:22 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1494 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:22.629420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6e6c55cc-68d6-4ef5-912b-14f1bb84aefe tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f417c289dc0>, body: {"security_group_rule": {"parent_group_id": "4fdfe9d3-a8af-46f2-94f2-7546ea9c245c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:23.191272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6e6c55cc-68d6-4ef5-912b-14f1bb84aefe tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.566628 Oct 01 21:06:23.194738 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2244/3514] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:06:22 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:23.210636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:23.211535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:23.229167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:23.230311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:23.231837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:23.233299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:23.234478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:23.235972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:23.813632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:23.836022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:23.841577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:23.865381 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0c05ff62-858e-4aa9-8911-404feb94ded6 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.668971 Oct 01 21:06:23.867283 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2245/3515] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:23 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:23.892548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:23.893807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:23.912641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:23.913848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:23.914888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:23.916163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:23.916933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:23.917605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:24.048648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:06:24.169465 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-baf9d5e3-fbaa-4acf-90c3-0cb0928b04b0 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 204 len: 0 microversion: 2.1 time: 0.293594 Oct 01 21:06:24.171564 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2246/3516] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:06:23 2022] DELETE /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:06:24.189876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ffa1676e-55c8-4bc5-bee6-62cfcdb6f61c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1377184216", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ffa1676e-55c8-4bc5-bee6-62cfcdb6f61c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 492 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1377184216", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1377184216', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:24.208076 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ffa1676e-55c8-4bc5-bee6-62cfcdb6f61c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ffa1676e-55c8-4bc5-bee6-62cfcdb6f61c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.035752 Oct 01 21:06:24.214123 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2247/3517] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:24 2022] POST /compute/v2.1/servers => generated 624 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:06:24.235217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa7d2ccc-898f-4ce2-bcd7-47f7fa1b7f13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:24.235911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aa7d2ccc-898f-4ce2-bcd7-47f7fa1b7f13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:24.247339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa7d2ccc-898f-4ce2-bcd7-47f7fa1b7f13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:24.247870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa7d2ccc-898f-4ce2-bcd7-47f7fa1b7f13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:24.248318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa7d2ccc-898f-4ce2-bcd7-47f7fa1b7f13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:24.249512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa7d2ccc-898f-4ce2-bcd7-47f7fa1b7f13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:24.249986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa7d2ccc-898f-4ce2-bcd7-47f7fa1b7f13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:24.250425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa7d2ccc-898f-4ce2-bcd7-47f7fa1b7f13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:24.419398 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aa7d2ccc-898f-4ce2-bcd7-47f7fa1b7f13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "POST /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f/action" status: 202 len: 0 microversion: 2.1 time: 0.203214 Oct 01 21:06:24.420467 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2248/3518] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:06:24 2022] POST /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:24.429249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f708c47-972b-4d3e-8175-1e7dcfe1d7cd tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f4172b76e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1217536292", "description": "tempest-description-1746851145"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:24.872626 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f708c47-972b-4d3e-8175-1e7dcfe1d7cd tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.450313 Oct 01 21:06:24.873824 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2249/3519] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:06:24 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:25.292467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:25.293313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:25.307042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:25.307782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:25.308334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:25.309781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:25.310628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:25.311490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:25.768829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:25.777376 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-66cdd4c7-bb21-43c9-b9ea-b33e0ac0f0e2 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1507 microversion: 2.1 time: 0.902194 Oct 01 21:06:25.778893 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2250/3520] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:24 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1507 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:25.791928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:25.794584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:25.809120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:25.814756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:25.815651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:25.816705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:25.818705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:25.819350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:26.052192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:26.066168 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-83f314b3-703c-4f48-9ca3-9f4ccbb64c7f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.285828 Oct 01 21:06:26.067499 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2251/3521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:25 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:26.075747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:26.081660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:26.119928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:26.125835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:26.127246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:26.129938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:26.131219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:26.133852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:26.486624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:26.506903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8c39e9b4-6b86-4eee-abfd-d805699db64c tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1500 microversion: 2.1 time: 0.437418 Oct 01 21:06:26.513027 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2252/3522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:26 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1500 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:26.529074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6f65387-ded6-4aff-88a2-eef9762cd85f tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f4172f76310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-281111333", "description": "tempest-description-111326318"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:26.867173 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d6f65387-ded6-4aff-88a2-eef9762cd85f tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.353041 Oct 01 21:06:26.867969 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2253/3523] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:06:26 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:26.873356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:26.874112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:26.892283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:26.892801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:26.893249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:26.894151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:26.894799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:26.895490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:27.216184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:27.233772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:27.237891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:27.241013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b95b3238-44c5-4b7e-997f-c0150292df39 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.371411 Oct 01 21:06:27.244010 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2254/3524] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:26 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:27.255923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:27.257463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:27.275053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:27.275911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:27.276887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:27.278051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:27.279622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:27.280379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:27.627268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:27.639213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e0e54c16-e645-438a-b963-f2c6625a7eca tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.393733 Oct 01 21:06:27.651988 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2255/3525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:27 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:27.668082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:27.668757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:27.685332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:27.685847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:27.687530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:27.688614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:27.691533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:27.692210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:27.966006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:27.977213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7aec8a3-3d5c-4e7e-8b94-5e11ef2f6eca tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 200 len: 1507 microversion: 2.1 time: 0.321105 Oct 01 21:06:27.982189 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2256/3526] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:27 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:27.991895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f2a8085-7589-4cb6-911b-b8b531d60344 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f41730a70d0>, body: {"security_group_rule": {"parent_group_id": "e9733e2f-0339-484c-88e4-b5929713dc6f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "cf570081-1ebd-4d0d-8850-6fad223de988"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:28.399324 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f2a8085-7589-4cb6-911b-b8b531d60344 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.413411 Oct 01 21:06:28.410357 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2257/3527] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:06:27 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:28.415692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:28.416338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:28.424987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:28.426181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:28.426181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:28.427279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:28.427657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:28.428460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:29.113330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:29.130027 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-be81d37d-e7d1-4baa-900f-b02611294d78 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1503 microversion: 2.1 time: 0.718173 Oct 01 21:06:29.130692 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2258/3528] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:28 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1503 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:29.144347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa548e27-42a9-400d-b2e9-e3e2d8544f46 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa548e27-42a9-400d-b2e9-e3e2d8544f46 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 416 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:29.154917 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:06:29.158321 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:29.161026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa548e27-42a9-400d-b2e9-e3e2d8544f46 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:29.169892 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aa548e27-42a9-400d-b2e9-e3e2d8544f46 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.035252 Oct 01 21:06:29.171163 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2259/3529] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:29 2022] POST /compute/v2.1/servers => generated 619 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:06:29.209285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:29.209931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:29.234188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:29.234734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:29.235189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:29.236113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:29.236591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:29.237030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:29.785836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:29.802666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:29.804429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:29.806081 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6df87e2e-63b5-4821-8827-75bb2b17406e tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.625189 Oct 01 21:06:29.811356 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2260/3530] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:29 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:29.818291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-940c3cb8-8095-4295-a81c-0d3921589b72 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f4172b32820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-280384579", "description": "tempest-description-1571130510"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:30.726837 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-940c3cb8-8095-4295-a81c-0d3921589b72 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.913998 Oct 01 21:06:30.727504 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2261/3531] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:06:29 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:30.746008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9059d7f5-687c-44f6-8745-ad52dc53a7cb req-16e7844b-79f0-4bdd-919a-d2ff582efdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0ecd67-d12c-4226-946f-ad9664f38e63", "name": "network-vif-deleted", "tag": "3561d0f4-806f-4f37-9e89-bd72c7be656f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:30.793652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9059d7f5-687c-44f6-8745-ad52dc53a7cb req-16e7844b-79f0-4bdd-919a-d2ff582efdd8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:30.800388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9059d7f5-687c-44f6-8745-ad52dc53a7cb req-16e7844b-79f0-4bdd-919a-d2ff582efdd8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:30.801110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9059d7f5-687c-44f6-8745-ad52dc53a7cb req-16e7844b-79f0-4bdd-919a-d2ff582efdd8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:30.846046 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9059d7f5-687c-44f6-8745-ad52dc53a7cb req-16e7844b-79f0-4bdd-919a-d2ff582efdd8 service nova] Creating event network-vif-deleted:3561d0f4-806f-4f37-9e89-bd72c7be656f for instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 on nch2-master-1 Oct 01 21:06:30.857430 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9059d7f5-687c-44f6-8745-ad52dc53a7cb req-16e7844b-79f0-4bdd-919a-d2ff582efdd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128383 Oct 01 21:06:30.858549 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2262/3532] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:30.872601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:30.873567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 7e0ecd67-d12c-4226-946f-ad9664f38e63] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:30.881697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:30.882461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:30.883128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:30.884034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:30.884977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:30.885582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:30.904133 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] HTTP exception thrown: Instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 could not be found. Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Request method failure captured: Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 HTTP/1.1 Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqkgfbc_8hDaJm-zKHvqTb6WWcCcwT0-Bfkvm8f894klqAsv6S6gceYSMqZE_iA9F1ar8j4XUgVkIuKhn9h8Rgo_aMUHe71Q6i1rgQeqhiP7Q24mua9fZcb3yfEC6hkQVWHSn1eqeodqqIny5w_VbZ67CSAF_63x-EWWDMDYONExeM Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10fefee3d6a6430682316cd94b859f1e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}] Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6bda28994cb14f92b014a147a7e74476 Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 could not be found. Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7e0ecd67-d12c-4226-946f-ad9664f38e63'} Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 could not be found. Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 could not be found. Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:30.906570 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:30.910455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:30.910455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:30.910455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:30.910455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:30.910455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:30.910455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:30.910455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 could not be found. Oct 01 21:06:30.910455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:30.912007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Returning 404 to user: Instance 7e0ecd67-d12c-4226-946f-ad9664f38e63 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:30.913120 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-267f9867-48ca-47d1-a6ff-b058db56d558 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63" status: 404 len: 111 microversion: 2.1 time: 0.050770 Oct 01 21:06:30.914288 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2263/3533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:30 2022] GET /compute/v2.1/servers/7e0ecd67-d12c-4226-946f-ad9664f38e63 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:06:30.924034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:30.924834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:30.932198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:30.932978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:30.933576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:30.935090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:30.935971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:30.936568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:30.968389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:30.973174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lazy-loading 'flavor' on Instance uuid 54fe3bb9-900c-45d4-9a78-bc9385c8360f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:06:31.098791 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5632f22a-ea9e-4fef-9a81-2fbafd62b257 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "POST /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f/action" status: 202 len: 0 microversion: 2.1 time: 0.177082 Oct 01 21:06:31.107051 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2264/3534] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:06:30 2022] POST /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:31.116974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:31.117992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:31.126515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:31.127339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:31.127982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:31.128955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:31.129591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:31.130025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:31.565370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:31.577726 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7521ce0f-2b78-4678-8d16-e7984ca1f864 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.469317 Oct 01 21:06:31.586048 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2265/3535] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:31 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:31.848832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9948b463-a008-4f2b-bdaf-81366d35e6a8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'create', calling method: .version_select at 0x7f417c2ec820>, body: {"keypair": {"name": "tempest-keypair-1865114026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl4azGUcb5+u7ZBvDT4oOrAzCzYU0cTktXfhMzFORjIt3xU9DZGfsgiGPJ/D/OQinME7/qfBCz6VN5XZYtC6rJNLS8eBDBYfKFU1N4MVCCy/3tOS0idQBL+Q1k1UyUc4A=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:31.876860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9948b463-a008-4f2b-bdaf-81366d35e6a8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Getting quotas for project 0b5bb0c08a5145369fc64e13d190c988. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:06:31.891489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9948b463-a008-4f2b-bdaf-81366d35e6a8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Getting quotas for user f74f251052ee4c9a99db0c43bc00da9f and project 0b5bb0c08a5145369fc64e13d190c988. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:06:31.940219 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9948b463-a008-4f2b-bdaf-81366d35e6a8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.352730 Oct 01 21:06:31.941371 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2266/3536] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:06:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:31.968129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d287dc43-5d5a-4fe8-ad01-c6b2d3dfc9ba tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f4172b62550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1992080601", "description": "tempest-description-772425540"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:32.510879 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d287dc43-5d5a-4fe8-ad01-c6b2d3dfc9ba tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.568246 Oct 01 21:06:32.511741 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2267/3537] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:06:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:32.525281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:32.526104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:32.559400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:32.560242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:32.563052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:32.564070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:32.564754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:32.565423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:33.093332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:33.159019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:33.160567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:33.161816 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c454e210-dd7e-4be8-a55e-d608a151fec4 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.640851 Oct 01 21:06:33.167124 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2268/3538] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:32 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:33.173320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:33.174159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:33.182172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:33.182917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:33.183615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:33.185108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:33.185737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:33.186445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:33.264263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:06:33.382020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:33.422733 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-799d4455-0109-4d6a-a359-bc6ac8d59c3f tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 204 len: 0 microversion: 2.1 time: 0.252850 Oct 01 21:06:33.423658 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2269/3539] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:06:33 2022] DELETE /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:06:33.433960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:33.435165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:33.445690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:33.446671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:33.451594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:33.452762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:33.454211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:33.455853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:33.888623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:33.900049 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cff3a250-7822-4c68-889e-06944e18e8ee tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1494 microversion: 2.1 time: 0.474919 Oct 01 21:06:33.903200 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2270/3540] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:33 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1494 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:33.915531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:33.917064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:33.932631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:33.939105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:33.939620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:33.940400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:33.940890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:33.941339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:34.241648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:34.255091 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2fa971cd-2531-480c-9b9f-9018baec678b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.350773 Oct 01 21:06:34.256742 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2271/3541] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:33 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:34.263883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c3e19e9-4b56-4cce-afdd-27578e7dd179 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f417c2ec8b0>, body: {"security_group_rule": {"parent_group_id": "18ff4644-0dc2-4bb4-8ca4-97afbf07ebad", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bab659c1-13c3-453e-a77d-84041e8d6190"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:34.932271 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4c3e19e9-4b56-4cce-afdd-27578e7dd179 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.674163 Oct 01 21:06:34.933139 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2272/3542] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:06:34 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:34.940360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:34.941255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:34.948639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:34.949986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:34.950685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:34.951639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:34.952252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:34.952853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:35.188751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda28994cb14f92b014a147a7e74476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fefee3d6a6430682316cd94b859f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:35.204303 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7eeb4ab7-374e-4400-a3dc-b9fb4fddf7fa tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 200 len: 1521 microversion: 2.1 time: 0.268683 Oct 01 21:06:35.218863 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2273/3543] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:34 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:35.218863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c3cfbb88-8493-4778-a7cf-8ee359cb1331 req-bd3c49da-2aa3-4484-8fbe-9e9a1390ffa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-plugged", "status": "completed", "tag": "9107bd19-676f-4b6f-ab6d-ea79909a7672"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:35.238612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c3cfbb88-8493-4778-a7cf-8ee359cb1331 req-bd3c49da-2aa3-4484-8fbe-9e9a1390ffa9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:35.239224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c3cfbb88-8493-4778-a7cf-8ee359cb1331 req-bd3c49da-2aa3-4484-8fbe-9e9a1390ffa9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:35.239915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c3cfbb88-8493-4778-a7cf-8ee359cb1331 req-bd3c49da-2aa3-4484-8fbe-9e9a1390ffa9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:35.256889 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c3cfbb88-8493-4778-a7cf-8ee359cb1331 req-bd3c49da-2aa3-4484-8fbe-9e9a1390ffa9 service nova] Creating event network-vif-plugged:9107bd19-676f-4b6f-ab6d-ea79909a7672 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:35.263668 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c3cfbb88-8493-4778-a7cf-8ee359cb1331 req-bd3c49da-2aa3-4484-8fbe-9e9a1390ffa9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056414 Oct 01 21:06:35.265961 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2274/3544] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:35.274555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9747243d-0346-4f75-8de1-1fe2021d3d6e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:35.275322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9747243d-0346-4f75-8de1-1fe2021d3d6e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:35.283287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9747243d-0346-4f75-8de1-1fe2021d3d6e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:35.283980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9747243d-0346-4f75-8de1-1fe2021d3d6e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:35.284633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9747243d-0346-4f75-8de1-1fe2021d3d6e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:35.285509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9747243d-0346-4f75-8de1-1fe2021d3d6e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:35.286129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9747243d-0346-4f75-8de1-1fe2021d3d6e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:35.286717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9747243d-0346-4f75-8de1-1fe2021d3d6e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:35.366697 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9747243d-0346-4f75-8de1-1fe2021d3d6e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "POST /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f/action" status: 202 len: 0 microversion: 2.1 time: 0.099021 Oct 01 21:06:35.367513 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2275/3545] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:06:35 2022] POST /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:35.374716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:35.375790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:35.384719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:35.385861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:35.386879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:35.387846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:35.388917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:35.389455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:35.924538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:35.937634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:35.952132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:35.953405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c67e9458-276d-41cc-bcaf-0516028e8832 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.584524 Oct 01 21:06:35.953990 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2276/3546] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:35 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:35.959496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b560ad77-8617-4a52-9f10-b231717eff98 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-13333888", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": -1, "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:35.984905 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b560ad77-8617-4a52-9f10-b231717eff98 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Flavor -1 could not be found. Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b560ad77-8617-4a52-9f10-b231717eff98 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 204 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-13333888", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": -1, "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: exception: Flavor -1 could not be found. Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-13333888', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': -1, 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:36.003619 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 01 21:06:36.007995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:36.010042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b560ad77-8617-4a52-9f10-b231717eff98 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:36.011137 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b560ad77-8617-4a52-9f10-b231717eff98 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.055671 Oct 01 21:06:36.012588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2277/3547] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:35 2022] POST /compute/v2.1/servers => generated 73 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 21:06:36.022382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1055659957", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7829a3e2-b2da-4a9b-86e1-6df7525abb9a"}], "security_groups": [{"name": "tempest-securitygroup--782987922"}], "key_name": "tempest-keypair-1865114026", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:36.276233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] validate_networks() for [('7829a3e2-b2da-4a9b-86e1-6df7525abb9a', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:06:37.946878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:06:37.948404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:06:37.948743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:06:37.950012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:06:37.950706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:06:37.969085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:37.969919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:37.970582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:37.971763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:37.973118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:37.973796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:38.012510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Getting quotas for project 0b5bb0c08a5145369fc64e13d190c988. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:06:38.018727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Getting quotas for user f74f251052ee4c9a99db0c43bc00da9f and project 0b5bb0c08a5145369fc64e13d190c988. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:06:38.053616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:06:38.060680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:06:38.156046 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a4dd965-d53f-4b8b-bda5-5d2d39e5ba49 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.142003 Oct 01 21:06:38.157324 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2278/3548] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:06:38.163413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8829ad02-b552-4c80-8f41-32aa8234afba tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172a9a160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:38.959494 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8829ad02-b552-4c80-8f41-32aa8234afba tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/bab659c1-13c3-453e-a77d-84041e8d6190" status: 202 len: 0 microversion: 2.1 time: 0.800593 Oct 01 21:06:38.961309 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2279/3549] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:06:38 2022] DELETE /compute/v2.1/os-security-groups/bab659c1-13c3-453e-a77d-84041e8d6190 => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:38.969990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:38.970888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:38.987404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:38.987915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:38.988365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:38.992375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:38.994165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:38.994658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:39.305551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:39.321434 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6271ee85-3353-4662-8c5c-c5f1555d3071 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1503 microversion: 2.1 time: 0.358861 Oct 01 21:06:39.327747 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2280/3550] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:38 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:39.350558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:39.351509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:39.358634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:39.359488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:39.360142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:39.361086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:39.362148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:39.362839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:39.867600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:39.881002 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-31bab958-43be-4140-a60f-dfb7f529d103 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.535775 Oct 01 21:06:39.897458 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2281/3551] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:39 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:39.910336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:39.912339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] [instance: 30280ed1-e136-4729-8d11-bcec883bebd5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:39.934730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:39.935604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:39.936270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:39.945932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:39.948840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:39.950090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:39.991588 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] HTTP exception thrown: Instance 30280ed1-e136-4729-8d11-bcec883bebd5 could not be found. Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Request method failure captured: Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 HTTP/1.1 Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKqkgfbc_8hDaJm-zKHvqTb6WWcCcwT0-Bfkvm8f894klqAsv6S6gceYSMqZE_iA9F1ar8j4XUgVkIuKhn9h8Rgo_aMUHe71Q6i1rgQeqhiP7Q24mua9fZcb3yfEC6hkQVWHSn1eqeodqqIny5w_VbZ67CSAF_63x-EWWDMDYONExeM Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10fefee3d6a6430682316cd94b859f1e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10fefee3d6a6430682316cd94b859f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10fefee3d6a6430682316cd94b859f1e"}]}] Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 10fefee3d6a6430682316cd94b859f1e Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894078329 Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6bda28994cb14f92b014a147a7e74476 Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894078329-project Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 30280ed1-e136-4729-8d11-bcec883bebd5 could not be found. Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '30280ed1-e136-4729-8d11-bcec883bebd5'} Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30280ed1-e136-4729-8d11-bcec883bebd5 could not be found. Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30280ed1-e136-4729-8d11-bcec883bebd5 could not be found. Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:40.014731 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:40.019452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:40.019452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:40.019452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:40.019452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:40.019452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:40.019452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:40.019452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30280ed1-e136-4729-8d11-bcec883bebd5 could not be found. Oct 01 21:06:40.019452 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:40.021615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] Returning 404 to user: Instance 30280ed1-e136-4729-8d11-bcec883bebd5 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:40.022665 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ba114b4-9be1-47c8-bbca-91cc4bc03fe9 tempest-ServerRescueNegativeTestJSON-894078329 tempest-ServerRescueNegativeTestJSON-894078329-project] 10.222.0.17 "GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5" status: 404 len: 111 microversion: 2.1 time: 0.120694 Oct 01 21:06:40.026565 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2282/3552] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:39 2022] GET /compute/v2.1/servers/30280ed1-e136-4729-8d11-bcec883bebd5 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:06:40.059538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ce768a3b-94ec-4ab0-ac6a-faa4fa0b3f5e req-f5ac8820-1c04-48df-b275-546618a356af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30280ed1-e136-4729-8d11-bcec883bebd5", "name": "network-vif-deleted", "tag": "4f2dd5ff-1c5e-4766-b573-59458dfe4990"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:40.087319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ce768a3b-94ec-4ab0-ac6a-faa4fa0b3f5e req-f5ac8820-1c04-48df-b275-546618a356af service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:40.087817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ce768a3b-94ec-4ab0-ac6a-faa4fa0b3f5e req-f5ac8820-1c04-48df-b275-546618a356af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:40.088264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ce768a3b-94ec-4ab0-ac6a-faa4fa0b3f5e req-f5ac8820-1c04-48df-b275-546618a356af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:40.116724 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ce768a3b-94ec-4ab0-ac6a-faa4fa0b3f5e req-f5ac8820-1c04-48df-b275-546618a356af service nova] Creating event network-vif-deleted:4f2dd5ff-1c5e-4766-b573-59458dfe4990 for instance 30280ed1-e136-4729-8d11-bcec883bebd5 on nch2-master-1 Oct 01 21:06:40.133965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ce768a3b-94ec-4ab0-ac6a-faa4fa0b3f5e req-f5ac8820-1c04-48df-b275-546618a356af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102817 Oct 01 21:06:40.134647 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2283/3553] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:40.146882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:40.153574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:40.166954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:40.168374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:40.173471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:40.174888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:40.175543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:40.176140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:40.241916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:40.642444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:40.673720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:40.679614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:40.681112 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-439ab323-df3a-48a1-8fc0-2cc709e2c4e5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.545277 Oct 01 21:06:40.699361 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2284/3554] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:40 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:40.724543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9f207c03-83f8-49db-bd9e-f0559bab3888 req-13440ccb-973c-4ff4-985a-ddd435c5d915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-plugged", "status": "completed", "tag": "533ea925-dedd-4f5f-a365-4706cb3420d1"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-plugged", "status": "completed", "tag": "7c63803c-b52f-4b0f-83b4-c88b63b742db"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-plugged", "status": "completed", "tag": "82e99bc6-f268-4fdd-8550-c975a4937b54"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-plugged", "status": "completed", "tag": "fb0092f2-a3d1-47ee-9275-921730efb7ec"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:40.747096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9f207c03-83f8-49db-bd9e-f0559bab3888 req-13440ccb-973c-4ff4-985a-ddd435c5d915 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:40.747826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9f207c03-83f8-49db-bd9e-f0559bab3888 req-13440ccb-973c-4ff4-985a-ddd435c5d915 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:40.748491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9f207c03-83f8-49db-bd9e-f0559bab3888 req-13440ccb-973c-4ff4-985a-ddd435c5d915 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:40.785575 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9f207c03-83f8-49db-bd9e-f0559bab3888 req-13440ccb-973c-4ff4-985a-ddd435c5d915 service nova] Creating event network-vif-plugged:533ea925-dedd-4f5f-a365-4706cb3420d1 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:40.786838 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9f207c03-83f8-49db-bd9e-f0559bab3888 req-13440ccb-973c-4ff4-985a-ddd435c5d915 service nova] Creating event network-vif-plugged:7c63803c-b52f-4b0f-83b4-c88b63b742db for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:40.789157 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9f207c03-83f8-49db-bd9e-f0559bab3888 req-13440ccb-973c-4ff4-985a-ddd435c5d915 service nova] Creating event network-vif-plugged:82e99bc6-f268-4fdd-8550-c975a4937b54 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:40.789802 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9f207c03-83f8-49db-bd9e-f0559bab3888 req-13440ccb-973c-4ff4-985a-ddd435c5d915 service nova] Creating event network-vif-plugged:fb0092f2-a3d1-47ee-9275-921730efb7ec for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:40.811765 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9f207c03-83f8-49db-bd9e-f0559bab3888 req-13440ccb-973c-4ff4-985a-ddd435c5d915 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.110631 Oct 01 21:06:40.814749 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2285/3555] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:40.831459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:40.832460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:40.851017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:40.851839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:40.853752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:40.857018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:40.858924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:40.859504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:40.988235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:41.001256 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1b824f28-597e-4d26-a648-d23dd468f541 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1296 microversion: 2.1 time: 0.184069 Oct 01 21:06:41.003436 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2286/3556] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:40 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1296 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:41.011199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-decec70b-8c47-4cd5-92d9-75ec437298be tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172b7d3a0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:41.130427 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-decec70b-8c47-4cd5-92d9-75ec437298be tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/18ff4644-0dc2-4bb4-8ca4-97afbf07ebad" status: 200 len: 247 microversion: 2.1 time: 0.124715 Oct 01 21:06:41.132348 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2287/3557] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:06:41 2022] GET /compute/v2.1/os-security-groups/18ff4644-0dc2-4bb4-8ca4-97afbf07ebad => generated 247 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:41.138522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:41.143067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:41.189880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:41.190780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:41.191601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:41.193242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:41.193734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:41.194281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:41.227975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:06:41.337550 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35f12e65-3681-4e31-b6aa-fcbdac1f816e tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "DELETE /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 204 len: 0 microversion: 2.1 time: 0.202483 Oct 01 21:06:41.341604 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2288/3558] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:06:41 2022] DELETE /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:06:41.346934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:41.348336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:41.359082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:41.359653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:41.360313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:41.361098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:41.361649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:41.362144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:41.553942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:41.568152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e82ee43c-cf2d-4fe3-a15c-9c44dff95128 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.226304 Oct 01 21:06:41.592612 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2289/3559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:41 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:41.598793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-660ecd19-3c2b-4293-8db6-ba5223b6addd tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f4172b32820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1034799138", "description": "tempest-description-871017036"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:41.980802 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-660ecd19-3c2b-4293-8db6-ba5223b6addd tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.385755 Oct 01 21:06:41.984665 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2290/3560] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:06:41 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:41.990152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:41.991054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:42.006308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:42.008604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:42.009095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:42.009854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:42.013319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:42.013878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:42.278407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:42.287556 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b876b950-c122-4bc0-923d-1be68ee55a13 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1509 microversion: 2.1 time: 0.301562 Oct 01 21:06:42.303176 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2291/3561] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:41 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:42.303176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:42.303176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:42.308078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:42.309123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:42.309572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:42.310307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:42.310817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:42.311254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:42.561971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:42.574990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:42.578235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:42.580008 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a64fb87f-4679-4ef3-bed2-f2d82341e117 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.290396 Oct 01 21:06:42.580702 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2292/3562] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:42 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:42.589465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-977c7a58-7b1f-4222-a4e2-66c626fa6aa4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2145427462", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-977c7a58-7b1f-4222-a4e2-66c626fa6aa4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 173 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2145427462", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2145427462', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi -1 Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:06:42.598317 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-977c7a58-7b1f-4222-a4e2-66c626fa6aa4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-977c7a58-7b1f-4222-a4e2-66c626fa6aa4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.017759 Oct 01 21:06:42.606409 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2293/3563] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:42 2022] POST /compute/v2.1/servers => generated 145 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:06:42.610963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-780c3265-e5d6-482f-9a65-ba1516754c86 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f4172b6a790>, body: {"security_group_rule": {"parent_group_id": "66a0e571-ea8a-4fd3-824e-b23ea7832c03", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:42.916840 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-780c3265-e5d6-482f-9a65-ba1516754c86 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.310738 Oct 01 21:06:42.919363 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2294/3564] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:06:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:42.934799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:42.935436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:42.950755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:42.951267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:42.951842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:42.952730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:42.953354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:42.954554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:43.240977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:43.284153 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f96fba8c-ed7b-4aa0-b8f7-30d9eadd5484 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1363 microversion: 2.1 time: 0.363351 Oct 01 21:06:43.286263 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2295/3565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:42 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:43.297813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:43.299302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:43.312283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:43.313022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:43.313854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:43.314883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:43.315700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:43.316112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:43.680023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:43.700071 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88052111-829e-4260-96d1-ac1de047b531 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.409852 Oct 01 21:06:43.702321 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2296/3566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:43 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:43.711819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-daa00f32-7d28-4eec-a311-74c9bc44532f req-496ffb49-507c-400b-a073-829cad7a4ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-plugged", "status": "completed", "tag": "2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-plugged", "status": "completed", "tag": "ad134ac7-069e-4067-94cd-612e65d3dac2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:43.750736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-daa00f32-7d28-4eec-a311-74c9bc44532f req-496ffb49-507c-400b-a073-829cad7a4ac0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:43.751252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-daa00f32-7d28-4eec-a311-74c9bc44532f req-496ffb49-507c-400b-a073-829cad7a4ac0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:43.751699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-daa00f32-7d28-4eec-a311-74c9bc44532f req-496ffb49-507c-400b-a073-829cad7a4ac0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:43.777702 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-daa00f32-7d28-4eec-a311-74c9bc44532f req-496ffb49-507c-400b-a073-829cad7a4ac0 service nova] Creating event network-vif-plugged:2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:43.788659 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-daa00f32-7d28-4eec-a311-74c9bc44532f req-496ffb49-507c-400b-a073-829cad7a4ac0 service nova] Creating event network-vif-plugged:ad134ac7-069e-4067-94cd-612e65d3dac2 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:43.807646 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-daa00f32-7d28-4eec-a311-74c9bc44532f req-496ffb49-507c-400b-a073-829cad7a4ac0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098630 Oct 01 21:06:43.809383 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2297/3567] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:43.814786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b609f843-7578-4dc6-a2af-5274eccbb2fc tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Action: 'create', calling method: .version_select at 0x7f4172b7dca0>, body: {"security_group_rule": {"parent_group_id": "66a0e571-ea8a-4fd3-824e-b23ea7832c03", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:44.679471 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b609f843-7578-4dc6-a2af-5274eccbb2fc tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.868637 Oct 01 21:06:44.680075 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2298/3568] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:06:43 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:44.692970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:44.693741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:44.705267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:44.706059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:44.706682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:44.707562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:44.708686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:44.709281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:45.234045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8c90c2e17c4fb799678e81e57d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3242ac5d0c3146b0bed8fd2f2e48584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:45.265828 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d7c1fee-cd3a-4bcd-ba79-641c4698bb00 tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 200 len: 1509 microversion: 2.1 time: 0.584333 Oct 01 21:06:45.267642 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2299/3569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:44 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 1509 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:45.275466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:45.276504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:45.296187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:45.296702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:45.297165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:45.297931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:45.298400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:45.301957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:45.829563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:45.844845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:45.848520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:45.851544 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-410eb568-40a8-4b43-911e-83835f3dbf90 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1878 microversion: 2.32 time: 0.581117 Oct 01 21:06:45.855897 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2300/3570] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:45 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1878 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:45.867756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:45.868623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:45.880968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:45.881409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:45.881862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:45.882626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:45.883230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:45.883675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:46.141458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:46.150951 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75b23de4-cb34-4842-ba85-e733e23b763c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.293769 Oct 01 21:06:46.152281 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2301/3571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:45 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:46.188114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:46.188875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:46.197255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:46.198201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:46.198849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:46.199634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:46.200101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:46.200961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:46.550573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:46.564660 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a0cda6a4-7104-4b33-a756-a1c85ec233ff tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1363 microversion: 2.1 time: 0.381833 Oct 01 21:06:46.566692 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2302/3572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:46 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:46.573473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f82cfdd-e330-4cf1-b336-cd9a671f3eb1 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172971dc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:46.829883 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f82cfdd-e330-4cf1-b336-cd9a671f3eb1 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/66a0e571-ea8a-4fd3-824e-b23ea7832c03" status: 200 len: 664 microversion: 2.1 time: 0.260717 Oct 01 21:06:46.839962 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2303/3573] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:06:46 2022] GET /compute/v2.1/os-security-groups/66a0e571-ea8a-4fd3-824e-b23ea7832c03 => generated 664 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:46.868099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-f952ab93-ba81-4029-890c-31dce85bdd40 req-b0ec252c-9c83-4310-8ef4-7a7432174a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fe3bb9-900c-45d4-9a78-bc9385c8360f", "name": "network-vif-deleted", "tag": "9097b4ab-0be9-4f9e-a0dd-de68a926b982"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:46.901609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f952ab93-ba81-4029-890c-31dce85bdd40 req-b0ec252c-9c83-4310-8ef4-7a7432174a49 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:46.902574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f952ab93-ba81-4029-890c-31dce85bdd40 req-b0ec252c-9c83-4310-8ef4-7a7432174a49 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:46.903155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f952ab93-ba81-4029-890c-31dce85bdd40 req-b0ec252c-9c83-4310-8ef4-7a7432174a49 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:46.924569 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-f952ab93-ba81-4029-890c-31dce85bdd40 req-b0ec252c-9c83-4310-8ef4-7a7432174a49 service nova] Creating event network-vif-deleted:9097b4ab-0be9-4f9e-a0dd-de68a926b982 for instance 54fe3bb9-900c-45d4-9a78-bc9385c8360f on nch1-master-1 Oct 01 21:06:46.938367 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-f952ab93-ba81-4029-890c-31dce85bdd40 req-b0ec252c-9c83-4310-8ef4-7a7432174a49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105111 Oct 01 21:06:46.939154 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2304/3574] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:46.946830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:46.950294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] [instance: 54fe3bb9-900c-45d4-9a78-bc9385c8360f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:46.965117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:46.965615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:46.971514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:46.972602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:46.973354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:46.973943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:47.000501 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] HTTP exception thrown: Instance 54fe3bb9-900c-45d4-9a78-bc9385c8360f could not be found. Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Request method failure captured: Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f HTTP/1.1 Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKumHD5uFfCdsAGQdFWGfZMonF827r2Ht99x2pxIElaVqNaT_7b7sD1EohUBnP070bld0XoiNUWWh1111EDl4A-xqGg09uSnHpGSJq67AncXS75KZ2e8kElkQWUuHH0tK1pp40c3UQDr822IQkkPu0YETm-8Jv2jzxUOzHJHXpuy9yI Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 3242ac5d0c3146b0bed8fd2f2e48584b Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestServerAdvancedOps-1097884337 Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3242ac5d0c3146b0bed8fd2f2e48584b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3242ac5d0c3146b0bed8fd2f2e48584b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3242ac5d0c3146b0bed8fd2f2e48584b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3242ac5d0c3146b0bed8fd2f2e48584b"}]}] Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestServerAdvancedOps-1097884337 Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 3242ac5d0c3146b0bed8fd2f2e48584b Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestServerAdvancedOps-1097884337 Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestServerAdvancedOps-1097884337-project Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: de8c90c2e17c4fb799678e81e57d9765 Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestServerAdvancedOps-1097884337-project Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 54fe3bb9-900c-45d4-9a78-bc9385c8360f could not be found. Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '54fe3bb9-900c-45d4-9a78-bc9385c8360f'} Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54fe3bb9-900c-45d4-9a78-bc9385c8360f could not be found. Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54fe3bb9-900c-45d4-9a78-bc9385c8360f could not be found. Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:47.006672 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:47.010564 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:47.010564 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:47.010564 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:47.010564 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:47.010564 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:47.010564 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54fe3bb9-900c-45d4-9a78-bc9385c8360f could not be found. Oct 01 21:06:47.010564 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:47.015678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] Returning 404 to user: Instance 54fe3bb9-900c-45d4-9a78-bc9385c8360f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:47.017001 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e3aa3b1-c9a7-42a6-ae29-2feb0c7dabbc tempest-TestServerAdvancedOps-1097884337 tempest-TestServerAdvancedOps-1097884337-project] 10.222.0.17 "GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f" status: 404 len: 111 microversion: 2.1 time: 0.076600 Oct 01 21:06:47.019503 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2305/3575] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:46 2022] GET /compute/v2.1/servers/54fe3bb9-900c-45d4-9a78-bc9385c8360f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:06:47.024699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-814502f4-3ea0-4fc1-8428-80386df48bcc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-472707726", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:47.030239 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-814502f4-3ea0-4fc1-8428-80386df48bcc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-814502f4-3ea0-4fc1-8428-80386df48bcc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 215 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-472707726", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-472707726', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:47.032183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:47.036041 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:47.036041 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:47.036041 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:47.036041 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:47.036041 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:47.036041 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:47.036041 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 01 21:06:47.036041 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:47.037478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-814502f4-3ea0-4fc1-8428-80386df48bcc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:47.038502 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-814502f4-3ea0-4fc1-8428-80386df48bcc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.017869 Oct 01 21:06:47.039534 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2306/3576] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:47 2022] POST /compute/v2.1/servers => generated 123 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:06:47.044788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-818bb096-e1bd-451b-80bd-caabc3171351 req-a2384912-179a-4b5c-984b-224cdface3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4461cf-b0a2-40ed-9edb-ad64e615d2ea", "tag": "ba342b04-ec5c-4f1e-99f7-b15cbde6dd19"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:47.068602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-818bb096-e1bd-451b-80bd-caabc3171351 req-a2384912-179a-4b5c-984b-224cdface3dd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:47.069275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-818bb096-e1bd-451b-80bd-caabc3171351 req-a2384912-179a-4b5c-984b-224cdface3dd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:47.069876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-818bb096-e1bd-451b-80bd-caabc3171351 req-a2384912-179a-4b5c-984b-224cdface3dd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:47.096109 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-818bb096-e1bd-451b-80bd-caabc3171351 req-a2384912-179a-4b5c-984b-224cdface3dd service nova] Creating event network-changed:ba342b04-ec5c-4f1e-99f7-b15cbde6dd19 for instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea on nch2-master-1 Oct 01 21:06:47.109655 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-818bb096-e1bd-451b-80bd-caabc3171351 req-a2384912-179a-4b5c-984b-224cdface3dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066209 Oct 01 21:06:47.111906 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2307/3577] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:47.127568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-411aff81-5f60-4ba3-9763-21d158b41f1b tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172971ee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:47.995365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:48.036385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:48.424565 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-411aff81-5f60-4ba3-9763-21d158b41f1b tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/1abbff3e-4b81-4f26-b9ac-6509c7582d10" status: 202 len: 0 microversion: 2.1 time: 1.310739 Oct 01 21:06:48.430209 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2308/3578] 10.222.0.17 () {58 vars in 1287 bytes} [Sat Oct 1 21:06:47 2022] DELETE /compute/v2.1/os-security-group-rules/1abbff3e-4b81-4f26-b9ac-6509c7582d10 => generated 0 bytes in 1317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:48.435955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:48.436707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:48.445182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:48.445976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:48.446430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:48.447221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:48.447691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:48.448131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:49.232592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:49.248904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:49.261809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:49.261809 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea053e81-73fc-4875-830b-3865c464bf2f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2830 microversion: 2.32 time: 0.824990 Oct 01 21:06:49.278910 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2309/3579] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:06:48 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2830 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:49.288795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:49.289857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:49.297207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:49.298187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:49.299084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:49.300041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:49.300680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:49.301326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:49.320274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:50.213546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:50.233648 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f738fae-588f-4a7d-958d-49e42c6a553b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.952355 Oct 01 21:06:50.234365 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2310/3580] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:49 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:50.247850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:50.250551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:50.268986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:50.270663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:50.273418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:50.274557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:50.276046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:50.277449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:50.634942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:50.646683 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ce2d75a-6345-4e46-aef3-51bb2f0723aa tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1363 microversion: 2.1 time: 0.409768 Oct 01 21:06:50.651151 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2311/3581] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:50 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:50.660169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-332b4805-676f-4552-83d5-7a049d219aff tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f41730a78b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:51.467502 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-332b4805-676f-4552-83d5-7a049d219aff tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/66a0e571-ea8a-4fd3-824e-b23ea7832c03" status: 202 len: 0 microversion: 2.1 time: 0.814939 Oct 01 21:06:51.469220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2312/3582] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:06:50 2022] DELETE /compute/v2.1/os-security-groups/66a0e571-ea8a-4fd3-824e-b23ea7832c03 => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:51.474570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ada8324-0edd-4a47-aacd-0ca140e26f32 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:51.475466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ada8324-0edd-4a47-aacd-0ca140e26f32 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:51.489908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ada8324-0edd-4a47-aacd-0ca140e26f32 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:51.491231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ada8324-0edd-4a47-aacd-0ca140e26f32 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:51.491961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ada8324-0edd-4a47-aacd-0ca140e26f32 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:51.492865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ada8324-0edd-4a47-aacd-0ca140e26f32 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:51.493984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ada8324-0edd-4a47-aacd-0ca140e26f32 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:51.494614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ada8324-0edd-4a47-aacd-0ca140e26f32 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:51.787526 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ada8324-0edd-4a47-aacd-0ca140e26f32 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.317051 Oct 01 21:06:51.798772 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2313/3583] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Oct 1 21:06:51 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f/os-interface => generated 1830 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:06:51.804840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:51.805737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:51.813725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:51.814575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:51.815246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:51.816178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:51.816908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:51.817559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:52.438316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:52.454847 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a45ea84-edcd-4b24-b081-d91808123c99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.649070 Oct 01 21:06:52.457765 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2314/3584] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:51 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:52.469360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f20aa545-7d97-46f9-ad36-74392a3a2cf5 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172735c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:52.537344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-f20aa545-7d97-46f9-ad36-74392a3a2cf5 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bab659c1-13c3-453e-a77d-84041e8d6190 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:06:52.538019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-f20aa545-7d97-46f9-ad36-74392a3a2cf5 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Neutron security group bab659c1-13c3-453e-a77d-84041e8d6190 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:06:52.538640 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f20aa545-7d97-46f9-ad36-74392a3a2cf5 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] HTTP exception thrown: Security group bab659c1-13c3-453e-a77d-84041e8d6190 does not exist Oct 01 21:06:52.538640 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-115b1b6a-9447-46e6-abae-4d0ae95a17ad'] Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f20aa545-7d97-46f9-ad36-74392a3a2cf5 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Request method failure captured: Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/bab659c1-13c3-453e-a77d-84041e8d6190 HTTP/1.1 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKvFM26dGdZdkRjOusFk4d94aTpezUpI-sbpNm897SHBj2KVGxcI8yYm9RBqOxyiiTX4ZPG5DsI7SNh40a2G8uv_RKPnPqqwaif4iPdNWOKpeJpzuCe5Ff-PMJJ_dxWFvr63t5y7l57EISmKeFYOogeel9be80WVYsxLNdkmnjlQvhw Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d3434dac76ec46b3a5e10f840b7c2785 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1711160077 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3434dac76ec46b3a5e10f840b7c2785", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3434dac76ec46b3a5e10f840b7c2785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3434dac76ec46b3a5e10f840b7c2785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3434dac76ec46b3a5e10f840b7c2785"}]}] Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1711160077 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d3434dac76ec46b3a5e10f840b7c2785 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1711160077 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupRulesTestJSON-1711160077-project Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 646f6f5cff204d27b0476d53bd9e6fa0 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1711160077-project Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group bab659c1-13c3-453e-a77d-84041e8d6190 does not exist Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-115b1b6a-9447-46e6-abae-4d0ae95a17ad'] Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'bab659c1-13c3-453e-a77d-84041e8d6190'} Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:06:52.540999 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bab659c1-13c3-453e-a77d-84041e8d6190 does not exist Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-115b1b6a-9447-46e6-abae-4d0ae95a17ad'] Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bab659c1-13c3-453e-a77d-84041e8d6190 does not exist Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-115b1b6a-9447-46e6-abae-4d0ae95a17ad'] Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bab659c1-13c3-453e-a77d-84041e8d6190 does not exist Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-115b1b6a-9447-46e6-abae-4d0ae95a17ad'] Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bab659c1-13c3-453e-a77d-84041e8d6190 does not exist Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-115b1b6a-9447-46e6-abae-4d0ae95a17ad'] Oct 01 21:06:52.545106 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:52.549047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f20aa545-7d97-46f9-ad36-74392a3a2cf5 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Returning 404 to user: Security group bab659c1-13c3-453e-a77d-84041e8d6190 does not exist Oct 01 21:06:52.549047 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-115b1b6a-9447-46e6-abae-4d0ae95a17ad'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:52.550734 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f20aa545-7d97-46f9-ad36-74392a3a2cf5 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/bab659c1-13c3-453e-a77d-84041e8d6190" status: 404 len: 194 microversion: 2.1 time: 0.091377 Oct 01 21:06:52.551818 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2315/3585] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:06:52 2022] DELETE /compute/v2.1/os-security-groups/bab659c1-13c3-453e-a77d-84041e8d6190 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:06:52.562157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:52.570160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:52.587491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:52.592306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:52.593099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:52.595420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:52.596175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:52.599778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:53.613944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:53.625661 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-28af02d6-9063-4f80-9c09-62cb5542681f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1363 microversion: 2.1 time: 1.069969 Oct 01 21:06:53.644460 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2316/3586] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:52 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1363 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:53.649845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29a4f9a5-52cf-414d-a414-36cb0f91cc10 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172fde670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:54.556658 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29a4f9a5-52cf-414d-a414-36cb0f91cc10 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/18ff4644-0dc2-4bb4-8ca4-97afbf07ebad" status: 202 len: 0 microversion: 2.1 time: 0.909797 Oct 01 21:06:54.558554 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2317/3587] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:06:53 2022] DELETE /compute/v2.1/os-security-groups/18ff4644-0dc2-4bb4-8ca4-97afbf07ebad => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:54.570004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a45add1-bd21-48a4-9b76-64669dbb52bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2027008869", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "key_name": "tempest-key-902596634", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:54.744164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-9a45add1-bd21-48a4-9b76-64669dbb52bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] validate_networks() for [('a5c86243-7722-488d-b90b-df7ddabb6bde', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:06:55.296229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:06:55.299711 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-9a45add1-bd21-48a4-9b76-64669dbb52bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Invalid key_name provided. Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a45add1-bd21-48a4-9b76-64669dbb52bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 246 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2027008869", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "key_name": "tempest-key-902596634", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid key_name provided. Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2027008869', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'key_name': 'tempest-key-902596634', 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-902596634 not found for user 6d63c633112e49d091421c84cea3422b Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:55.302956 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 01 21:06:55.307219 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:06:55.309086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a45add1-bd21-48a4-9b76-64669dbb52bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid key_name provided. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:06:55.311698 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a45add1-bd21-48a4-9b76-64669dbb52bb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.751802 Oct 01 21:06:55.313118 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2318/3588] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:06:54 2022] POST /compute/v2.1/servers => generated 70 bytes in 753 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 21:06:55.326761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-30de4abc-9404-4d4b-b515-ed920b646783 req-26865ca6-8e2e-43f1-8e59-2d0cd4bca7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4461cf-b0a2-40ed-9edb-ad64e615d2ea", "name": "network-vif-plugged", "status": "completed", "tag": "ba342b04-ec5c-4f1e-99f7-b15cbde6dd19"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:55.356240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-30de4abc-9404-4d4b-b515-ed920b646783 req-26865ca6-8e2e-43f1-8e59-2d0cd4bca7f4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:55.356902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-30de4abc-9404-4d4b-b515-ed920b646783 req-26865ca6-8e2e-43f1-8e59-2d0cd4bca7f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:55.357665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-30de4abc-9404-4d4b-b515-ed920b646783 req-26865ca6-8e2e-43f1-8e59-2d0cd4bca7f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:55.388002 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-30de4abc-9404-4d4b-b515-ed920b646783 req-26865ca6-8e2e-43f1-8e59-2d0cd4bca7f4 service nova] Creating event network-vif-plugged:ba342b04-ec5c-4f1e-99f7-b15cbde6dd19 for instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea on nch2-master-1 Oct 01 21:06:55.397665 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-30de4abc-9404-4d4b-b515-ed920b646783 req-26865ca6-8e2e-43f1-8e59-2d0cd4bca7f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083100 Oct 01 21:06:55.413079 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2319/3589] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:55.447221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d38fe92-b064-4f19-ab8d-54db453d9624 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172aac940>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:56.453864 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9d38fe92-b064-4f19-ab8d-54db453d9624 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/cf570081-1ebd-4d0d-8850-6fad223de988" status: 202 len: 0 microversion: 2.1 time: 1.038955 Oct 01 21:06:56.455279 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2320/3590] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:06:55 2022] DELETE /compute/v2.1/os-security-groups/cf570081-1ebd-4d0d-8850-6fad223de988 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:56.463247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:56.464925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:56.478688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:56.481225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:56.481912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:56.484212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:56.488756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:56.489950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:57.035770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:57.057614 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-67d71baa-9e1c-40fb-b7f9-c5bb2d99f19c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1363 microversion: 2.1 time: 0.600791 Oct 01 21:06:57.060732 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2321/3591] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:56 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1363 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:57.067693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-89f589a6-9ca5-47ff-b8aa-f8b3af7e0f28 req-3f7efa58-a7d8-4878-93f2-bad6574a31ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "tag": "2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:06:57.092189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-89f589a6-9ca5-47ff-b8aa-f8b3af7e0f28 req-3f7efa58-a7d8-4878-93f2-bad6574a31ac service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:57.092687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-89f589a6-9ca5-47ff-b8aa-f8b3af7e0f28 req-3f7efa58-a7d8-4878-93f2-bad6574a31ac service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:57.093138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-89f589a6-9ca5-47ff-b8aa-f8b3af7e0f28 req-3f7efa58-a7d8-4878-93f2-bad6574a31ac service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:57.121298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-89f589a6-9ca5-47ff-b8aa-f8b3af7e0f28 req-3f7efa58-a7d8-4878-93f2-bad6574a31ac service nova] Creating event network-changed:2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:06:57.134187 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-89f589a6-9ca5-47ff-b8aa-f8b3af7e0f28 req-3f7efa58-a7d8-4878-93f2-bad6574a31ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071037 Oct 01 21:06:57.134862 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2322/3592] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:06:57.148091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:57.150070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:57.165212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:57.169998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:57.171020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:57.172346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:57.174710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:57.175408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:57.725121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:57.734248 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-962e2b22-668e-46c7-a693-18695f52746f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.594122 Oct 01 21:06:57.752566 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2323/3593] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:57 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:57.752566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7db9110-f431-457c-9436-45bace8adae9 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172921dc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:58.777205 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7db9110-f431-457c-9436-45bace8adae9 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/e9733e2f-0339-484c-88e4-b5929713dc6f" status: 202 len: 0 microversion: 2.1 time: 1.041163 Oct 01 21:06:58.781283 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2324/3594] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:06:57 2022] DELETE /compute/v2.1/os-security-groups/e9733e2f-0339-484c-88e4-b5929713dc6f => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:06:58.783503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:58.784373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:58.792396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:58.793378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:58.794084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:58.795263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:58.795930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:58.796626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:59.277588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:59.292457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-816af75b-9057-4e01-82a2-12076c297a4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.512475 Oct 01 21:06:59.293492 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2325/3595] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:58 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:59.305057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:06:59.308228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:06:59.330941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:59.331731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:59.332406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:59.333913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:06:59.334632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:06:59.335452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:06:59.650943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:06:59.664792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-708839da-a8e5-44dd-917c-f1d41516ce07 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1548 microversion: 2.1 time: 0.369953 Oct 01 21:06:59.665595 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2326/3596] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:06:59 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1548 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:06:59.689743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f79128d7-67f7-4cf4-8c87-05342e617e97 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172b6a790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:00.189747 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f79128d7-67f7-4cf4-8c87-05342e617e97 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/4fdfe9d3-a8af-46f2-94f2-7546ea9c245c" status: 202 len: 0 microversion: 2.1 time: 0.503906 Oct 01 21:07:00.191912 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2327/3597] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:06:59 2022] DELETE /compute/v2.1/os-security-groups/4fdfe9d3-a8af-46f2-94f2-7546ea9c245c => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:00.198705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b3ad6ac-7b08-4851-be1e-52dec2e8e298 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187239766", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:00.423633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-2b3ad6ac-7b08-4851-be1e-52dec2e8e298 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Neutron security group does_not_exist not found {{(pid=140438) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 01 21:07:00.424943 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-2b3ad6ac-7b08-4851-be1e-52dec2e8e298 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b3ad6ac-7b08-4851-be1e-52dec2e8e298 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 257 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187239766", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-187239766', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 01 21:07:00.440733 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 01 21:07:00.445773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:00.458565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b3ad6ac-7b08-4851-be1e-52dec2e8e298 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:00.460168 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b3ad6ac-7b08-4851-be1e-52dec2e8e298 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.266870 Oct 01 21:07:00.465889 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2328/3598] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:07:00 2022] POST /compute/v2.1/servers => generated 106 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:07:00.473563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-59f26341-b097-4cc3-860a-2deb2b7f7961 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:00.474665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-59f26341-b097-4cc3-860a-2deb2b7f7961 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:00.486210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f26341-b097-4cc3-860a-2deb2b7f7961 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:00.487433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f26341-b097-4cc3-860a-2deb2b7f7961 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:00.488029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f26341-b097-4cc3-860a-2deb2b7f7961 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:00.488775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f26341-b097-4cc3-860a-2deb2b7f7961 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:00.492541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f26341-b097-4cc3-860a-2deb2b7f7961 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:00.493535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f26341-b097-4cc3-860a-2deb2b7f7961 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:00.978524 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-59f26341-b097-4cc3-860a-2deb2b7f7961 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.510638 Oct 01 21:07:00.980985 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2329/3599] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:07:00 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/os-interface => generated 284 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:01.012892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c3f7d6e0-3107-40a6-96b2-3ed4b7a03c17 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] Calling method '.version_select at 0x7f4172837ee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:01.650674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c3f7d6e0-3107-40a6-96b2-3ed4b7a03c17 tempest-SecurityGroupRulesTestJSON-1711160077 tempest-SecurityGroupRulesTestJSON-1711160077-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/24e468e4-8b71-4bdd-b8bb-29a7ef4a3255" status: 202 len: 0 microversion: 2.1 time: 0.657183 Oct 01 21:07:01.651409 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2330/3600] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:07:00 2022] DELETE /compute/v2.1/os-security-groups/24e468e4-8b71-4bdd-b8bb-29a7ef4a3255 => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:01.659658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:01.660289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:01.674040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:01.675414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:01.676044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:01.676721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:01.677191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:01.677631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:02.447412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:02.464475 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-afceeaa9-08d4-40e8-b6de-d94da52fca17 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.810803 Oct 01 21:07:02.466081 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2331/3601] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:01 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:02.496761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:02.497489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:02.506602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:02.507507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:02.508249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:02.509190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:02.509864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:02.510637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:03.161360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:03.177122 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-51cd73db-dc45-460c-a9cd-b792d43e4cfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.685673 Oct 01 21:07:03.179352 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2332/3602] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:02 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:03.211162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbf406ff-b8c9-4908-b6d6-178c253e2fb0 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:03.213157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cbf406ff-b8c9-4908-b6d6-178c253e2fb0 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: cc29449b-96bf-44e0-a0fa-1becdfde27bb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:03.232401 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-cbf406ff-b8c9-4908-b6d6-178c253e2fb0 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance cc29449b-96bf-44e0-a0fa-1becdfde27bb could not be found. Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbf406ff-b8c9-4908-b6d6-178c253e2fb0 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/cc29449b-96bf-44e0-a0fa-1becdfde27bb HTTP/1.1 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance cc29449b-96bf-44e0-a0fa-1becdfde27bb could not be found. Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'cc29449b-96bf-44e0-a0fa-1becdfde27bb'} Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc29449b-96bf-44e0-a0fa-1becdfde27bb could not be found. Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc29449b-96bf-44e0-a0fa-1becdfde27bb could not be found. Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:03.234694 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:03.238249 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:03.238249 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:03.238249 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:03.238249 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:03.238249 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:03.238249 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:03.238249 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc29449b-96bf-44e0-a0fa-1becdfde27bb could not be found. Oct 01 21:07:03.238249 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:03.238249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbf406ff-b8c9-4908-b6d6-178c253e2fb0 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance cc29449b-96bf-44e0-a0fa-1becdfde27bb could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:03.238777 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cbf406ff-b8c9-4908-b6d6-178c253e2fb0 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cc29449b-96bf-44e0-a0fa-1becdfde27bb" status: 404 len: 111 microversion: 2.1 time: 0.039250 Oct 01 21:07:03.241805 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2333/3603] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:07:03 2022] DELETE /compute/v2.1/servers/cc29449b-96bf-44e0-a0fa-1becdfde27bb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:07:03.254353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:03.255029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:03.278591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:03.279171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:03.279639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:03.280398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:03.280875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:03.284048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:03.965250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:03.977774 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-becfcbd9-0cd7-4ae5-88d2-30b9c52f7cf6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.731097 Oct 01 21:07:03.981115 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2334/3604] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:03 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:04.005397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:04.010114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:04.030223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:04.031004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:04.031600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:04.033653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:04.037308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:04.038307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:04.793426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:04.845428 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9faa4e8-b3bf-432b-b06f-2ee61c841577 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.843839 Oct 01 21:07:04.846039 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2335/3605] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:04 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:04.878642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1871c3aa-b331-4788-9570-069fbb1973e2 req-a06e4373-5e67-4ba2-9de9-74adcc5a190e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4461cf-b0a2-40ed-9edb-ad64e615d2ea", "tag": "ba342b04-ec5c-4f1e-99f7-b15cbde6dd19"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:04.906871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1871c3aa-b331-4788-9570-069fbb1973e2 req-a06e4373-5e67-4ba2-9de9-74adcc5a190e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:04.907369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1871c3aa-b331-4788-9570-069fbb1973e2 req-a06e4373-5e67-4ba2-9de9-74adcc5a190e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:04.908081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1871c3aa-b331-4788-9570-069fbb1973e2 req-a06e4373-5e67-4ba2-9de9-74adcc5a190e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:04.955203 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1871c3aa-b331-4788-9570-069fbb1973e2 req-a06e4373-5e67-4ba2-9de9-74adcc5a190e service nova] Creating event network-changed:ba342b04-ec5c-4f1e-99f7-b15cbde6dd19 for instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea on nch2-master-1 Oct 01 21:07:04.985997 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1871c3aa-b331-4788-9570-069fbb1973e2 req-a06e4373-5e67-4ba2-9de9-74adcc5a190e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106346 Oct 01 21:07:04.987832 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2336/3606] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:04.993210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-36311b17-a2c5-4469-960f-7d63cb8b5c1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:04.993706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-36311b17-a2c5-4469-960f-7d63cb8b5c1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Failed to fetch instance by id 9223372036854775808 {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 01 21:07:04.994236 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-36311b17-a2c5-4469-960f-7d63cb8b5c1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-36311b17-a2c5-4469-960f-7d63cb8b5c1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 9223372036854775808 could not be found. Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '9223372036854775808'} Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:05.002554 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:05.006009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:05.006009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:05.006009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:05.006009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 01 21:07:05.006009 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:05.006009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-36311b17-a2c5-4469-960f-7d63cb8b5c1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:05.006009 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-36311b17-a2c5-4469-960f-7d63cb8b5c1d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.015962 Oct 01 21:07:05.014564 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2337/3607] 10.222.0.17 () {58 vars in 1188 bytes} [Sat Oct 1 21:07:04 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:07:05.025200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:05.027521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:05.046305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:05.048781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:05.049924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:05.051394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:05.053867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:05.056452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:05.560924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:05.577815 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0a9847c0-e80d-4185-8230-d04944c9f5b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.559501 Oct 01 21:07:05.580849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2338/3608] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:05 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:05.612161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:05.613226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:05.623752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:05.627944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:05.628802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:05.632372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:05.633335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:05.634218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:06.483633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:06.502318 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab519524-daea-45a9-8bee-232400099a0e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.891448 Oct 01 21:07:06.504322 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2339/3609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:05 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:07:06.528414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6c69850-261e-43c8-b3ec-d0ef08ca884c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:06.529276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a6c69850-261e-43c8-b3ec-d0ef08ca884c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Failed to fetch instance by id -1 {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 01 21:07:06.530010 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a6c69850-261e-43c8-b3ec-d0ef08ca884c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance -1 could not be found. Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6c69850-261e-43c8-b3ec-d0ef08ca884c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance -1 could not be found. Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '-1'} Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:06.532597 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:06.537813 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:06.537813 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:06.537813 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 01 21:07:06.537813 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:06.544441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6c69850-261e-43c8-b3ec-d0ef08ca884c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance -1 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:06.549298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a6c69850-261e-43c8-b3ec-d0ef08ca884c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.025099 Oct 01 21:07:06.550589 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2340/3610] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 21:07:06 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 01 21:07:06.575831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:06.577210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:06.587600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:06.588324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:06.589243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:06.590466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:06.593590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:06.594298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:07.309047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:07.337334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:07.341307 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-200dc592-fda0-4c56-8195-ab054b2c49a6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.783551 Oct 01 21:07:07.342590 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2341/3611] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:06 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:07.374002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:07.376633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:07.396707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:07.397326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:07.397899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:07.398761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:07.400372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:07.403477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:07.883633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:07.898515 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6542a6b1-dedf-4beb-a301-ca677008af77 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.529798 Oct 01 21:07:07.904876 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2342/3612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:07 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:07.926459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d71c252-4585-432c-9b04-98ee41bfe7ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:07.927461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9d71c252-4585-432c-9b04-98ee41bfe7ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 8c91524d-9990-4c51-a6f1-1b266eaa3f4f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:07.936093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-9d71c252-4585-432c-9b04-98ee41bfe7ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance 8c91524d-9990-4c51-a6f1-1b266eaa3f4f could not be found. Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d71c252-4585-432c-9b04-98ee41bfe7ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/8c91524d-9990-4c51-a6f1-1b266eaa3f4f/action HTTP/1.1 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 19 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: {"forceDelete": {}} Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 8c91524d-9990-4c51-a6f1-1b266eaa3f4f could not be found. Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '8c91524d-9990-4c51-a6f1-1b266eaa3f4f', 'body': {'forceDelete': {}}} Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c91524d-9990-4c51-a6f1-1b266eaa3f4f could not be found. Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c91524d-9990-4c51-a6f1-1b266eaa3f4f could not be found. Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:07.951183 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:07.955505 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:07.955505 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:07.955505 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c91524d-9990-4c51-a6f1-1b266eaa3f4f could not be found. Oct 01 21:07:07.955505 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:07.955505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d71c252-4585-432c-9b04-98ee41bfe7ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance 8c91524d-9990-4c51-a6f1-1b266eaa3f4f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:07.955505 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9d71c252-4585-432c-9b04-98ee41bfe7ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/8c91524d-9990-4c51-a6f1-1b266eaa3f4f/action" status: 404 len: 111 microversion: 2.1 time: 0.033365 Oct 01 21:07:07.955505 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2343/3613] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:07 2022] POST /compute/v2.1/servers/8c91524d-9990-4c51-a6f1-1b266eaa3f4f/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (3 switches on core 0) Oct 01 21:07:07.963261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:07.964556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:07.980809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:07.985179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:07.985179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:07.986198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:07.990030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:07.990867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:08.453586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:08.467718 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca0f003b-adee-464b-8360-ce7446ecfd38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.508685 Oct 01 21:07:08.468942 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2344/3614] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:07 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:07:08.493363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:08.494114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:08.507176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:08.511254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:08.512625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:08.514763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:08.516858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:08.517554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:09.076956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:09.085508 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9218e008-f82d-4d3a-a36b-98f68799831e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.596044 Oct 01 21:07:09.098785 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2345/3615] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:08 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:07:09.111529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5aeb94e-3a10-4552-83b7-552ed49e51b1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:09.117721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a5aeb94e-3a10-4552-83b7-552ed49e51b1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: cc630d36-272a-40e1-babf-edecf2f26570] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:09.134479 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a5aeb94e-3a10-4552-83b7-552ed49e51b1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance cc630d36-272a-40e1-babf-edecf2f26570 could not be found. Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5aeb94e-3a10-4552-83b7-552ed49e51b1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/cc630d36-272a-40e1-babf-edecf2f26570/action HTTP/1.1 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 39 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: {"os-getConsoleOutput": {"length": 10}} Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance cc630d36-272a-40e1-babf-edecf2f26570 could not be found. Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'cc630d36-272a-40e1-babf-edecf2f26570', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc630d36-272a-40e1-babf-edecf2f26570 could not be found. Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc630d36-272a-40e1-babf-edecf2f26570 could not be found. Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:09.139363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:09.143937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:09.143937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:09.143937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:09.143937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:09.143937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc630d36-272a-40e1-babf-edecf2f26570 could not be found. Oct 01 21:07:09.143937 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:09.145944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5aeb94e-3a10-4552-83b7-552ed49e51b1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance cc630d36-272a-40e1-babf-edecf2f26570 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:09.147122 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a5aeb94e-3a10-4552-83b7-552ed49e51b1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/cc630d36-272a-40e1-babf-edecf2f26570/action" status: 404 len: 111 microversion: 2.1 time: 0.040868 Oct 01 21:07:09.147996 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2346/3616] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:09 2022] POST /compute/v2.1/servers/cc630d36-272a-40e1-babf-edecf2f26570/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:07:09.164078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:09.165066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:09.181183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:09.181699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:09.183247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:09.184212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:09.184830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:09.185411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:09.472785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:09.489383 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc25b2d4-daf6-4548-824a-2fe2840d6e53 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.332474 Oct 01 21:07:09.490437 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2347/3617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:09 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:09.534473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:09.538722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:09.580152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:09.581672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:09.583877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:09.585899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:09.587174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:09.588801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:10.056273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:10.068006 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d9c440fe-923c-4b62-9a28-4e01ffbf4c64 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.552117 Oct 01 21:07:10.069488 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2348/3618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:09 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:10.097404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b4fdee0-a1ff-4b5e-a805-a488e79106b4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:10.100124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1b4fdee0-a1ff-4b5e-a805-a488e79106b4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 8343f870-28b8-484b-97d4-8d622e1a1c12] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:10.110897 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1b4fdee0-a1ff-4b5e-a805-a488e79106b4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance 8343f870-28b8-484b-97d4-8d622e1a1c12 could not be found. Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b4fdee0-a1ff-4b5e-a805-a488e79106b4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/8343f870-28b8-484b-97d4-8d622e1a1c12 HTTP/1.1 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 8343f870-28b8-484b-97d4-8d622e1a1c12 could not be found. Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '8343f870-28b8-484b-97d4-8d622e1a1c12'} Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8343f870-28b8-484b-97d4-8d622e1a1c12 could not be found. Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8343f870-28b8-484b-97d4-8d622e1a1c12 could not be found. Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:10.113015 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:10.123168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:10.123168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:10.123168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:10.123168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8343f870-28b8-484b-97d4-8d622e1a1c12 could not be found. Oct 01 21:07:10.123168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:10.147148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b4fdee0-a1ff-4b5e-a805-a488e79106b4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance 8343f870-28b8-484b-97d4-8d622e1a1c12 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:10.150484 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1b4fdee0-a1ff-4b5e-a805-a488e79106b4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/8343f870-28b8-484b-97d4-8d622e1a1c12" status: 404 len: 111 microversion: 2.1 time: 0.056769 Oct 01 21:07:10.154409 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2349/3619] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:10 2022] GET /compute/v2.1/servers/8343f870-28b8-484b-97d4-8d622e1a1c12 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:10.164582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:10.165592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:10.175479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:10.176739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:10.177383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:10.178283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:10.179351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:10.180015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:11.104363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:11.114783 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc64f9c6-4581-4ad0-a7e5-bf4cb444fe3f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.957452 Oct 01 21:07:11.122883 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2350/3620] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:10 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:11.148140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:11.148847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:11.166477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:11.167089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:11.167604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:11.168936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:11.169938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:11.173136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:11.483995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:11.492859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-995d44c6-fabc-4283-8071-c06764eaf928 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.348815 Oct 01 21:07:11.497185 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2351/3621] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:11 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:11.774268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd43d75e-2b70-49f7-bc85-ef7ae94e1a43 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2147070994", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd43d75e-2b70-49f7-bc85-ef7ae94e1a43 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 238 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2147070994", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2147070994', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:11.806470 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd43d75e-2b70-49f7-bc85-ef7ae94e1a43 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd43d75e-2b70-49f7-bc85-ef7ae94e1a43 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.038260 Oct 01 21:07:11.816643 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2352/3622] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:07:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 01 21:07:11.820553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:11.821779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:11.859518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:11.860149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:11.860694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:11.861566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:11.864393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:11.867204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:12.573824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:12.591988 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c534d3b7-ea9d-4ed0-9a65-3ed00b87add1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.777107 Oct 01 21:07:12.597111 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2353/3623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:11 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:12.627633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:12.628276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:12.642158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:12.645301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:12.646681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:12.654080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:12.656847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:12.670453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:13.449172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:13.458404 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2f574de-ac2d-4c16-88a5-15ee066ea22c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.836097 Oct 01 21:07:13.465737 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2354/3624] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:12 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:13.701294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34c829fb-a098-4564-85ab-8ffeb0b99a41 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839730497", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34c829fb-a098-4564-85ab-8ffeb0b99a41 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 235 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839730497", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1839730497', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:13.706379 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 01 21:07:13.711099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:13.722855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34c829fb-a098-4564-85ab-8ffeb0b99a41 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:13.724222 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34c829fb-a098-4564-85ab-8ffeb0b99a41 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.027421 Oct 01 21:07:13.725322 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2355/3625] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:07:13 2022] POST /compute/v2.1/servers => generated 133 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:07:13.734228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:13.735148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:13.748369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:13.749204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:13.749839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:13.755510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:13.756638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:13.757303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:14.779285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:14.803015 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c18aca4a-0ee9-4e8c-9d47-78ad3cbfdf5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 1.068017 Oct 01 21:07:14.832856 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2356/3626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:13 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:14.852139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:14.855550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:14.884166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:14.891416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:14.895427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:14.896679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:14.897416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:14.898038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:15.603728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:15.624584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-edfd5ab0-7fd4-46ee-bd61-5fe9c17f9cce tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.789946 Oct 01 21:07:15.629315 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2357/3627] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:14 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:15.660886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-78c57f2e-3dcb-4d38-b00f-f74e5c9fc2bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:15.661918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-78c57f2e-3dcb-4d38-b00f-f74e5c9fc2bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: bb4bf78e-2449-4f29-9543-104e0df18443] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:15.683127 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-78c57f2e-3dcb-4d38-b00f-f74e5c9fc2bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance bb4bf78e-2449-4f29-9543-104e0df18443 could not be found. Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-78c57f2e-3dcb-4d38-b00f-f74e5c9fc2bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/bb4bf78e-2449-4f29-9543-104e0df18443/action HTTP/1.1 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 13 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: {"pause": {}} Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance bb4bf78e-2449-4f29-9543-104e0df18443 could not be found. Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'bb4bf78e-2449-4f29-9543-104e0df18443', 'body': {'pause': {}}} Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4bf78e-2449-4f29-9543-104e0df18443 could not be found. Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4bf78e-2449-4f29-9543-104e0df18443 could not be found. Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:15.692582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:15.697032 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:15.697032 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:15.697032 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4bf78e-2449-4f29-9543-104e0df18443 could not be found. Oct 01 21:07:15.697032 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:15.701219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-78c57f2e-3dcb-4d38-b00f-f74e5c9fc2bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance bb4bf78e-2449-4f29-9543-104e0df18443 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:15.702570 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-78c57f2e-3dcb-4d38-b00f-f74e5c9fc2bf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/bb4bf78e-2449-4f29-9543-104e0df18443/action" status: 404 len: 111 microversion: 2.1 time: 0.046687 Oct 01 21:07:15.703606 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2358/3628] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:15 2022] POST /compute/v2.1/servers/bb4bf78e-2449-4f29-9543-104e0df18443/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:07:15.723147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:15.724636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:15.754262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:15.754724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:15.755311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:15.756048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:15.763527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:15.772161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:16.600754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:16.621435 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0fa2b674-14f0-46d9-a3e0-cd18d5922225 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.912439 Oct 01 21:07:16.625297 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2359/3629] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:15 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:16.651666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:16.652554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:16.663220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:16.664468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:16.664919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:16.665652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:16.666178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:16.666722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:17.298936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:17.319457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92f03b42-b62f-4c66-a948-b94d9f31a160 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.672672 Oct 01 21:07:17.330354 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2360/3630] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:16 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:17.348685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d3a20293-7221-4465-b3cf-afb6ee988be1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:17.349555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d3a20293-7221-4465-b3cf-afb6ee988be1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:17.369995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3a20293-7221-4465-b3cf-afb6ee988be1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:17.370831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3a20293-7221-4465-b3cf-afb6ee988be1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:17.371517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3a20293-7221-4465-b3cf-afb6ee988be1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:17.372471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3a20293-7221-4465-b3cf-afb6ee988be1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:17.373185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3a20293-7221-4465-b3cf-afb6ee988be1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:17.373839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3a20293-7221-4465-b3cf-afb6ee988be1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:17.527881 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d3a20293-7221-4465-b3cf-afb6ee988be1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 202 len: 0 microversion: 2.1 time: 0.183345 Oct 01 21:07:17.529351 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2361/3631] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:17 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:17.539969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:17.541761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:17.561512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:17.576437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:17.577943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:17.581473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:17.582706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:17.585494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:18.099803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:18.112985 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-97c5e069-33d5-405a-a8a3-9457fde8d977 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1511 microversion: 2.1 time: 0.579085 Oct 01 21:07:18.114006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2362/3632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:17 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1511 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:19.137627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:19.138470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:19.158252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:19.159123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:19.159727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:19.160634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:19.161095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:19.161680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:19.189672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:19.819391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:19.874995 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a70fc236-eea5-4e92-9b91-1a72a239de2f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1491 microversion: 2.1 time: 0.738240 Oct 01 21:07:19.876689 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2363/3633] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:19 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1491 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:07:19.901933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:19.904303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:19.911862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:19.915412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:19.916683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:19.917632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:19.920230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:19.920872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:20.012459 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Cannot 'pause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state paused Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action HTTP/1.1 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 13 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: {"pause": {}} Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'pause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state paused Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8', 'body': {'pause': {}}} Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 in vm_state paused. Cannot pause while the instance is in this state. Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state paused Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:20.018660 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:20.027168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:20.027168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:20.027168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:20.027168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state paused Oct 01 21:07:20.027168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:20.027168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 409 to user: Cannot 'pause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state paused {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:20.027168 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f071e45c-a003-4aa0-92ce-ef6420145e9c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 409 len: 143 microversion: 2.1 time: 0.127550 Oct 01 21:07:20.028772 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2364/3634] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:19 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 143 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 01 21:07:20.042673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a66813c-62d0-4dae-92eb-9c5d1d3bb20a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:20.046213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a66813c-62d0-4dae-92eb-9c5d1d3bb20a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:20.065816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a66813c-62d0-4dae-92eb-9c5d1d3bb20a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:20.066605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a66813c-62d0-4dae-92eb-9c5d1d3bb20a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:20.078283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a66813c-62d0-4dae-92eb-9c5d1d3bb20a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:20.079791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a66813c-62d0-4dae-92eb-9c5d1d3bb20a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:20.080527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a66813c-62d0-4dae-92eb-9c5d1d3bb20a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:20.081423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a66813c-62d0-4dae-92eb-9c5d1d3bb20a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:20.246212 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a66813c-62d0-4dae-92eb-9c5d1d3bb20a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 202 len: 0 microversion: 2.1 time: 0.212545 Oct 01 21:07:20.248358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2365/3635] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:20 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:20.262765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:20.264043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:20.288152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:20.291642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:20.293043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:20.294216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:20.296973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:20.300272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:20.990244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:21.004857 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3347f052-39cf-4b0a-ac6e-4da8664760e8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1498 microversion: 2.1 time: 0.751300 Oct 01 21:07:21.018668 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2366/3636] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:20 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1498 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:22.033321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:22.034001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:22.054244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:22.058877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:22.059819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:22.069821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:22.073693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:22.076286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:22.743734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:22.758279 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4e1dd6a8-596e-4165-adb6-54aa05e42c09 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.729597 Oct 01 21:07:22.759088 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2367/3637] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:22 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:22.794305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:22.795247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:22.807969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:22.808745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:22.810692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:22.812017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:22.814243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:22.817741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:24.355034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:24.372840 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20a7188c-b100-4423-9171-046f113d4f4f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 1.584048 Oct 01 21:07:24.374657 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2368/3638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:22 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:24.398659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:24.407374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:24.427885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:24.428838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:24.429765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:24.430896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:24.432276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:24.432977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:24.479256 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b/action HTTP/1.1 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 28 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: {"reboot": {"type": "SOFT"}} Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd2309b08-05db-4a69-9b23-76111e0ee07b', 'body': {'reboot': {'type': 'SOFT'}}} Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:24.483100 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:24.486838 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd2dbc53-de96-4188-ac68-383c53cabc6f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b/action" status: 404 len: 111 microversion: 2.1 time: 0.090337 Oct 01 21:07:24.490010 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2369/3639] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:24 2022] POST /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:24.503828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:24.532276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:24.576888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:24.577737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:24.578390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:24.580033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:24.581167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:24.581837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:25.688750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:25.705442 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0f74da7-9c78-49cf-bd5a-dd6771bdcb3e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 1.214156 Oct 01 21:07:25.706072 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2370/3640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:24 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:25.736004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:25.736700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:25.766984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=89 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:25.772086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:25.772661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:25.782574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:25.783991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:25.784714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:25.785378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:26.478049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:26.491228 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-46c43378-340f-41fa-8f3a-389d81a31ba2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.759385 Oct 01 21:07:26.492579 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2371/3641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:25 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:07:26.520817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19230133-a994-4094-9a84-420511a86640 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:26.523951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-19230133-a994-4094-9a84-420511a86640 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: acbe79c9-c698-4b04-97f3-b6c55d02deba] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:26.530702 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-19230133-a994-4094-9a84-420511a86640 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance acbe79c9-c698-4b04-97f3-b6c55d02deba could not be found. Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19230133-a994-4094-9a84-420511a86640 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/acbe79c9-c698-4b04-97f3-b6c55d02deba/action HTTP/1.1 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 28 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: {"reboot": {"type": "SOFT"}} Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance acbe79c9-c698-4b04-97f3-b6c55d02deba could not be found. Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'acbe79c9-c698-4b04-97f3-b6c55d02deba', 'body': {'reboot': {'type': 'SOFT'}}} Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbe79c9-c698-4b04-97f3-b6c55d02deba could not be found. Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbe79c9-c698-4b04-97f3-b6c55d02deba could not be found. Oct 01 21:07:26.534633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbe79c9-c698-4b04-97f3-b6c55d02deba could not be found. Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19230133-a994-4094-9a84-420511a86640 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance acbe79c9-c698-4b04-97f3-b6c55d02deba could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19230133-a994-4094-9a84-420511a86640 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/acbe79c9-c698-4b04-97f3-b6c55d02deba/action" status: 404 len: 111 microversion: 2.1 time: 0.018293 Oct 01 21:07:26.538617 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2372/3642] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:26 2022] POST /compute/v2.1/servers/acbe79c9-c698-4b04-97f3-b6c55d02deba/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:26.546637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:26.547272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:26.559735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:26.560506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:26.560956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:26.561869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:26.562525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:26.562981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:26.859918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:26.876089 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-db21c7e0-2b30-40cb-b17f-7119530f8638 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.336366 Oct 01 21:07:26.876912 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2373/3643] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:26 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:07:27.242127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-904440062", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "3c2f7971-e6b7-44c5-8e02-28c20d45e2d8"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:27.356470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] validate_networks() for [('3c2f7971-e6b7-44c5-8e02-28c20d45e2d8', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:07:28.828663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:07:28.829265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:07:28.829987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:07:28.830733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:07:28.831256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:07:28.891666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:28.894999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:28.905093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:28.906325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:28.910512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:28.911123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:28.977904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Getting quotas for project a2d2517d51d0417880e6e3d601c52744. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:07:29.011515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Getting quotas for user e7e3bc6d5e45497bb876d5cbcec61835 and project a2d2517d51d0417880e6e3d601c52744. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:07:29.038169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:07:29.045410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:07:29.173436 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a46329cb-fc7a-486e-b332-bbdef512cb48 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.275299 Oct 01 21:07:29.176780 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2374/3644] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:07:29.189321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:29.191251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:29.223425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:29.224369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:29.225478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:29.227311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:29.229692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:29.231765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:30.617703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:30.645575 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6c23345f-ee32-4933-bbd1-0c08c583e3bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 1.467192 Oct 01 21:07:30.651117 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2375/3645] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:29 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:30.668334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:30.668981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:30.692389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:30.692923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:30.707200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:30.709138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:30.710087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:30.712433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:31.347452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:31.365340 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-661eb192-773a-4726-9362-2061300d26c6 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1279 microversion: 2.1 time: 0.711478 Oct 01 21:07:31.369973 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2376/3646] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:30 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1279 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:31.386021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:31.389243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:31.406376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:31.409296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:31.413663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:31.418813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:31.419375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:31.419836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:31.469986 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b/action HTTP/1.1 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 65 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd2309b08-05db-4a69-9b23-76111e0ee07b', 'body': {'rebuild': {'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607'}}} Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 01 21:07:31.474844 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:31.482351 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b02c668f-b2f7-47ce-8f11-0bf8b8025a0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b/action" status: 404 len: 111 microversion: 2.1 time: 0.103655 Oct 01 21:07:31.486604 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2377/3647] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:31 2022] POST /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b/action => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:31.505827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:31.507472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:31.525724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:31.526203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:31.528909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:31.530993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:31.533179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:31.537633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:32.227867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:32.237254 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92b0e2a2-360d-4db6-b71d-30f389de86b8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.751148 Oct 01 21:07:32.238132 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2378/3648] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:31 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:32.243318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64e7e42f-0fde-4aac-95ee-fd5c852bf57f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:32.244107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64e7e42f-0fde-4aac-95ee-fd5c852bf57f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:32.253576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64e7e42f-0fde-4aac-95ee-fd5c852bf57f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:32.256038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64e7e42f-0fde-4aac-95ee-fd5c852bf57f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:32.256738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64e7e42f-0fde-4aac-95ee-fd5c852bf57f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:32.257854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64e7e42f-0fde-4aac-95ee-fd5c852bf57f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:32.262974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64e7e42f-0fde-4aac-95ee-fd5c852bf57f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:32.264643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64e7e42f-0fde-4aac-95ee-fd5c852bf57f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:32.308816 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64e7e42f-0fde-4aac-95ee-fd5c852bf57f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/ips" status: 200 len: 145 microversion: 2.1 time: 0.069327 Oct 01 21:07:32.309753 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2379/3649] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:07:32 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/ips => generated 145 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:32.319999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:32.320982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:32.331644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:32.332499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:32.333820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:32.334830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:32.335550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:32.336220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:32.925233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:32.950786 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5038f838-44d1-41bc-9cb3-3831a6e89513 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.637457 Oct 01 21:07:32.952218 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2380/3650] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:32 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:32.973377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:32.974412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:32.984552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:32.985654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:32.986318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:32.987663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:32.988341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:32.990452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:33.216697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:33.232426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf2acc89-31ec-457c-81be-5c1e532cedc8 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1285 microversion: 2.1 time: 0.273435 Oct 01 21:07:33.233814 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2381/3651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:32 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1285 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:33.251485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0738fd1-c679-47cd-abae-376906d6eeeb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:33.263309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e0738fd1-c679-47cd-abae-376906d6eeeb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:33.278370 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e0738fd1-c679-47cd-abae-376906d6eeeb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe could not be found. Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0738fd1-c679-47cd-abae-376906d6eeeb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe/action HTTP/1.1 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 65 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe could not be found. Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe', 'body': {'rebuild': {'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607'}}} Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe could not be found. Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 01 21:07:33.281180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe could not be found. Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe could not be found. Oct 01 21:07:33.285582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:33.286666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0738fd1-c679-47cd-abae-376906d6eeeb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:33.288953 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e0738fd1-c679-47cd-abae-376906d6eeeb tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe/action" status: 404 len: 111 microversion: 2.1 time: 0.054113 Oct 01 21:07:33.289634 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2382/3652] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:33 2022] POST /compute/v2.1/servers/a95a83d4-0c56-4e5e-a27f-2a4b9a618dfe/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:33.302750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:33.303647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:33.325167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:33.325974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:33.326714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:33.327631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:33.329550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:33.330159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:33.691268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:33.693580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:33.705699 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-10ed2e3d-df0a-4e02-b229-8cec0f04531b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.410544 Oct 01 21:07:33.706289 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2383/3653] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:33 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:33.739443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:33.740650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:33.760552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:33.761299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:33.762135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:33.765370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:33.766748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:33.771411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:34.591354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:34.601568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9605c09b-09eb-4447-bb1f-8a7cff4fdf4e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.870959 Oct 01 21:07:34.602748 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2384/3654] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:33 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:07:34.622855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:34.624574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:34.649593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:34.653474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:34.654250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:34.675425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:34.676200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:34.698676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:36.010683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:36.039037 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d214615e-ff9d-4e45-a679-d2fc8fd9b49b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1327 microversion: 2.1 time: 1.433912 Oct 01 21:07:36.064207 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2385/3655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:34 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1327 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:36.083600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-308442f6-23bf-4651-baf1-722f0854ac02 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:36.084273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-308442f6-23bf-4651-baf1-722f0854ac02 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: c7dd39ae-e9fa-4684-a6e3-c93b98587305] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:36.103876 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-308442f6-23bf-4651-baf1-722f0854ac02 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance c7dd39ae-e9fa-4684-a6e3-c93b98587305 could not be found. Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-308442f6-23bf-4651-baf1-722f0854ac02 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/c7dd39ae-e9fa-4684-a6e3-c93b98587305/action HTTP/1.1 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 15 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: {"restore": {}} Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance c7dd39ae-e9fa-4684-a6e3-c93b98587305 could not be found. Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'c7dd39ae-e9fa-4684-a6e3-c93b98587305', 'body': {'restore': {}}} Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7dd39ae-e9fa-4684-a6e3-c93b98587305 could not be found. Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7dd39ae-e9fa-4684-a6e3-c93b98587305 could not be found. Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:36.105465 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:36.109659 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:36.109659 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:36.109659 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7dd39ae-e9fa-4684-a6e3-c93b98587305 could not be found. Oct 01 21:07:36.109659 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:36.120939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-308442f6-23bf-4651-baf1-722f0854ac02 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance c7dd39ae-e9fa-4684-a6e3-c93b98587305 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:36.120939 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-308442f6-23bf-4651-baf1-722f0854ac02 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/c7dd39ae-e9fa-4684-a6e3-c93b98587305/action" status: 404 len: 111 microversion: 2.1 time: 0.054955 Oct 01 21:07:36.123699 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2386/3656] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:36 2022] POST /compute/v2.1/servers/c7dd39ae-e9fa-4684-a6e3-c93b98587305/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:36.148496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac8f2848-09df-42a2-8de6-afb47b1cac1b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f05a8921-7393-4c72-bce8-e68fb45486ed"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:36.155466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac8f2848-09df-42a2-8de6-afb47b1cac1b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:36.179464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac8f2848-09df-42a2-8de6-afb47b1cac1b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:36.183197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac8f2848-09df-42a2-8de6-afb47b1cac1b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:36.183656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac8f2848-09df-42a2-8de6-afb47b1cac1b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:36.184429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac8f2848-09df-42a2-8de6-afb47b1cac1b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:36.184907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac8f2848-09df-42a2-8de6-afb47b1cac1b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:36.186169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac8f2848-09df-42a2-8de6-afb47b1cac1b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:36.590800 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac8f2848-09df-42a2-8de6-afb47b1cac1b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.456494 Oct 01 21:07:36.591426 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2387/3657] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:07:36 2022] POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/os-volume_attachments => generated 194 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:36.619287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:36.624744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:36.654926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:36.656261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:36.660514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:36.661625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:36.664037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:36.664507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:37.294727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:37.322617 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-797196d4-9d36-415b-a3a3-e4e49e132ff3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.709300 Oct 01 21:07:37.339047 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2388/3658] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:36 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:37.348445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:37.349090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:37.365028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:37.365818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:37.366478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:37.367447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:37.368106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:37.373188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:37.881740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:37.916130 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-03bc7d3e-a010-4aed-a04a-2c9c43de69ee tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1327 microversion: 2.1 time: 0.575183 Oct 01 21:07:37.925539 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2389/3659] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:37 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1327 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:37.946793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:37.948245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:37.968707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:37.969336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:37.970092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:37.970771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:37.971337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:37.974159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:38.657271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:38.670296 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-10f5f54c-a8ec-490f-8334-bbc80bd3c302 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.737894 Oct 01 21:07:38.671473 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2390/3660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:37 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:38.695686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b3b47e48-fa6f-4ed6-aa9b-39a00fc9c784 req-31bfad69-7ac1-48f0-b355-d5cc7f048861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d97511-64e4-4ee2-a853-a189f8658893", "tag": "ccb27259-67b2-43bf-b5f7-1b86246f386e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:38.706901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b3b47e48-fa6f-4ed6-aa9b-39a00fc9c784 req-31bfad69-7ac1-48f0-b355-d5cc7f048861 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:38.707665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b3b47e48-fa6f-4ed6-aa9b-39a00fc9c784 req-31bfad69-7ac1-48f0-b355-d5cc7f048861 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:38.708853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b3b47e48-fa6f-4ed6-aa9b-39a00fc9c784 req-31bfad69-7ac1-48f0-b355-d5cc7f048861 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:38.739599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b3b47e48-fa6f-4ed6-aa9b-39a00fc9c784 req-31bfad69-7ac1-48f0-b355-d5cc7f048861 service nova] Creating event network-changed:ccb27259-67b2-43bf-b5f7-1b86246f386e for instance 32d97511-64e4-4ee2-a853-a189f8658893 on nch1-master-1 Oct 01 21:07:38.751595 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b3b47e48-fa6f-4ed6-aa9b-39a00fc9c784 req-31bfad69-7ac1-48f0-b355-d5cc7f048861 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064230 Oct 01 21:07:38.752605 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2391/3661] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:38.948432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:38.979069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4b9c9d7-55b4-4437-a515-de93009f44b8 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f41726a9550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-526658878", "description": "tempest-description-1220231182"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:39.022799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:39.226629 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a4b9c9d7-55b4-4437-a515-de93009f44b8 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.470314 Oct 01 21:07:39.227253 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2392/3662] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:07:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:39.240968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:39.241659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:39.260335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:39.262420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:39.263256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:39.267000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:39.267907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:39.268663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:39.316930 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Cannot 'restore' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action HTTP/1.1 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 15 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: {"restore": {}} Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'restore' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8', 'body': {'restore': {}}} Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 in vm_state active. Cannot restore while the instance is in this state. Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:39.318808 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:39.324146 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:39.324146 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:39.324146 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:39.324146 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:07:39.324146 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:39.324146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 409 to user: Cannot 'restore' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:39.324689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b984dc54-a1b4-464c-b96f-a37498876a99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 409 len: 145 microversion: 2.1 time: 0.095160 Oct 01 21:07:39.325827 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2393/3663] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:39 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 145 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:07:39.331074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:39.332012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:39.339935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:39.340687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:39.341383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:39.342316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:39.343064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:39.343734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:39.542857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:39.565108 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b76b356d-11b5-4d72-bf88-daa578c8618e tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1327 microversion: 2.1 time: 0.229698 Oct 01 21:07:39.566163 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2394/3664] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:39 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1327 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:39.582674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e830c74e-0203-46ed-9480-999c66f528e4 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f4172989550>, body: {"security_group_rule": {"parent_group_id": "926dd6b3-668b-4737-9846-5961561d80fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:40.672752 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e830c74e-0203-46ed-9480-999c66f528e4 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.105400 Oct 01 21:07:40.678229 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2395/3665] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:07:39 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:40.690323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:40.700254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:40.734876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:40.735612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:40.736296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:40.737281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:40.737904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:40.738825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:41.167151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:41.182005 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-457f0ace-7912-4413-a999-8b3dec9f3345 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.500936 Oct 01 21:07:41.182961 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2396/3666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:40 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:41.188144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-11e8cb14-e422-4bcd-832e-d08788957ddb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:41.196529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11e8cb14-e422-4bcd-832e-d08788957ddb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:41.197241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11e8cb14-e422-4bcd-832e-d08788957ddb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:41.197921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11e8cb14-e422-4bcd-832e-d08788957ddb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:41.232703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-11e8cb14-e422-4bcd-832e-d08788957ddb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Going to try to stop instance {{(pid=140438) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 21:07:41.307371 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-11e8cb14-e422-4bcd-832e-d08788957ddb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/action" status: 202 len: 0 microversion: 2.1 time: 0.122997 Oct 01 21:07:41.308329 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2397/3667] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:41 2022] POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:41.318017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:41.318946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:41.326135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:41.326934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:41.327542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:41.328454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:41.329070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:41.329964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:42.061953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:42.079899 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24325a11-714f-48c0-813f-231e20cd6a56 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1327 microversion: 2.1 time: 0.765591 Oct 01 21:07:42.080680 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2398/3668] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:41 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1327 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:42.086748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-071d6751-2b52-4976-9ec4-55be4994e9e9 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f417284a5e0>, body: {"security_group_rule": {"parent_group_id": "926dd6b3-668b-4737-9846-5961561d80fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:42.259513 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-071d6751-2b52-4976-9ec4-55be4994e9e9 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] HTTP exception thrown: This rule already exists in group 926dd6b3-668b-4737-9846-5961561d80fe Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-071d6751-2b52-4976-9ec4-55be4994e9e9 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Request method failure captured: Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 138 Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwZ8KMjHTohlwBaSMyyynbJbsHVnUwL8LGHeeYAE9qpQ68BU-31XVAVdZD17hofuhARTFQo3fZqtGb7ccGXTJZDpP3uguOB2MSwf4ikgJPxf22_Th-qzNYb4IhKWfdUQg15RYCp-BE6zCYXsRu2cB4SYbp66bbg2AH095f3m0R_Qno Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a8725bd62074b56b5712f469358728c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a8725bd62074b56b5712f469358728c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}] Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 148cdf56f4a14512aba0659e4c362959 Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: {"security_group_rule": {"parent_group_id": "926dd6b3-668b-4737-9846-5961561d80fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: exception: This rule already exists in group 926dd6b3-668b-4737-9846-5961561d80fe Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'security_group_rule': {'parent_group_id': '926dd6b3-668b-4737-9846-5961561d80fe', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 926dd6b3-668b-4737-9846-5961561d80fe Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 926dd6b3-668b-4737-9846-5961561d80fe Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:42.261497 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:42.266913 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:42.266913 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:42.266913 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 926dd6b3-668b-4737-9846-5961561d80fe Oct 01 21:07:42.266913 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:42.268990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-071d6751-2b52-4976-9ec4-55be4994e9e9 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Returning 400 to user: This rule already exists in group 926dd6b3-668b-4737-9846-5961561d80fe {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:42.271594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-071d6751-2b52-4976-9ec4-55be4994e9e9 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.189536 Oct 01 21:07:42.272685 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2399/3669] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:07:42 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:07:42.293457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:42.295527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:42.365676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:42.366200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:42.366657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:42.371300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:42.372005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:42.372911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:42.631008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:42.641133 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-538b0a83-6dfd-4092-a58e-7f4df8bb9315 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.366652 Oct 01 21:07:42.660039 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2400/3670] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:42 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:42.669525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:42.670942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:42.686220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:42.694549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:42.695049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:42.695885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:42.696349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:42.702592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:43.055234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:43.072132 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4e9d559e-2bde-4962-b504-303ec4e6d7d4 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1723 microversion: 2.1 time: 0.410262 Oct 01 21:07:43.072812 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2401/3671] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:42 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:43.085260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0639bd09-dd51-4358-8fbb-f7213acf3586 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Calling method '.version_select at 0x7f4172692f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:43.534215 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0639bd09-dd51-4358-8fbb-f7213acf3586 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/7efe7c7a-a429-4112-888d-6433253cee06" status: 202 len: 0 microversion: 2.1 time: 0.456038 Oct 01 21:07:43.539696 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2402/3672] 10.222.0.17 () {58 vars in 1287 bytes} [Sat Oct 1 21:07:43 2022] DELETE /compute/v2.1/os-security-group-rules/7efe7c7a-a429-4112-888d-6433253cee06 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:43.543025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a043acf-b8e7-4fce-84c9-ffe2b5be4b66 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:43.543799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a043acf-b8e7-4fce-84c9-ffe2b5be4b66 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 928611f4-1964-4e0a-bd2b-ff7336ae31ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:43.551729 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3a043acf-b8e7-4fce-84c9-ffe2b5be4b66 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance 928611f4-1964-4e0a-bd2b-ff7336ae31ea could not be found. Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a043acf-b8e7-4fce-84c9-ffe2b5be4b66 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/928611f4-1964-4e0a-bd2b-ff7336ae31ea/action HTTP/1.1 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 14 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: {"resume": {}} Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 928611f4-1964-4e0a-bd2b-ff7336ae31ea could not be found. Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '928611f4-1964-4e0a-bd2b-ff7336ae31ea', 'body': {'resume': {}}} Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928611f4-1964-4e0a-bd2b-ff7336ae31ea could not be found. Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928611f4-1964-4e0a-bd2b-ff7336ae31ea could not be found. Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:43.560414 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:43.565617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:43.565617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:43.565617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928611f4-1964-4e0a-bd2b-ff7336ae31ea could not be found. Oct 01 21:07:43.565617 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:43.565617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a043acf-b8e7-4fce-84c9-ffe2b5be4b66 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance 928611f4-1964-4e0a-bd2b-ff7336ae31ea could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:43.566984 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a043acf-b8e7-4fce-84c9-ffe2b5be4b66 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/928611f4-1964-4e0a-bd2b-ff7336ae31ea/action" status: 404 len: 111 microversion: 2.1 time: 0.027750 Oct 01 21:07:43.567611 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2403/3673] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:43 2022] POST /compute/v2.1/servers/928611f4-1964-4e0a-bd2b-ff7336ae31ea/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:43.575347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:43.576194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:43.583758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:43.584247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:43.584686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:43.585447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:43.585916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:43.586334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:43.907861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:43.920024 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3330267b-7de4-4153-89a7-9761be5bb07b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1327 microversion: 2.1 time: 0.350867 Oct 01 21:07:43.922564 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2404/3674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:43 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1327 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:43.928858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5923cfad-0779-4f36-bbd5-895d78cafa25 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f4172692a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1873408288", "description": "tempest-description-156049128"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:44.252893 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5923cfad-0779-4f36-bbd5-895d78cafa25 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.329002 Oct 01 21:07:44.254223 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2405/3675] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:07:43 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:44.268468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:44.269376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:44.278700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:44.281516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:44.282643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:44.283574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:44.284208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:44.284827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:44.290025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:44.486170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:44.504177 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a018b9e5-c2d4-4cc2-bb35-0642b0394855 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.248266 Oct 01 21:07:44.505250 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2406/3676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:44 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:44.528747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:44.529443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:44.550308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:44.551260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:44.551936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:44.552866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:44.553875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:44.554557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:44.754259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:44.769352 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe55c08e-76a9-4c83-ac99-74574c1d2031 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1723 microversion: 2.1 time: 0.262376 Oct 01 21:07:44.770326 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2407/3677] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:44 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:44.776874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83bbf3dd-0be4-4a5d-b8ce-39d00665fcf6 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f41728373a0>, body: {"security_group_rule": {"parent_group_id": "2e01ca54-7d45-4a7a-8bc9-f55900386f2b", "ip_protocol": "tcp", "from_port": 19028057, "to_port": 22}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:44.857587 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-83bbf3dd-0be4-4a5d-b8ce-39d00665fcf6 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] HTTP exception thrown: Invalid port range 19028057:22. Former value cannot be greater than the later Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83bbf3dd-0be4-4a5d-b8ce-39d00665fcf6 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Request method failure captured: Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 144 Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwZ8KMjHTohlwBaSMyyynbJbsHVnUwL8LGHeeYAE9qpQ68BU-31XVAVdZD17hofuhARTFQo3fZqtGb7ccGXTJZDpP3uguOB2MSwf4ikgJPxf22_Th-qzNYb4IhKWfdUQg15RYCp-BE6zCYXsRu2cB4SYbp66bbg2AH095f3m0R_Qno Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a8725bd62074b56b5712f469358728c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a8725bd62074b56b5712f469358728c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}] Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 148cdf56f4a14512aba0659e4c362959 Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: {"security_group_rule": {"parent_group_id": "2e01ca54-7d45-4a7a-8bc9-f55900386f2b", "ip_protocol": "tcp", "from_port": 19028057, "to_port": 22}} Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid port range 19028057:22. Former value cannot be greater than the later Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2e01ca54-7d45-4a7a-8bc9-f55900386f2b', 'ip_protocol': 'tcp', 'from_port': 19028057, 'to_port': 22}}} Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 19028057:22. Former value cannot be greater than the later Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 19028057:22. Former value cannot be greater than the later Oct 01 21:07:44.859439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 19028057:22. Former value cannot be greater than the later Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83bbf3dd-0be4-4a5d-b8ce-39d00665fcf6 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Returning 400 to user: Invalid port range 19028057:22. Former value cannot be greater than the later {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-83bbf3dd-0be4-4a5d-b8ce-39d00665fcf6 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.089644 Oct 01 21:07:44.863904 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2408/3678] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:07:44 2022] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:07:44.872339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:44.873342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:44.881029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:44.881917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:44.882478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:44.883577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:44.884703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:44.885581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:45.065382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:45.076873 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-42326896-e674-4842-a304-b37baf967796 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.209080 Oct 01 21:07:45.078014 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2409/3679] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:44 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:45.085593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8357532-9718-4b68-8ed9-4596b0afe1f7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f41728370d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1701327045", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:45.085593 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b8357532-9718-4b68-8ed9-4596b0afe1f7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] HTTP exception thrown: Security group id should be uuid Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8357532-9718-4b68-8ed9-4596b0afe1f7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Request method failure captured: Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 131 Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwZ8KMjHTohlwBaSMyyynbJbsHVnUwL8LGHeeYAE9qpQ68BU-31XVAVdZD17hofuhARTFQo3fZqtGb7ccGXTJZDpP3uguOB2MSwf4ikgJPxf22_Th-qzNYb4IhKWfdUQg15RYCp-BE6zCYXsRu2cB4SYbp66bbg2AH095f3m0R_Qno Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a8725bd62074b56b5712f469358728c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a8725bd62074b56b5712f469358728c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}] Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 148cdf56f4a14512aba0659e4c362959 Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1701327045", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group id should be uuid Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1701327045', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:45.087380 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:45.093167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 01 21:07:45.093167 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.094179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8357532-9718-4b68-8ed9-4596b0afe1f7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Returning 400 to user: Security group id should be uuid {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:45.095598 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8357532-9718-4b68-8ed9-4596b0afe1f7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016227 Oct 01 21:07:45.097009 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2410/3680] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:07:45 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 21:07:45.102899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:45.103934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:45.116054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:45.116875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:45.117322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:45.118075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:45.118552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:45.119322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:45.302251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:45.317142 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-757f7883-7f02-453d-ac15-c9d78702d977 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1327 microversion: 2.1 time: 0.218796 Oct 01 21:07:45.334943 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2411/3681] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:45 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1327 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:45.344397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:45.344964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:45.354807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:45.355824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:45.356648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:45.357573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:45.358313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:45.359567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:45.402677 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Cannot 'resume' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action HTTP/1.1 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 14 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: {"resume": {}} Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'resume' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8', 'body': {'resume': {}}} Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 in vm_state active. Cannot resume while the instance is in this state. Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:45.406019 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.411582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:45.411582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:45.411582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:45.411582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:45.411582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:45.411582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:07:45.411582 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:45.413732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 409 to user: Cannot 'resume' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:45.416830 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-145ebdea-63e4-47af-8cab-184f6fb37062 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 409 len: 144 microversion: 2.1 time: 0.077053 Oct 01 21:07:45.418047 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2412/3682] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:45 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 144 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:07:45.431695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4a6965a-e421-4aa8-b7cc-fcd18f77aa09 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f4172ff28b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1587858558", "description": "tempest-description-2013199307"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:45.686898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4a6965a-e421-4aa8-b7cc-fcd18f77aa09 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.267029 Oct 01 21:07:45.687921 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2413/3683] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:07:45 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:45.701436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:45.702747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:45.712685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:45.713782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:45.714571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:45.715810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:45.716614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:45.718645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:45.886029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:45.897338 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-472c1d61-e8f4-4358-86af-bceedd466d8d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.207208 Oct 01 21:07:45.903962 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2414/3684] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:45 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:45.909378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-abd1207f-6a65-4bbd-ab17-b37f947e1dac req-f63094ab-ad77-413c-8d02-a26d5a688689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d97511-64e4-4ee2-a853-a189f8658893", "name": "network-vif-plugged", "status": "completed", "tag": "ccb27259-67b2-43bf-b5f7-1b86246f386e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:45.921932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-abd1207f-6a65-4bbd-ab17-b37f947e1dac req-f63094ab-ad77-413c-8d02-a26d5a688689 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:45.923331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-abd1207f-6a65-4bbd-ab17-b37f947e1dac req-f63094ab-ad77-413c-8d02-a26d5a688689 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:45.924804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-abd1207f-6a65-4bbd-ab17-b37f947e1dac req-f63094ab-ad77-413c-8d02-a26d5a688689 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:45.941393 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-abd1207f-6a65-4bbd-ab17-b37f947e1dac req-f63094ab-ad77-413c-8d02-a26d5a688689 service nova] Creating event network-vif-plugged:ccb27259-67b2-43bf-b5f7-1b86246f386e for instance 32d97511-64e4-4ee2-a853-a189f8658893 on nch1-master-1 Oct 01 21:07:45.948544 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-abd1207f-6a65-4bbd-ab17-b37f947e1dac req-f63094ab-ad77-413c-8d02-a26d5a688689 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042844 Oct 01 21:07:45.950796 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2415/3685] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:45.959500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5251b14d-1c6e-432c-a3ad-d4453c2335f8 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f4172735820>, body: {"security_group_rule": {"parent_group_id": "3cf8efef-9a32-4c26-b290-0d03490bdf24", "ip_protocol": "tempest-999-263833162", "from_port": 22, "to_port": 22}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:46.089877 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5251b14d-1c6e-432c-a3ad-d4453c2335f8 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] HTTP exception thrown: Invalid IP protocol tempest-999-263833162. Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5251b14d-1c6e-432c-a3ad-d4453c2335f8 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Request method failure captured: Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 156 Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwZ8KMjHTohlwBaSMyyynbJbsHVnUwL8LGHeeYAE9qpQ68BU-31XVAVdZD17hofuhARTFQo3fZqtGb7ccGXTJZDpP3uguOB2MSwf4ikgJPxf22_Th-qzNYb4IhKWfdUQg15RYCp-BE6zCYXsRu2cB4SYbp66bbg2AH095f3m0R_Qno Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a8725bd62074b56b5712f469358728c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a8725bd62074b56b5712f469358728c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}] Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 148cdf56f4a14512aba0659e4c362959 Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: {"security_group_rule": {"parent_group_id": "3cf8efef-9a32-4c26-b290-0d03490bdf24", "ip_protocol": "tempest-999-263833162", "from_port": 22, "to_port": 22}} Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid IP protocol tempest-999-263833162. Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3cf8efef-9a32-4c26-b290-0d03490bdf24', 'ip_protocol': 'tempest-999-263833162', 'from_port': 22, 'to_port': 22}}} Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-263833162. Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-263833162. Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:46.093331 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:46.099630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:46.099630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:46.099630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:46.099630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:46.099630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:46.099630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:46.099630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-263833162. Oct 01 21:07:46.099630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:46.102659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5251b14d-1c6e-432c-a3ad-d4453c2335f8 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Returning 400 to user: Invalid IP protocol tempest-999-263833162. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:46.104048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5251b14d-1c6e-432c-a3ad-d4453c2335f8 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.153078 Oct 01 21:07:46.105300 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2416/3686] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:07:45 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 01 21:07:46.125907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:46.129853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:46.152853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:46.154056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:46.154993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:46.156136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:46.156586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:46.157166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:46.418611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:46.440434 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99853e13-bcd9-45fb-b358-cf763158c945 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1723 microversion: 2.1 time: 0.333718 Oct 01 21:07:46.442045 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2417/3687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:46 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:46.448353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:46.449084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:46.456681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:46.456681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:46.457143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:46.458185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:46.458919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:46.459401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:46.669501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:46.679204 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-59ac8fd7-ff1e-4f47-af06-1d8540871648 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.235557 Oct 01 21:07:46.679810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2418/3688] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:46 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:46.688206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbe43159-2d35-4df7-a16f-7f3427ae68ac tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f4172837ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1465592762", "description": "tempest-description-255160966"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:46.966992 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cbe43159-2d35-4df7-a16f-7f3427ae68ac tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.284931 Oct 01 21:07:46.967800 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2419/3689] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:07:46 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:46.974126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:46.975035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:46.984063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:46.985350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:46.985821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:46.987384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:46.988217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:46.988848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:47.175666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:47.189336 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1f710133-e556-4fb7-9e1e-7e2d242f677b tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1327 microversion: 2.1 time: 0.219757 Oct 01 21:07:47.190360 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2420/3690] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:46 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1327 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:47.195783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4feb0b54-bb70-40b1-8916-5a3e4b875cf7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f4172b32dc0>, body: {"security_group_rule": {"parent_group_id": "70d789cd-d55c-4a17-832d-2e8e83cae090", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:47.257213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-4feb0b54-bb70-40b1-8916-5a3e4b875cf7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4feb0b54-bb70-40b1-8916-5a3e4b875cf7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Request method failure captured: Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 138 Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwZ8KMjHTohlwBaSMyyynbJbsHVnUwL8LGHeeYAE9qpQ68BU-31XVAVdZD17hofuhARTFQo3fZqtGb7ccGXTJZDpP3uguOB2MSwf4ikgJPxf22_Th-qzNYb4IhKWfdUQg15RYCp-BE6zCYXsRu2cB4SYbp66bbg2AH095f3m0R_Qno Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a8725bd62074b56b5712f469358728c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a8725bd62074b56b5712f469358728c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}] Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 148cdf56f4a14512aba0659e4c362959 Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: {"security_group_rule": {"parent_group_id": "70d789cd-d55c-4a17-832d-2e8e83cae090", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'security_group_rule': {'parent_group_id': '70d789cd-d55c-4a17-832d-2e8e83cae090', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 01 21:07:47.260251 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4feb0b54-bb70-40b1-8916-5a3e4b875cf7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4feb0b54-bb70-40b1-8916-5a3e4b875cf7 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.070228 Oct 01 21:07:47.265318 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2421/3691] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:07:47 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:07:47.272651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3dbc6f8b-f50a-44cb-bb31-7b0408a1614f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3dbc6f8b-f50a-44cb-bb31-7b0408a1614f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 160 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a5c86243-7722-488d-b90b-df7ddabb6bde"}]}} Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'server': {'name': '', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'networks': [{'uuid': 'a5c86243-7722-488d-b90b-df7ddabb6bde'}]}}} Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '' Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:07:47.278476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3dbc6f8b-f50a-44cb-bb31-7b0408a1614f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3dbc6f8b-f50a-44cb-bb31-7b0408a1614f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.015722 Oct 01 21:07:47.283743 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2422/3692] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:07:47 2022] POST /compute/v2.1/servers => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:07:47.295352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c76b0bcf-4f14-4ef0-9f89-254c4c369804 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f41728db820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1562851509", "description": "tempest-description-1952379805"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:47.542484 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c76b0bcf-4f14-4ef0-9f89-254c4c369804 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.260181 Oct 01 21:07:47.543150 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2423/3693] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:07:47 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:47.548955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:47.549865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:47.566139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:47.566760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:47.568547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:47.568547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:47.580594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:47.581771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:47.764881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:47.777055 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b9d07675-d5e6-489f-92ad-800ecb5a5bfe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.232819 Oct 01 21:07:47.777914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2424/3694] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:47 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:47.783826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:47.784519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:47.792422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:47.793668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:47.794286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:47.795246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:47.795910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:47.796637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:47.984662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:47.996768 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a6ff65d-378f-457e-86ff-76ee6186a50b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1723 microversion: 2.1 time: 0.217501 Oct 01 21:07:47.997388 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2425/3695] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:47 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:48.002448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2c09fcd-0406-4fcc-b408-bbd77dabca42 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f417284a5e0>, body: {"security_group_rule": {"parent_group_id": "5e0548fb-6ccd-4b9d-be7a-5c5e217f8c46", "ip_protocol": "tcp", "from_port": 22, "to_port": 187394500}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:48.095028 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a2c09fcd-0406-4fcc-b408-bbd77dabca42 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] HTTP exception thrown: Invalid port range 22:187394500. Valid TCP ports should be between 1-65535 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2c09fcd-0406-4fcc-b408-bbd77dabca42 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Request method failure captured: Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 145 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwZ8KMjHTohlwBaSMyyynbJbsHVnUwL8LGHeeYAE9qpQ68BU-31XVAVdZD17hofuhARTFQo3fZqtGb7ccGXTJZDpP3uguOB2MSwf4ikgJPxf22_Th-qzNYb4IhKWfdUQg15RYCp-BE6zCYXsRu2cB4SYbp66bbg2AH095f3m0R_Qno Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a8725bd62074b56b5712f469358728c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a8725bd62074b56b5712f469358728c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}] Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 148cdf56f4a14512aba0659e4c362959 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: {"security_group_rule": {"parent_group_id": "5e0548fb-6ccd-4b9d-be7a-5c5e217f8c46", "ip_protocol": "tcp", "from_port": 22, "to_port": 187394500}} Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid port range 22:187394500. Valid TCP ports should be between 1-65535 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5e0548fb-6ccd-4b9d-be7a-5c5e217f8c46', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 187394500}}} Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:187394500. Valid TCP ports should be between 1-65535 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:187394500. Valid TCP ports should be between 1-65535 Oct 01 21:07:48.096688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:187394500. Valid TCP ports should be between 1-65535 Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2c09fcd-0406-4fcc-b408-bbd77dabca42 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Returning 400 to user: Invalid port range 22:187394500. Valid TCP ports should be between 1-65535 {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a2c09fcd-0406-4fcc-b408-bbd77dabca42 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.099780 Oct 01 21:07:48.101630 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2426/3696] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:07:47 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:07:48.106821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:48.108243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:48.132222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:48.138529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:48.139073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:48.139827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:48.140229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:48.140674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:48.339700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:48.353064 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-59d3979f-5f60-4432-a1b7-7abb1ed71c29 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.251874 Oct 01 21:07:48.354010 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2427/3697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:48 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:48.360273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bf16ad1-4d38-4287-b69e-f1d5becc3ed1 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Action: 'create', calling method: .version_select at 0x7f417c2ecb80>, body: {"security_group_rule": {"parent_group_id": "29603a53-89cc-44aa-8fa6-dc8bf5796a9a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:48.389791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-6bf16ad1-4d38-4287-b69e-f1d5becc3ed1 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 29603a53-89cc-44aa-8fa6-dc8bf5796a9a does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:07:48.390640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-6bf16ad1-4d38-4287-b69e-f1d5becc3ed1 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Neutron security group 29603a53-89cc-44aa-8fa6-dc8bf5796a9a not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:07:48.391847 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-6bf16ad1-4d38-4287-b69e-f1d5becc3ed1 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] HTTP exception thrown: Security group 29603a53-89cc-44aa-8fa6-dc8bf5796a9a does not exist Oct 01 21:07:48.391847 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-150364a6-2f95-42df-b444-b56da97f1f33'] Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bf16ad1-4d38-4287-b69e-f1d5becc3ed1 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Request method failure captured: Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 138 Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwZ8KMjHTohlwBaSMyyynbJbsHVnUwL8LGHeeYAE9qpQ68BU-31XVAVdZD17hofuhARTFQo3fZqtGb7ccGXTJZDpP3uguOB2MSwf4ikgJPxf22_Th-qzNYb4IhKWfdUQg15RYCp-BE6zCYXsRu2cB4SYbp66bbg2AH095f3m0R_Qno Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a8725bd62074b56b5712f469358728c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a8725bd62074b56b5712f469358728c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}] Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 148cdf56f4a14512aba0659e4c362959 Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: {"security_group_rule": {"parent_group_id": "29603a53-89cc-44aa-8fa6-dc8bf5796a9a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group 29603a53-89cc-44aa-8fa6-dc8bf5796a9a does not exist Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-150364a6-2f95-42df-b444-b56da97f1f33'] Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'body': {'security_group_rule': {'parent_group_id': '29603a53-89cc-44aa-8fa6-dc8bf5796a9a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:07:48.393991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 29603a53-89cc-44aa-8fa6-dc8bf5796a9a does not exist Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-150364a6-2f95-42df-b444-b56da97f1f33'] Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 29603a53-89cc-44aa-8fa6-dc8bf5796a9a does not exist Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-150364a6-2f95-42df-b444-b56da97f1f33'] Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 29603a53-89cc-44aa-8fa6-dc8bf5796a9a does not exist Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-150364a6-2f95-42df-b444-b56da97f1f33'] Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 29603a53-89cc-44aa-8fa6-dc8bf5796a9a does not exist Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-150364a6-2f95-42df-b444-b56da97f1f33'] Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bf16ad1-4d38-4287-b69e-f1d5becc3ed1 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Returning 404 to user: Security group 29603a53-89cc-44aa-8fa6-dc8bf5796a9a does not exist Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-150364a6-2f95-42df-b444-b56da97f1f33'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6bf16ad1-4d38-4287-b69e-f1d5becc3ed1 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.040252 Oct 01 21:07:48.397690 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2428/3698] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Oct 1 21:07:48 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:48.404290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:48.406543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:48.416168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:48.418151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:48.419070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:48.419957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:48.421112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:48.421937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:48.422746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:48.806915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:48.817774 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c9466294-3c0f-4ff4-bf9e-ae701a3072e9 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1528 microversion: 2.1 time: 0.418458 Oct 01 21:07:48.819183 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2429/3699] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:48 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1528 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:48.824929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b30ba60-36bc-481d-9350-f44eb3a439cc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:48.825704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4b30ba60-36bc-481d-9350-f44eb3a439cc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: ae4cea17-52aa-4329-9469-1895208b125c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:48.832348 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-4b30ba60-36bc-481d-9350-f44eb3a439cc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance ae4cea17-52aa-4329-9469-1895208b125c could not be found. Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b30ba60-36bc-481d-9350-f44eb3a439cc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/ae4cea17-52aa-4329-9469-1895208b125c/action HTTP/1.1 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 14 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: {"shelve": {}} Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance ae4cea17-52aa-4329-9469-1895208b125c could not be found. Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'ae4cea17-52aa-4329-9469-1895208b125c', 'body': {'shelve': {}}} Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae4cea17-52aa-4329-9469-1895208b125c could not be found. Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4cea17-52aa-4329-9469-1895208b125c could not be found. Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:48.835595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:48.844772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:48.844772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:48.844772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4cea17-52aa-4329-9469-1895208b125c could not be found. Oct 01 21:07:48.844772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.844772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b30ba60-36bc-481d-9350-f44eb3a439cc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance ae4cea17-52aa-4329-9469-1895208b125c could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:48.844772 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b30ba60-36bc-481d-9350-f44eb3a439cc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/ae4cea17-52aa-4329-9469-1895208b125c/action" status: 404 len: 111 microversion: 2.1 time: 0.017341 Oct 01 21:07:48.844772 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2430/3700] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:48 2022] POST /compute/v2.1/servers/ae4cea17-52aa-4329-9469-1895208b125c/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:48.846853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33d8f942-b7b4-4462-9751-ecd3f80e1c8e tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Calling method '.version_select at 0x7f4172795310>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:48.922447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-33d8f942-b7b4-4462-9751-ecd3f80e1c8e tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 0f8fbf86-754f-4d97-807e-3ef1a82f38ae does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:07:48.923503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-33d8f942-b7b4-4462-9751-ecd3f80e1c8e tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Neutron security group rule 0f8fbf86-754f-4d97-807e-3ef1a82f38ae not found {{(pid=140438) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 01 21:07:48.929821 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-33d8f942-b7b4-4462-9751-ecd3f80e1c8e tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] HTTP exception thrown: Security group rule 0f8fbf86-754f-4d97-807e-3ef1a82f38ae does not exist Oct 01 21:07:48.929821 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-8d714857-6bfd-4e10-a1f5-39e099060477'] Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33d8f942-b7b4-4462-9751-ecd3f80e1c8e tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Request method failure captured: Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-group-rules/0f8fbf86-754f-4d97-807e-3ef1a82f38ae HTTP/1.1 Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwZ8KMjHTohlwBaSMyyynbJbsHVnUwL8LGHeeYAE9qpQ68BU-31XVAVdZD17hofuhARTFQo3fZqtGb7ccGXTJZDpP3uguOB2MSwf4ikgJPxf22_Th-qzNYb4IhKWfdUQg15RYCp-BE6zCYXsRu2cB4SYbp66bbg2AH095f3m0R_Qno Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a8725bd62074b56b5712f469358728c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a8725bd62074b56b5712f469358728c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a8725bd62074b56b5712f469358728c"}]}] Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 7a8725bd62074b56b5712f469358728c Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842 Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 148cdf56f4a14512aba0659e4c362959 Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group rule 0f8fbf86-754f-4d97-807e-3ef1a82f38ae does not exist Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-8d714857-6bfd-4e10-a1f5-39e099060477'] Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0f8fbf86-754f-4d97-807e-3ef1a82f38ae'} Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:07:48.934581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 0f8fbf86-754f-4d97-807e-3ef1a82f38ae does not exist Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d714857-6bfd-4e10-a1f5-39e099060477'] Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 0f8fbf86-754f-4d97-807e-3ef1a82f38ae does not exist Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d714857-6bfd-4e10-a1f5-39e099060477'] Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 0f8fbf86-754f-4d97-807e-3ef1a82f38ae does not exist Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d714857-6bfd-4e10-a1f5-39e099060477'] Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 0f8fbf86-754f-4d97-807e-3ef1a82f38ae does not exist Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d714857-6bfd-4e10-a1f5-39e099060477'] Oct 01 21:07:48.939904 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:48.943594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33d8f942-b7b4-4462-9751-ecd3f80e1c8e tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Returning 404 to user: Security group rule 0f8fbf86-754f-4d97-807e-3ef1a82f38ae does not exist Oct 01 21:07:48.943594 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-8d714857-6bfd-4e10-a1f5-39e099060477'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:48.945617 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-33d8f942-b7b4-4462-9751-ecd3f80e1c8e tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/0f8fbf86-754f-4d97-807e-3ef1a82f38ae" status: 404 len: 199 microversion: 2.1 time: 0.105750 Oct 01 21:07:48.950020 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2431/3701] 10.222.0.17 () {58 vars in 1287 bytes} [Sat Oct 1 21:07:48 2022] DELETE /compute/v2.1/os-security-group-rules/0f8fbf86-754f-4d97-807e-3ef1a82f38ae => generated 199 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:48.961614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:48.962610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:48.969267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:48.969825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:48.970316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:48.971183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:48.972226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:48.972667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:49.228844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:49.238298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d6a5a887-d871-45d4-a9b1-cd7689ac1046 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1528 microversion: 2.1 time: 0.289692 Oct 01 21:07:49.239302 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2432/3702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:48 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1528 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:49.244302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:49.245085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:49.251855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:49.263352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:49.263834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:49.267400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:49.267958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:49.268587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:49.478591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:49.491555 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3aeb5a44-d208-4125-a627-c3f510a56461 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.248212 Oct 01 21:07:49.492558 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2433/3703] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:49 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:49.499939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75d76d64-2a44-453c-a5cf-1530a34fdb7d tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Calling method '.version_select at 0x7f41728dbee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:49.769906 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75d76d64-2a44-453c-a5cf-1530a34fdb7d tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5e0548fb-6ccd-4b9d-be7a-5c5e217f8c46" status: 202 len: 0 microversion: 2.1 time: 0.274912 Oct 01 21:07:49.770839 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2434/3704] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:07:49 2022] DELETE /compute/v2.1/os-security-groups/5e0548fb-6ccd-4b9d-be7a-5c5e217f8c46 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:49.776304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:49.777078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:49.787153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:49.788154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:49.788256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:49.789396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:49.794947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:49.795887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:50.016527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:50.065660 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99901a55-10e0-4437-b0de-5b6f4ff6ada7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1723 microversion: 2.1 time: 0.293331 Oct 01 21:07:50.066037 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2435/3705] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:49 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:50.454932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:50.455597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:50.466019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:50.466669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:50.467127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:50.468116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:50.468781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:50.469256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:50.508168 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] HTTP exception thrown: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Request method failure captured: Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 HTTP/1.1 Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwOEcJTOYsN--cP8Xn2wHuvmGWGwGnueg43lOlzor8o8eGDhNhgW-sV8EyQJPBX5O48Wc9cJBLqfWPPKsKnebo0u01BNfKDzP1eJmuajqomXeilMNIK0VA620XYkF8WbwE6OwrjEmsvSO_cublKrh4A2JquMkK9GurYC-PDI4KLJkE Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 478d0fd7c1664a6cbd61419bbb335beb Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1040923582 Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_478d0fd7c1664a6cbd61419bbb335beb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/478d0fd7c1664a6cbd61419bbb335beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/478d0fd7c1664a6cbd61419bbb335beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/478d0fd7c1664a6cbd61419bbb335beb"}]}] Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1040923582 Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 478d0fd7c1664a6cbd61419bbb335beb Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1040923582 Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1040923582-project Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: af3bc6e921b6454496accdab2890bfc3 Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1040923582-project Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '32d97511-64e4-4ee2-a853-a189f8658893'} Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:50.511094 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Returning 404 to user: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:50.516545 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2a787ba1-12bd-4652-a6eb-e30da8ae70cb tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] 10.222.0.17 "DELETE /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 404 len: 111 microversion: 2.1 time: 0.446261 Oct 01 21:07:50.520302 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2436/3706] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:07:50 2022] DELETE /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 111 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:50.526401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:50.527286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:50.536456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:50.537212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:50.537845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:50.538837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:50.539863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:50.540732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:50.570518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:50.785776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:50.795248 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ceb2ea25-e1b5-46be-96a0-ab539c8aef6e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.273184 Oct 01 21:07:50.796191 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2437/3707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:50 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:50.813355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8529b03c-0fb3-4a3f-84b4-fcd161eff6da tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Calling method '.version_select at 0x7f417291e5e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:51.105131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8529b03c-0fb3-4a3f-84b4-fcd161eff6da tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/70d789cd-d55c-4a17-832d-2e8e83cae090" status: 202 len: 0 microversion: 2.1 time: 0.306914 Oct 01 21:07:51.106569 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2438/3708] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:07:50 2022] DELETE /compute/v2.1/os-security-groups/70d789cd-d55c-4a17-832d-2e8e83cae090 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:51.112012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:51.112874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:51.128276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:51.129031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:51.129641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:51.130408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:51.130874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:51.131277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:51.362548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:51.378752 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0833dec1-9f07-414a-83ab-83957499fa29 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1528 microversion: 2.1 time: 0.271267 Oct 01 21:07:51.380403 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2439/3709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:51 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1528 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:51.407331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:51.408196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:51.418156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:51.419017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:51.419713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:51.421232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:51.423399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:51.424627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:51.463945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lazy-loading 'flavor' on Instance uuid 5bdeea1a-94c5-4666-b874-01634b5b5cd8 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:07:51.779145 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa2bd3ec-bf84-4aad-bc3d-e1512a939974 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 202 len: 0 microversion: 2.1 time: 0.397151 Oct 01 21:07:51.781426 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2440/3710] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:51 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:51.813556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:51.816758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:51.828338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:51.829271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:51.829843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:51.830703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:51.841633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:51.846102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:52.140487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:52.161064 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b557d71-5e35-4530-b303-ba6998cace08 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1700 microversion: 2.1 time: 0.359662 Oct 01 21:07:52.162375 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2441/3711] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:51 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1700 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:52.167711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a8b4dda5-a548-4b51-8073-447e7efa1c54 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Calling method '.version_select at 0x7f4172692790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:52.444070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a8b4dda5-a548-4b51-8073-447e7efa1c54 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/3cf8efef-9a32-4c26-b290-0d03490bdf24" status: 202 len: 0 microversion: 2.1 time: 0.280241 Oct 01 21:07:52.444988 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2442/3712] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:07:52 2022] DELETE /compute/v2.1/os-security-groups/3cf8efef-9a32-4c26-b290-0d03490bdf24 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:52.450392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Action: 'update', calling method: >, body: {"server": {"name": "32d97511-64e4-4ee2-a853-a189f8658893_new"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:52.453178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:52.467714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:52.468232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:52.468691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:52.469412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:52.469889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:52.470329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:52.494912 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] HTTP exception thrown: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Request method failure captured: Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 HTTP/1.1 Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 64 Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKwOEcJTOYsN--cP8Xn2wHuvmGWGwGnueg43lOlzor8o8eGDhNhgW-sV8EyQJPBX5O48Wc9cJBLqfWPPKsKnebo0u01BNfKDzP1eJmuajqomXeilMNIK0VA620XYkF8WbwE6OwrjEmsvSO_cublKrh4A2JquMkK9GurYC-PDI4KLJkE Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 478d0fd7c1664a6cbd61419bbb335beb Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1040923582 Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_478d0fd7c1664a6cbd61419bbb335beb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/478d0fd7c1664a6cbd61419bbb335beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/478d0fd7c1664a6cbd61419bbb335beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/478d0fd7c1664a6cbd61419bbb335beb"}]}] Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1040923582 Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 478d0fd7c1664a6cbd61419bbb335beb Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1040923582 Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1040923582-project Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: af3bc6e921b6454496accdab2890bfc3 Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1040923582-project Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "32d97511-64e4-4ee2-a853-a189f8658893_new"}} Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '32d97511-64e4-4ee2-a853-a189f8658893', 'body': {'server': {'name': '32d97511-64e4-4ee2-a853-a189f8658893_new'}}} Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:07:52.496964 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:52.501592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:52.503467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] Returning 404 to user: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:52.504597 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a13a5b9-f2c4-4c93-94e3-067905cfe5b8 tempest-ServersNegativeTestMultiTenantJSON-1040923582 tempest-ServersNegativeTestMultiTenantJSON-1040923582-project] 10.222.0.17 "PUT /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 404 len: 111 microversion: 2.1 time: 0.058538 Oct 01 21:07:52.510389 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2443/3713] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:07:52 2022] PUT /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:52.516540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:52.517520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:52.526894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:52.527663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:52.528896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:52.530464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:52.531183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:52.531999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:52.724893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:52.736770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae462d9f-a1bf-4460-9572-2704407b3d20 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1512 microversion: 2.1 time: 0.225005 Oct 01 21:07:52.743584 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2444/3714] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:52 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:52.766160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94cd61d1-78da-4604-a3d3-8edeba83cc12 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:52.776911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cd61d1-78da-4604-a3d3-8edeba83cc12 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:52.778552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cd61d1-78da-4604-a3d3-8edeba83cc12 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:52.779922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94cd61d1-78da-4604-a3d3-8edeba83cc12 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:52.820849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94cd61d1-78da-4604-a3d3-8edeba83cc12 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Going to try to start instance {{(pid=140438) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 01 21:07:52.900594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94cd61d1-78da-4604-a3d3-8edeba83cc12 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/action" status: 202 len: 0 microversion: 2.1 time: 0.155245 Oct 01 21:07:52.905982 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2445/3715] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:07:52 2022] POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:52.911693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8703731d-dbe2-4ab8-a076-1c5c9bd75c14 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Calling method '.version_select at 0x7f4172698430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:53.194042 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8703731d-dbe2-4ab8-a076-1c5c9bd75c14 tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/2e01ca54-7d45-4a7a-8bc9-f55900386f2b" status: 202 len: 0 microversion: 2.1 time: 0.286390 Oct 01 21:07:53.199382 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2446/3716] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:07:52 2022] DELETE /compute/v2.1/os-security-groups/2e01ca54-7d45-4a7a-8bc9-f55900386f2b => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:53.207154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:53.208033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:53.231470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:53.232672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:53.233746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:53.235635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:53.236389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:53.237185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:53.307920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:07:53.454283 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b5e9631-f003-45d7-b8b9-2ed151ed0f87 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "DELETE /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 204 len: 0 microversion: 2.1 time: 0.252640 Oct 01 21:07:53.456640 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2447/3717] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:07:53 2022] DELETE /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:07:53.464975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:53.466384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:53.473316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:53.473866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:53.474399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:53.475427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:53.475854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:53.476699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:53.728921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:53.746262 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6fc24d20-1e88-4e05-abec-ff0754216324 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1709 microversion: 2.1 time: 0.287853 Oct 01 21:07:53.747739 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2448/3718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:53 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1709 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:53.753750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1188b3da-963f-4de5-96b3-98901c4702ff tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] Calling method '.version_select at 0x7f4172698af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:54.232088 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1188b3da-963f-4de5-96b3-98901c4702ff tempest-SecurityGroupRulesNegativeTestJSON-1558215842 tempest-SecurityGroupRulesNegativeTestJSON-1558215842-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/926dd6b3-668b-4737-9846-5961561d80fe" status: 202 len: 0 microversion: 2.1 time: 0.482327 Oct 01 21:07:54.239935 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2449/3719] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:07:53 2022] DELETE /compute/v2.1/os-security-groups/926dd6b3-668b-4737-9846-5961561d80fe => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:07:54.249162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:54.251044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:54.265778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:54.266472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:54.267088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:54.268005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:54.268731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:54.269404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:54.717694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:54.726161 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c65f2776-a032-49ac-9693-be1c84041f2d tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1534 microversion: 2.1 time: 0.484120 Oct 01 21:07:54.727084 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2450/3720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:54 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1534 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:54.748104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:54.748695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:54.755150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:54.755736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:54.756182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:54.756984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:54.757455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:54.757951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:55.839438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:55.853876 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2480c08-f19e-4ff3-9b63-bb47e26efc71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1512 microversion: 2.1 time: 1.111114 Oct 01 21:07:55.855363 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2451/3721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:54 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1512 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:55.861994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:55.862971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:55.870812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:55.871430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:55.871983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:55.873952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:55.874718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:55.875798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:56.724408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:56.742024 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ceadf9f-a6b4-4ffe-9990-89c850d9948c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1713 microversion: 2.1 time: 0.883006 Oct 01 21:07:56.743055 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2452/3722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:55 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1713 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:56.749012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:56.750057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:56.764437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:56.765577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:56.766210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:56.767624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:56.768328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:56.768925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:57.007649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e3bc6d5e45497bb876d5cbcec61835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d2517d51d0417880e6e3d601c52744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:57.030207 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-91242bf8-c10b-4d06-9dca-5e2d410f8209 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 200 len: 1492 microversion: 2.1 time: 0.274169 Oct 01 21:07:57.032787 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2453/3723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:56 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 1492 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:57.046231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3c28154c-f1ad-433c-a8d6-e86d51147c27 req-180c3e51-cdf7-4697-9f96-05cb71057443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d97511-64e4-4ee2-a853-a189f8658893", "name": "network-vif-deleted", "tag": "ccb27259-67b2-43bf-b5f7-1b86246f386e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:07:57.074050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3c28154c-f1ad-433c-a8d6-e86d51147c27 req-180c3e51-cdf7-4697-9f96-05cb71057443 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:57.077224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3c28154c-f1ad-433c-a8d6-e86d51147c27 req-180c3e51-cdf7-4697-9f96-05cb71057443 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:57.078766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3c28154c-f1ad-433c-a8d6-e86d51147c27 req-180c3e51-cdf7-4697-9f96-05cb71057443 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:57.093529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:07:57.097615 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3c28154c-f1ad-433c-a8d6-e86d51147c27 req-180c3e51-cdf7-4697-9f96-05cb71057443 service nova] Creating event network-vif-deleted:ccb27259-67b2-43bf-b5f7-1b86246f386e for instance 32d97511-64e4-4ee2-a853-a189f8658893 on nch1-master-1 Oct 01 21:07:57.111251 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3c28154c-f1ad-433c-a8d6-e86d51147c27 req-180c3e51-cdf7-4697-9f96-05cb71057443 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075938 Oct 01 21:07:57.113959 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2454/3724] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:07:57.121811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:57.122769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:57.132862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:57.133891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:57.134548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:57.136883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:57.138830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:57.142969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:57.395774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:57.407442 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-214d19dd-7f69-4f39-bee2-61801cb9f68d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1512 microversion: 2.1 time: 0.291973 Oct 01 21:07:57.408103 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2455/3725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:57 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1512 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:58.065578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:58.066975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] [instance: 32d97511-64e4-4ee2-a853-a189f8658893] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:58.082563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:58.083448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:58.084469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:58.085523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:58.087434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:58.089511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:58.123721 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] HTTP exception thrown: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Request method failure captured: Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 HTTP/1.1 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKv_zXioj8MYHK2datEeKyEXcVicGA6ESETqGYdq-b39xb7W1lD4Sht4LSErmhks30BxkdCUG97B8ZgJVVLJV8OiPyAXBLaHheQbgStdDqYM82cJdgLutctcsRyZDjC1Wsjsf46DwcJnqWLMbDlk26UEPM8e9tGHitN9ktJVHqFoOC4 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a2d2517d51d0417880e6e3d601c52744 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2138531725 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a2d2517d51d0417880e6e3d601c52744", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a2d2517d51d0417880e6e3d601c52744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a2d2517d51d0417880e6e3d601c52744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a2d2517d51d0417880e6e3d601c52744"}]}] Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2138531725 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a2d2517d51d0417880e6e3d601c52744 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2138531725 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2138531725-project Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: e7e3bc6d5e45497bb876d5cbcec61835 Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2138531725-project Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '32d97511-64e4-4ee2-a853-a189f8658893'} Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:58.126165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:58.130924 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:07:58.130924 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:58.130924 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:07:58.130924 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:07:58.130924 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:07:58.130924 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:07:58.130924 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:07:58.130924 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. Oct 01 21:07:58.130924 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:07:58.132394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] Returning 404 to user: Instance 32d97511-64e4-4ee2-a853-a189f8658893 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:07:58.134149 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4bfed729-ef83-457d-a4e5-3a449a4b8980 tempest-ServersNegativeTestMultiTenantJSON-2138531725 tempest-ServersNegativeTestMultiTenantJSON-2138531725-project] 10.222.0.17 "GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893" status: 404 len: 111 microversion: 2.1 time: 0.074455 Oct 01 21:07:58.135395 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2456/3726] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:58 2022] GET /compute/v2.1/servers/32d97511-64e4-4ee2-a853-a189f8658893 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:07:58.431400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:58.432455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:58.442815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:58.443337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:58.443773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:58.444550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:58.445022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:58.456039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:58.887135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:07:58.900810 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f37eb4e4-f3de-448c-be53-5c5936be8db3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1512 microversion: 2.1 time: 0.473768 Oct 01 21:07:58.906795 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2457/3727] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:58 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1512 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:07:59.933551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:07:59.934479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:07:59.946777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:59.949668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:59.950316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:07:59.951273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:07:59.952525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:07:59.953151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:00.612723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:00.625207 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0151ed6f-3d06-41f9-a412-3380873e030f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1512 microversion: 2.1 time: 0.696211 Oct 01 21:08:00.626593 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2458/3728] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:07:59 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1512 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:01.649511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:01.650857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:01.660107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:01.661065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:01.661674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:01.662607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:01.663231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:01.663829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:02.239944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:02.252547 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7dc82b7-e105-4b4d-84d4-44a638f99ebf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1512 microversion: 2.1 time: 0.607227 Oct 01 21:08:02.262832 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2459/3729] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:01 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1512 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:08:03.293584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:03.295378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:03.312394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:03.313687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:03.314970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:03.315907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:03.316536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:03.317900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:03.775856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:03.791775 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba55c972-0f46-47b4-a428-0aa13d830e61 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1533 microversion: 2.1 time: 0.505957 Oct 01 21:08:03.793934 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2460/3730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:03 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1533 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:04.829079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:04.830770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:04.845059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:04.845653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:04.846708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:04.847504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:04.848248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:04.848436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:05.233112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:05.241643 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-554dbb1c-2d53-4f20-9a2b-b2a8b3d0f99c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.424155 Oct 01 21:08:05.262607 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2461/3731] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:04 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:08:06.273000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:06.275743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:06.293912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:06.296925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:06.297721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:06.299213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:06.301094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:06.302099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:06.680494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:06.695432 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd49816f-dd6b-4774-bb8e-9cef0cf2f978 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.426732 Oct 01 21:08:06.700520 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2462/3732] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:06 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:07.099785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:07.106025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:07.152562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:07.160232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:07.161767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:07.168583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:07.169447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:07.172172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:08.135266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:08.146978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:08.157190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:08.162163 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8bef7e67-5269-48fe-b491-050db16f05e8 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2947 microversion: 2.32 time: 1.070962 Oct 01 21:08:08.162888 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2463/3733] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:08:07 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2947 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:08:08.179124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:08.180759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:08.192652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:08.195518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:08.196121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:08.199510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:08.200139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:08.200681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:08.488067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:08.505736 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71842184-0a8d-4ed8-a226-426c032f6548 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.341182 Oct 01 21:08:08.508771 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2464/3734] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:08 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:08.514018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6886e28d-4e69-46dc-a2f2-280fd343c1c1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:08.514813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6886e28d-4e69-46dc-a2f2-280fd343c1c1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:08.521348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6886e28d-4e69-46dc-a2f2-280fd343c1c1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:08.522092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6886e28d-4e69-46dc-a2f2-280fd343c1c1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:08.522787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6886e28d-4e69-46dc-a2f2-280fd343c1c1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:08.523778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6886e28d-4e69-46dc-a2f2-280fd343c1c1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:08.524430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6886e28d-4e69-46dc-a2f2-280fd343c1c1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:08.525049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6886e28d-4e69-46dc-a2f2-280fd343c1c1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:08.821152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6886e28d-4e69-46dc-a2f2-280fd343c1c1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.309916 Oct 01 21:08:08.822074 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2465/3735] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Oct 1 21:08:08 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f/os-interface => generated 1830 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:08:09.412327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a8763462-d37f-4b52-9bc5-b9ff57c84204 req-33b6c43f-f254-4f4c-b9e3-c1f49dd8aff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdeea1a-94c5-4666-b874-01634b5b5cd8", "name": "network-vif-plugged", "status": "completed", "tag": "e91fadf8-47e8-4e70-9ac2-c2c6258d58be"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:09.430280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a8763462-d37f-4b52-9bc5-b9ff57c84204 req-33b6c43f-f254-4f4c-b9e3-c1f49dd8aff8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:09.431233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a8763462-d37f-4b52-9bc5-b9ff57c84204 req-33b6c43f-f254-4f4c-b9e3-c1f49dd8aff8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:09.432014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a8763462-d37f-4b52-9bc5-b9ff57c84204 req-33b6c43f-f254-4f4c-b9e3-c1f49dd8aff8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:09.448740 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a8763462-d37f-4b52-9bc5-b9ff57c84204 req-33b6c43f-f254-4f4c-b9e3-c1f49dd8aff8 service nova] Creating event network-vif-plugged:e91fadf8-47e8-4e70-9ac2-c2c6258d58be for instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 on nch2-master-1 Oct 01 21:08:09.457606 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a8763462-d37f-4b52-9bc5-b9ff57c84204 req-33b6c43f-f254-4f4c-b9e3-c1f49dd8aff8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055525 Oct 01 21:08:09.459058 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2466/3736] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:08:09.537153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:09.542247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:09.565436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:09.566164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:09.568494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:09.572055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:09.572917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:09.573554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:09.926372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:09.939086 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f59b295f-ba16-4681-b19b-1c9c90c0ffd6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.407012 Oct 01 21:08:09.941851 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2467/3737] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:09 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:08:10.964966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:10.966656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:10.978344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:10.978753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:10.990918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:10.991829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:10.992856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:10.993310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:11.342040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:11.352686 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3c966f6-e0c2-4c62-83e0-bf21434fcd12 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.391642 Oct 01 21:08:11.362407 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2468/3738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:10 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:12.386375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:12.390198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:12.405554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:12.406625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:12.408229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:12.410914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:12.411909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:12.413478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:12.801928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:12.816471 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2fdfdca6-ede7-48fd-beda-cc2bc9b65a88 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.434677 Oct 01 21:08:12.820339 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2469/3739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:12 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:08:13.843513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:13.844982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:13.855050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:13.857571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:13.858248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:13.862726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:13.863499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:13.864386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:14.385985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:14.399145 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-66a859cd-6b0d-4012-9e72-7b8dd4787019 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.559223 Oct 01 21:08:14.403351 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2470/3740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:13 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:15.427167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:15.428388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:15.440125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:15.441494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:15.443262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:15.444936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:15.447026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:15.447765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:16.106531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:16.118646 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5865e3cf-7589-41ba-84b2-a38d336af331 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.695985 Oct 01 21:08:16.119970 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2471/3741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:15 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:17.146120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:17.149207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:17.184111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:17.185414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:17.186669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:17.194236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:17.201897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:17.203878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:17.682927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:17.692639 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4f0c43d-c59e-476e-b991-ede7edada6ec tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.553817 Oct 01 21:08:17.695269 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2472/3742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:17 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:18.719443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:18.720071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:18.741397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:08:18.743174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:18.743856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:18.744937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:18.745850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:18.755185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:18.763601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:18.827353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:08:19.171724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:19.180879 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a8cca6a-609a-4a3e-b9b3-4314696ba4a5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.465442 Oct 01 21:08:19.190146 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2473/3743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:18 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:20.216765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:20.218162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:20.231274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:20.244011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:20.244607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:20.245433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:20.245968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:20.246474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:20.749600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:20.759956 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1fd299d9-531c-44a1-b5c8-d6d502c453bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.548121 Oct 01 21:08:20.761128 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2474/3744] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:20 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:21.787194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:21.789092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:21.808619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:21.809465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:21.814115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:21.815153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:21.825556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:21.826214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:22.141655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:22.155614 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2565439-5970-45d9-aa0c-30c0ccb0b7bd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.372255 Oct 01 21:08:22.156178 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2475/3745] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:21 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:08:23.182175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:23.182997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:23.202073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:23.204920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:23.211393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:23.212340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:23.216839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:23.217792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:23.932188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:23.940720 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2dbab1a4-7459-4078-b56a-77016f6e66f5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.763670 Oct 01 21:08:23.941318 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2476/3746] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:23 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:24.970102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:24.971672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:24.990110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:24.992943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:24.995628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:24.997012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:25.000912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:25.003853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:25.575188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:25.597251 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a9f2bdc-ac48-4cb2-8776-e987230c2d59 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.630440 Oct 01 21:08:25.597893 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2477/3747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:24 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:26.614199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad6b12ca-fa06-4a0f-997e-1f9519ac7f89 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: .version_select at 0x7f4172665280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-401742553", "description": "tempest-description-2124206511"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:27.001190 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad6b12ca-fa06-4a0f-997e-1f9519ac7f89 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.759818 Oct 01 21:08:27.011302 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2478/3748] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:08:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:27.016651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:27.017551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:27.030962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:27.035255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:27.036039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:27.036967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:27.037723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:27.041584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:27.764804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:27.778859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2de6d13-cef2-434d-9aa8-7f3c50da503b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.765168 Oct 01 21:08:27.800197 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2479/3749] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:27 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:27.819897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5abc2fdf-ae15-4273-8f8f-7f3633088d29 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: .version_select at 0x7f4172658790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1638862073", "description": "tempest-description-1262457660"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:28.218891 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5abc2fdf-ae15-4273-8f8f-7f3633088d29 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.417046 Oct 01 21:08:28.220358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2480/3750] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:08:27 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:28.467511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1835649846", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a0fbff96-d41c-4e39-a7a7-f83fd2ac93f6"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:28.555329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] validate_networks() for [('a0fbff96-d41c-4e39-a7a7-f83fd2ac93f6', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:08:29.974950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:08:29.975580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:08:29.976236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:08:29.976755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:08:29.977179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:08:29.999679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:30.004427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:30.005131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:30.006115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:30.006594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:30.007852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:30.062835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Getting quotas for project 337bb3ce6f304c58902406f7279af3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:08:30.078200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Getting quotas for user d2a67ba740284d5589df8bdad6ab671f and project 337bb3ce6f304c58902406f7279af3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:08:30.136641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:08:30.139315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:08:30.270477 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-67d1277b-d315-4574-8b37-cc114df88825 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809059 Oct 01 21:08:30.277670 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2481/3751] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:08:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:08:30.291242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:30.297314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:30.313914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:30.322762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:30.325668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:30.328201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:30.330326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:30.332933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:31.087609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:31.100907 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e334aeae-1462-4911-8ea4-c96d3c63df16 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1528 microversion: 2.1 time: 0.821371 Oct 01 21:08:31.104327 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2482/3752] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:30 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1528 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:31.119621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:31.120436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:31.143647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:31.144164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:31.144678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:31.145708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:31.146340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:31.147246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:31.369080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lazy-loading 'services' on Instance uuid fa4461cf-b0a2-40ed-9edb-ad64e615d2ea {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:08:31.529426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-04966ebe-38bf-4aa4-b28b-9a2a1370babd tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/os-volume_attachments/f05a8921-7393-4c72-bce8-e68fb45486ed" status: 202 len: 0 microversion: 2.1 time: 0.422634 Oct 01 21:08:31.530068 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2483/3753] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:08:31 2022] DELETE /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/os-volume_attachments/f05a8921-7393-4c72-bce8-e68fb45486ed => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:08:31.545148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:31.545885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:31.571675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:31.572193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:31.572670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:31.588870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:31.595420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:31.602579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:31.758402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:31.769871 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-940d1707-08d5-4f27-91d3-bff412852e96 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1220 microversion: 2.1 time: 0.236671 Oct 01 21:08:31.787712 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2484/3754] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:31 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1220 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:32.128277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:32.129040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:32.139466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:32.140336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:32.140453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:32.141164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:32.144501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:32.145062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:32.427746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:32.448595 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-438c708c-c928-4218-b3d5-610bb25ae2c3 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1510 microversion: 2.1 time: 0.325119 Oct 01 21:08:32.469559 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2485/3755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:32 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:32.817392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:32.818699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:32.835570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:32.836442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:32.837206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:32.838104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:32.838983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:32.839601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:33.018194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:33.038028 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5320cdde-67e5-405e-8af4-b7f5eee8604b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1286 microversion: 2.1 time: 0.238454 Oct 01 21:08:33.059728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2486/3756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:32 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1286 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:08:33.074067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea00ef78-ad02-48ae-8537-43d3232a4d87 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:33.087039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea00ef78-ad02-48ae-8537-43d3232a4d87 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:33.091489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea00ef78-ad02-48ae-8537-43d3232a4d87 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:33.092918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea00ef78-ad02-48ae-8537-43d3232a4d87 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:33.154221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea00ef78-ad02-48ae-8537-43d3232a4d87 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Going to try to stop instance {{(pid=140438) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 21:08:33.262689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea00ef78-ad02-48ae-8537-43d3232a4d87 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/action" status: 202 len: 0 microversion: 2.1 time: 0.198418 Oct 01 21:08:33.266549 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2487/3757] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:08:33 2022] POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:08:33.280099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:33.281380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:33.293612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:33.294565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:33.295481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:33.296887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:33.297680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:33.298582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:33.563149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:33.574453 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-55da167b-3855-4cee-b77a-d1347bc9ef4e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1677 microversion: 2.1 time: 0.302624 Oct 01 21:08:33.575074 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2488/3758] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:33 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1677 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:08:33.590588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:33.591223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:33.606261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:33.607002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:33.607674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:33.609795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:33.610451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:33.611532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:34.005521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:34.016090 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b81f334-263c-48fd-bdd0-d5876a04b87b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1510 microversion: 2.1 time: 0.434501 Oct 01 21:08:34.020065 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2489/3759] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:33 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:34.065153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:34.066030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:34.076081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:34.081793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:34.083236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:34.085357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:34.086201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:34.087573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:34.618220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:34.620770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:08:34.652406 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c7cb009-3634-411b-85b7-8f58bf348b06 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1316 microversion: 2.1 time: 0.591257 Oct 01 21:08:34.667067 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2490/3760] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:34 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:08:34.677123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:34.678014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:34.684663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:34.685156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:34.685610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:34.686326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:34.699029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:34.699778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:35.193278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:35.207242 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a2c39f7d-1dd3-454a-8c62-52b8f51cf3bb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1677 microversion: 2.1 time: 0.542259 Oct 01 21:08:35.208439 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2491/3761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:34 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1677 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:35.220795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:35.224792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:35.241606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:35.242791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:35.243419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:35.244624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:35.245111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:35.246591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:35.685376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:35.698444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8724de42-1ed4-4cd7-8c72-199f6845b6ef tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1510 microversion: 2.1 time: 0.486668 Oct 01 21:08:35.699660 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2492/3762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:35 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:35.729425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:35.730252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:35.746367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:35.747173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:35.747756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:35.749383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:35.752613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:35.753575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:36.160851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:36.173839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a4709d3-160c-4a7f-8444-a5323eef1dbf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1316 microversion: 2.1 time: 0.453568 Oct 01 21:08:36.178391 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2493/3763] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:35 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:36.185662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-94d3cbe9-5c25-4c88-9294-75c480c61269 req-160ca189-aa72-49b6-bdb2-35b804c688f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdeea1a-94c5-4666-b874-01634b5b5cd8", "name": "network-vif-unplugged", "status": "completed", "tag": "e91fadf8-47e8-4e70-9ac2-c2c6258d58be"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:36.221432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-94d3cbe9-5c25-4c88-9294-75c480c61269 req-160ca189-aa72-49b6-bdb2-35b804c688f3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:36.222328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-94d3cbe9-5c25-4c88-9294-75c480c61269 req-160ca189-aa72-49b6-bdb2-35b804c688f3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:36.223292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-94d3cbe9-5c25-4c88-9294-75c480c61269 req-160ca189-aa72-49b6-bdb2-35b804c688f3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:36.261505 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-94d3cbe9-5c25-4c88-9294-75c480c61269 req-160ca189-aa72-49b6-bdb2-35b804c688f3 service nova] Creating event network-vif-unplugged:e91fadf8-47e8-4e70-9ac2-c2c6258d58be for instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 on nch2-master-1 Oct 01 21:08:36.269596 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-94d3cbe9-5c25-4c88-9294-75c480c61269 req-160ca189-aa72-49b6-bdb2-35b804c688f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089667 Oct 01 21:08:36.270901 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2494/3764] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:36.299948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:36.301870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:36.317761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:36.320278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:36.322250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:36.325260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:36.326276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:36.330314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:36.890389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:36.917530 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c258c348-4966-4f80-99e9-afdc82c506ac tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1677 microversion: 2.1 time: 0.645247 Oct 01 21:08:36.923358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2495/3765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:36 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1677 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:36.948422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b27e896b-05a4-4a67-896f-50e28f1f1f15 req-5abb22cb-10a8-486d-9405-7434c0f3749e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8499779-fa7d-459a-8832-35f644706d38", "tag": "8222ff7e-e137-43a6-9457-3e311bdca5ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:36.984613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b27e896b-05a4-4a67-896f-50e28f1f1f15 req-5abb22cb-10a8-486d-9405-7434c0f3749e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:36.994131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b27e896b-05a4-4a67-896f-50e28f1f1f15 req-5abb22cb-10a8-486d-9405-7434c0f3749e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:36.994551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b27e896b-05a4-4a67-896f-50e28f1f1f15 req-5abb22cb-10a8-486d-9405-7434c0f3749e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:37.028172 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b27e896b-05a4-4a67-896f-50e28f1f1f15 req-5abb22cb-10a8-486d-9405-7434c0f3749e service nova] Creating event network-changed:8222ff7e-e137-43a6-9457-3e311bdca5ba for instance c8499779-fa7d-459a-8832-35f644706d38 on nch1-master-1 Oct 01 21:08:37.052152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b27e896b-05a4-4a67-896f-50e28f1f1f15 req-5abb22cb-10a8-486d-9405-7434c0f3749e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123379 Oct 01 21:08:37.056689 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2496/3766] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:37.071540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:37.072279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:37.102156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:37.102905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:37.103378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:37.104147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:37.104623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:37.105063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:37.518820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:37.529076 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3e7bc3db-e6ce-4c9c-a98e-47d570899422 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1453 microversion: 2.1 time: 0.471063 Oct 01 21:08:37.533880 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2497/3767] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:37 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1453 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:37.542841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:37.544193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:37.575262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:37.576656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:37.579722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:37.580656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:37.581079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:37.581527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:37.861256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:37.870742 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-384d6752-d0bf-483c-a252-a150a089ae4e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1316 microversion: 2.1 time: 0.335119 Oct 01 21:08:37.872146 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2498/3768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:37 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:37.881129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:37.882015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:37.891420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:37.892055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:37.892349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:37.893186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:37.893612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:37.894037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:38.091573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:38.117079 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f63c020e-d36d-43b1-a89e-ba0fd479a52a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1453 microversion: 2.1 time: 0.242024 Oct 01 21:08:38.117685 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2499/3769] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:37 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1453 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:38.132374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:38.149223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:38.161953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:38.162505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:38.162991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:38.163725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:38.164197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:38.164636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:38.520220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:38.535626 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-79b0255c-1928-42e6-ae4b-203ca3d9dd5f tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1677 microversion: 2.1 time: 0.411809 Oct 01 21:08:38.536749 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2500/3770] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:38 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1677 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:38.542739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:38.543609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:38.550600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:38.551437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:38.552254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:38.553711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:38.554665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:38.555341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:38.611394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lazy-loading 'flavor' on Instance uuid 5bdeea1a-94c5-4666-b874-01634b5b5cd8 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:08:38.632726 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Cannot 'shelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state shelved_offloaded Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action HTTP/1.1 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 14 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: {"shelve": {}} Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'shelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state shelved_offloaded Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8', 'body': {'shelve': {}}} Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:08:38.634538 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state shelved_offloaded Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state shelved_offloaded Oct 01 21:08:38.638926 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:38.640548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 409 to user: Cannot 'shelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state shelved_offloaded {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:08:38.641583 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-97972e96-6d66-4707-a1c1-529a6e03e1c5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 409 len: 155 microversion: 2.1 time: 0.102750 Oct 01 21:08:38.646006 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2501/3771] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:08:38 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 155 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:08:38.652955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:38.653571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:38.668200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:38.669046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:38.669693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:38.670636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:38.672244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:38.674788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:38.769575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140438) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 21:08:38.896891 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-780821ea-fb86-4a77-8207-6e0bc49ccc74 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 202 len: 0 microversion: 2.1 time: 0.248094 Oct 01 21:08:38.897675 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2502/3772] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:08:38 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:08:38.902596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:38.904096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:38.910989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:38.911744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:38.912400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:38.913877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:38.914615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:38.915268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:39.352489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:39.361880 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cbb587e2-72a8-46bd-9a03-0a1cbecf4c74 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1316 microversion: 2.1 time: 0.462772 Oct 01 21:08:39.373975 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2503/3773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:38 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:39.373975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:39.373975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:39.377874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:39.378544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:39.379005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:39.379942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:39.380411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:39.380857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:39.787130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:39.801452 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5fd147e3-5fcc-43e4-88af-c531553c3865 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1461 microversion: 2.1 time: 0.435228 Oct 01 21:08:39.802915 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2504/3774] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:39 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1461 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:39.918220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7464267-6b40-423b-b60f-8729f51d156b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'create', calling method: .version_select at 0x7f4172658b80>, body: {"keypair": {"name": "tempest-keypair-13264243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQ3ls3d7j7mNHV2OhmqRduA7QvVpSk6hJCwQYM7WiZ8djRZFNDXCmQTFZ/HurTASqibFIrcyS+Mm/jUrvRQ19z6bH6tuTEI0zdJ/bkEuTgKYSLQ0y1bcMMlGcDA9mDyag=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:39.941437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f7464267-6b40-423b-b60f-8729f51d156b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Getting quotas for project fa37082733634ec688c9d6272a0d9b1d. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:08:39.954083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f7464267-6b40-423b-b60f-8729f51d156b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Getting quotas for user 8d79dff848bf40fc89377e13736c527b and project fa37082733634ec688c9d6272a0d9b1d. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:08:40.018228 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7464267-6b40-423b-b60f-8729f51d156b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.213226 Oct 01 21:08:40.026333 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2505/3775] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Oct 1 21:08:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 222 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 01 21:08:40.033119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:40.035573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:40.043613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:08:40.071885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:40.072411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:40.072969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:40.073796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:40.074274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:40.074740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:40.499020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:40.509573 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e5ebb4a-b5fb-4e77-8259-a92034387287 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1677 microversion: 2.1 time: 0.481638 Oct 01 21:08:40.510176 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2506/3776] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:40 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1677 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:40.543861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:40.544797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:40.558421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:40.558987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:40.560204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:40.561009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:40.561517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:40.561984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:40.750380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:40.774295 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-058a8175-5cff-4e49-b139-4ee2d798238e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1316 microversion: 2.1 time: 0.246459 Oct 01 21:08:40.776831 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2507/3777] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:40 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:40.830628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:40.831479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:40.842372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:40.843020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:40.843999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:40.846422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:40.847142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:40.849129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:42.066372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:42.075354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:08:42.086235 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a69241d-d1f3-4f76-ac03-00645dc30521 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 1.260239 Oct 01 21:08:42.086900 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2508/3778] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:40 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:42.113991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:42.114716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:42.151791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:42.152338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:42.158628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:42.177164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:42.179861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:42.181017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:42.581600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:42.597293 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b056b43e-3b9f-4d9d-b13e-b5ac59889e05 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1677 microversion: 2.1 time: 0.505138 Oct 01 21:08:42.598649 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2509/3779] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:42 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1677 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:42.607857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:42.608704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:42.612367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:08:42.622087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:42.623668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:42.624712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:42.625950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:42.626998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:42.627625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:43.078020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:43.093298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc901e4f-e048-4b88-bb6b-b32cecde4f12 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1316 microversion: 2.1 time: 0.491302 Oct 01 21:08:43.093877 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2510/3780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:42 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:43.120436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:43.121474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:43.145576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:43.155953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:43.160339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:43.166149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:43.168290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:43.169726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:43.708956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:43.718159 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9fe87163-cdd5-4d41-9412-1a619fe49b5f tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.603304 Oct 01 21:08:43.729808 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2511/3781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:43 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:43.769653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-234047943", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "331d621d-8c17-4a0b-842e-0a1a9b8bb154"}], "security_groups": [{"name": "tempest-securitygroup--1577647737"}], "key_name": "tempest-keypair-13264243", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:44.004986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] validate_networks() for [('331d621d-8c17-4a0b-842e-0a1a9b8bb154', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:08:45.165845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:08:45.166338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:08:45.167552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:08:45.168189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:08:45.168614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:08:45.191977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:45.193000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:45.193451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:45.197841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:45.198336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:45.198799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:45.285037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Getting quotas for project fa37082733634ec688c9d6272a0d9b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:08:45.311338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Getting quotas for user 8d79dff848bf40fc89377e13736c527b and project fa37082733634ec688c9d6272a0d9b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:08:45.361104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:08:45.363883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:08:45.473397 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e26484af-6fd6-40d7-9158-db4c8a8126b1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.718383 Oct 01 21:08:45.483396 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2512/3782] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 21:08:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 21:08:45.488903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:45.489865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:45.504598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:45.505552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:45.506282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:45.507551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:45.508255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:45.508930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:45.594730 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:08:45.595342 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:08:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:08:45.682693 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:08:45.682833 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:08:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:08:45.951494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:45.967190 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0fb5e65-292d-434b-81d1-419e75c683f7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1654 microversion: 2.1 time: 0.482142 Oct 01 21:08:45.968626 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2513/3783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:45 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1654 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:45.975341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:45.976302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:45.985874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:45.986793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:45.987456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:45.988391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:45.989129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:45.989906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:46.565163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:46.574780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-74b689fd-b72b-423c-87f1-9c15d6caabd2 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1316 microversion: 2.1 time: 0.604711 Oct 01 21:08:46.576480 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2514/3784] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:45 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:46.587046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8c7adfdb-f5a2-40aa-994a-7de8dc889fb5 req-46e9b9e3-0567-40f4-b16d-12171308d15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8499779-fa7d-459a-8832-35f644706d38", "name": "network-vif-plugged", "status": "completed", "tag": "8222ff7e-e137-43a6-9457-3e311bdca5ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:46.609340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8c7adfdb-f5a2-40aa-994a-7de8dc889fb5 req-46e9b9e3-0567-40f4-b16d-12171308d15e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:46.609934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8c7adfdb-f5a2-40aa-994a-7de8dc889fb5 req-46e9b9e3-0567-40f4-b16d-12171308d15e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:46.610446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8c7adfdb-f5a2-40aa-994a-7de8dc889fb5 req-46e9b9e3-0567-40f4-b16d-12171308d15e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:46.653059 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8c7adfdb-f5a2-40aa-994a-7de8dc889fb5 req-46e9b9e3-0567-40f4-b16d-12171308d15e service nova] Creating event network-vif-plugged:8222ff7e-e137-43a6-9457-3e311bdca5ba for instance c8499779-fa7d-459a-8832-35f644706d38 on nch1-master-1 Oct 01 21:08:46.666337 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8c7adfdb-f5a2-40aa-994a-7de8dc889fb5 req-46e9b9e3-0567-40f4-b16d-12171308d15e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088267 Oct 01 21:08:46.668179 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2515/3785] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:46.675957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:46.678936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:46.689846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:46.690766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:46.693157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:46.696301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:46.696935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:46.697482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:47.200352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:47.213195 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0de46b7-9450-4602-b93f-6c599b83b38a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.543257 Oct 01 21:08:47.214940 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2516/3786] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:46 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:47.227102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:47.228694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:47.236367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:47.237927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:47.238673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:47.242229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:47.243154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:47.243928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:47.404931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:47.417087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:47.421469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:47.424452 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf79e52d-77e5-43eb-98b4-2e45dfba21b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1275 microversion: 2.20 time: 0.204945 Oct 01 21:08:47.425550 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2517/3787] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:08:47 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:08:47.432478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20e60552-d964-47b4-816e-22c847620da6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:47.441140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20e60552-d964-47b4-816e-22c847620da6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:47.441931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20e60552-d964-47b4-816e-22c847620da6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:47.442709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20e60552-d964-47b4-816e-22c847620da6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:47.499934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20e60552-d964-47b4-816e-22c847620da6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Going to try to start instance {{(pid=140438) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 01 21:08:47.632013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20e60552-d964-47b4-816e-22c847620da6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/action" status: 202 len: 0 microversion: 2.1 time: 0.200667 Oct 01 21:08:47.634643 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2518/3788] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:08:47 2022] POST /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:08:47.675635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:47.676299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:47.691142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:47.691985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:47.692566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:47.693358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:47.695107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:47.733022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:48.605722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:48.615950 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0591ad01-2edd-4ac2-914e-a1baac4923c3 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1316 microversion: 2.1 time: 0.978960 Oct 01 21:08:48.623465 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2519/3789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:47 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1316 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:48.644085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:48.648037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:48.678612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:48.687195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:48.688119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:48.688401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:48.696534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:48.697002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:49.214932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:49.225646 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c2ebd272-b7a1-4e03-8747-f1d065d8ebe3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1663 microversion: 2.1 time: 0.597626 Oct 01 21:08:49.227051 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2520/3790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:48 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1663 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:49.244112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:49.244788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:49.253336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:49.255708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:49.258923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:49.259869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:49.261151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:49.269546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:49.461607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:49.476271 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85ba71c5-1164-40e8-93fc-063e99575e82 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.236412 Oct 01 21:08:49.478454 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2521/3791] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:49 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:49.488108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:49.488735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:49.507565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:49.508208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:49.508796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:49.511451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:49.512885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:49.514872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:49.708553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:49.732402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:49.733895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:49.735794 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd655e21-57df-4f75-96bb-3f5b59576d27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1337 microversion: 2.20 time: 0.256308 Oct 01 21:08:49.736572 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2522/3792] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:08:49 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1337 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:08:49.778262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:49.780513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:49.797486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:49.798294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:49.798956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:49.802174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:49.803245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:49.803896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:50.102396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:50.120534 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-862bcaa0-648c-4cf9-a319-076a0c62531d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1504 microversion: 2.1 time: 0.360433 Oct 01 21:08:50.121290 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2523/3793] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:49 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:50.146984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-401742553"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:50.147806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:50.155937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:50.156719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:50.157667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:50.158594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:50.171259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:50.172082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:50.429023 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.network.security_group_api [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Adding security group cfb98761-eebb-4e83-ac5b-91108f40a62a to port 8222ff7e-e137-43a6-9457-3e311bdca5ba Oct 01 21:08:51.543048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e037b3c3-7ede-4696-beee-1d39a814ff40 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38/action" status: 202 len: 0 microversion: 2.1 time: 1.402275 Oct 01 21:08:51.545084 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2524/3794] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:08:50 2022] POST /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38/action => generated 0 bytes in 1405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:08:51.553364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:51.554223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:51.573659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:51.576972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:51.578559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:51.585830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:51.588149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:51.589265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:52.138679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:52.149596 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5ed1871f-05f1-4bb7-bf34-e7dc3ee2d570 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1663 microversion: 2.1 time: 0.602945 Oct 01 21:08:52.151494 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2525/3795] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:51 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1663 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:52.156473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:52.157534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:52.183520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:52.187836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:52.188757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:52.189739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:52.190423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:52.192741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:52.205553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:08:52.856840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:52.877636 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dff0378e-9be8-4bea-a4a0-2cbcc11e0dc2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.718189 Oct 01 21:08:52.879068 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2526/3796] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:52 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:52.920165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:52.922347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:52.962006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:52.963480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:52.965723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:52.968252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:52.970205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:52.971449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:53.119983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:53.131691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:53.138125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:53.139456 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-824397bc-95fd-4cb7-b586-b536bbd22db6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1337 microversion: 2.20 time: 0.245453 Oct 01 21:08:53.141414 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2527/3797] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:08:52 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1337 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:08:53.151759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1638862073"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:53.155736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:53.176527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:53.177042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:53.178355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:53.186390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:53.186919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:53.187448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:54.000124 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.network.security_group_api [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Adding security group b4f07aec-ad95-4722-b57d-a5f41e5749c8 to port 8222ff7e-e137-43a6-9457-3e311bdca5ba Oct 01 21:08:55.238207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:08:55.311464 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6129f5f1-1a53-4096-845c-754cd74995bb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38/action" status: 202 len: 0 microversion: 2.1 time: 2.166517 Oct 01 21:08:55.312492 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2528/3798] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:08:53 2022] POST /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38/action => generated 0 bytes in 2169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:08:55.321541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1f58ce79-3fd8-4d9e-b7ab-71e7eed7ae94 req-5a53aee8-fbfa-4062-998f-177fcbe2f467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8499779-fa7d-459a-8832-35f644706d38", "tag": "8222ff7e-e137-43a6-9457-3e311bdca5ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:55.346898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1f58ce79-3fd8-4d9e-b7ab-71e7eed7ae94 req-5a53aee8-fbfa-4062-998f-177fcbe2f467 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:55.351435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1f58ce79-3fd8-4d9e-b7ab-71e7eed7ae94 req-5a53aee8-fbfa-4062-998f-177fcbe2f467 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:55.354851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1f58ce79-3fd8-4d9e-b7ab-71e7eed7ae94 req-5a53aee8-fbfa-4062-998f-177fcbe2f467 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:55.368083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=16 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:08:55.387937 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1f58ce79-3fd8-4d9e-b7ab-71e7eed7ae94 req-5a53aee8-fbfa-4062-998f-177fcbe2f467 service nova] Creating event network-changed:8222ff7e-e137-43a6-9457-3e311bdca5ba for instance c8499779-fa7d-459a-8832-35f644706d38 on nch1-master-1 Oct 01 21:08:55.399761 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1f58ce79-3fd8-4d9e-b7ab-71e7eed7ae94 req-5a53aee8-fbfa-4062-998f-177fcbe2f467 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084782 Oct 01 21:08:55.400650 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2529/3799] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:55.408919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:55.410073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:55.422247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:55.423030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:55.423713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:55.424688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:55.425372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:55.426127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:55.810380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:55.824544 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a1794f4-dfb0-4879-a8da-5aa6c6616bd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1667 microversion: 2.1 time: 0.422443 Oct 01 21:08:55.825636 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2530/3800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:55 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1667 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:55.833403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:55.834945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:55.865604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:55.866109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:55.866575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:55.867286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:55.867743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:55.868167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:56.225263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:56.233788 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c829b15e-dda1-4bb6-9972-c6fe70c630a7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.404552 Oct 01 21:08:56.250280 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2531/3801] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:55 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:56.250280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:56.250280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:56.250280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:56.250280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:56.250280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:56.250280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:56.250280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:56.251580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:56.599805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:56.614610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:56.616577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:56.617726 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ffe0887e-2c07-46f5-9b8f-88d5e8071192 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1405 microversion: 2.20 time: 0.381770 Oct 01 21:08:56.618308 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2532/3802] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:08:56 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1405 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:08:56.626565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2e47528-d43e-422c-8058-35eafa7c5c94 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:56.630157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2e47528-d43e-422c-8058-35eafa7c5c94 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:56.650293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2e47528-d43e-422c-8058-35eafa7c5c94 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:56.650747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2e47528-d43e-422c-8058-35eafa7c5c94 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:56.651181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2e47528-d43e-422c-8058-35eafa7c5c94 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:56.651908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2e47528-d43e-422c-8058-35eafa7c5c94 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:56.652366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2e47528-d43e-422c-8058-35eafa7c5c94 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:56.653679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2e47528-d43e-422c-8058-35eafa7c5c94 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:57.022536 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2e47528-d43e-422c-8058-35eafa7c5c94 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.401043 Oct 01 21:08:57.023301 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2533/3803] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Oct 1 21:08:56 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38/os-security-groups => generated 1158 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:57.028763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9e2d619d-540b-4c3f-957b-97b0048bb387 req-dddc3fe9-6f0b-4eab-b25b-7325ffe27acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97be5f25-216d-464d-944b-3d6108312f20", "tag": "a4d6a1de-27d2-4876-8b56-131f6ba7888d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:57.038405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9e2d619d-540b-4c3f-957b-97b0048bb387 req-dddc3fe9-6f0b-4eab-b25b-7325ffe27acb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:57.039108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9e2d619d-540b-4c3f-957b-97b0048bb387 req-dddc3fe9-6f0b-4eab-b25b-7325ffe27acb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:57.039868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9e2d619d-540b-4c3f-957b-97b0048bb387 req-dddc3fe9-6f0b-4eab-b25b-7325ffe27acb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:57.054206 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9e2d619d-540b-4c3f-957b-97b0048bb387 req-dddc3fe9-6f0b-4eab-b25b-7325ffe27acb service nova] Creating event network-changed:a4d6a1de-27d2-4876-8b56-131f6ba7888d for instance 97be5f25-216d-464d-944b-3d6108312f20 on nch2-master-1 Oct 01 21:08:57.060166 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9e2d619d-540b-4c3f-957b-97b0048bb387 req-dddc3fe9-6f0b-4eab-b25b-7325ffe27acb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035545 Oct 01 21:08:57.061085 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2534/3804] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:57.067381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f51b96e-5678-4010-ad58-f44328317a32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: .version_select at 0x7f4172658280>, body: {"security_group": {"name": " tempest-securitygroup -302206258 ", "description": "tempest-description-1570029931"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:57.716945 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f51b96e-5678-4010-ad58-f44328317a32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.653663 Oct 01 21:08:57.727108 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2535/3805] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:08:57 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:57.732169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:57.733002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:57.745817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:57.746319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:57.746794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:57.747531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:57.748164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:57.748591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:58.312326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:58.322103 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd699e40-f3e9-46b7-a5e9-47a98abdf01c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.593797 Oct 01 21:08:58.323091 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2536/3806] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:57 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:58.331252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7c4c54fe-e117-4806-baca-fad3ece1b2cf req-36a270d0-8fb0-4dde-ac03-0b03fd3bdd67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8499779-fa7d-459a-8832-35f644706d38", "tag": "8222ff7e-e137-43a6-9457-3e311bdca5ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:08:58.350581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c4c54fe-e117-4806-baca-fad3ece1b2cf req-36a270d0-8fb0-4dde-ac03-0b03fd3bdd67 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:58.351474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c4c54fe-e117-4806-baca-fad3ece1b2cf req-36a270d0-8fb0-4dde-ac03-0b03fd3bdd67 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:58.352156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c4c54fe-e117-4806-baca-fad3ece1b2cf req-36a270d0-8fb0-4dde-ac03-0b03fd3bdd67 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:58.368044 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7c4c54fe-e117-4806-baca-fad3ece1b2cf req-36a270d0-8fb0-4dde-ac03-0b03fd3bdd67 service nova] Creating event network-changed:8222ff7e-e137-43a6-9457-3e311bdca5ba for instance c8499779-fa7d-459a-8832-35f644706d38 on nch1-master-1 Oct 01 21:08:58.373248 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7c4c54fe-e117-4806-baca-fad3ece1b2cf req-36a270d0-8fb0-4dde-ac03-0b03fd3bdd67 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048731 Oct 01 21:08:58.373866 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2537/3807] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:58.379213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:58.379914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:58.386952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:58.387441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:58.387901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:58.388615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:58.389081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:58.389518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:58.748020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:58.759835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:58.761671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:58.763252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da59501a-1290-402a-932c-1ab0d6a50d6d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1405 microversion: 2.20 time: 0.387805 Oct 01 21:08:58.764004 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2538/3808] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:08:58 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1405 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:08:58.768952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68a449d0-0c95-46ae-b4b5-7129002f26c7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172671af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:58.914363 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68a449d0-0c95-46ae-b4b5-7129002f26c7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017" status: 200 len: 223 microversion: 2.1 time: 0.148976 Oct 01 21:08:58.915183 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2539/3809] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:08:58 2022] GET /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:08:58.928148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-676a49b1-26b8-4a7e-a0f2-d2cfb4511aab tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172606f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:59.474687 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-676a49b1-26b8-4a7e-a0f2-d2cfb4511aab tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017" status: 202 len: 0 microversion: 2.1 time: 0.550563 Oct 01 21:08:59.476147 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2540/3810] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:08:58 2022] DELETE /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:08:59.483380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:59.484414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:08:59.493456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:59.494378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:59.495792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:59.497731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:08:59.498685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:08:59.499392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:08:59.696400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:08:59.707504 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4d868067-85f3-48ec-a3a1-fc5f983460ac tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.229992 Oct 01 21:08:59.708694 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2541/3811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:08:59 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:08:59.714085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ce1b7a22-5764-4924-9912-bbdf1b08028d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172735550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:08:59.762369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-ce1b7a22-5764-4924-9912-bbdf1b08028d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:08:59.763146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-ce1b7a22-5764-4924-9912-bbdf1b08028d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:08:59.764025 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ce1b7a22-5764-4924-9912-bbdf1b08028d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:08:59.764025 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-0ea3cefd-74a8-4c96-981a-c1a11403f5ec'] Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ce1b7a22-5764-4924-9912-bbdf1b08028d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017 HTTP/1.1 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-0ea3cefd-74a8-4c96-981a-c1a11403f5ec'] Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a9a8b41b-b03c-41a5-b3cf-e310af95f017'} Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:08:59.765887 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ea3cefd-74a8-4c96-981a-c1a11403f5ec'] Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ea3cefd-74a8-4c96-981a-c1a11403f5ec'] Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ea3cefd-74a8-4c96-981a-c1a11403f5ec'] Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ea3cefd-74a8-4c96-981a-c1a11403f5ec'] Oct 01 21:08:59.769898 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:08:59.773228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ce1b7a22-5764-4924-9912-bbdf1b08028d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:08:59.773228 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-0ea3cefd-74a8-4c96-981a-c1a11403f5ec'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:08:59.774316 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ce1b7a22-5764-4924-9912-bbdf1b08028d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017" status: 404 len: 194 microversion: 2.1 time: 0.064362 Oct 01 21:08:59.778979 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2542/3812] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:08:59 2022] GET /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:08:59.786419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae22a334-8f97-402f-83d1-4b74792a8f11 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: .version_select at 0x7f4172698d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-183369175", "description": "tempest-description-1139473725"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:00.129131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae22a334-8f97-402f-83d1-4b74792a8f11 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.348658 Oct 01 21:09:00.129810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2543/3813] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:08:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:09:00.134633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:00.135245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:00.142690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:00.143407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:00.143893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:00.144559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:00.145169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:00.145615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:00.374773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:00.383052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:00.384520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:00.385680 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60fc3807-f95f-49c8-a955-0a75335d800d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1405 microversion: 2.20 time: 0.254947 Oct 01 21:09:00.402907 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2544/3814] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:00 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:00.402907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-830027cf-4679-4fd3-9855-4b646ae5134b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: .version_select at 0x7f41726980d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1394367296", "description": "tempest-description-818032299"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:00.650622 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-830027cf-4679-4fd3-9855-4b646ae5134b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.262998 Oct 01 21:09:00.651349 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2545/3815] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:09:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:00.686100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6a795ce-4275-451a-b268-e31b39bddf34 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: .version_select at 0x7f4172667f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1715406990", "description": "tempest-description-977238310"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:00.850521 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a6a795ce-4275-451a-b268-e31b39bddf34 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.178351 Oct 01 21:09:00.851601 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2546/3816] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:09:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:09:00.857723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:00.858744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:00.870335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:00.871000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:00.871537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:00.872375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:00.873146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:00.873760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:01.010577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:01.019079 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99385351-d31f-4203-985f-d50668fa4579 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.165999 Oct 01 21:09:01.019656 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2547/3817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:00 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:01.024126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f432523-2535-48a1-9d88-c76541564810 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172671b80>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:01.236833 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f432523-2535-48a1-9d88-c76541564810 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.216006 Oct 01 21:09:01.237691 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2548/3818] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 21:09:01 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:01.252125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf1f4cea-3d2b-4951-adb0-77eb055dd5b4 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172667790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:01.456318 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf1f4cea-3d2b-4951-adb0-77eb055dd5b4 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/b8fc4d48-b55f-46f7-ac45-8b5b6931f868" status: 202 len: 0 microversion: 2.1 time: 0.207787 Oct 01 21:09:01.462924 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2549/3819] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:01 2022] DELETE /compute/v2.1/os-security-groups/b8fc4d48-b55f-46f7-ac45-8b5b6931f868 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:09:01.470220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:01.471205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:01.482139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:01.483082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:01.483728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:01.485334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:01.485897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:01.486638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:01.663885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:01.674626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:01.678036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:01.679326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc72a670-7b13-431e-8b75-9bd149aa40e6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1405 microversion: 2.20 time: 0.214050 Oct 01 21:09:01.680072 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2550/3820] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:01 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:01.685826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ca708ae-9221-4d4b-95d9-533c4376a817 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172667820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:01.729670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-1ca708ae-9221-4d4b-95d9-533c4376a817 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:01.730647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-1ca708ae-9221-4d4b-95d9-533c4376a817 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:09:01.731357 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1ca708ae-9221-4d4b-95d9-533c4376a817 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:01.731357 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-7ce5402f-ff74-4a38-97ce-845f9b5c8eb5'] Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ca708ae-9221-4d4b-95d9-533c4376a817 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-security-groups/b8fc4d48-b55f-46f7-ac45-8b5b6931f868 HTTP/1.1 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-7ce5402f-ff74-4a38-97ce-845f9b5c8eb5'] Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'b8fc4d48-b55f-46f7-ac45-8b5b6931f868'} Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:01.733500 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ce5402f-ff74-4a38-97ce-845f9b5c8eb5'] Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ce5402f-ff74-4a38-97ce-845f9b5c8eb5'] Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ce5402f-ff74-4a38-97ce-845f9b5c8eb5'] Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ce5402f-ff74-4a38-97ce-845f9b5c8eb5'] Oct 01 21:09:01.737684 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:01.743058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ca708ae-9221-4d4b-95d9-533c4376a817 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:01.743058 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-7ce5402f-ff74-4a38-97ce-845f9b5c8eb5'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:01.746574 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1ca708ae-9221-4d4b-95d9-533c4376a817 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/b8fc4d48-b55f-46f7-ac45-8b5b6931f868" status: 404 len: 194 microversion: 2.1 time: 0.064495 Oct 01 21:09:01.747329 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2551/3821] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:09:01 2022] GET /compute/v2.1/os-security-groups/b8fc4d48-b55f-46f7-ac45-8b5b6931f868 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:01.759258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4bec3c68-6337-4944-b3ea-51981e46d7cb req-5464cdc4-e1e2-4867-b196-661c11b4d655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdeea1a-94c5-4666-b874-01634b5b5cd8", "name": "network-vif-plugged", "status": "completed", "tag": "e91fadf8-47e8-4e70-9ac2-c2c6258d58be"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:01.778878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4bec3c68-6337-4944-b3ea-51981e46d7cb req-5464cdc4-e1e2-4867-b196-661c11b4d655 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:01.779741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4bec3c68-6337-4944-b3ea-51981e46d7cb req-5464cdc4-e1e2-4867-b196-661c11b4d655 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:01.780342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4bec3c68-6337-4944-b3ea-51981e46d7cb req-5464cdc4-e1e2-4867-b196-661c11b4d655 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:01.794962 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4bec3c68-6337-4944-b3ea-51981e46d7cb req-5464cdc4-e1e2-4867-b196-661c11b4d655 service nova] Creating event network-vif-plugged:e91fadf8-47e8-4e70-9ac2-c2c6258d58be for instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 on nch2-master-1 Oct 01 21:09:01.800949 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4bec3c68-6337-4944-b3ea-51981e46d7cb req-5464cdc4-e1e2-4867-b196-661c11b4d655 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051129 Oct 01 21:09:01.805882 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2552/3822] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:01.813309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-85f49c63-afc5-4dc6-9936-9fd4eef75663 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f417265cc10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:02.267797 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-85f49c63-afc5-4dc6-9936-9fd4eef75663 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/e1aabd6f-8180-480d-903f-5e1a9b836da0" status: 202 len: 0 microversion: 2.1 time: 0.460066 Oct 01 21:09:02.271314 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2553/3823] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:01 2022] DELETE /compute/v2.1/os-security-groups/e1aabd6f-8180-480d-903f-5e1a9b836da0 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:02.273528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:02.274253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:02.280463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:02.280954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:02.281388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:02.282115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:02.282596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:02.283029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:02.454729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:02.464417 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e52fc34a-e3ff-467f-8ecd-7ad8e8dc36fe tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.194608 Oct 01 21:09:02.465081 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2554/3824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:02 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:02.470141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b750577-f5c1-4645-9bd6-3106c7e0868b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172667c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:02.498723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-3b750577-f5c1-4645-9bd6-3106c7e0868b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:02.499763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-3b750577-f5c1-4645-9bd6-3106c7e0868b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group e1aabd6f-8180-480d-903f-5e1a9b836da0 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:09:02.501013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3b750577-f5c1-4645-9bd6-3106c7e0868b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:02.501013 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-9169dcbe-c339-4fcf-a3e0-c32cd4a20a84'] Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b750577-f5c1-4645-9bd6-3106c7e0868b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-security-groups/e1aabd6f-8180-480d-903f-5e1a9b836da0 HTTP/1.1 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-9169dcbe-c339-4fcf-a3e0-c32cd4a20a84'] Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e1aabd6f-8180-480d-903f-5e1a9b836da0'} Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:02.503952 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9169dcbe-c339-4fcf-a3e0-c32cd4a20a84'] Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9169dcbe-c339-4fcf-a3e0-c32cd4a20a84'] Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9169dcbe-c339-4fcf-a3e0-c32cd4a20a84'] Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9169dcbe-c339-4fcf-a3e0-c32cd4a20a84'] Oct 01 21:09:02.508402 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.512580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b750577-f5c1-4645-9bd6-3106c7e0868b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:02.512580 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-9169dcbe-c339-4fcf-a3e0-c32cd4a20a84'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:02.513691 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b750577-f5c1-4645-9bd6-3106c7e0868b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/e1aabd6f-8180-480d-903f-5e1a9b836da0" status: 404 len: 194 microversion: 2.1 time: 0.047622 Oct 01 21:09:02.514817 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2555/3825] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:09:02 2022] GET /compute/v2.1/os-security-groups/e1aabd6f-8180-480d-903f-5e1a9b836da0 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:02.523026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec56456f-5040-4b3c-88b0-a959e93d1bdf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f41726065e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:02.726020 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec56456f-5040-4b3c-88b0-a959e93d1bdf tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/223d2587-820f-43d4-9020-0996ef57882e" status: 202 len: 0 microversion: 2.1 time: 0.207028 Oct 01 21:09:02.726832 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2556/3826] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:02 2022] DELETE /compute/v2.1/os-security-groups/223d2587-820f-43d4-9020-0996ef57882e => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:09:02.733615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:02.734524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:02.743177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:02.743689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:02.744211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:02.744915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:02.745558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:02.745987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:02.899260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:02.909168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:02.910693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:02.911860 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b95ac719-542f-4ce2-9142-bf2a18f72fd4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1405 microversion: 2.20 time: 0.183903 Oct 01 21:09:02.913060 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2557/3827] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:02 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:02.917788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-93b925c7-00b0-4fc7-b3ab-9bd93f8bfa76 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172606160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:02.947819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-93b925c7-00b0-4fc7-b3ab-9bd93f8bfa76 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:02.949879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-93b925c7-00b0-4fc7-b3ab-9bd93f8bfa76 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group 223d2587-820f-43d4-9020-0996ef57882e not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:09:02.950803 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-93b925c7-00b0-4fc7-b3ab-9bd93f8bfa76 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:02.950803 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-a1e4c4e5-2fbc-4a40-b738-3c635d57aa04'] Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-93b925c7-00b0-4fc7-b3ab-9bd93f8bfa76 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/os-security-groups/223d2587-820f-43d4-9020-0996ef57882e HTTP/1.1 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-a1e4c4e5-2fbc-4a40-b738-3c635d57aa04'] Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '223d2587-820f-43d4-9020-0996ef57882e'} Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:02.952807 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e4c4e5-2fbc-4a40-b738-3c635d57aa04'] Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e4c4e5-2fbc-4a40-b738-3c635d57aa04'] Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e4c4e5-2fbc-4a40-b738-3c635d57aa04'] Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e4c4e5-2fbc-4a40-b738-3c635d57aa04'] Oct 01 21:09:02.956920 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:02.961092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-93b925c7-00b0-4fc7-b3ab-9bd93f8bfa76 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:02.961092 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-a1e4c4e5-2fbc-4a40-b738-3c635d57aa04'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:02.961962 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-93b925c7-00b0-4fc7-b3ab-9bd93f8bfa76 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/223d2587-820f-43d4-9020-0996ef57882e" status: 404 len: 194 microversion: 2.1 time: 0.047763 Oct 01 21:09:02.966266 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2558/3828] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:09:02 2022] GET /compute/v2.1/os-security-groups/223d2587-820f-43d4-9020-0996ef57882e => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:02.971603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21c4a76a-430d-4714-bb4b-6782d5936a21 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172658e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:03.315287 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21c4a76a-430d-4714-bb4b-6782d5936a21 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.347706 Oct 01 21:09:03.323353 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2559/3829] 10.222.0.17 () {58 vars in 1158 bytes} [Sat Oct 1 21:09:02 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:03.335181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af6607a6-be4c-4a59-abaf-e10fd3d0d26b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: .version_select at 0x7f4172654160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1356987803", "description": "tempest-description-1275487444"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:03.616816 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-af6607a6-be4c-4a59-abaf-e10fd3d0d26b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.286545 Oct 01 21:09:03.617747 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2560/3830] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:09:03 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:03.623003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:03.623688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:03.637167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:03.637673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:03.642429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:03.643928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:03.644389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:03.644840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:03.917530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:03.927898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77968520-8717-41bd-b05f-251a0eed98fa tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1519 microversion: 2.1 time: 0.308578 Oct 01 21:09:03.946692 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2561/3831] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:03 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1519 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:03.946692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19773312-1657-468d-b21d-a97446bdc277 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: .version_select at 0x7f4172667700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1689509621", "description": "tempest-description-1916654263"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:04.159604 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19773312-1657-468d-b21d-a97446bdc277 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.223528 Oct 01 21:09:04.161407 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2562/3832] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:09:03 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:04.167372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-11e05922-6ddf-4a1d-a112-bfc91a804a08 req-966f1f36-12c6-472c-af48-d17b9eee57a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97be5f25-216d-464d-944b-3d6108312f20", "name": "network-vif-plugged", "status": "completed", "tag": "a4d6a1de-27d2-4876-8b56-131f6ba7888d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:04.180069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-11e05922-6ddf-4a1d-a112-bfc91a804a08 req-966f1f36-12c6-472c-af48-d17b9eee57a4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:04.180563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-11e05922-6ddf-4a1d-a112-bfc91a804a08 req-966f1f36-12c6-472c-af48-d17b9eee57a4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:04.181213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-11e05922-6ddf-4a1d-a112-bfc91a804a08 req-966f1f36-12c6-472c-af48-d17b9eee57a4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:04.183967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:04.209453 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-11e05922-6ddf-4a1d-a112-bfc91a804a08 req-966f1f36-12c6-472c-af48-d17b9eee57a4 service nova] Creating event network-vif-plugged:a4d6a1de-27d2-4876-8b56-131f6ba7888d for instance 97be5f25-216d-464d-944b-3d6108312f20 on nch2-master-1 Oct 01 21:09:04.215923 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-11e05922-6ddf-4a1d-a112-bfc91a804a08 req-966f1f36-12c6-472c-af48-d17b9eee57a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052886 Oct 01 21:09:04.216948 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2563/3833] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:04.224963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:04.225687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:04.232065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:04.232566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:04.233041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:04.233761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:04.234221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:04.234732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:04.448180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:04.460146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:04.461863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:04.462878 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e20ba212-b4db-40c4-81e0-26e6be517689 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1405 microversion: 2.20 time: 0.244542 Oct 01 21:09:04.463683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2564/3834] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:04 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:04.468710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1364284615", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a0fbff96-d41c-4e39-a7a7-f83fd2ac93f6"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:04.557756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] validate_networks() for [('a0fbff96-d41c-4e39-a7a7-f83fd2ac93f6', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:09:05.221115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:09:05.221575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:09:05.222049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:09:05.222673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:09:05.223113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:09:05.232582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:05.233181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:05.233756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:05.234669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:05.235211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:05.235725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:05.253794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Getting quotas for project 337bb3ce6f304c58902406f7279af3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:09:05.260056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Getting quotas for user d2a67ba740284d5589df8bdad6ab671f and project 337bb3ce6f304c58902406f7279af3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:09:05.262808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:05.276568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:09:05.278757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:09:05.329105 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d7959490-7882-4765-ac36-6fab4143ad20 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864189 Oct 01 21:09:05.330192 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2565/3835] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:09:05.335902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:05.337042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:05.344814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:05.345561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:05.346006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:05.346939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:05.347404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:05.347833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:05.532395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:05.573130 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ff0bb36-fab8-4755-bc1c-0485b5c21a3d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.241264 Oct 01 21:09:05.574044 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2566/3836] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:05 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:05.583603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-830b7882-1c6a-4e32-ada5-59d216b4cd3f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:05.584628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-830b7882-1c6a-4e32-ada5-59d216b4cd3f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:05.712847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-830b7882-1c6a-4e32-ada5-59d216b4cd3f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:05.722528 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-830b7882-1c6a-4e32-ada5-59d216b4cd3f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1216 microversion: 2.1 time: 0.146873 Oct 01 21:09:05.723888 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2567/3837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:05 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:05.735553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:05.737453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:05.744706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:05.745222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:05.745663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:05.747153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:05.747153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:05.747596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:05.908662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:05.918246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:05.919872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:05.921151 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d7f403f7-a196-4b34-84ee-a944347acb8e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1597 microversion: 2.20 time: 0.195738 Oct 01 21:09:05.924166 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2568/3838] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:05 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1597 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:05.932066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:05.933013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:05.940950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:05.941978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:05.943298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:05.944537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:05.945236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:05.945956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:06.063180 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:09:06.064072 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:09:06.184305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:06.197759 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a9e8ed1-bb34-48e2-bc5f-c4bb7f4c5b38 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.271433 Oct 01 21:09:06.210097 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2569/3839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:05 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:06.231278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5bf5e5ef-64f2-455a-b265-14809433148c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:06.232025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5bf5e5ef-64f2-455a-b265-14809433148c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:06.241015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bf5e5ef-64f2-455a-b265-14809433148c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:06.241559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bf5e5ef-64f2-455a-b265-14809433148c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:06.241961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bf5e5ef-64f2-455a-b265-14809433148c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:06.242918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bf5e5ef-64f2-455a-b265-14809433148c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:06.243529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bf5e5ef-64f2-455a-b265-14809433148c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:06.244115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bf5e5ef-64f2-455a-b265-14809433148c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:06.343405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5bf5e5ef-64f2-455a-b265-14809433148c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131592 Oct 01 21:09:06.346932 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2570/3840] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Oct 1 21:09:06 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:09:06.354016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:06.357066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:06.373374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:06.374782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:06.376246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:06.377433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:06.378125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:06.379398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:06.642815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:06.652096 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35c98ed0-f330-46ea-ad22-fc45e185835c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.303461 Oct 01 21:09:06.653265 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2571/3841] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:06 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:06.680743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c0b48ea-547e-4ce2-b482-93c62b0fda3a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:06.688735 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-4c0b48ea-547e-4ce2-b482-93c62b0fda3a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance 3ffcd7c7-63c1-4714-941d-9c10a7671183 has no mapping to a cell. Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c0b48ea-547e-4ce2-b482-93c62b0fda3a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/3ffcd7c7-63c1-4714-941d-9c10a7671183/action HTTP/1.1 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 15 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: {"os-stop": {}} Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 3ffcd7c7-63c1-4714-941d-9c10a7671183 has no mapping to a cell. Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '3ffcd7c7-63c1-4714-941d-9c10a7671183', 'body': {'os-stop': {}}} Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 3ffcd7c7-63c1-4714-941d-9c10a7671183 has no mapping to a cell. Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:06.696991 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffcd7c7-63c1-4714-941d-9c10a7671183 has no mapping to a cell. Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffcd7c7-63c1-4714-941d-9c10a7671183 has no mapping to a cell. Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c0b48ea-547e-4ce2-b482-93c62b0fda3a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance 3ffcd7c7-63c1-4714-941d-9c10a7671183 has no mapping to a cell. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4c0b48ea-547e-4ce2-b482-93c62b0fda3a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/3ffcd7c7-63c1-4714-941d-9c10a7671183/action" status: 404 len: 117 microversion: 2.1 time: 0.026041 Oct 01 21:09:06.701327 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2572/3842] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:06 2022] POST /compute/v2.1/servers/3ffcd7c7-63c1-4714-941d-9c10a7671183/action => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:06.710089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:06.710781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:06.719219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:06.719748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:06.720326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:06.721244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:06.721717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:06.722145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:07.047253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:07.063815 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24853bf6-7c89-459c-908c-0f5c698345d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.358878 Oct 01 21:09:07.064837 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2573/3843] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:06 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:07.085778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:07.086639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:07.104649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:07.105319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:07.105782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:07.106545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:07.107213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:07.107812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:07.223354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:07.255199 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd1e190b-7770-4561-b6a6-6ea4ecfaad24 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1274 microversion: 2.1 time: 0.189030 Oct 01 21:09:07.261687 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2574/3844] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:07 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:07.270264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:07.270969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:07.279841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:07.280358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:07.280798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:07.281901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:07.282710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:07.283301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:07.678067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:07.685946 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b98a3ae9-5017-4814-896b-96d3b810b587 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.422946 Oct 01 21:09:07.698895 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2575/3845] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:07 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:07.715648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19833842-fcc7-4c55-a6e8-61d3e6d2d7d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:07.716455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-19833842-fcc7-4c55-a6e8-61d3e6d2d7d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 61c5ab41-c63d-4ee8-aa65-64be0fc73b26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:07.723233 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-19833842-fcc7-4c55-a6e8-61d3e6d2d7d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance 61c5ab41-c63d-4ee8-aa65-64be0fc73b26 could not be found. Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19833842-fcc7-4c55-a6e8-61d3e6d2d7d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/61c5ab41-c63d-4ee8-aa65-64be0fc73b26/action HTTP/1.1 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 15 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: {"suspend": {}} Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 61c5ab41-c63d-4ee8-aa65-64be0fc73b26 could not be found. Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '61c5ab41-c63d-4ee8-aa65-64be0fc73b26', 'body': {'suspend': {}}} Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c5ab41-c63d-4ee8-aa65-64be0fc73b26 could not be found. Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c5ab41-c63d-4ee8-aa65-64be0fc73b26 could not be found. Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:07.726309 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:07.731060 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:07.731060 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:07.731060 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c5ab41-c63d-4ee8-aa65-64be0fc73b26 could not be found. Oct 01 21:09:07.731060 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:07.732285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19833842-fcc7-4c55-a6e8-61d3e6d2d7d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance 61c5ab41-c63d-4ee8-aa65-64be0fc73b26 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:07.733322 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19833842-fcc7-4c55-a6e8-61d3e6d2d7d7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/61c5ab41-c63d-4ee8-aa65-64be0fc73b26/action" status: 404 len: 111 microversion: 2.1 time: 0.026255 Oct 01 21:09:07.737550 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2576/3846] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:07 2022] POST /compute/v2.1/servers/61c5ab41-c63d-4ee8-aa65-64be0fc73b26/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:07.743414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:07.744270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:07.752720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:07.753395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:07.753982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:07.754906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:07.756080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:07.756667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:08.610565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:08.619153 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-050f1949-91bf-43c0-bb4b-14eb148c37ff tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.880138 Oct 01 21:09:08.620049 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2577/3847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:07 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:08.634406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ba659db8-1303-4a15-89ae-2bc87b6530dc req-f906ee64-74c8-4325-b04c-94402d23b4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97be5f25-216d-464d-944b-3d6108312f20", "tag": "a4d6a1de-27d2-4876-8b56-131f6ba7888d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:08.646863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ba659db8-1303-4a15-89ae-2bc87b6530dc req-f906ee64-74c8-4325-b04c-94402d23b4e5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:08.647373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ba659db8-1303-4a15-89ae-2bc87b6530dc req-f906ee64-74c8-4325-b04c-94402d23b4e5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:08.647993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ba659db8-1303-4a15-89ae-2bc87b6530dc req-f906ee64-74c8-4325-b04c-94402d23b4e5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:08.660290 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ba659db8-1303-4a15-89ae-2bc87b6530dc req-f906ee64-74c8-4325-b04c-94402d23b4e5 service nova] Creating event network-changed:a4d6a1de-27d2-4876-8b56-131f6ba7888d for instance 97be5f25-216d-464d-944b-3d6108312f20 on nch2-master-1 Oct 01 21:09:08.665807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ba659db8-1303-4a15-89ae-2bc87b6530dc req-f906ee64-74c8-4325-b04c-94402d23b4e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044413 Oct 01 21:09:08.666720 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2578/3848] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:08.673159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:08.674033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:08.680944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:08.682255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:08.682903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:08.684162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:08.684942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:08.685633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:08.790450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:08.803682 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aaf727ce-da01-4688-b141-826b9cc29f8f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1274 microversion: 2.1 time: 0.135302 Oct 01 21:09:08.805665 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2579/3849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:08 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1274 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:08.811709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:08.812887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:08.824698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:08.825297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:08.825877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:08.826872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:08.827514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:08.828207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:09.166478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:09.188077 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87d005ff-6aff-4242-969a-5e3c99693c0d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.380859 Oct 01 21:09:09.189267 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2580/3850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:08 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:09.222721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:09.225005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:09.233405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:09.234034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:09.234969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:09.235927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:09.236771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:09.237277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:09.288366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lazy-loading 'flavor' on Instance uuid 5bdeea1a-94c5-4666-b874-01634b5b5cd8 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:09:09.464531 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6b1010b8-dda8-4f88-8522-ece4226611cf tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 202 len: 0 microversion: 2.1 time: 0.246852 Oct 01 21:09:09.465747 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2581/3851] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:09 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:09.479968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:09.482986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:09.512403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:09.513471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:09.514539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:09.516044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:09.520452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:09.521979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:09.943036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:09.951508 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d4b0f49-ec83-47b5-82be-2bca097fb5d2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1514 microversion: 2.1 time: 0.481503 Oct 01 21:09:09.952309 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2582/3852] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:09 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1514 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:09.957692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:09.958971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:09.965603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:09.965751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:09.966160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:09.966913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:09.967373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:09.967923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:09.985357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:10.363514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:10.375087 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0d23d063-26c3-4366-96e8-f9a7fc67fc33 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1316 microversion: 2.1 time: 0.421720 Oct 01 21:09:10.393727 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2583/3853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:09 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:10.976454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:10.977428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:11.001900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.002553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.004252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.005750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.006246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.006757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.371966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:11.380497 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc450df5-e0f1-4d69-a38e-60940cb8c3f9 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1497 microversion: 2.1 time: 0.408478 Oct 01 21:09:11.381084 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2584/3854] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:10 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1497 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:11.385846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6f008a78-7607-4e38-9efc-8aec4b7ff116 req-aadf3b47-dfe8-44d0-9718-5f4404f7dd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93ba1638-584e-408f-8dcd-e67015ec7bd3", "tag": "5c30809e-0ae6-4470-beed-b0426c4a5ff9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:11.395301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6f008a78-7607-4e38-9efc-8aec4b7ff116 req-aadf3b47-dfe8-44d0-9718-5f4404f7dd14 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.396443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6f008a78-7607-4e38-9efc-8aec4b7ff116 req-aadf3b47-dfe8-44d0-9718-5f4404f7dd14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.397086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6f008a78-7607-4e38-9efc-8aec4b7ff116 req-aadf3b47-dfe8-44d0-9718-5f4404f7dd14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.413205 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6f008a78-7607-4e38-9efc-8aec4b7ff116 req-aadf3b47-dfe8-44d0-9718-5f4404f7dd14 service nova] Creating event network-changed:5c30809e-0ae6-4470-beed-b0426c4a5ff9 for instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 on nch1-master-1 Oct 01 21:09:11.418361 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6f008a78-7607-4e38-9efc-8aec4b7ff116 req-aadf3b47-dfe8-44d0-9718-5f4404f7dd14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035919 Oct 01 21:09:11.419582 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2585/3855] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:11.425701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:11.426633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:11.434097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.434852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.435483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.436463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.437103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.437709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.696767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:11.707649 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c01b167d-891b-4b00-8de2-ffb75d8a0a5b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1316 microversion: 2.1 time: 0.286445 Oct 01 21:09:11.709851 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2586/3856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:11 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:11.715592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:11.716200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:11.723304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.724570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.725582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.726458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.727227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.727777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.764844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lazy-loading 'flavor' on Instance uuid 5bdeea1a-94c5-4666-b874-01634b5b5cd8 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:09:11.779360 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Cannot 'suspend' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state suspended Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action HTTP/1.1 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 15 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: {"suspend": {}} Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'suspend' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state suspended Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8', 'body': {'suspend': {}}} Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 01 21:09:11.781099 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state suspended Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state suspended Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 409 to user: Cannot 'suspend' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state suspended {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-730dfce5-1508-4b34-a580-d43ed4411f99 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 409 len: 148 microversion: 2.1 time: 0.071354 Oct 01 21:09:11.788398 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2587/3857] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:11 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 148 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:09:11.791381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b3eb2245-a8c6-4064-af82-260607b3a4c8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:11.791926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b3eb2245-a8c6-4064-af82-260607b3a4c8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:11.799466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3eb2245-a8c6-4064-af82-260607b3a4c8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.800026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3eb2245-a8c6-4064-af82-260607b3a4c8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.800748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3eb2245-a8c6-4064-af82-260607b3a4c8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.801769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3eb2245-a8c6-4064-af82-260607b3a4c8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.803087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3eb2245-a8c6-4064-af82-260607b3a4c8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.803525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3eb2245-a8c6-4064-af82-260607b3a4c8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.895045 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b3eb2245-a8c6-4064-af82-260607b3a4c8 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 202 len: 0 microversion: 2.1 time: 0.106971 Oct 01 21:09:11.896094 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2588/3858] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:11 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:11.909091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:11.912789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:11.921364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.922070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.923443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:11.924346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:11.924994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:11.925692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:12.175734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:12.184518 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2245860-49ae-48e4-ade3-c4b78df1946d tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1503 microversion: 2.1 time: 0.280425 Oct 01 21:09:12.188126 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2589/3859] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:11 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:12.732771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:12.733393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:12.739386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:12.739880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:12.740333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:12.741013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:12.741501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:12.741933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:12.934738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:12.944128 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ced6a42c-07f8-4ea5-a6bf-985e9aa3a101 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1316 microversion: 2.1 time: 0.215547 Oct 01 21:09:12.962294 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2590/3860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:12 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:09:13.210673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:13.211358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:13.220671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:13.221971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:13.222640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:13.223547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:13.225127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:13.225733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:13.552704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:13.561169 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6bdbfbd0-4de5-403c-98d0-359f938b93f6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.355644 Oct 01 21:09:13.561748 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2591/3861] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:13 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:13.595624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:13.596481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:13.604187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:13.604761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:13.605272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:13.606277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:13.606849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:13.607388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:13.830089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:13.839052 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-caee1ee5-8abc-4628-88a3-f6b4764aea71 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.255942 Oct 01 21:09:13.839648 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2592/3862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:13 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:13.862080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f44af6b-faa3-4d30-9a73-53c6597725f7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:13.862622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f44af6b-faa3-4d30-9a73-53c6597725f7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: c3d62391-af9b-4a34-a748-bbb34434c272] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:13.868108 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-0f44af6b-faa3-4d30-9a73-53c6597725f7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance c3d62391-af9b-4a34-a748-bbb34434c272 could not be found. Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f44af6b-faa3-4d30-9a73-53c6597725f7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/c3d62391-af9b-4a34-a748-bbb34434c272/action HTTP/1.1 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 15 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: {"unpause": {}} Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance c3d62391-af9b-4a34-a748-bbb34434c272 could not be found. Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'c3d62391-af9b-4a34-a748-bbb34434c272', 'body': {'unpause': {}}} Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d62391-af9b-4a34-a748-bbb34434c272 could not be found. Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d62391-af9b-4a34-a748-bbb34434c272 could not be found. Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:13.869713 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:13.874142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:13.874142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:13.874142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d62391-af9b-4a34-a748-bbb34434c272 could not be found. Oct 01 21:09:13.874142 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:13.874142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f44af6b-faa3-4d30-9a73-53c6597725f7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance c3d62391-af9b-4a34-a748-bbb34434c272 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:13.874142 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f44af6b-faa3-4d30-9a73-53c6597725f7 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/c3d62391-af9b-4a34-a748-bbb34434c272/action" status: 404 len: 111 microversion: 2.1 time: 0.013255 Oct 01 21:09:13.874142 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2593/3863] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:13 2022] POST /compute/v2.1/servers/c3d62391-af9b-4a34-a748-bbb34434c272/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:09:13.880579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:13.881292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:14.139190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.139737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.140185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:14.140914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.141380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.141816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:14.362340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:14.371365 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5968bad0-0aed-4872-aef8-8791b0e79149 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.494666 Oct 01 21:09:14.371944 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2594/3864] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:13 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:09:14.394066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:14.394717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:14.401439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.401942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.402460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:14.403131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.403600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.404038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:14.599662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:14.607846 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aa216e7f-5ae5-4258-9993-d6a8ad63d01d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1316 microversion: 2.1 time: 0.217458 Oct 01 21:09:14.623680 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2595/3865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:14 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:14.628730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:14.629345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:14.635953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.636454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.636902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:14.637599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.638063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.638536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:14.865119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:14.873507 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68d81327-fd52-4b6b-bfc7-868485959398 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.248667 Oct 01 21:09:14.874169 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2596/3866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:14 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:14.898831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:14.899935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:14.908196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.909195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.909882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:14.910944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.912195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.912872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:14.940464 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Cannot 'unpause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action HTTP/1.1 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 15 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: {"unpause": {}} Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'unpause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8', 'body': {'unpause': {}}} Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 in vm_state active. Cannot unpause while the instance is in this state. Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:14.941994 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:14.946897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:14.946897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:14.946897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:14.946897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:09:14.946897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:14.946897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 409 to user: Cannot 'unpause' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:14.946897 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49ef48e4-3757-4077-899c-e7bd457788a2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 409 len: 145 microversion: 2.1 time: 0.051235 Oct 01 21:09:14.946897 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2597/3867] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:14 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 145 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 01 21:09:14.953480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:14.954284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:14.961277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.961954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.962820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:14.963581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:14.964115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:14.964599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:15.121654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:15.134969 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6ec9e92-a790-40dd-842a-9398405d7f69 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.185198 Oct 01 21:09:15.135725 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2598/3868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:14 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:15.164688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:15.165557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:15.172536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:15.173171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:15.174078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:15.175027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:15.175898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:15.176246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:15.244101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:15.326994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:15.335658 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a70a6855-44c2-482d-a7d7-30641a7418df tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.175796 Oct 01 21:09:15.336242 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2599/3869] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:15 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:15.358152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a16ff9a8-5cfb-495e-8080-82612c1d7268 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:15.358794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a16ff9a8-5cfb-495e-8080-82612c1d7268 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: c895fda1-df2a-47d0-8c76-f7f9c2ed970b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:15.364265 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a16ff9a8-5cfb-495e-8080-82612c1d7268 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance c895fda1-df2a-47d0-8c76-f7f9c2ed970b could not be found. Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a16ff9a8-5cfb-495e-8080-82612c1d7268 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/c895fda1-df2a-47d0-8c76-f7f9c2ed970b/action HTTP/1.1 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 18 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: {"unshelve": null} Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance c895fda1-df2a-47d0-8c76-f7f9c2ed970b could not be found. Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'c895fda1-df2a-47d0-8c76-f7f9c2ed970b', 'body': {'unshelve': None}} Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c895fda1-df2a-47d0-8c76-f7f9c2ed970b could not be found. Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c895fda1-df2a-47d0-8c76-f7f9c2ed970b could not be found. Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:15.365830 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c895fda1-df2a-47d0-8c76-f7f9c2ed970b could not be found. Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a16ff9a8-5cfb-495e-8080-82612c1d7268 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance c895fda1-df2a-47d0-8c76-f7f9c2ed970b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a16ff9a8-5cfb-495e-8080-82612c1d7268 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/c895fda1-df2a-47d0-8c76-f7f9c2ed970b/action" status: 404 len: 111 microversion: 2.1 time: 0.013046 Oct 01 21:09:15.369773 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2600/3870] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:15 2022] POST /compute/v2.1/servers/c895fda1-df2a-47d0-8c76-f7f9c2ed970b/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:09:15.376826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:15.377204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:15.386101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:15.386633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:15.387084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:15.387952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:15.388489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:15.388933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:15.537562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:15.546365 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0e688594-ea30-4272-b6d5-2f56b95fc3b5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.173995 Oct 01 21:09:15.547650 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2601/3871] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:15 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:15.575309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:15.577256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:15.584568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:15.585350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:15.585952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:15.587058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:15.587685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:15.589401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:15.596013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:15.720064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:15.742545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:15.750520 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e50795df-9726-47f9-866e-e17a96f4a5e4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.181656 Oct 01 21:09:15.751100 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2602/3872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:15 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:09:15.756138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:15.756920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:15.763248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:15.763942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:15.764402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:15.765120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:15.765594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:15.766361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:16.426140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:16.435213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6c208a91-184c-4ab3-9486-3e7a9d9ae809 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1316 microversion: 2.1 time: 0.683071 Oct 01 21:09:16.439755 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2603/3873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:15 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1316 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:16.445306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:16.446043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:16.452137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:16.452912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:16.453580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:16.454534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:16.455215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:16.455856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:16.481392 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Cannot 'unshelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action HTTP/1.1 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 18 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: {"unshelve": null} Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: exception: Cannot 'unshelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8', 'body': {'unshelve': None}} Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 in vm_state active. Cannot unshelve while the instance is in this state. Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 21:09:16.483557 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active Oct 01 21:09:16.487838 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:16.490448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 409 to user: Cannot 'unshelve' instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 while it is in vm_state active {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:16.492274 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe20ae4a-bcc7-40ec-b3ab-2b4eaa146ec5 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action" status: 409 len: 146 microversion: 2.1 time: 0.050600 Oct 01 21:09:16.493479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2604/3874] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:16 2022] POST /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8/action => generated 146 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:09:16.501792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:16.502846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:16.510408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:16.511191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:16.511851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:16.512837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:16.513514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:16.514414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:16.740301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:16.757229 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-47732b31-92b0-467a-958f-db419f2dcf7a tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.259040 Oct 01 21:09:16.759299 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2605/3875] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:16 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:16.795323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:16.797391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:16.812616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:16.813522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:16.816815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:16.818304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:16.819688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:16.820775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:17.067299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:17.078242 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02d83080-2834-430f-a841-bd068e7610fd tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.297329 Oct 01 21:09:17.078867 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2606/3876] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:16 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:17.103533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-16d4d11d-1a41-47c9-8782-2c3b390fb6d4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-976761676_updated"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:17.106364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-16d4d11d-1a41-47c9-8782-2c3b390fb6d4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 7ff94e4a-50d1-4646-94a3-065f2159fc72] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:17.113721 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-16d4d11d-1a41-47c9-8782-2c3b390fb6d4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance 7ff94e4a-50d1-4646-94a3-065f2159fc72 could not be found. Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-16d4d11d-1a41-47c9-8782-2c3b390fb6d4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/servers/7ff94e4a-50d1-4646-94a3-065f2159fc72 HTTP/1.1 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 80 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-976761676_updated"}} Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 7ff94e4a-50d1-4646-94a3-065f2159fc72 could not be found. Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7ff94e4a-50d1-4646-94a3-065f2159fc72', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-976761676_updated'}}} Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ff94e4a-50d1-4646-94a3-065f2159fc72 could not be found. Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 01 21:09:17.122139 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ff94e4a-50d1-4646-94a3-065f2159fc72 could not be found. Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ff94e4a-50d1-4646-94a3-065f2159fc72 could not be found. Oct 01 21:09:17.127622 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.128764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-16d4d11d-1a41-47c9-8782-2c3b390fb6d4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance 7ff94e4a-50d1-4646-94a3-065f2159fc72 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:17.129541 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-16d4d11d-1a41-47c9-8782-2c3b390fb6d4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "PUT /compute/v2.1/servers/7ff94e4a-50d1-4646-94a3-065f2159fc72" status: 404 len: 111 microversion: 2.1 time: 0.031024 Oct 01 21:09:17.130160 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2607/3877] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:09:17 2022] PUT /compute/v2.1/servers/7ff94e4a-50d1-4646-94a3-065f2159fc72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:09:17.139800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:17.141107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:17.149629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:17.150464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:17.151137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:17.152149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:17.152821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:17.153341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:17.375812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:17.386824 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc5b09dc-237c-4670-b875-427ec7d5124b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.251744 Oct 01 21:09:17.387555 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2608/3878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:17 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:17.415327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:17.416209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:17.423437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:17.424025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:17.424472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:17.425365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:17.425941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:17.426816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:17.609613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:17.620490 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e962991-969c-4cd4-bf9a-2b827366bb5e tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.209069 Oct 01 21:09:17.635447 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2609/3879] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:17 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:17.635447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:17.635447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:17.638797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:17.639494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:17.640132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:17.641164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:17.642045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:17.642862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:17.815792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:17.825805 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-17778b0d-c6a4-48d5-9879-9dec18d8acd5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1316 microversion: 2.1 time: 0.200537 Oct 01 21:09:17.826556 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2610/3880] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:17 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:17.831702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64e50d95-ddb4-4efb-95e8-bae12347024b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64e50d95-ddb4-4efb-95e8-bae12347024b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 HTTP/1.1 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 280 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.842455 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64e50d95-ddb4-4efb-95e8-bae12347024b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64e50d95-ddb4-4efb-95e8-bae12347024b tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "PUT /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 400 len: 619 microversion: 2.1 time: 0.016307 Oct 01 21:09:17.852196 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2611/3881] 10.222.0.17 () {60 vars in 1257 bytes} [Sat Oct 1 21:09:17 2022] PUT /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:09:17.855550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:17.856508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:17.860720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:17.866175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:17.866838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:17.867293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:17.868082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:17.868628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:17.869072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:18.079424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:18.089675 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cbc4e6ff-2671-4803-964d-7bcf58c643c2 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.238208 Oct 01 21:09:18.090420 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2612/3882] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:17 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:18.116747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:18.117440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:18.130547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:18.135733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:18.142459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:18.143057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:18.143633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:18.144327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:18.429671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:18.450336 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-edd4d47e-d604-41fe-8a9e-34b6d0a6029c tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.336637 Oct 01 21:09:18.451202 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2613/3883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:18 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:09:18.464837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-83e0e72f-d32b-4be8-a5f2-579bb7d9a785 req-061c69b3-fb3f-4cd8-8ce1-83959350e7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ba1638-584e-408f-8dcd-e67015ec7bd3", "name": "network-vif-plugged", "status": "completed", "tag": "5c30809e-0ae6-4470-beed-b0426c4a5ff9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:18.499325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-83e0e72f-d32b-4be8-a5f2-579bb7d9a785 req-061c69b3-fb3f-4cd8-8ce1-83959350e7ab service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:18.500189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-83e0e72f-d32b-4be8-a5f2-579bb7d9a785 req-061c69b3-fb3f-4cd8-8ce1-83959350e7ab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:18.501046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-83e0e72f-d32b-4be8-a5f2-579bb7d9a785 req-061c69b3-fb3f-4cd8-8ce1-83959350e7ab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:18.519853 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-83e0e72f-d32b-4be8-a5f2-579bb7d9a785 req-061c69b3-fb3f-4cd8-8ce1-83959350e7ab service nova] Creating event network-vif-plugged:5c30809e-0ae6-4470-beed-b0426c4a5ff9 for instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 on nch1-master-1 Oct 01 21:09:18.533185 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-83e0e72f-d32b-4be8-a5f2-579bb7d9a785 req-061c69b3-fb3f-4cd8-8ce1-83959350e7ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075224 Oct 01 21:09:18.535084 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2614/3884] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:18.546009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a55aee4-8f53-4ce0-a8bd-85d374a85687 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a55aee4-8f53-4ce0-a8bd-85d374a85687 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: request: PUT /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 HTTP/1.1 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 24 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: {"server": {"name": ""}} Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8', 'body': {'server': {'name': ''}}} Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '' Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:09:18.551047 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a55aee4-8f53-4ce0-a8bd-85d374a85687 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:18.559676 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0a55aee4-8f53-4ce0-a8bd-85d374a85687 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "PUT /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 400 len: 108 microversion: 2.1 time: 0.019098 Oct 01 21:09:18.565302 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2615/3885] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:09:18 2022] PUT /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:09:18.575200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:18.576023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:18.608048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:18.608542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:18.609082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:18.609754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:18.613869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:18.614826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:18.883506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:18.894875 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cdedd9c4-4ec8-4938-9ad0-34df96e78892 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1506 microversion: 2.1 time: 0.328390 Oct 01 21:09:18.896642 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2616/3886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:18 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:18.901999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:18.902922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:18.910083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:18.912587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:18.913397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:18.915094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:18.915909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:18.916577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:19.180353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:19.189659 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7597b5bd-1535-4d1e-8a32-ff39aff96a86 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1316 microversion: 2.1 time: 0.291338 Oct 01 21:09:19.190162 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2617/3887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:18 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:20.235370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:20.236167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:20.255220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:20.257214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:20.258573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:20.260624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:20.263409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:20.264291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:20.500948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:20.512217 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0a0705f-081d-44cc-89e5-e222cb54556b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1504 microversion: 2.1 time: 0.289971 Oct 01 21:09:20.527416 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2618/3888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:20 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:20.536535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1356987803"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:20.537776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:20.544774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:20.545631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:20.546307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:20.547890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:20.548651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:20.549322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:20.762804 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.network.security_group_api [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Adding security group 5f0348d1-09af-494a-9dda-1c486fe0939d to port 5c30809e-0ae6-4470-beed-b0426c4a5ff9 Oct 01 21:09:21.462986 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6ce84cda-9f10-4448-a9ac-e9f66b1406e6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3/action" status: 202 len: 0 microversion: 2.1 time: 0.930312 Oct 01 21:09:21.464784 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2619/3889] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:20 2022] POST /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3/action => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:09:21.472663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:21.472976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:21.490964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:21.492871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:21.493879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:21.497047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:21.498113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:21.499099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:21.523092 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b HTTP/1.1 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd2309b08-05db-4a69-9b23-76111e0ee07b'} Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:21.525932 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.530595 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.533394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:21.534536 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99c3446e-48b1-434d-ba43-fffa20b45ca1 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 404 len: 111 microversion: 2.1 time: 0.067761 Oct 01 21:09:21.535701 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2620/3890] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:09:21 2022] DELETE /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:09:21.541580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-720bcbe7-99ff-424a-884c-a7a4de272624 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172946e50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:21.748732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-720bcbe7-99ff-424a-884c-a7a4de272624 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5f0348d1-09af-494a-9dda-1c486fe0939d in use.", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:21.749527 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-720bcbe7-99ff-424a-884c-a7a4de272624 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security Group 5f0348d1-09af-494a-9dda-1c486fe0939d in use. Oct 01 21:09:21.749527 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-6e7ff54b-e3aa-401c-b81f-ccfdb108301e'] Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-720bcbe7-99ff-424a-884c-a7a4de272624 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/5f0348d1-09af-494a-9dda-1c486fe0939d HTTP/1.1 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: exception: Security Group 5f0348d1-09af-494a-9dda-1c486fe0939d in use. Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-6e7ff54b-e3aa-401c-b81f-ccfdb108301e'] Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5f0348d1-09af-494a-9dda-1c486fe0939d'} Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:21.752103 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5f0348d1-09af-494a-9dda-1c486fe0939d in use. Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e7ff54b-e3aa-401c-b81f-ccfdb108301e'] Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5f0348d1-09af-494a-9dda-1c486fe0939d in use. Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e7ff54b-e3aa-401c-b81f-ccfdb108301e'] Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5f0348d1-09af-494a-9dda-1c486fe0939d in use. Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e7ff54b-e3aa-401c-b81f-ccfdb108301e'] Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5f0348d1-09af-494a-9dda-1c486fe0939d in use. Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e7ff54b-e3aa-401c-b81f-ccfdb108301e'] Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-720bcbe7-99ff-424a-884c-a7a4de272624 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 400 to user: Security Group 5f0348d1-09af-494a-9dda-1c486fe0939d in use. Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-6e7ff54b-e3aa-401c-b81f-ccfdb108301e'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-720bcbe7-99ff-424a-884c-a7a4de272624 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5f0348d1-09af-494a-9dda-1c486fe0939d" status: 400 len: 185 microversion: 2.1 time: 0.216875 Oct 01 21:09:21.758027 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2621/3891] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:21 2022] DELETE /compute/v2.1/os-security-groups/5f0348d1-09af-494a-9dda-1c486fe0939d => generated 185 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:09:21.766074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1eace93e-bb31-4ed1-80f1-160b6141a278 req-fe4c45d9-4697-4e42-85fd-5b737d813070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93ba1638-584e-408f-8dcd-e67015ec7bd3", "tag": "5c30809e-0ae6-4470-beed-b0426c4a5ff9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:21.796114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1eace93e-bb31-4ed1-80f1-160b6141a278 req-fe4c45d9-4697-4e42-85fd-5b737d813070 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:21.796612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1eace93e-bb31-4ed1-80f1-160b6141a278 req-fe4c45d9-4697-4e42-85fd-5b737d813070 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:21.797073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1eace93e-bb31-4ed1-80f1-160b6141a278 req-fe4c45d9-4697-4e42-85fd-5b737d813070 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:21.848780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1eace93e-bb31-4ed1-80f1-160b6141a278 req-fe4c45d9-4697-4e42-85fd-5b737d813070 service nova] Creating event network-changed:5c30809e-0ae6-4470-beed-b0426c4a5ff9 for instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 on nch1-master-1 Oct 01 21:09:21.859698 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1eace93e-bb31-4ed1-80f1-160b6141a278 req-fe4c45d9-4697-4e42-85fd-5b737d813070 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102834 Oct 01 21:09:21.865323 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2622/3892] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:21.873709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:21.874922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: d2309b08-05db-4a69-9b23-76111e0ee07b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:21.884132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:21.885501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:21.892188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:21.894300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:21.894966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:21.897350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:21.952588 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b HTTP/1.1 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd2309b08-05db-4a69-9b23-76111e0ee07b'} Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:21.959322 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.963268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:21.963268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:21.963268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:21.963268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:21.963268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:21.963268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. Oct 01 21:09:21.963268 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:21.967155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance d2309b08-05db-4a69-9b23-76111e0ee07b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:21.968063 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-efdc967c-1450-4cf3-8784-6ecfbf3870d6 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b" status: 404 len: 111 microversion: 2.1 time: 0.100997 Oct 01 21:09:21.968666 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2623/3893] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:21 2022] GET /compute/v2.1/servers/d2309b08-05db-4a69-9b23-76111e0ee07b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:21.989660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6626384b-0555-4225-a4a2-bdc75a3efca7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:21.992887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6626384b-0555-4225-a4a2-bdc75a3efca7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:22.003237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6626384b-0555-4225-a4a2-bdc75a3efca7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:22.004222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6626384b-0555-4225-a4a2-bdc75a3efca7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:22.006228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6626384b-0555-4225-a4a2-bdc75a3efca7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:22.008250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6626384b-0555-4225-a4a2-bdc75a3efca7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:22.012173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6626384b-0555-4225-a4a2-bdc75a3efca7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:22.012827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6626384b-0555-4225-a4a2-bdc75a3efca7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:22.185598 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6626384b-0555-4225-a4a2-bdc75a3efca7 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3/action" status: 202 len: 0 microversion: 2.1 time: 0.215037 Oct 01 21:09:22.190162 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2624/3894] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:21 2022] POST /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:22.220569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:22.221421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:22.232030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:22.232710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:22.233156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:22.234225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:22.235202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:22.236145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:22.243109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:22.282024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:09:22.399951 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e9ddc7d8-4795-438a-aa58-9bf420bb9ec4 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 204 len: 0 microversion: 2.1 time: 0.189840 Oct 01 21:09:22.400584 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2625/3895] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:09:22 2022] DELETE /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:09:22.410435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:22.411535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:22.421271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:22.422042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:22.423204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:22.424153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:22.426687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:22.427772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:22.705961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:22.719879 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1ebc1346-3584-48f8-b236-4357e1764803 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1575 microversion: 2.1 time: 0.314460 Oct 01 21:09:22.720706 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2626/3896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:22 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1575 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:22.730662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:22.731490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:22.754924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:22.755434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:22.760375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:22.763166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:22.791951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:22.792807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:23.271099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:23.286571 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19397bd8-3d07-48cf-b860-e21ec6dd5c86 tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1512 microversion: 2.1 time: 0.562991 Oct 01 21:09:23.291399 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2627/3897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:22 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1512 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:23.744511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:23.745183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:23.754656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:23.755159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:23.755789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:23.756698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:23.757169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:23.757606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:24.018360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:24.028809 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64498ca9-551f-4ba7-8811-2935a59477af tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1575 microversion: 2.1 time: 0.288598 Oct 01 21:09:24.029204 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2628/3898] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:23 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1575 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:24.316135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:24.317490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:24.330080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:24.333708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:24.334333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:24.335266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:24.336036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:24.336660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:24.672479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d63c633112e49d091421c84cea3422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0ad82595344eb4a1122d294faf15b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:24.687524 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2aad54cc-1dd2-446f-a414-4d37449644dc tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 200 len: 1512 microversion: 2.1 time: 0.375747 Oct 01 21:09:24.689254 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2629/3899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:24 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:25.259276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3b35ff08-c9c3-417e-a1c4-6eccf4003869 req-fc0e2bbd-4960-4b16-85b6-6e442b7ff4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdeea1a-94c5-4666-b874-01634b5b5cd8", "name": "network-vif-deleted", "tag": "e91fadf8-47e8-4e70-9ac2-c2c6258d58be"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:25.274430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3b35ff08-c9c3-417e-a1c4-6eccf4003869 req-fc0e2bbd-4960-4b16-85b6-6e442b7ff4da service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:25.275488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3b35ff08-c9c3-417e-a1c4-6eccf4003869 req-fc0e2bbd-4960-4b16-85b6-6e442b7ff4da service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:25.276115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3b35ff08-c9c3-417e-a1c4-6eccf4003869 req-fc0e2bbd-4960-4b16-85b6-6e442b7ff4da service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:25.290966 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3b35ff08-c9c3-417e-a1c4-6eccf4003869 req-fc0e2bbd-4960-4b16-85b6-6e442b7ff4da service nova] Creating event network-vif-deleted:e91fadf8-47e8-4e70-9ac2-c2c6258d58be for instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 on nch2-master-1 Oct 01 21:09:25.298168 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3b35ff08-c9c3-417e-a1c4-6eccf4003869 req-fc0e2bbd-4960-4b16-85b6-6e442b7ff4da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307834 Oct 01 21:09:25.299302 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2630/3900] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:25.309013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:25.310877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:25.320858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:25.321684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:25.322623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:25.324428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:25.325164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:25.325878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:25.554897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:25.576431 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8bddc82-4bed-4da8-9019-435db8ca4e49 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1573 microversion: 2.1 time: 0.275298 Oct 01 21:09:25.577349 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2631/3901] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:25 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1573 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:25.609586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1689509621"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:25.609586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:25.633178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:25.633938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:25.634591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:25.635534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:25.636173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:25.636627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:25.862367 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.network.security_group_api [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Adding security group 0c5404bc-94df-4660-addd-6f31e007959f to port 5c30809e-0ae6-4470-beed-b0426c4a5ff9 Oct 01 21:09:26.328048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-399d0ea8-77c2-4960-954c-3fc160103c32 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3/action" status: 202 len: 0 microversion: 2.1 time: 0.727946 Oct 01 21:09:26.328752 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2632/3902] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:09:25 2022] POST /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:26.337435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:26.339627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] [instance: 5bdeea1a-94c5-4666-b874-01634b5b5cd8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:26.354036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:26.354935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:26.355563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:26.356572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:26.357552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:26.358228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:26.378264 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] HTTP exception thrown: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 could not be found. Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Request method failure captured: Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 HTTP/1.1 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKt_nAEpiwN59uTgQ_K__xJY7oPVM0X7ShVeS0t2cB7oLlEmzaEZXgqelcm2IVu1cVVM6SlIrT5DOwdst7Fh2vqNJCRKba6Nr0brJtAiiVqdAnjg2r8jbrVaONxpLFKe70SolgifCoJ4xezrwR1GgRt6A9EykLtAlSCnRdm3PnAb150 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c0ad82595344eb4a1122d294faf15b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c0ad82595344eb4a1122d294faf15b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c0ad82595344eb4a1122d294faf15b2"}]}] Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6c0ad82595344eb4a1122d294faf15b2 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1224281476 Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6d63c633112e49d091421c84cea3422b Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1224281476-project Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 could not be found. Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5bdeea1a-94c5-4666-b874-01634b5b5cd8'} Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 could not be found. Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 could not be found. Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:26.381509 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.386741 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:26.386741 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:26.386741 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:26.386741 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:26.386741 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:26.386741 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 could not be found. Oct 01 21:09:26.386741 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.388564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] Returning 404 to user: Instance 5bdeea1a-94c5-4666-b874-01634b5b5cd8 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:26.389765 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e1bb292e-ab60-4440-8f2d-6be957dc46ed tempest-ServersNegativeTestJSON-1224281476 tempest-ServersNegativeTestJSON-1224281476-project] 10.222.0.17 "GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8" status: 404 len: 111 microversion: 2.1 time: 0.059824 Oct 01 21:09:26.391139 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2633/3903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:26 2022] GET /compute/v2.1/servers/5bdeea1a-94c5-4666-b874-01634b5b5cd8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:26.398114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c14a1cf5-29e4-4101-b005-f5f57206275b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172667ca0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:26.534501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-c14a1cf5-29e4-4101-b005-f5f57206275b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0c5404bc-94df-4660-addd-6f31e007959f in use.", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:26.535217 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c14a1cf5-29e4-4101-b005-f5f57206275b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security Group 0c5404bc-94df-4660-addd-6f31e007959f in use. Oct 01 21:09:26.535217 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-dfc7f688-2408-40b5-ab8d-e65f2490a93c'] Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c14a1cf5-29e4-4101-b005-f5f57206275b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/0c5404bc-94df-4660-addd-6f31e007959f HTTP/1.1 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: exception: Security Group 0c5404bc-94df-4660-addd-6f31e007959f in use. Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-dfc7f688-2408-40b5-ab8d-e65f2490a93c'] Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0c5404bc-94df-4660-addd-6f31e007959f'} Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:26.537377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0c5404bc-94df-4660-addd-6f31e007959f in use. Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfc7f688-2408-40b5-ab8d-e65f2490a93c'] Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0c5404bc-94df-4660-addd-6f31e007959f in use. Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfc7f688-2408-40b5-ab8d-e65f2490a93c'] Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0c5404bc-94df-4660-addd-6f31e007959f in use. Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfc7f688-2408-40b5-ab8d-e65f2490a93c'] Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0c5404bc-94df-4660-addd-6f31e007959f in use. Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfc7f688-2408-40b5-ab8d-e65f2490a93c'] Oct 01 21:09:26.541965 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:26.546528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c14a1cf5-29e4-4101-b005-f5f57206275b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 400 to user: Security Group 0c5404bc-94df-4660-addd-6f31e007959f in use. Oct 01 21:09:26.546528 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-dfc7f688-2408-40b5-ab8d-e65f2490a93c'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:26.547754 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c14a1cf5-29e4-4101-b005-f5f57206275b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0c5404bc-94df-4660-addd-6f31e007959f" status: 400 len: 185 microversion: 2.1 time: 0.155462 Oct 01 21:09:26.553950 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2634/3904] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:26 2022] DELETE /compute/v2.1/os-security-groups/0c5404bc-94df-4660-addd-6f31e007959f => generated 185 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:09:26.633987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ff654626-d215-4a84-9abf-51beca5685f2 req-b41aa3ec-746a-47c6-a2ed-24398ab7c8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93ba1638-584e-408f-8dcd-e67015ec7bd3", "tag": "5c30809e-0ae6-4470-beed-b0426c4a5ff9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:26.651097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ff654626-d215-4a84-9abf-51beca5685f2 req-b41aa3ec-746a-47c6-a2ed-24398ab7c8a6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:26.651598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ff654626-d215-4a84-9abf-51beca5685f2 req-b41aa3ec-746a-47c6-a2ed-24398ab7c8a6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:26.652525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ff654626-d215-4a84-9abf-51beca5685f2 req-b41aa3ec-746a-47c6-a2ed-24398ab7c8a6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:26.666785 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ff654626-d215-4a84-9abf-51beca5685f2 req-b41aa3ec-746a-47c6-a2ed-24398ab7c8a6 service nova] Creating event network-changed:5c30809e-0ae6-4470-beed-b0426c4a5ff9 for instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 on nch1-master-1 Oct 01 21:09:26.673376 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ff654626-d215-4a84-9abf-51beca5685f2 req-b41aa3ec-746a-47c6-a2ed-24398ab7c8a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116356 Oct 01 21:09:26.678249 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2635/3905] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:26.686529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:26.687128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:26.694863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:26.695620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:26.696240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:26.696995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:26.697469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:26.697904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:26.734118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:09:26.887526 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4e1f1ec7-c146-44b9-b1ad-b3effdefe111 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 204 len: 0 microversion: 2.1 time: 0.205562 Oct 01 21:09:26.888381 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2636/3906] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:09:26 2022] DELETE /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:09:26.905955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:26.906722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:26.923619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:26.924485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:26.925104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:26.926005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:26.927457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:26.928063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:27.279989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:27.289861 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3fe86b3b-a90b-4a31-b2f7-0c0ffefcb074 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1648 microversion: 2.1 time: 0.393303 Oct 01 21:09:27.294931 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2637/3907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:26 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1648 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:28.318039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:28.318732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:28.336867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:28.347672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:28.348761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:28.349556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:28.350033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:28.350471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:29.520837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:29.535143 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-90541ec2-d6e7-49f0-ba83-a3a443092f7c tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1648 microversion: 2.1 time: 1.221046 Oct 01 21:09:29.537146 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2638/3908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:28 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1648 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:09:29.543918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5081b715-4d72-4546-8b5c-ce7926529ec5 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:29.548360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5081b715-4d72-4546-8b5c-ce7926529ec5 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:29.558776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5081b715-4d72-4546-8b5c-ce7926529ec5 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:29.559832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5081b715-4d72-4546-8b5c-ce7926529ec5 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:29.561122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5081b715-4d72-4546-8b5c-ce7926529ec5 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:29.562066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5081b715-4d72-4546-8b5c-ce7926529ec5 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:29.565733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5081b715-4d72-4546-8b5c-ce7926529ec5 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:29.567811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5081b715-4d72-4546-8b5c-ce7926529ec5 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:29.614395 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5081b715-4d72-4546-8b5c-ce7926529ec5 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074484 Oct 01 21:09:29.615498 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2639/3909] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:09:29 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:09:29.722686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:29.723553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:29.730208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:29.731086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:29.731709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:29.732627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:29.733254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:29.735458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:29.769098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:09:29.839745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:29.970870 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b1c228ab-9da4-452d-9d03-7defbb96bfd8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 204 len: 0 microversion: 2.1 time: 0.250944 Oct 01 21:09:29.973653 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2640/3910] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:09:29 2022] DELETE /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 21:09:29.986657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-10ef4f23-31cd-4aa9-878a-f301aa5a8553 req-d0e41a60-7661-43dd-9637-ba8a3f1f8923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ba1638-584e-408f-8dcd-e67015ec7bd3", "name": "network-vif-deleted", "tag": "5c30809e-0ae6-4470-beed-b0426c4a5ff9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:30.001245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-10ef4f23-31cd-4aa9-878a-f301aa5a8553 req-d0e41a60-7661-43dd-9637-ba8a3f1f8923 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:30.001868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-10ef4f23-31cd-4aa9-878a-f301aa5a8553 req-d0e41a60-7661-43dd-9637-ba8a3f1f8923 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:30.002373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-10ef4f23-31cd-4aa9-878a-f301aa5a8553 req-d0e41a60-7661-43dd-9637-ba8a3f1f8923 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:30.019485 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-10ef4f23-31cd-4aa9-878a-f301aa5a8553 req-d0e41a60-7661-43dd-9637-ba8a3f1f8923 service nova] Creating event network-vif-deleted:5c30809e-0ae6-4470-beed-b0426c4a5ff9 for instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 on nch1-master-1 Oct 01 21:09:30.032824 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-10ef4f23-31cd-4aa9-878a-f301aa5a8553 req-d0e41a60-7661-43dd-9637-ba8a3f1f8923 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050385 Oct 01 21:09:30.033518 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2641/3911] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:30.051155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:30.057104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:30.090575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:30.093438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:30.093907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:30.096507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:30.096986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:30.097424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:30.559722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:30.576048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-69352335-9678-4ae5-af76-e474b66bfecf tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1673 microversion: 2.1 time: 0.541146 Oct 01 21:09:30.590558 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2642/3912] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:30 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1673 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:30.590558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:30.590558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:30.605553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:30.606188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:30.606523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:30.607248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:30.607710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:30.608150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:30.701767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:30.702554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:30.703069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:30.703675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lazy-loading 'fault' on Instance uuid 93ba1638-584e-408f-8dcd-e67015ec7bd3 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:09:30.777921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:30.792127 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-59f56ccc-6d40-479b-ab53-3460148a682d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 200 len: 1306 microversion: 2.1 time: 0.214083 Oct 01 21:09:30.810892 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2643/3913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:30 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 1306 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:31.603556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:31.604273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:31.611258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:31.612097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:31.612719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:31.613576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:31.614200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:31.614855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:31.813785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:31.826878 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4fd7bf2a-092b-413f-90b6-63cbe4c6c90a tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1673 microversion: 2.1 time: 0.227472 Oct 01 21:09:31.833458 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2644/3914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:31 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1673 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:31.842211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:31.845349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:31.858563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:31.859628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:31.859628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:31.860318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:31.860798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:31.861228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:31.876528 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 HTTP/1.1 Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '93ba1638-584e-408f-8dcd-e67015ec7bd3'} Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:31.877794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6bfaa126-e986-4ab5-ab0e-cac89a49b567 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 404 len: 111 microversion: 2.1 time: 0.045064 Oct 01 21:09:31.882048 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2645/3915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:31 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:31.889331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e4c89964-4481-4141-9cf9-a7706680da6d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f417c2ec550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:32.227144 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e4c89964-4481-4141-9cf9-a7706680da6d tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5f0348d1-09af-494a-9dda-1c486fe0939d" status: 202 len: 0 microversion: 2.1 time: 0.341632 Oct 01 21:09:32.227810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2646/3916] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:31 2022] DELETE /compute/v2.1/os-security-groups/5f0348d1-09af-494a-9dda-1c486fe0939d => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:32.235943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82b9a712-6114-4193-aa1d-99ced95e8aad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f41739c1280>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:32.522517 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82b9a712-6114-4193-aa1d-99ced95e8aad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0c5404bc-94df-4660-addd-6f31e007959f" status: 202 len: 0 microversion: 2.1 time: 0.290205 Oct 01 21:09:32.523614 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2647/3917] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:32 2022] DELETE /compute/v2.1/os-security-groups/0c5404bc-94df-4660-addd-6f31e007959f => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:09:32.537820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-191c1c57-8ecb-4ec0-819f-3556231a3a42 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'create', calling method: .version_select at 0x7f4172989a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-836125985", "description": "tempest-description-2120982148"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:32.768895 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-191c1c57-8ecb-4ec0-819f-3556231a3a42 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.236573 Oct 01 21:09:32.770323 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2648/3918] 10.222.0.17 () {60 vars in 1180 bytes} [Sat Oct 1 21:09:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:32.790338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a19c70f1-8e4f-40aa-9f5b-8ce55763a8d0 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Action: 'update', calling method: .version_select at 0x7f4172611af0>, body: {"security_group": {"name": "tempest-sg-hth-1302257845", "description": "tempest-description-hth-1339536458"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:33.038538 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a19c70f1-8e4f-40aa-9f5b-8ce55763a8d0 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "PUT /compute/v2.1/os-security-groups/fe3cf71c-579d-4cb3-aced-4df6ed8989fb" status: 200 len: 218 microversion: 2.1 time: 0.258822 Oct 01 21:09:33.039514 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2649/3919] 10.222.0.17 () {60 vars in 1290 bytes} [Sat Oct 1 21:09:32 2022] PUT /compute/v2.1/os-security-groups/fe3cf71c-579d-4cb3-aced-4df6ed8989fb => generated 218 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:09:33.048521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:33.049281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:33.061871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:33.062379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:33.062854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:33.065022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:33.072698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:33.073416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:33.189892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:33.201578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c3442211-e86d-43b9-80ee-d4c87043d1b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1606 microversion: 2.1 time: 0.161006 Oct 01 21:09:33.202419 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2650/3920] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:33 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1606 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:33.224655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2a3ad0b6-6e38-42dd-9245-c21948a96f5e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f41728d9280>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:33.312583 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2a3ad0b6-6e38-42dd-9245-c21948a96f5e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/fe3cf71c-579d-4cb3-aced-4df6ed8989fb" status: 200 len: 218 microversion: 2.1 time: 0.092544 Oct 01 21:09:33.314251 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2651/3921] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:09:33 2022] GET /compute/v2.1/os-security-groups/fe3cf71c-579d-4cb3-aced-4df6ed8989fb => generated 218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:33.333612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d654422c-8e40-4ed4-9a1f-a56fc8223911 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f417c2ec940>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:33.699052 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d654422c-8e40-4ed4-9a1f-a56fc8223911 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/fe3cf71c-579d-4cb3-aced-4df6ed8989fb" status: 202 len: 0 microversion: 2.1 time: 0.373098 Oct 01 21:09:33.700364 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2652/3922] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:33 2022] DELETE /compute/v2.1/os-security-groups/fe3cf71c-579d-4cb3-aced-4df6ed8989fb => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:33.943990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bbe9baa5-5a5c-4f44-9be7-407e09e1be5d tempest-ExtensionsTest-1592519991 tempest-ExtensionsTest-1592519991-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:33.945628 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bbe9baa5-5a5c-4f44-9be7-407e09e1be5d tempest-ExtensionsTest-1592519991 tempest-ExtensionsTest-1592519991-project] 10.222.0.17 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.244069 Oct 01 21:09:33.946179 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2653/3923] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Oct 1 21:09:33 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:33.959069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:33.959762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:33.968217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:33.969179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:33.969985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:33.971922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:33.972433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:33.973074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:34.021926 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 HTTP/1.1 Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '93ba1638-584e-408f-8dcd-e67015ec7bd3'} Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:34.026634 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.030368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:34.031141 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68c2f33f-6a13-4ee6-a910-bc315319cd1e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 404 len: 111 microversion: 2.1 time: 0.083524 Oct 01 21:09:34.035403 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2654/3924] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:09:33 2022] DELETE /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:34.041772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ce5f8b22-b677-48df-a10a-d4c6bacd3c0f req-f7752626-9340-42aa-aca3-7f589a548b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4461cf-b0a2-40ed-9edb-ad64e615d2ea", "name": "network-vif-deleted", "tag": "ba342b04-ec5c-4f1e-99f7-b15cbde6dd19"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:34.059803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ce5f8b22-b677-48df-a10a-d4c6bacd3c0f req-f7752626-9340-42aa-aca3-7f589a548b07 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:34.060770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ce5f8b22-b677-48df-a10a-d4c6bacd3c0f req-f7752626-9340-42aa-aca3-7f589a548b07 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:34.061386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ce5f8b22-b677-48df-a10a-d4c6bacd3c0f req-f7752626-9340-42aa-aca3-7f589a548b07 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:34.082342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ce5f8b22-b677-48df-a10a-d4c6bacd3c0f req-f7752626-9340-42aa-aca3-7f589a548b07 service nova] Creating event network-vif-deleted:ba342b04-ec5c-4f1e-99f7-b15cbde6dd19 for instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea on nch2-master-1 Oct 01 21:09:34.088733 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ce5f8b22-b677-48df-a10a-d4c6bacd3c0f req-f7752626-9340-42aa-aca3-7f589a548b07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051606 Oct 01 21:09:34.088921 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2655/3925] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:34.111485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-73433c93-aeae-44e5-ad34-295871cf4055 tempest-ExtensionsTest-1592519991 tempest-ExtensionsTest-1592519991-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.114481 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-73433c93-aeae-44e5-ad34-295871cf4055 tempest-ExtensionsTest-1592519991 tempest-ExtensionsTest-1592519991-project] 10.222.0.17 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.014539 Oct 01 21:09:34.115150 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2656/3926] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Oct 1 21:09:34 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:09:34.120134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.121077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: 93ba1638-584e-408f-8dcd-e67015ec7bd3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:34.140823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:34.146877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:34.148156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:34.149943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:34.150708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:34.151408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:34.167753 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 HTTP/1.1 Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '93ba1638-584e-408f-8dcd-e67015ec7bd3'} Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.169914 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Instance 93ba1638-584e-408f-8dcd-e67015ec7bd3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c477e254-c314-43a4-84ef-6901337d883b tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3" status: 404 len: 111 microversion: 2.1 time: 0.056270 Oct 01 21:09:34.173780 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2657/3927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:34 2022] GET /compute/v2.1/servers/93ba1638-584e-408f-8dcd-e67015ec7bd3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:34.196282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef20337a-bb06-4fe5-82dc-6190e9ba38a0 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172aac820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.228290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-ef20337a-bb06-4fe5-82dc-6190e9ba38a0 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0c5404bc-94df-4660-addd-6f31e007959f does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:34.229162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-ef20337a-bb06-4fe5-82dc-6190e9ba38a0 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group 0c5404bc-94df-4660-addd-6f31e007959f not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:09:34.230601 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ef20337a-bb06-4fe5-82dc-6190e9ba38a0 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group 0c5404bc-94df-4660-addd-6f31e007959f does not exist Oct 01 21:09:34.230601 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-4a750e03-0066-45b2-b046-3811e952fe68'] Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef20337a-bb06-4fe5-82dc-6190e9ba38a0 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/0c5404bc-94df-4660-addd-6f31e007959f HTTP/1.1 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group 0c5404bc-94df-4660-addd-6f31e007959f does not exist Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-4a750e03-0066-45b2-b046-3811e952fe68'] Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0c5404bc-94df-4660-addd-6f31e007959f'} Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:34.232749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0c5404bc-94df-4660-addd-6f31e007959f does not exist Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a750e03-0066-45b2-b046-3811e952fe68'] Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0c5404bc-94df-4660-addd-6f31e007959f does not exist Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a750e03-0066-45b2-b046-3811e952fe68'] Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0c5404bc-94df-4660-addd-6f31e007959f does not exist Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a750e03-0066-45b2-b046-3811e952fe68'] Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0c5404bc-94df-4660-addd-6f31e007959f does not exist Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a750e03-0066-45b2-b046-3811e952fe68'] Oct 01 21:09:34.237848 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.243445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef20337a-bb06-4fe5-82dc-6190e9ba38a0 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group 0c5404bc-94df-4660-addd-6f31e007959f does not exist Oct 01 21:09:34.243445 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-4a750e03-0066-45b2-b046-3811e952fe68'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:34.244896 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef20337a-bb06-4fe5-82dc-6190e9ba38a0 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0c5404bc-94df-4660-addd-6f31e007959f" status: 404 len: 194 microversion: 2.1 time: 0.060631 Oct 01 21:09:34.245665 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2658/3928] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:34 2022] DELETE /compute/v2.1/os-security-groups/0c5404bc-94df-4660-addd-6f31e007959f => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:34.252731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.253565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:34.263285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:34.264009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:34.264673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:34.265594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:34.266258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:34.267079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:34.304379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:34.305189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:34.305834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:34.306512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lazy-loading 'fault' on Instance uuid fa4461cf-b0a2-40ed-9edb-ad64e615d2ea {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:09:34.359867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:34.370051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95267a4a-069b-4a10-bf28-4946e5aa92f1 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 200 len: 1328 microversion: 2.1 time: 0.122876 Oct 01 21:09:34.374622 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2659/3929] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:34 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:34.380837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09f68bf6-0a0e-48a8-88fd-e0a1ce90f5a5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172aac700>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.428366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-09f68bf6-0a0e-48a8-88fd-e0a1ce90f5a5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f0348d1-09af-494a-9dda-1c486fe0939d does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:34.429046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-09f68bf6-0a0e-48a8-88fd-e0a1ce90f5a5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group 5f0348d1-09af-494a-9dda-1c486fe0939d not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:09:34.429654 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-09f68bf6-0a0e-48a8-88fd-e0a1ce90f5a5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group 5f0348d1-09af-494a-9dda-1c486fe0939d does not exist Oct 01 21:09:34.429654 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-4fdbb5ac-8ce7-4ceb-9e9b-f6758d9f9121'] Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09f68bf6-0a0e-48a8-88fd-e0a1ce90f5a5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/5f0348d1-09af-494a-9dda-1c486fe0939d HTTP/1.1 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group 5f0348d1-09af-494a-9dda-1c486fe0939d does not exist Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-4fdbb5ac-8ce7-4ceb-9e9b-f6758d9f9121'] Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5f0348d1-09af-494a-9dda-1c486fe0939d'} Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:34.454918 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f0348d1-09af-494a-9dda-1c486fe0939d does not exist Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fdbb5ac-8ce7-4ceb-9e9b-f6758d9f9121'] Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f0348d1-09af-494a-9dda-1c486fe0939d does not exist Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fdbb5ac-8ce7-4ceb-9e9b-f6758d9f9121'] Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f0348d1-09af-494a-9dda-1c486fe0939d does not exist Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fdbb5ac-8ce7-4ceb-9e9b-f6758d9f9121'] Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f0348d1-09af-494a-9dda-1c486fe0939d does not exist Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fdbb5ac-8ce7-4ceb-9e9b-f6758d9f9121'] Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09f68bf6-0a0e-48a8-88fd-e0a1ce90f5a5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group 5f0348d1-09af-494a-9dda-1c486fe0939d does not exist Oct 01 21:09:34.459397 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-4fdbb5ac-8ce7-4ceb-9e9b-f6758d9f9121'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:34.463810 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-09f68bf6-0a0e-48a8-88fd-e0a1ce90f5a5 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5f0348d1-09af-494a-9dda-1c486fe0939d" status: 404 len: 194 microversion: 2.1 time: 0.090770 Oct 01 21:09:34.464802 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2660/3930] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:34 2022] DELETE /compute/v2.1/os-security-groups/5f0348d1-09af-494a-9dda-1c486fe0939d => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:34.472455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc8cb844-a494-4738-b884-6270d0dc0ded tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f41729214c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.538368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-fc8cb844-a494-4738-b884-6270d0dc0ded tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:34.539347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-fc8cb844-a494-4738-b884-6270d0dc0ded tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group 223d2587-820f-43d4-9020-0996ef57882e not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:09:34.540051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-fc8cb844-a494-4738-b884-6270d0dc0ded tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:34.540051 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-2ced226f-0c88-4a1c-8111-ce2e8bf4c937'] Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc8cb844-a494-4738-b884-6270d0dc0ded tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/223d2587-820f-43d4-9020-0996ef57882e HTTP/1.1 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-2ced226f-0c88-4a1c-8111-ce2e8bf4c937'] Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '223d2587-820f-43d4-9020-0996ef57882e'} Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:34.542154 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ced226f-0c88-4a1c-8111-ce2e8bf4c937'] Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ced226f-0c88-4a1c-8111-ce2e8bf4c937'] Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ced226f-0c88-4a1c-8111-ce2e8bf4c937'] Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ced226f-0c88-4a1c-8111-ce2e8bf4c937'] Oct 01 21:09:34.545903 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.551312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc8cb844-a494-4738-b884-6270d0dc0ded tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group 223d2587-820f-43d4-9020-0996ef57882e does not exist Oct 01 21:09:34.551312 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-2ced226f-0c88-4a1c-8111-ce2e8bf4c937'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:34.552766 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc8cb844-a494-4738-b884-6270d0dc0ded tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/223d2587-820f-43d4-9020-0996ef57882e" status: 404 len: 194 microversion: 2.1 time: 0.084156 Oct 01 21:09:34.553860 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2661/3931] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:34 2022] DELETE /compute/v2.1/os-security-groups/223d2587-820f-43d4-9020-0996ef57882e => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:34.568945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d5ed589b-e285-45a4-aa5f-11bf2d00c75e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f417389f1f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.605054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-d5ed589b-e285-45a4-aa5f-11bf2d00c75e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:34.605913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-d5ed589b-e285-45a4-aa5f-11bf2d00c75e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group e1aabd6f-8180-480d-903f-5e1a9b836da0 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:09:34.606761 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d5ed589b-e285-45a4-aa5f-11bf2d00c75e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:34.606761 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-4b7d6cd4-ed6b-4277-8b86-cf6cd18903ff'] Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d5ed589b-e285-45a4-aa5f-11bf2d00c75e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/e1aabd6f-8180-480d-903f-5e1a9b836da0 HTTP/1.1 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-4b7d6cd4-ed6b-4277-8b86-cf6cd18903ff'] Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e1aabd6f-8180-480d-903f-5e1a9b836da0'} Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:34.609437 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b7d6cd4-ed6b-4277-8b86-cf6cd18903ff'] Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b7d6cd4-ed6b-4277-8b86-cf6cd18903ff'] Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b7d6cd4-ed6b-4277-8b86-cf6cd18903ff'] Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b7d6cd4-ed6b-4277-8b86-cf6cd18903ff'] Oct 01 21:09:34.613681 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.617890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d5ed589b-e285-45a4-aa5f-11bf2d00c75e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group e1aabd6f-8180-480d-903f-5e1a9b836da0 does not exist Oct 01 21:09:34.617890 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-4b7d6cd4-ed6b-4277-8b86-cf6cd18903ff'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:34.619097 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d5ed589b-e285-45a4-aa5f-11bf2d00c75e tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/e1aabd6f-8180-480d-903f-5e1a9b836da0" status: 404 len: 194 microversion: 2.1 time: 0.056216 Oct 01 21:09:34.620731 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2662/3932] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:34 2022] DELETE /compute/v2.1/os-security-groups/e1aabd6f-8180-480d-903f-5e1a9b836da0 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:34.632933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4f9248b-48ea-4c56-a4e7-8ce9415f1713 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172b76790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.736291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-b4f9248b-48ea-4c56-a4e7-8ce9415f1713 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:34.737355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-b4f9248b-48ea-4c56-a4e7-8ce9415f1713 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:09:34.738098 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b4f9248b-48ea-4c56-a4e7-8ce9415f1713 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:34.738098 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-921f6c73-0adb-46df-856a-d7fb7d35f86c'] Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4f9248b-48ea-4c56-a4e7-8ce9415f1713 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/b8fc4d48-b55f-46f7-ac45-8b5b6931f868 HTTP/1.1 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-921f6c73-0adb-46df-856a-d7fb7d35f86c'] Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'b8fc4d48-b55f-46f7-ac45-8b5b6931f868'} Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:34.741124 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-921f6c73-0adb-46df-856a-d7fb7d35f86c'] Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-921f6c73-0adb-46df-856a-d7fb7d35f86c'] Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-921f6c73-0adb-46df-856a-d7fb7d35f86c'] Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-921f6c73-0adb-46df-856a-d7fb7d35f86c'] Oct 01 21:09:34.745680 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.751956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4f9248b-48ea-4c56-a4e7-8ce9415f1713 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group b8fc4d48-b55f-46f7-ac45-8b5b6931f868 does not exist Oct 01 21:09:34.751956 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-921f6c73-0adb-46df-856a-d7fb7d35f86c'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:34.752692 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4f9248b-48ea-4c56-a4e7-8ce9415f1713 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/b8fc4d48-b55f-46f7-ac45-8b5b6931f868" status: 404 len: 194 microversion: 2.1 time: 0.125864 Oct 01 21:09:34.753574 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2663/3933] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:34 2022] DELETE /compute/v2.1/os-security-groups/b8fc4d48-b55f-46f7-ac45-8b5b6931f868 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:34.776700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1249efcd-5f4d-4d91-b29c-753d2875c4b6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172b76a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.861187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG neutronclient.v2_0.client [None req-1249efcd-5f4d-4d91-b29c-753d2875c4b6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist", "detail": ""}} {{(pid=140438) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:09:34.861904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.security_group_api [None req-1249efcd-5f4d-4d91-b29c-753d2875c4b6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Neutron security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 not found {{(pid=140438) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 01 21:09:34.862591 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1249efcd-5f4d-4d91-b29c-753d2875c4b6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:09:34.862591 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-3a6f5463-6efb-47e5-9583-32657a4ae274'] Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1249efcd-5f4d-4d91-b29c-753d2875c4b6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017 HTTP/1.1 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: method: Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: exception: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-3a6f5463-6efb-47e5-9583-32657a4ae274'] Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'a9a8b41b-b03c-41a5-b3cf-e310af95f017'} Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:09:34.866394 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a6f5463-6efb-47e5-9583-32657a4ae274'] Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a6f5463-6efb-47e5-9583-32657a4ae274'] Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a6f5463-6efb-47e5-9583-32657a4ae274'] Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a6f5463-6efb-47e5-9583-32657a4ae274'] Oct 01 21:09:34.870941 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:34.873880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1249efcd-5f4d-4d91-b29c-753d2875c4b6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Security group a9a8b41b-b03c-41a5-b3cf-e310af95f017 does not exist Oct 01 21:09:34.873880 ncdv-master-1 devstack@n-api.service[140438]: Neutron server returns request_ids: ['req-3a6f5463-6efb-47e5-9583-32657a4ae274'] {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:34.875271 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1249efcd-5f4d-4d91-b29c-753d2875c4b6 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017" status: 404 len: 194 microversion: 2.1 time: 0.115121 Oct 01 21:09:34.875991 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2664/3934] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:34 2022] DELETE /compute/v2.1/os-security-groups/a9a8b41b-b03c-41a5-b3cf-e310af95f017 => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:34.886868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:34.887651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:34.896524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:34.897808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:34.899106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:34.900598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:34.901805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:34.902633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:34.940059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:09:35.059904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:35.075873 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c89ab3e6-dc68-495f-9afe-b3eeb2092edb tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 204 len: 0 microversion: 2.1 time: 0.194573 Oct 01 21:09:35.081038 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2665/3935] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:09:34 2022] DELETE /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 21:09:35.092291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:35.093820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:35.111874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:35.112504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:35.116756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:35.117727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:35.118920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:35.120672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:35.404768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:35.416409 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac3d3d1f-b95b-4154-9cd8-5f7c283e368f tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1647 microversion: 2.1 time: 0.330984 Oct 01 21:09:35.417570 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2666/3936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:35 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1647 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:35.422442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:35.423245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:35.430739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:35.431502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:35.439720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:35.440791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:35.442857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:35.443652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:35.468546 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] HTTP exception thrown: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Request method failure captured: Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea HTTP/1.1 Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKvVk2kJdyVuz5yaTY_r2J_eMSW4OkZpTN6bbG8Zj22NsbMRj_SWX0jInlKYcNM-hc_HTOiv7El7-Uj8Z9cBapkipS7g52LKnijPEOTt8SPpx2L7W3708T1-KHaUyIQZZFOLxlRRr5gPWdVdivLs9XiX4s8q-hxRMjnq-QZDSJdkxEU Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0b5bb0c08a5145369fc64e13d190c988", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}] Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f74f251052ee4c9a99db0c43bc00da9f Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'fa4461cf-b0a2-40ed-9edb-ad64e615d2ea'} Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:35.475609 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Returning 404 to user: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ecee822a-ec84-46f9-bfe4-918472ed7bd3 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 404 len: 111 microversion: 2.1 time: 0.055420 Oct 01 21:09:35.479891 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2667/3937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:35 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:09:35.499083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ca7551c-4b69-431e-861a-49b880d75852 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '.version_select at 0x7f41729219d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:35.529092 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ca7551c-4b69-431e-861a-49b880d75852 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865114026" status: 202 len: 0 microversion: 2.1 time: 0.046704 Oct 01 21:09:35.529842 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2668/3938] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 21:09:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865114026 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:36.444637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:36.446670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:36.458239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:36.459128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:36.460732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:36.462185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:36.463384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:36.464059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:37.080966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:37.091171 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a016371-c87a-4882-bf88-29e707658bd8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1647 microversion: 2.1 time: 0.652215 Oct 01 21:09:37.094155 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2669/3939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:36 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1647 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:37.463720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26c07ede-5f9b-4aba-adf1-aa76170ec1ef tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'create', calling method: .version_select at 0x7f4172b323a0>, body: {"keypair": {"name": "tempest-keypair-288050708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPN3hBdfjaTwdOblN6ynGHwwaynrTb9vPj3HmVlvTgsbNB02pTJChWcZOEZNoxJ8avX+gaikrlHC8QROTQfaPolCqwrQ0AmcKjxnnDG3XiSP4CRv+95LCmgHcMWd3tUgA=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:37.498677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-26c07ede-5f9b-4aba-adf1-aa76170ec1ef tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Getting quotas for project 0b5bb0c08a5145369fc64e13d190c988. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:09:37.511470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-26c07ede-5f9b-4aba-adf1-aa76170ec1ef tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Getting quotas for user f74f251052ee4c9a99db0c43bc00da9f and project 0b5bb0c08a5145369fc64e13d190c988. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:09:37.545648 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26c07ede-5f9b-4aba-adf1-aa76170ec1ef tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086653 Oct 01 21:09:37.560806 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2670/3940] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:09:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:37.592538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4f491610-98dc-4eee-9055-3bc0ee835452 req-d16971fd-729a-410e-8625-baf179e7ffd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8499779-fa7d-459a-8832-35f644706d38", "name": "network-vif-deleted", "tag": "8222ff7e-e137-43a6-9457-3e311bdca5ba"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:37.632234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4f491610-98dc-4eee-9055-3bc0ee835452 req-d16971fd-729a-410e-8625-baf179e7ffd1 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:37.632938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4f491610-98dc-4eee-9055-3bc0ee835452 req-d16971fd-729a-410e-8625-baf179e7ffd1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:37.635205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4f491610-98dc-4eee-9055-3bc0ee835452 req-d16971fd-729a-410e-8625-baf179e7ffd1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:37.671839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4f491610-98dc-4eee-9055-3bc0ee835452 req-d16971fd-729a-410e-8625-baf179e7ffd1 service nova] Creating event network-vif-deleted:8222ff7e-e137-43a6-9457-3e311bdca5ba for instance c8499779-fa7d-459a-8832-35f644706d38 on nch1-master-1 Oct 01 21:09:37.685946 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4f491610-98dc-4eee-9055-3bc0ee835452 req-d16971fd-729a-410e-8625-baf179e7ffd1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121023 Oct 01 21:09:37.688152 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2671/3941] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:38.131277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:38.132724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:38.155501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:38.156031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:38.158147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:38.160594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:38.162140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:38.162650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:38.235108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:38.236719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:38.237474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:38.238215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lazy-loading 'fault' on Instance uuid c8499779-fa7d-459a-8832-35f644706d38 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:09:38.373917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a67ba740284d5589df8bdad6ab671f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bb3ce6f304c58902406f7279af3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:38.390692 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e58c6f35-5c8a-40ff-b48b-e064804f7dad tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 200 len: 1306 microversion: 2.1 time: 0.269925 Oct 01 21:09:38.391744 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2672/3942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:38 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 1306 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:39.418819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:39.419676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] [instance: c8499779-fa7d-459a-8832-35f644706d38] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:39.434357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:39.435962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:39.436653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:39.437659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:39.439402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:39.440135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:39.495820 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] HTTP exception thrown: Instance c8499779-fa7d-459a-8832-35f644706d38 could not be found. Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Request method failure captured: Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 HTTP/1.1 Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxJZReu8oBYpXvE1OYV7cAGDY-1xn1HYKAxDdvYcMZge9BYo9btHuiwjFT8fdVtXMorCgv9foUTc4C7DDOVIQSKNqkrl4n_PM5SanSQzf2AoVWL65Kb42iWpZZkbNWZjd8FJcbsFWwyI5MCr457HRiHz3_6Dsvsptsg9HELYN3hJlI Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_337bb3ce6f304c58902406f7279af3f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/337bb3ce6f304c58902406f7279af3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/337bb3ce6f304c58902406f7279af3f1"}]}] Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 337bb3ce6f304c58902406f7279af3f1 Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055251816 Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d2a67ba740284d5589df8bdad6ab671f Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-SecurityGroupsTestJSON-2055251816-project Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance c8499779-fa7d-459a-8832-35f644706d38 could not be found. Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'c8499779-fa7d-459a-8832-35f644706d38'} Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8499779-fa7d-459a-8832-35f644706d38 could not be found. Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8499779-fa7d-459a-8832-35f644706d38 could not be found. Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:09:39.497976 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:39.507562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:09:39.507562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:09:39.507562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:09:39.507562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:09:39.507562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:09:39.507562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8499779-fa7d-459a-8832-35f644706d38 could not be found. Oct 01 21:09:39.507562 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:09:39.518141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Returning 404 to user: Instance c8499779-fa7d-459a-8832-35f644706d38 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:09:39.520743 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-931277e5-fd75-4821-8568-ff6dfec219f8 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38" status: 404 len: 111 microversion: 2.1 time: 0.108284 Oct 01 21:09:39.526078 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2673/3943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:39 2022] GET /compute/v2.1/servers/c8499779-fa7d-459a-8832-35f644706d38 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:09:39.537579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15019895-94ec-4d77-8fca-fa6a88398faa tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f4172aac3a0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:40.619722 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15019895-94ec-4d77-8fca-fa6a88398faa tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/b4f07aec-ad95-4722-b57d-a5f41e5749c8" status: 202 len: 0 microversion: 2.1 time: 1.087490 Oct 01 21:09:40.623163 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2674/3944] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:39 2022] DELETE /compute/v2.1/os-security-groups/b4f07aec-ad95-4722-b57d-a5f41e5749c8 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:40.629755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bd4bd39-cc13-4ea3-b21e-7ffeb78c3560 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] Calling method '.version_select at 0x7f41729468b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:41.247754 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6bd4bd39-cc13-4ea3-b21e-7ffeb78c3560 tempest-SecurityGroupsTestJSON-2055251816 tempest-SecurityGroupsTestJSON-2055251816-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/cfb98761-eebb-4e83-ac5b-91108f40a62a" status: 202 len: 0 microversion: 2.1 time: 0.623093 Oct 01 21:09:41.248492 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2675/3945] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:09:40 2022] DELETE /compute/v2.1/os-security-groups/cfb98761-eebb-4e83-ac5b-91108f40a62a => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:09:41.263543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1005014002", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7829a3e2-b2da-4a9b-86e1-6df7525abb9a"}], "security_groups": [{"name": "tempest-securitygroup--1292913378"}], "key_name": "tempest-keypair-288050708", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:41.553263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] validate_networks() for [('7829a3e2-b2da-4a9b-86e1-6df7525abb9a', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:09:42.683229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:09:42.684022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:09:42.684179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:09:42.684603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:09:42.685465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:09:42.705722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:42.706504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:42.707677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:42.708599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:42.715004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:42.715728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:42.762088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Getting quotas for project 0b5bb0c08a5145369fc64e13d190c988. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:09:42.768463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Getting quotas for user f74f251052ee4c9a99db0c43bc00da9f and project 0b5bb0c08a5145369fc64e13d190c988. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:09:42.788287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:09:42.801865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:09:42.871629 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4c1d1d4c-aa8c-4824-a983-a8baeca119b9 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.619006 Oct 01 21:09:42.873317 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2676/3946] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:09:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:09:42.884391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b16763a-3290-4973-bb82-b21385a0fe27 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:42.885358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1b16763a-3290-4973-bb82-b21385a0fe27 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:42.992156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1b16763a-3290-4973-bb82-b21385a0fe27 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:43.004980 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1b16763a-3290-4973-bb82-b21385a0fe27 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1237 microversion: 2.1 time: 0.124294 Oct 01 21:09:43.008870 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2677/3947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:42 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:44.031570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:44.044027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:44.065117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:44.065627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:44.066700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:44.067427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:44.067889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:44.068332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:44.246120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:44.255547 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e18f01d6-89b0-4064-bc23-8a319b550016 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1233 microversion: 2.1 time: 0.227985 Oct 01 21:09:44.271457 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2678/3948] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:44 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1233 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:44.271457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c72d506-0c6a-47b0-95b3-4451c68e988b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:44.271457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7c72d506-0c6a-47b0-95b3-4451c68e988b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:44.290330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c72d506-0c6a-47b0-95b3-4451c68e988b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:44.291143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c72d506-0c6a-47b0-95b3-4451c68e988b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:44.291601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c72d506-0c6a-47b0-95b3-4451c68e988b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:44.292351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c72d506-0c6a-47b0-95b3-4451c68e988b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:44.292814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c72d506-0c6a-47b0-95b3-4451c68e988b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:44.302407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c72d506-0c6a-47b0-95b3-4451c68e988b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:44.335166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:44.339816 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c72d506-0c6a-47b0-95b3-4451c68e988b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/ips" status: 200 len: 152 microversion: 2.20 time: 0.075187 Oct 01 21:09:44.340601 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2679/3949] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Oct 1 21:09:44 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/ips => generated 152 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:09:45.286328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:45.287812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:45.301330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:45.303737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:45.304677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:45.305630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:45.306324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:45.306981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:45.509035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:45.546008 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-32220f98-86d4-4e5b-82f6-e77324f538af tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1295 microversion: 2.1 time: 0.264847 Oct 01 21:09:45.571624 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2680/3950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:45 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1295 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:09:46.577955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:46.579615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:46.595947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:46.600056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:46.600795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:46.601862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:46.603142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:46.605064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:47.014849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:47.024150 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bcb94621-b620-4704-b0c9-9e7d7dd8dc83 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1295 microversion: 2.1 time: 0.452688 Oct 01 21:09:47.052714 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2681/3951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:46 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1295 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:09:47.058714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:47.062298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:47.080619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:47.081380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:47.082610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:47.083598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:47.084375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:47.085041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:47.119789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lazy-loading 'flavor' on Instance uuid 97be5f25-216d-464d-944b-3d6108312f20 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:09:47.442008 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8156b787-627f-41bf-9074-92efac9743cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/action" status: 202 len: 0 microversion: 2.20 time: 0.386596 Oct 01 21:09:47.442661 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2682/3952] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 21:09:47 2022] POST /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:09:47.451819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:47.452538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:47.460282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:47.461062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:47.461742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:47.462666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:47.463297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:47.464189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:48.028758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:48.049021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:48.053309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:48.055386 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-51963357-3b94-4117-bcc7-7a6f43295604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1722 microversion: 2.20 time: 0.608068 Oct 01 21:09:48.057537 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2683/3953] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:47 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1722 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:48.089361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:48.091486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:48.110126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:48.110688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:48.111145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:48.111887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:48.112363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:48.113851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:49.312424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:49.338188 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f9e7f1d4-5f8d-4a02-9fff-f9445d91b34c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1363 microversion: 2.1 time: 1.276673 Oct 01 21:09:49.339637 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2684/3954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:48 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1363 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:49.356509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:49.357460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:49.372527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:49.373649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:49.374994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:49.377046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:49.379170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:49.379895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:49.959101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:49.976477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:49.978066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:49.986990 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2bdffae0-62b6-45f9-a320-c7c8bc6e1346 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1722 microversion: 2.20 time: 0.645993 Oct 01 21:09:49.987824 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2685/3955] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:49 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1722 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:50.366636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:50.367267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:50.374335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:50.374987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:50.375498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:50.376527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:50.377196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:50.377997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:50.879910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:50.893831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e5834b78-4dc7-4d16-8f1d-763a098c6708 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1363 microversion: 2.1 time: 0.532336 Oct 01 21:09:50.897499 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2686/3956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:50 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1363 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:51.017254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:51.017887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:51.026876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:51.027391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:51.027847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:51.028582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:51.029058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:51.029494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:51.859693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:51.872145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:51.874638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:51.886794 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37e89743-9e3b-48d4-9377-bab99a960339 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1722 microversion: 2.20 time: 0.873350 Oct 01 21:09:51.887837 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2687/3957] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:51 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1722 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:52.123502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9564aa62-8f0f-4e87-a36c-3c62b931ccb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: .version_select at 0x7f4172b32670>, body: {"keypair": {"name": "tempest-keypair-2075809194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvuR1bMcg48CSCJ/9GsAzjyf805RVs3jROY+Db67jiQFrxpsr54cJG9DE27/AAGkVLI2bJsq3JG6faV81ucvcYaOzTdQl/MNSHHz0G0mCEYbRmbOoriUAOcUL6oS6Oo7Q=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:52.148713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9564aa62-8f0f-4e87-a36c-3c62b931ccb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:09:52.154227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-9564aa62-8f0f-4e87-a36c-3c62b931ccb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for user 902ba44d318d4a01a510f732d27467c9 and project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:09:52.184140 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9564aa62-8f0f-4e87-a36c-3c62b931ccb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.295200 Oct 01 21:09:52.184959 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2688/3958] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:09:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:52.194576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:52.195209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:52.209756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:52.210277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:52.210760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:52.211492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:52.211961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:52.212400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:52.610461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:52.633034 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8734437c-7572-45ce-a601-6fb8abf7b313 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1363 microversion: 2.1 time: 0.446960 Oct 01 21:09:52.633943 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2689/3959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:52 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:52.664015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-470da5f7-45cc-4085-85b2-ffb2f60ecf84 req-c1744520-af94-47d8-92ea-57f78c79bd84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a24a06-58b4-49d3-a715-257d1d18c9f6", "tag": "d5c6efba-d090-42c1-8f91-3691cef16e27"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:52.682070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-470da5f7-45cc-4085-85b2-ffb2f60ecf84 req-c1744520-af94-47d8-92ea-57f78c79bd84 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:52.700328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-470da5f7-45cc-4085-85b2-ffb2f60ecf84 req-c1744520-af94-47d8-92ea-57f78c79bd84 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:52.700930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-470da5f7-45cc-4085-85b2-ffb2f60ecf84 req-c1744520-af94-47d8-92ea-57f78c79bd84 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:52.723113 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-470da5f7-45cc-4085-85b2-ffb2f60ecf84 req-c1744520-af94-47d8-92ea-57f78c79bd84 service nova] Creating event network-changed:d5c6efba-d090-42c1-8f91-3691cef16e27 for instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 on nch1-master-1 Oct 01 21:09:52.763754 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-470da5f7-45cc-4085-85b2-ffb2f60ecf84 req-c1744520-af94-47d8-92ea-57f78c79bd84 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114260 Oct 01 21:09:52.771072 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2690/3960] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:52.923605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:52.934366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:52.936746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:52.961416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:52.962638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:52.963324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:52.971599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:52.973131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:52.973824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:53.381768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:53.404463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:53.418959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:53.423856 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ee1b21ee-a005-445c-b9ce-903a994d3757 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1722 microversion: 2.20 time: 0.508968 Oct 01 21:09:53.446892 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2691/3961] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:52 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1722 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:53.662475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:53.663373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:53.698082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:53.699934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:53.700980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:53.704850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:53.707196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:53.707669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:54.078553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:54.096216 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d39a5ff2-b4a9-4e3f-b1fd-f39df07a4ae7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1363 microversion: 2.1 time: 0.439477 Oct 01 21:09:54.107751 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2692/3962] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:53 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:54.457227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:54.458181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:54.472912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:54.478070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:54.478859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:54.479789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:54.480433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:54.481521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:54.932208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:54.954717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:54.959273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:54.965828 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-50a0994d-9201-4600-9674-fd76eb99232b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1722 microversion: 2.20 time: 0.512120 Oct 01 21:09:54.975397 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2693/3963] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:54 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1722 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:55.120120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:55.122155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:55.141151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:55.141670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:55.142301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:55.143334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:55.144019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:55.144638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:55.579765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:55.590673 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62777ce1-e863-4eb7-8fcf-58353217d818 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1363 microversion: 2.1 time: 0.475169 Oct 01 21:09:55.593275 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2694/3964] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:55 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:55.994567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:55.996320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:56.007681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:56.008474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:56.009069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:56.009997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:56.010691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:56.011282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:56.326259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:56.329655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:56.340960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:56.343056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:56.344300 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0378ff8e-b937-46aa-9376-b4e5cd3cfae6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1722 microversion: 2.20 time: 0.355309 Oct 01 21:09:56.365184 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2695/3965] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:55 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:56.371188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1393712761", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aff7b153-98c7-4cda-8b6f-d6403aba7e87"}], "security_groups": [{"name": "tempest-securitygroup--1103027630"}], "key_name": "tempest-keypair-2075809194", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:56.392623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:09:56.531503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] validate_networks() for [('aff7b153-98c7-4cda-8b6f-d6403aba7e87', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:09:57.521783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:09:57.522931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:09:57.523669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:09:57.525285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:09:57.525979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:09:57.544133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:57.545678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:57.546301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:57.547386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:57.548194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:57.548815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:57.586158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:09:57.605272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for user 902ba44d318d4a01a510f732d27467c9 and project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:09:57.627642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:09:57.632312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:09:57.715722 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3dc1cefe-f0d1-4222-a00d-c7d1bacb4814 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.349111 Oct 01 21:09:57.717648 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2696/3966] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:09:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:09:57.737328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:57.757025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:57.775418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:57.776134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:57.777444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:57.778663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:57.779379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:57.779973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:58.160048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:58.171591 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e5771d07-3a6d-44d1-9b15-1d54d918e90e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1363 microversion: 2.1 time: 0.443461 Oct 01 21:09:58.172545 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2697/3967] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:57 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:58.208792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:58.210040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:58.218920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:58.219615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:58.220227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:58.221123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:58.221588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:58.222076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:58.439032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:58.452474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:58.455525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:58.473649 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0fdcb193-7b41-4e72-b6d3-a1832e0e8d25 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1743 microversion: 2.20 time: 0.287624 Oct 01 21:09:58.474275 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2698/3968] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:58 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1743 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:58.492625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2a306d9-3f0a-47b2-a6fc-f64422c940cc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:58.493639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2a306d9-3f0a-47b2-a6fc-f64422c940cc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:58.573369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b2a306d9-3f0a-47b2-a6fc-f64422c940cc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:58.584273 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2a306d9-3f0a-47b2-a6fc-f64422c940cc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1242 microversion: 2.1 time: 0.106917 Oct 01 21:09:58.585234 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2699/3969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:58 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1242 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:58.776973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a1a3fb78-dfb2-438a-852c-322300785596 req-61cf3cca-8e1f-4a48-afad-71366e97e43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a24a06-58b4-49d3-a715-257d1d18c9f6", "name": "network-vif-plugged", "status": "completed", "tag": "d5c6efba-d090-42c1-8f91-3691cef16e27"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:09:58.791683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a1a3fb78-dfb2-438a-852c-322300785596 req-61cf3cca-8e1f-4a48-afad-71366e97e43d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:58.792438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a1a3fb78-dfb2-438a-852c-322300785596 req-61cf3cca-8e1f-4a48-afad-71366e97e43d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:58.793197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a1a3fb78-dfb2-438a-852c-322300785596 req-61cf3cca-8e1f-4a48-afad-71366e97e43d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:58.845903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a1a3fb78-dfb2-438a-852c-322300785596 req-61cf3cca-8e1f-4a48-afad-71366e97e43d service nova] Creating event network-vif-plugged:d5c6efba-d090-42c1-8f91-3691cef16e27 for instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 on nch1-master-1 Oct 01 21:09:58.855240 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a1a3fb78-dfb2-438a-852c-322300785596 req-61cf3cca-8e1f-4a48-afad-71366e97e43d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267679 Oct 01 21:09:58.857224 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2700/3970] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:09:59.203409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:59.209177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:59.222734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:59.223881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:59.224577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:59.225571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:59.232638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:59.233861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:59.625317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:59.634288 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aff0c6cc-3126-43af-9fa6-5407c88fabe6 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1363 microversion: 2.1 time: 0.439786 Oct 01 21:09:59.639177 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2701/3971] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:59 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:09:59.652874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:09:59.653782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:09:59.666907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:59.667662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:59.668725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:59.670322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:09:59.670989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:09:59.671753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:09:59.953406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:59.967334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:59.970255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:09:59.976467 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a7b40bf-0e0c-48f2-8f79-0b7911f238e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1743 microversion: 2.20 time: 0.332814 Oct 01 21:09:59.979661 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2702/3972] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:09:59 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1743 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:09:59.997090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:00.003628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:00.021730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:00.022545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:00.023149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:00.024065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:00.024693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:00.032993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:00.234805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:00.245213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4ffdfed9-3391-47e2-9629-2b136c641f7c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1312 microversion: 2.1 time: 0.264128 Oct 01 21:10:00.245806 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2703/3973] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:09:59 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:00.665651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:00.667285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:00.681209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:00.685108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:00.685920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:00.692698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:00.693501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:00.694104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:01.196997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:01.210691 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6884c920-167f-4f15-a5c2-4704fe6a5c11 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1549 microversion: 2.1 time: 0.547822 Oct 01 21:10:01.211419 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2704/3974] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:00 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1549 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:01.225384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:01.227771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:01.247208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:01.249788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:01.250989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:01.253684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:01.255000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:01.255568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:01.482912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:01.488381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:01.489915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:01.491673 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9bbdb3a5-f6de-4e2b-a8b1-90b05a3a28c4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.277737 Oct 01 21:10:01.494393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2705/3975] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:01 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:01.504035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0796283e-757c-4ab8-9b1a-7092bbedea3c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:01.504845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0796283e-757c-4ab8-9b1a-7092bbedea3c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:01.516604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0796283e-757c-4ab8-9b1a-7092bbedea3c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:01.518131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0796283e-757c-4ab8-9b1a-7092bbedea3c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:01.518863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0796283e-757c-4ab8-9b1a-7092bbedea3c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:01.520274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0796283e-757c-4ab8-9b1a-7092bbedea3c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:01.520910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0796283e-757c-4ab8-9b1a-7092bbedea3c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:01.549723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0796283e-757c-4ab8-9b1a-7092bbedea3c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:01.766616 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0796283e-757c-4ab8-9b1a-7092bbedea3c tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.269616 Oct 01 21:10:01.769669 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2706/3976] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:10:01 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:02.181961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f72568fa-71bb-4387-9cb4-36b9fa68b730 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Action: 'create', calling method: .version_select at 0x7f4173afadc0>, body: {"keypair": {"name": "tempest-keypair-1032331356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6Q+ym+mO+Fw/Z6ROBQ+0YBEFMmz0PGmLRx6KX6IwzA75fAw+k5xNFsbYMZk2pjCBqJCmpHCfFdaggyC+gV72+Y4+YJVWVG25n7ldPzKTe7THn8knmkTwrXc+6oHxK+Gg=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:02.230714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f72568fa-71bb-4387-9cb4-36b9fa68b730 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Getting quotas for project 1215f2e4b926472794f0e60cefa2d90e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:10:02.245084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-f72568fa-71bb-4387-9cb4-36b9fa68b730 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Getting quotas for user 4f3c9d35f6b843ef905f43d758a9bb25 and project 1215f2e4b926472794f0e60cefa2d90e. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:10:02.299166 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f72568fa-71bb-4387-9cb4-36b9fa68b730 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.522428 Oct 01 21:10:02.300453 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2707/3977] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:10:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:02.324739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:02.327728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:02.339264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:02.340119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:02.340828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:02.341789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:02.343971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:02.344679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:02.679253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:02.688458 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bcc56f88-148f-434b-af67-556e9ba20bb8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1368 microversion: 2.1 time: 0.378966 Oct 01 21:10:02.691185 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2708/3978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:02 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:02.705031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:02.706750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:02.717757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:02.727147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:02.727865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:02.728783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:02.729507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:02.730161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:03.275668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:03.291232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:03.300782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:03.304725 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac0fdf36-370e-4003-8ea6-95a7707d9872 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.611205 Oct 01 21:10:03.312868 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2709/3979] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:02 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:03.565759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e4d9b2b6-379b-4116-a181-e12f9bcafe17 req-9b4d8461-9eb3-4633-9625-b69ce70d90b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97be5f25-216d-464d-944b-3d6108312f20", "name": "network-vif-plugged", "status": "completed", "tag": "a4d6a1de-27d2-4876-8b56-131f6ba7888d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:03.600180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e4d9b2b6-379b-4116-a181-e12f9bcafe17 req-9b4d8461-9eb3-4633-9625-b69ce70d90b2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:03.600676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e4d9b2b6-379b-4116-a181-e12f9bcafe17 req-9b4d8461-9eb3-4633-9625-b69ce70d90b2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:03.604277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e4d9b2b6-379b-4116-a181-e12f9bcafe17 req-9b4d8461-9eb3-4633-9625-b69ce70d90b2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:03.654583 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e4d9b2b6-379b-4116-a181-e12f9bcafe17 req-9b4d8461-9eb3-4633-9625-b69ce70d90b2 service nova] Creating event network-vif-plugged:a4d6a1de-27d2-4876-8b56-131f6ba7888d for instance 97be5f25-216d-464d-944b-3d6108312f20 on nch2-master-1 Oct 01 21:10:03.676034 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e4d9b2b6-379b-4116-a181-e12f9bcafe17 req-9b4d8461-9eb3-4633-9625-b69ce70d90b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108618 Oct 01 21:10:03.677275 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2710/3980] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:10:03.725815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:03.727800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:03.763639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:03.764478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:03.765501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:03.767195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:03.767674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:03.768114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:04.614266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:04.635623 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68654874-8b73-4d76-972f-80a5ec4a1662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1368 microversion: 2.1 time: 0.917531 Oct 01 21:10:04.641358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2711/3981] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:03 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1368 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:04.671599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:04.675143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:04.769126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:04.771188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:04.777137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:04.777977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:04.778478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:04.778963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:05.291050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:05.320281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:05.325143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:05.326975 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7984e490-7683-4b44-aa6f-0657544f5a64 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.681445 Oct 01 21:10:05.348544 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2712/3982] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:04 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:05.668094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:05.668756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:05.694938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:05.695357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:05.695841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:05.708345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:05.709056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:05.714651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:06.192290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:06.208814 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8f8b60ec-c11e-419f-9923-cf32494f820a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1368 microversion: 2.1 time: 0.537278 Oct 01 21:10:06.213061 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2713/3983] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:05 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1368 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:10:06.239506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0189b5c1-1dca-41ea-bc22-5477a8d61989 req-7cc15e42-5148-454f-a0ce-dbeb0b49a769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a24a06-58b4-49d3-a715-257d1d18c9f6", "tag": "d5c6efba-d090-42c1-8f91-3691cef16e27"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:06.310205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0189b5c1-1dca-41ea-bc22-5477a8d61989 req-7cc15e42-5148-454f-a0ce-dbeb0b49a769 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:06.310743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0189b5c1-1dca-41ea-bc22-5477a8d61989 req-7cc15e42-5148-454f-a0ce-dbeb0b49a769 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:06.311189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0189b5c1-1dca-41ea-bc22-5477a8d61989 req-7cc15e42-5148-454f-a0ce-dbeb0b49a769 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:06.362653 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0189b5c1-1dca-41ea-bc22-5477a8d61989 req-7cc15e42-5148-454f-a0ce-dbeb0b49a769 service nova] Creating event network-changed:d5c6efba-d090-42c1-8f91-3691cef16e27 for instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 on nch1-master-1 Oct 01 21:10:06.372440 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0189b5c1-1dca-41ea-bc22-5477a8d61989 req-7cc15e42-5148-454f-a0ce-dbeb0b49a769 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157729 Oct 01 21:10:06.376956 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2714/3984] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:06.394432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-acb7a77d-9258-4ffd-bd85-f442defa7270 req-a9cd1807-4bde-496f-8fad-eac4e220b8ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec205c2f-e515-4a25-a372-64bdb58ac51b", "tag": "52eec226-a379-4f11-8bbe-ce0482e41158"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:06.433403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-acb7a77d-9258-4ffd-bd85-f442defa7270 req-a9cd1807-4bde-496f-8fad-eac4e220b8ef service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:06.433923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-acb7a77d-9258-4ffd-bd85-f442defa7270 req-a9cd1807-4bde-496f-8fad-eac4e220b8ef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:06.434377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-acb7a77d-9258-4ffd-bd85-f442defa7270 req-a9cd1807-4bde-496f-8fad-eac4e220b8ef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:06.467324 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-acb7a77d-9258-4ffd-bd85-f442defa7270 req-a9cd1807-4bde-496f-8fad-eac4e220b8ef service nova] Creating event network-changed:52eec226-a379-4f11-8bbe-ce0482e41158 for instance ec205c2f-e515-4a25-a372-64bdb58ac51b on nch2-master-1 Oct 01 21:10:06.474435 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-acb7a77d-9258-4ffd-bd85-f442defa7270 req-a9cd1807-4bde-496f-8fad-eac4e220b8ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094447 Oct 01 21:10:06.475416 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2715/3985] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:06.485560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:06.486298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:06.571291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:06.572071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:06.572678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:06.573575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:06.574201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:06.574860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:07.337077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:07.354046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:07.359556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:07.360861 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-51543fc7-4a24-40c3-993a-4727ef6fe7cd tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.884277 Oct 01 21:10:07.366973 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2716/3986] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:06 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:07.398798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:07.399429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:07.427875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:07.428634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:07.429315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:07.430198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:07.430845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:07.431441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:07.571408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:08.350804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:08.364763 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-318d176f-0cb8-4a80-8d4f-0dd0ed52c9ff tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1368 microversion: 2.1 time: 0.969778 Oct 01 21:10:08.372110 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2717/3987] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:07 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1368 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:08.396462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:08.397551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:08.422944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:08.425584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:08.426911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:08.428337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:08.436470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:08.437183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:08.449707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:09.184629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:09.215815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:09.219104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:09.227404 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-54613aea-0de4-4b3a-9f23-05d5ca4d0053 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.835675 Oct 01 21:10:09.244349 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2718/3988] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:08 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:09.391929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:09.392520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:09.405026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:09.405537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:09.405981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:09.406739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:09.413703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:09.415345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:09.996417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:10.014561 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-86325094-ebcc-4386-bf14-a29a0b6ae31b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1368 microversion: 2.1 time: 0.625099 Oct 01 21:10:10.018816 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2719/3989] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:09 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1368 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:10.259131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:10.260296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:10.273818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:10.274740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:10.280852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:10.282963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:10.286013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:10.288690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:10.605283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:10.620880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:10.629130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:10.640725 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1de8429a-f7b3-494e-998c-7a937f38bca4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.382574 Oct 01 21:10:10.663472 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2720/3990] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:10 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:11.051994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:11.053136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:11.068079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:11.078258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:11.079001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:11.079779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:11.080257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:11.080739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:11.448789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:11.462173 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-707d74f5-302f-45c9-9723-b8f77fd81eb1 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1368 microversion: 2.1 time: 0.414972 Oct 01 21:10:11.464610 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2721/3991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:11 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1368 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:11.672595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:11.676551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:11.699854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:11.702068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:11.713265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:11.714289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:11.719555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:11.723471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:12.235730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:12.257304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:12.266434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:12.269520 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c9be7f93-43b6-4a54-b86b-31a1aa64a663 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.601748 Oct 01 21:10:12.273189 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2722/3992] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:11 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:12.281123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:12.298849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-623bbf1a-e1d5-4f22-93b4-7b67085c10c6 req-d50ac831-b707-46e4-b810-3fad819a39eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec205c2f-e515-4a25-a372-64bdb58ac51b", "name": "network-vif-plugged", "status": "completed", "tag": "52eec226-a379-4f11-8bbe-ce0482e41158"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:12.325607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-623bbf1a-e1d5-4f22-93b4-7b67085c10c6 req-d50ac831-b707-46e4-b810-3fad819a39eb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:12.327768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-623bbf1a-e1d5-4f22-93b4-7b67085c10c6 req-d50ac831-b707-46e4-b810-3fad819a39eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:12.328220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-623bbf1a-e1d5-4f22-93b4-7b67085c10c6 req-d50ac831-b707-46e4-b810-3fad819a39eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:12.359668 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-623bbf1a-e1d5-4f22-93b4-7b67085c10c6 req-d50ac831-b707-46e4-b810-3fad819a39eb service nova] Creating event network-vif-plugged:52eec226-a379-4f11-8bbe-ce0482e41158 for instance ec205c2f-e515-4a25-a372-64bdb58ac51b on nch2-master-1 Oct 01 21:10:12.366634 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-623bbf1a-e1d5-4f22-93b4-7b67085c10c6 req-d50ac831-b707-46e4-b810-3fad819a39eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090722 Oct 01 21:10:12.368173 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2723/3993] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:12.500668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:12.501785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:12.513184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:12.519474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:12.520090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:12.520942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:12.521501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:12.522009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:12.877026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:12.903718 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a5baf404-4d6f-4a85-b15d-0b453bdd8141 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1368 microversion: 2.1 time: 0.408544 Oct 01 21:10:12.911471 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2724/3994] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:12 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1368 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:13.197828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1080135818", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "73e51e4d-bf86-428b-b97d-157c0472f21e"}], "security_groups": [{"name": "tempest-securitygroup--370746589"}], "key_name": "tempest-keypair-1032331356", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "057ca534-4250-412a-aa43-66638a05be1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:13.486573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] validate_networks() for [('73e51e4d-bf86-428b-b97d-157c0472f21e', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:10:14.279356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Getting quotas for project 1215f2e4b926472794f0e60cefa2d90e. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:10:14.287936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Getting quotas for user 4f3c9d35f6b843ef905f43d758a9bb25 and project 1215f2e4b926472794f0e60cefa2d90e. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:10:14.303369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:10:14.304079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:10:14.304726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:10:14.305305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:10:14.306025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:10:14.316680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:14.317454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:14.318089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:14.319297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:14.320072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:14.320824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:14.337919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:14.351019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Getting quotas for project 1215f2e4b926472794f0e60cefa2d90e. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:10:14.357995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Getting quotas for user 4f3c9d35f6b843ef905f43d758a9bb25 and project 1215f2e4b926472794f0e60cefa2d90e. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:10:14.481117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:10:14.484640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='057ca534-4250-412a-aa43-66638a05be1b',volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:10:14.774249 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-168f4f2d-ca62-4248-98e7-810345a44ce5 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.581019 Oct 01 21:10:14.781773 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2725/3995] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:10:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:10:14.788046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:14.788673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:14.795342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:14.795900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:14.796399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:14.797372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:14.797614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:14.798015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:15.224671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:15.241604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:15.246575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:15.247773 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d7e25402-beca-49f7-89b3-03a0e035ea91 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.464852 Oct 01 21:10:15.248533 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2726/3996] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:14 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:15.260827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:15.263185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:15.289025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:15.289692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:15.289964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:15.290924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:15.295116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:15.297458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:16.343737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:16.354696 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-55fa5ded-22c3-4391-b0ad-f34ca14bec84 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1558 microversion: 2.1 time: 1.104525 Oct 01 21:10:16.370829 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2727/3997] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:15 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1558 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:16.737802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:16.738257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:16.745523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:16.746236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:16.747313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:16.748464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:16.749167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:16.749764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:16.841625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:10:16.990128 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-43fa0959-20e5-4833-b922-2814b40ed169 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "DELETE /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 204 len: 0 microversion: 2.32 time: 0.617297 Oct 01 21:10:16.991801 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2728/3998] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:10:16 2022] DELETE /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:10:17.011663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:17.012761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:17.029065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:17.029884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:17.031487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:17.032504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:17.037701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:17.038275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:17.186952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:17.199513 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4868dfa8-acf4-409b-a980-81db89880a86 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1238 microversion: 2.1 time: 0.202143 Oct 01 21:10:17.201128 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2729/3999] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:16 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1238 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:17.213682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:17.214971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:17.225557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:17.226436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:17.227202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:17.228678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:17.229737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:17.230315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:17.491058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:17.506388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:17.508403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:17.510076 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1db16f90-a867-4157-9616-16087058a4c3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.306298 Oct 01 21:10:17.524129 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2730/4000] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:17 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:17.537347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-57f02024-5570-4707-91a4-2cc13cd03cda tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:17.538169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-57f02024-5570-4707-91a4-2cc13cd03cda tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:17.546810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57f02024-5570-4707-91a4-2cc13cd03cda tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:17.547790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57f02024-5570-4707-91a4-2cc13cd03cda tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:17.548489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57f02024-5570-4707-91a4-2cc13cd03cda tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:17.550060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57f02024-5570-4707-91a4-2cc13cd03cda tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:17.550991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57f02024-5570-4707-91a4-2cc13cd03cda tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:17.551917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57f02024-5570-4707-91a4-2cc13cd03cda tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:17.681551 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-57f02024-5570-4707-91a4-2cc13cd03cda tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156195 Oct 01 21:10:17.682588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2731/4001] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:10:17 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:17.699624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:17.699624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:17.720127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:17.720127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:17.720127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:17.720127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:17.720127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:17.720127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:18.020703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:18.032018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:18.036247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:18.037682 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4bfa18e-769d-440e-8cfb-fbc82bd2fd03 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2953 microversion: 2.32 time: 0.354044 Oct 01 21:10:18.038429 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2732/4002] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:17 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2953 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:18.225950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:18.226884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:18.237319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:18.242017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:18.242832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:18.243771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:18.244429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:18.244879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:18.366227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:18.378975 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-56fa85e2-838f-49f1-b063-d10aca31be37 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1238 microversion: 2.1 time: 0.156755 Oct 01 21:10:18.392056 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2733/4003] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:18 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1238 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:18.538002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:18.540542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:18.550471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:18.552569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:18.554402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:18.557355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:18.558153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:18.558978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:18.760007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:18.762611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:18.778365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:18.780092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:18.781880 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a48ead8-b90e-4d2a-b368-f7355725ed44 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.248207 Oct 01 21:10:18.797016 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2734/4004] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:18 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:10:19.069501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:19.070308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:19.082217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:19.083338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:19.084549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:19.085836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:19.086417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:19.086884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:19.385130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:19.399141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:19.405859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:19.407524 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d46403a-18e2-4d68-b664-49b22498f175 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2953 microversion: 2.32 time: 0.343048 Oct 01 21:10:19.411259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2735/4005] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:19 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2953 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:10:19.418657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:19.423932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:19.436078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:19.438230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:19.441354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:19.442403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:19.443161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:19.444889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:19.702514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:19.717998 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-222b6edd-84ac-42d6-a222-f8848095c31f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1238 microversion: 2.1 time: 0.305330 Oct 01 21:10:19.725791 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2736/4006] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:19 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1238 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:19.813286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:19.814522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:19.828489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:19.830121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:19.832345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:19.835539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:19.836170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:19.836901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:20.119984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:20.130253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:20.135856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:20.141700 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-57fb5b38-0fb1-4511-b963-7b9de8772dc0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.335623 Oct 01 21:10:20.142576 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2737/4007] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:19 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:20.312798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9dc02d5f-e0fd-41d0-84fe-a55fe002f557 req-016661dc-b381-4c85-be0d-dfed3f98bc95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec205c2f-e515-4a25-a372-64bdb58ac51b", "tag": "52eec226-a379-4f11-8bbe-ce0482e41158"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:20.335363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9dc02d5f-e0fd-41d0-84fe-a55fe002f557 req-016661dc-b381-4c85-be0d-dfed3f98bc95 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:20.336155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9dc02d5f-e0fd-41d0-84fe-a55fe002f557 req-016661dc-b381-4c85-be0d-dfed3f98bc95 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:20.336780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9dc02d5f-e0fd-41d0-84fe-a55fe002f557 req-016661dc-b381-4c85-be0d-dfed3f98bc95 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:20.386480 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9dc02d5f-e0fd-41d0-84fe-a55fe002f557 req-016661dc-b381-4c85-be0d-dfed3f98bc95 service nova] Creating event network-changed:52eec226-a379-4f11-8bbe-ce0482e41158 for instance ec205c2f-e515-4a25-a372-64bdb58ac51b on nch2-master-1 Oct 01 21:10:20.398471 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9dc02d5f-e0fd-41d0-84fe-a55fe002f557 req-016661dc-b381-4c85-be0d-dfed3f98bc95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089519 Oct 01 21:10:20.400932 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2738/4008] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:10:20.450759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:20.451876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:20.465379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:20.467134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:20.470939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:20.472035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:20.473377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:20.476340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:21.651523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:21.671893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:21.692632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:21.694393 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-55512307-ebfa-413b-a4c1-40522e5528a5 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2953 microversion: 2.32 time: 1.250278 Oct 01 21:10:21.697991 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2739/4009] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:20 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2953 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:21.708982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:21.711061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:21.736013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:21.736591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:21.737050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:21.737793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:21.738270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:21.738746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:22.942981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:22.952330 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-55827b3e-95cc-4f1f-a945-538d45292f47 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1305 microversion: 2.1 time: 1.252977 Oct 01 21:10:22.959869 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2740/4010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:21 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1305 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:22.973486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:22.974479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:22.981011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:22.981675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:22.982427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:22.984072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:22.984905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:22.985607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:23.944504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:23.957813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:23.961797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:23.967141 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bdfde052-8214-4545-b0c5-e1dfafef510d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 1.003416 Oct 01 21:10:23.968320 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2741/4011] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:22 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:23.977405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:23.980845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:24.004342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:24.004925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:24.005462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:24.006723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:24.009813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:24.010573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:24.332753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:24.368005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:24.782242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:24.802259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:24.803837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:24.805236 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-beebc270-edb6-4e00-b7c1-f713b7cb3340 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2932 microversion: 2.32 time: 0.835770 Oct 01 21:10:24.832674 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2742/4012] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:23 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2932 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:24.859014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d8b51128-d62e-403c-b829-bbaaf9b2c8f6 req-d8125a51-4231-45fe-9a46-3013e03f8ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-unplugged", "status": "completed", "tag": "9107bd19-676f-4b6f-ab6d-ea79909a7672"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:24.903602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8b51128-d62e-403c-b829-bbaaf9b2c8f6 req-d8125a51-4231-45fe-9a46-3013e03f8ef5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:24.903602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8b51128-d62e-403c-b829-bbaaf9b2c8f6 req-d8125a51-4231-45fe-9a46-3013e03f8ef5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:24.903872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8b51128-d62e-403c-b829-bbaaf9b2c8f6 req-d8125a51-4231-45fe-9a46-3013e03f8ef5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:24.922991 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d8b51128-d62e-403c-b829-bbaaf9b2c8f6 req-d8125a51-4231-45fe-9a46-3013e03f8ef5 service nova] Creating event network-vif-unplugged:9107bd19-676f-4b6f-ab6d-ea79909a7672 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:24.930016 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d8b51128-d62e-403c-b829-bbaaf9b2c8f6 req-d8125a51-4231-45fe-9a46-3013e03f8ef5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095823 Oct 01 21:10:24.934679 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2743/4013] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:24.944761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:24.947279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:24.955035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:24.956465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:24.957116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:24.958018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:24.958686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:24.960612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:25.404323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:25.421855 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-812cd4f9-246f-440c-a975-7ce6581b657c tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1293 microversion: 2.1 time: 0.481963 Oct 01 21:10:25.425761 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2744/4014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:24 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1293 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:25.443401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:25.444326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:25.459926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:25.463261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:25.464193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:25.464972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:25.465461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:25.466912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:26.310546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:26.332308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:26.338287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:26.345356 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c54329c-423a-4429-a1d5-81c1a3c0edbe tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1738 microversion: 2.20 time: 0.917864 Oct 01 21:10:26.351698 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2745/4015] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:25 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1738 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:26.374852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:26.375498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:26.397920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:26.399508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:26.401281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:26.403232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:26.408477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:26.410820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:26.878906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:26.906395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:26.907955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:26.909314 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a10d4e53-5eaf-435b-890b-82a5166720b2 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2911 microversion: 2.32 time: 0.553116 Oct 01 21:10:26.909879 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2746/4016] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:26 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2911 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:26.935510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9d07e4a9-05a9-43d0-b9d0-45a18ecf88a4 req-5de1c47a-3d26-4099-9d50-0082cf8873bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b2a4a7-e75d-4129-bf34-21a4f58cbf58", "tag": "e46336fe-2927-4294-8c44-23c99c640bb6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:26.973004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9d07e4a9-05a9-43d0-b9d0-45a18ecf88a4 req-5de1c47a-3d26-4099-9d50-0082cf8873bd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:26.973504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9d07e4a9-05a9-43d0-b9d0-45a18ecf88a4 req-5de1c47a-3d26-4099-9d50-0082cf8873bd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:26.973947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9d07e4a9-05a9-43d0-b9d0-45a18ecf88a4 req-5de1c47a-3d26-4099-9d50-0082cf8873bd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:27.015672 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9d07e4a9-05a9-43d0-b9d0-45a18ecf88a4 req-5de1c47a-3d26-4099-9d50-0082cf8873bd service nova] Creating event network-changed:e46336fe-2927-4294-8c44-23c99c640bb6 for instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 on nch1-master-1 Oct 01 21:10:27.037660 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9d07e4a9-05a9-43d0-b9d0-45a18ecf88a4 req-5de1c47a-3d26-4099-9d50-0082cf8873bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126287 Oct 01 21:10:27.038597 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2747/4017] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:27.045092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:27.046102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:27.062263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:27.063016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:27.063729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:27.084499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:27.085674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:27.090260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:27.617898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:27.636403 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23f6fef6-b7a9-4dbd-9732-5d1741849415 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1293 microversion: 2.1 time: 0.595671 Oct 01 21:10:27.644988 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2748/4018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:27 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1293 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:27.652472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-unplugged", "status": "completed", "tag": "82e99bc6-f268-4fdd-8550-c975a4937b54"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-unplugged", "status": "completed", "tag": "7c63803c-b52f-4b0f-83b4-c88b63b742db"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-unplugged", "status": "completed", "tag": "fb0092f2-a3d1-47ee-9275-921730efb7ec"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-unplugged", "status": "completed", "tag": "2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-unplugged", "status": "completed", "tag": "ad134ac7-069e-4067-94cd-612e65d3dac2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:27.677650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:27.682079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:27.682877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:27.714793 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] Creating event network-vif-unplugged:82e99bc6-f268-4fdd-8550-c975a4937b54 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:27.715526 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] Creating event network-vif-unplugged:7c63803c-b52f-4b0f-83b4-c88b63b742db for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:27.716408 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] Creating event network-vif-unplugged:fb0092f2-a3d1-47ee-9275-921730efb7ec for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:27.717982 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] Creating event network-vif-unplugged:2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:27.723782 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] Creating event network-vif-unplugged:ad134ac7-069e-4067-94cd-612e65d3dac2 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:27.733022 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ac22fcae-feb8-4446-926c-6865f74fdd0b req-2047aeaa-4f3b-49d9-8ad8-3505b9a02e6e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.086360 Oct 01 21:10:27.733916 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2749/4019] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:27.740101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:27.741123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:27.750271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:27.751126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:27.752966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:27.754035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:27.754778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:27.755408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:28.307312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:28.333122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:28.340007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:28.344901 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4ba452a-c88f-47f0-b797-2844906fc1d6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1720 microversion: 2.20 time: 0.606912 Oct 01 21:10:28.351379 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2750/4020] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:27 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1720 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:28.358151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:28.359357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:28.396227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:28.399264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:28.399732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:28.400714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:28.401191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:28.402944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:28.707349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:28.716863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:28.718329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:28.728359 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1dea9038-61a4-42cd-81db-8d641a80eeec tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2817 microversion: 2.32 time: 0.371465 Oct 01 21:10:28.729402 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2751/4021] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:28 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2817 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:28.750654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:28.751566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:28.758194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:28.770459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:28.771383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:28.772322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:28.772945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:28.773562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:29.044362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:29.058863 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-32f292a8-4386-4c38-8c90-7f3445a3f2e4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1293 microversion: 2.1 time: 0.328044 Oct 01 21:10:29.059486 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2752/4022] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:28 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1293 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:29.072210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-40d8da20-10e3-4878-969e-6f0564410288 req-d0235dec-6b09-4d65-874c-4f0b874d371e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-deleted", "tag": "7c63803c-b52f-4b0f-83b4-c88b63b742db"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-deleted", "tag": "ad134ac7-069e-4067-94cd-612e65d3dac2"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:29.084623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-40d8da20-10e3-4878-969e-6f0564410288 req-d0235dec-6b09-4d65-874c-4f0b874d371e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:29.085436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-40d8da20-10e3-4878-969e-6f0564410288 req-d0235dec-6b09-4d65-874c-4f0b874d371e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:29.086376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-40d8da20-10e3-4878-969e-6f0564410288 req-d0235dec-6b09-4d65-874c-4f0b874d371e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:29.101527 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-40d8da20-10e3-4878-969e-6f0564410288 req-d0235dec-6b09-4d65-874c-4f0b874d371e service nova] Creating event network-vif-deleted:7c63803c-b52f-4b0f-83b4-c88b63b742db for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:29.102559 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-40d8da20-10e3-4878-969e-6f0564410288 req-d0235dec-6b09-4d65-874c-4f0b874d371e service nova] Creating event network-vif-deleted:ad134ac7-069e-4067-94cd-612e65d3dac2 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:29.110017 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-40d8da20-10e3-4878-969e-6f0564410288 req-d0235dec-6b09-4d65-874c-4f0b874d371e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041327 Oct 01 21:10:29.111065 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2753/4023] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:10:29.380992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:29.381719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:29.390466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:29.392203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:29.393029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:29.394379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:29.395147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:29.396281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:29.741643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:29.745825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:29.762015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:29.765378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:29.767069 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-58872932-a2a0-4109-bb7f-dd993f39ac22 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1720 microversion: 2.20 time: 0.390778 Oct 01 21:10:29.768319 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2754/4024] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:29 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1720 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:29.775234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:29.776579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:29.786671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:29.787409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:29.788021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:29.788908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:29.789550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:29.800865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:30.123637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:30.139758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:30.142394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:30.144240 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-874fcb9d-1bd5-4e16-bd99-ec7be3b613ea tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2543 microversion: 2.32 time: 0.374338 Oct 01 21:10:30.154578 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2755/4025] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:29 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2543 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:30.154578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:30.154578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:30.164339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:30.164339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:30.164339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:30.164339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:30.165151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:30.166157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:30.465152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:30.483053 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d61bf87-3fee-4860-a81c-1d1df8565024 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1293 microversion: 2.1 time: 0.335868 Oct 01 21:10:30.515923 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2756/4026] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:30 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1293 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:30.800039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:30.801818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:30.809772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:30.811066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:30.811899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:30.813494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:30.815791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:30.816734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:31.162366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:31.173313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:31.175677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:31.178445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5fb77858-1326-47b1-bb03-4024041006ec tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1723 microversion: 2.20 time: 0.383689 Oct 01 21:10:31.193923 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2757/4027] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:30 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:31.208557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:31.209472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:31.219020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:31.219953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:31.221181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:31.221940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:31.222646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:31.223185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:31.539777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:31.551664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:31.557596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:31.559337 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6d3d5c96-137b-4353-930d-074c9606ce31 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 2543 microversion: 2.32 time: 0.364054 Oct 01 21:10:31.559930 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2758/4028] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:31 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 2543 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:31.569028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-397698a2-7751-403c-87e9-9bfb2ff9b671 req-b84d31e9-3abe-43d6-9230-0ad1af16fa82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-deleted", "tag": "2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:31.585630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-397698a2-7751-403c-87e9-9bfb2ff9b671 req-b84d31e9-3abe-43d6-9230-0ad1af16fa82 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:31.586209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-397698a2-7751-403c-87e9-9bfb2ff9b671 req-b84d31e9-3abe-43d6-9230-0ad1af16fa82 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:31.586728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-397698a2-7751-403c-87e9-9bfb2ff9b671 req-b84d31e9-3abe-43d6-9230-0ad1af16fa82 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:31.605280 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-397698a2-7751-403c-87e9-9bfb2ff9b671 req-b84d31e9-3abe-43d6-9230-0ad1af16fa82 service nova] Creating event network-vif-deleted:2b28c4a0-abfb-4845-ae8a-bf5e9b1515a8 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:31.620057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-397698a2-7751-403c-87e9-9bfb2ff9b671 req-b84d31e9-3abe-43d6-9230-0ad1af16fa82 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058664 Oct 01 21:10:31.620737 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2759/4029] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:31.628504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-033f31da-3def-4272-a1f2-f9a00cd0b9a9 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45c8ab81-bd0c-4e31-bf20-a283c57ecdab"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:31.632798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-033f31da-3def-4272-a1f2-f9a00cd0b9a9 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:31.640183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-033f31da-3def-4272-a1f2-f9a00cd0b9a9 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:31.640683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-033f31da-3def-4272-a1f2-f9a00cd0b9a9 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:31.641131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-033f31da-3def-4272-a1f2-f9a00cd0b9a9 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:31.641856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-033f31da-3def-4272-a1f2-f9a00cd0b9a9 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:31.643145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-033f31da-3def-4272-a1f2-f9a00cd0b9a9 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:31.643915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-033f31da-3def-4272-a1f2-f9a00cd0b9a9 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:32.246472 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-033f31da-3def-4272-a1f2-f9a00cd0b9a9 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.622727 Oct 01 21:10:32.247472 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2760/4030] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Oct 1 21:10:31 2022] POST /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments => generated 188 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:10:32.258319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:32.259014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:32.268080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:32.268590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:32.269038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:32.269764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:32.270224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:32.270728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:32.478461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:32.510723 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5bff747c-cffa-43d1-804c-94fca40672d4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1293 microversion: 2.1 time: 0.257325 Oct 01 21:10:32.510723 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2761/4031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:32 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1293 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:32.522544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a903948f-61d4-483d-b853-c283b840f912 req-af35c306-0c58-447c-bb5f-790fe885f78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97be5f25-216d-464d-944b-3d6108312f20", "name": "network-vif-unplugged", "status": "completed", "tag": "a4d6a1de-27d2-4876-8b56-131f6ba7888d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:32.538743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a903948f-61d4-483d-b853-c283b840f912 req-af35c306-0c58-447c-bb5f-790fe885f78f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:32.539250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a903948f-61d4-483d-b853-c283b840f912 req-af35c306-0c58-447c-bb5f-790fe885f78f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:32.539708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a903948f-61d4-483d-b853-c283b840f912 req-af35c306-0c58-447c-bb5f-790fe885f78f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:32.556826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.server_external_events [req-a903948f-61d4-483d-b853-c283b840f912 req-af35c306-0c58-447c-bb5f-790fe885f78f service nova] Unable to find a host for instance 97be5f25-216d-464d-944b-3d6108312f20. Dropping event network-vif-unplugged {{(pid=140438) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 01 21:10:32.558220 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a903948f-61d4-483d-b853-c283b840f912 req-af35c306-0c58-447c-bb5f-790fe885f78f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049018 Oct 01 21:10:32.559111 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2762/4032] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 01 21:10:32.565910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:32.567061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:32.582897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:32.583781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:32.584645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:32.585841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:32.587599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:32.588399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:32.639903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140438) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 21:10:32.831165 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1bfa66f6-f226-4ef3-a2aa-c7012f387888 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/action" status: 202 len: 0 microversion: 2.20 time: 0.270777 Oct 01 21:10:32.832433 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2763/4033] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 21:10:32 2022] POST /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:10:32.840158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:32.840796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:32.851111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:32.851735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:32.853466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:32.854221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:32.855486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:32.855779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:33.019301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:33.040551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:33.044663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5f90f4ec8b4b5cb4b64a2b99ca9beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf01814edfe46d5b1dd62f42c2fa45d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:33.061882 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8a414c72-0e08-40d1-bb26-af65a2d8c64f tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 200 len: 1603 microversion: 2.32 time: 0.220740 Oct 01 21:10:33.064938 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2764/4034] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:32 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 1603 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:33.092020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:33.096103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:33.101621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:33.112499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:33.113004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:33.113457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:33.116859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:33.124450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:33.124634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:33.349801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:33.362700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:33.367234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:33.369977 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-181524a6-e717-4053-9169-50ae550b8646 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1749 microversion: 2.20 time: 0.303540 Oct 01 21:10:33.371398 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2765/4035] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:33 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1749 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:33.532747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:33.533693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:33.543821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:33.544328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:33.551437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:33.551437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:33.560812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:33.562870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:33.765127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:33.773923 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea3ddfb0-23f7-4ed5-a723-becb4a283e3e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1293 microversion: 2.1 time: 0.247271 Oct 01 21:10:33.774480 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2766/4036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:33 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1293 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:33.779325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ae035290-cb66-430e-8a3a-c6a3a4b5b742 req-a7bcb7a8-b44f-4631-8733-de5cec24a6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-deleted", "tag": "9107bd19-676f-4b6f-ab6d-ea79909a7672"}, {"server_uuid": "70a51bd0-275a-4f23-8310-e1522df2775f", "name": "network-vif-deleted", "tag": "fb0092f2-a3d1-47ee-9275-921730efb7ec"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:33.788825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ae035290-cb66-430e-8a3a-c6a3a4b5b742 req-a7bcb7a8-b44f-4631-8733-de5cec24a6b2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:33.789325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ae035290-cb66-430e-8a3a-c6a3a4b5b742 req-a7bcb7a8-b44f-4631-8733-de5cec24a6b2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:33.789821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ae035290-cb66-430e-8a3a-c6a3a4b5b742 req-a7bcb7a8-b44f-4631-8733-de5cec24a6b2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:33.801420 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ae035290-cb66-430e-8a3a-c6a3a4b5b742 req-a7bcb7a8-b44f-4631-8733-de5cec24a6b2 service nova] Creating event network-vif-deleted:9107bd19-676f-4b6f-ab6d-ea79909a7672 for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:33.801956 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ae035290-cb66-430e-8a3a-c6a3a4b5b742 req-a7bcb7a8-b44f-4631-8733-de5cec24a6b2 service nova] Creating event network-vif-deleted:fb0092f2-a3d1-47ee-9275-921730efb7ec for instance 70a51bd0-275a-4f23-8310-e1522df2775f on nch1-master-1 Oct 01 21:10:33.807353 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ae035290-cb66-430e-8a3a-c6a3a4b5b742 req-a7bcb7a8-b44f-4631-8733-de5cec24a6b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031678 Oct 01 21:10:33.808348 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2767/4037] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:34.090032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:34.090878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:34.098191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:34.098725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:34.099166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:34.100064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:34.100687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:34.101283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:34.118026 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] HTTP exception thrown: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Request method failure captured: Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f HTTP/1.1 Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKtkMBk_LYILd11ut0yDGC3n7JqrKkvrUmJP8G83BxYkpEeXk01cRuTn1KmPB1VnJ-am3dGuUKXpBqV5MnY7hSArKlGqZHwGsm-6Ejq7TOjwurTIe8VfW_rXXRvnlk_T2Rxuz2K_vavFq9yQwKHcVuaD1iii7bhr4JWnlJhHK5Bv0NA Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.32 Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0bf01814edfe46d5b1dd62f42c2fa45d Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TaggedBootDevicesTest-874492856 Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0bf01814edfe46d5b1dd62f42c2fa45d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0bf01814edfe46d5b1dd62f42c2fa45d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0bf01814edfe46d5b1dd62f42c2fa45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0bf01814edfe46d5b1dd62f42c2fa45d"}]}] Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TaggedBootDevicesTest-874492856 Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0bf01814edfe46d5b1dd62f42c2fa45d Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TaggedBootDevicesTest-874492856 Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TaggedBootDevicesTest-874492856-project Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 9b5f90f4ec8b4b5cb4b64a2b99ca9beb Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TaggedBootDevicesTest-874492856-project Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '70a51bd0-275a-4f23-8310-e1522df2775f'} Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:10:34.119989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Returning 404 to user: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1db85de-355c-434d-be54-7496bfd2ea86 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 404 len: 111 microversion: 2.32 time: 0.035846 Oct 01 21:10:34.129768 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2768/4038] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:34 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:10:34.131401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f3dacc5-0e26-489e-8299-f6c83e08edde tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '.version_select at 0x7f4173126790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:34.157558 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f3dacc5-0e26-489e-8299-f6c83e08edde tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-156004127" status: 204 len: 0 microversion: 2.32 time: 0.030449 Oct 01 21:10:34.159305 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2769/4039] 10.222.0.17 () {60 vars in 1259 bytes} [Sat Oct 1 21:10:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-156004127 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 01 21:10:34.405855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:34.407407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:34.422938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:34.423492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:34.423944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:34.428491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:34.429028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:34.429590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:34.748797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:34.766411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:34.769250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:34.777216 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-101acf19-47dc-4288-96ee-66f7b2749051 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1751 microversion: 2.20 time: 0.377459 Oct 01 21:10:34.778364 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2770/4040] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:34 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1751 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:34.786164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2fd27dde-c63a-4af0-96c7-bf8dd8ba3fcb req-4a3d2070-594a-4528-824e-5bc8d289d14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b2a4a7-e75d-4129-bf34-21a4f58cbf58", "name": "network-vif-plugged", "status": "completed", "tag": "e46336fe-2927-4294-8c44-23c99c640bb6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:34.811076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2fd27dde-c63a-4af0-96c7-bf8dd8ba3fcb req-4a3d2070-594a-4528-824e-5bc8d289d14a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:34.812231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2fd27dde-c63a-4af0-96c7-bf8dd8ba3fcb req-4a3d2070-594a-4528-824e-5bc8d289d14a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:34.812877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2fd27dde-c63a-4af0-96c7-bf8dd8ba3fcb req-4a3d2070-594a-4528-824e-5bc8d289d14a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:34.831179 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2fd27dde-c63a-4af0-96c7-bf8dd8ba3fcb req-4a3d2070-594a-4528-824e-5bc8d289d14a service nova] Creating event network-vif-plugged:e46336fe-2927-4294-8c44-23c99c640bb6 for instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 on nch1-master-1 Oct 01 21:10:34.837197 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2fd27dde-c63a-4af0-96c7-bf8dd8ba3fcb req-4a3d2070-594a-4528-824e-5bc8d289d14a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056164 Oct 01 21:10:34.837992 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2771/4041] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:34.844232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:34.845699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:34.852445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:34.853260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:34.853875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:34.854796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:34.855420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:34.856348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:34.861686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:35.187337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:35.195518 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d585fcef-bab9-4252-a99d-cb987f9685c6 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1293 microversion: 2.1 time: 0.356097 Oct 01 21:10:35.210857 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2772/4042] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:34 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1293 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:35.819011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:35.831327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:35.850866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:35.853004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:35.853652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:35.854902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:35.856017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:35.856796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:36.084651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:36.094290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:36.101521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:36.105652 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3467b567-4da8-4709-8d2d-df733c2ec074 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.299353 Oct 01 21:10:36.108849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2773/4043] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:35 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:36.221107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:36.222524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:36.237592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:36.239529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:36.239988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:36.241745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:36.242382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:36.242924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:36.488926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:36.506755 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05a29c74-c425-44bd-812d-9e7a0eb8631e tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1293 microversion: 2.1 time: 0.292348 Oct 01 21:10:36.508633 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2774/4044] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:36 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1293 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:37.140985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:37.143506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:37.158982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:37.160750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:37.161392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:37.162136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:37.164330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:37.164807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:37.440818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:37.450476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:37.452221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:37.453633 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1fa58d51-3093-440a-9b0a-760bc19fe0ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.320895 Oct 01 21:10:37.454136 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2775/4045] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:37 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:37.532013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:37.532944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:37.540386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:37.541371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:37.542135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:37.547069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:37.547796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:37.548477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:38.026750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:38.042613 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f54615f7-2ca4-4fee-988d-0169e42e15be tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1483 microversion: 2.1 time: 0.515320 Oct 01 21:10:38.052074 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2776/4046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:37 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1483 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:38.081923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-406ce4dc-0074-4222-a3c2-15a7419e8e1f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:38.082829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-406ce4dc-0074-4222-a3c2-15a7419e8e1f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:38.090574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-406ce4dc-0074-4222-a3c2-15a7419e8e1f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:38.091405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-406ce4dc-0074-4222-a3c2-15a7419e8e1f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:38.092025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-406ce4dc-0074-4222-a3c2-15a7419e8e1f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:38.092973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-406ce4dc-0074-4222-a3c2-15a7419e8e1f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:38.093914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-406ce4dc-0074-4222-a3c2-15a7419e8e1f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:38.094565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-406ce4dc-0074-4222-a3c2-15a7419e8e1f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:38.225422 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-406ce4dc-0074-4222-a3c2-15a7419e8e1f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148168 Oct 01 21:10:38.244996 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2777/4047] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:10:38 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:10:38.279563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc14b903-d1fc-405f-a07c-33b38947c2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:38.285569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bc14b903-d1fc-405f-a07c-33b38947c2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:38.294849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc14b903-d1fc-405f-a07c-33b38947c2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:38.295569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc14b903-d1fc-405f-a07c-33b38947c2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:38.296188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc14b903-d1fc-405f-a07c-33b38947c2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:38.297274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc14b903-d1fc-405f-a07c-33b38947c2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:38.298046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc14b903-d1fc-405f-a07c-33b38947c2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:38.298943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc14b903-d1fc-405f-a07c-33b38947c2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:38.354148 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc14b903-d1fc-405f-a07c-33b38947c2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/ips" status: 200 len: 145 microversion: 2.1 time: 0.106704 Oct 01 21:10:38.363317 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2778/4048] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:10:38 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/ips => generated 145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:38.485604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:38.487148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:38.503002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:38.503882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:38.504511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:38.506137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:38.509784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:38.510428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:39.027571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:39.058958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:39.064399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:39.075009 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88702113-b2ff-414b-b825-58e4057303b5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.593918 Oct 01 21:10:39.078090 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2779/4049] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:38 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:10:40.109967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:40.111448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:40.145322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:40.148465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:40.150207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:40.152616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:40.157357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:40.158862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:40.714424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:40.734805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:40.746570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:40.748181 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-edc89c5f-280f-45df-84b2-ab6c3bc22968 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.644809 Oct 01 21:10:40.748940 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2780/4050] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:40 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:10:40.758297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:40.760532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:40.775411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:40.776277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:40.777553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:40.778891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:40.779713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:40.780442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:40.806216 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] HTTP exception thrown: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Request method failure captured: Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f HTTP/1.1 Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKtkMBk_LYILd11ut0yDGC3n7JqrKkvrUmJP8G83BxYkpEeXk01cRuTn1KmPB1VnJ-am3dGuUKXpBqV5MnY7hSArKlGqZHwGsm-6Ejq7TOjwurTIe8VfW_rXXRvnlk_T2Rxuz2K_vavFq9yQwKHcVuaD1iii7bhr4JWnlJhHK5Bv0NA Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.32 Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0bf01814edfe46d5b1dd62f42c2fa45d Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TaggedBootDevicesTest-874492856 Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0bf01814edfe46d5b1dd62f42c2fa45d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0bf01814edfe46d5b1dd62f42c2fa45d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0bf01814edfe46d5b1dd62f42c2fa45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0bf01814edfe46d5b1dd62f42c2fa45d"}]}] Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TaggedBootDevicesTest-874492856 Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0bf01814edfe46d5b1dd62f42c2fa45d Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TaggedBootDevicesTest-874492856 Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TaggedBootDevicesTest-874492856-project Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 9b5f90f4ec8b4b5cb4b64a2b99ca9beb Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TaggedBootDevicesTest-874492856-project Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '70a51bd0-275a-4f23-8310-e1522df2775f'} Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:10:40.808568 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Returning 404 to user: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd2606e0-d42e-4c46-9057-de0f0c95e000 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "DELETE /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 404 len: 111 microversion: 2.32 time: 0.060772 Oct 01 21:10:40.815000 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2781/4051] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:10:40 2022] DELETE /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:10:40.830821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af262b70-bcde-40d2-bbd7-858330afcfb7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "092a001a-07c1-4c2a-9b64-59c4a913b699"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:40.835069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-af262b70-bcde-40d2-bbd7-858330afcfb7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:40.855946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af262b70-bcde-40d2-bbd7-858330afcfb7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:40.856899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af262b70-bcde-40d2-bbd7-858330afcfb7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:40.857574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af262b70-bcde-40d2-bbd7-858330afcfb7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:40.858483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af262b70-bcde-40d2-bbd7-858330afcfb7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:40.859138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af262b70-bcde-40d2-bbd7-858330afcfb7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:40.859743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af262b70-bcde-40d2-bbd7-858330afcfb7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:41.291488 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-af262b70-bcde-40d2-bbd7-858330afcfb7 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476931 Oct 01 21:10:41.328839 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2782/4052] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:10:40 2022] POST /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:41.361957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:41.362944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] [instance: 70a51bd0-275a-4f23-8310-e1522df2775f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:41.385945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:41.386466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:41.390607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:41.395138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:41.395839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:41.396448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:41.446347 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] HTTP exception thrown: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Request method failure captured: Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f HTTP/1.1 Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKtkMBk_LYILd11ut0yDGC3n7JqrKkvrUmJP8G83BxYkpEeXk01cRuTn1KmPB1VnJ-am3dGuUKXpBqV5MnY7hSArKlGqZHwGsm-6Ejq7TOjwurTIe8VfW_rXXRvnlk_T2Rxuz2K_vavFq9yQwKHcVuaD1iii7bhr4JWnlJhHK5Bv0NA Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.32 Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0bf01814edfe46d5b1dd62f42c2fa45d Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TaggedBootDevicesTest-874492856 Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0bf01814edfe46d5b1dd62f42c2fa45d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0bf01814edfe46d5b1dd62f42c2fa45d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0bf01814edfe46d5b1dd62f42c2fa45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0bf01814edfe46d5b1dd62f42c2fa45d"}]}] Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TaggedBootDevicesTest-874492856 Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0bf01814edfe46d5b1dd62f42c2fa45d Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TaggedBootDevicesTest-874492856 Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TaggedBootDevicesTest-874492856-project Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 9b5f90f4ec8b4b5cb4b64a2b99ca9beb Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TaggedBootDevicesTest-874492856-project Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '70a51bd0-275a-4f23-8310-e1522df2775f'} Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:10:41.452389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] Returning 404 to user: Instance 70a51bd0-275a-4f23-8310-e1522df2775f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8b53590b-00b3-4313-86ea-4ae2d5d06de1 tempest-TaggedBootDevicesTest-874492856 tempest-TaggedBootDevicesTest-874492856-project] 10.222.0.17 "GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f" status: 404 len: 111 microversion: 2.32 time: 0.122187 Oct 01 21:10:41.458389 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2783/4053] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:41 2022] GET /compute/v2.1/servers/70a51bd0-275a-4f23-8310-e1522df2775f => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:10:41.670887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:41.671703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:41.691251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:41.691759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:41.692202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:41.692923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:41.693382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:41.698507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:42.027122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:42.046119 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-657ae194-6774-4820-9812-413e0af0c858 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1483 microversion: 2.1 time: 0.379941 Oct 01 21:10:42.047854 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2784/4054] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:41 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1483 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:42.080295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2d79bbca-0027-49f0-9af9-6c16ff9e10f2 req-316ae12f-0f87-41c8-a8fa-69edb36c3088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b2a4a7-e75d-4129-bf34-21a4f58cbf58", "tag": "e46336fe-2927-4294-8c44-23c99c640bb6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:42.124074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2d79bbca-0027-49f0-9af9-6c16ff9e10f2 req-316ae12f-0f87-41c8-a8fa-69edb36c3088 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:42.125649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2d79bbca-0027-49f0-9af9-6c16ff9e10f2 req-316ae12f-0f87-41c8-a8fa-69edb36c3088 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:42.127098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2d79bbca-0027-49f0-9af9-6c16ff9e10f2 req-316ae12f-0f87-41c8-a8fa-69edb36c3088 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:42.160141 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2d79bbca-0027-49f0-9af9-6c16ff9e10f2 req-316ae12f-0f87-41c8-a8fa-69edb36c3088 service nova] Creating event network-changed:e46336fe-2927-4294-8c44-23c99c640bb6 for instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 on nch1-master-1 Oct 01 21:10:42.188505 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2d79bbca-0027-49f0-9af9-6c16ff9e10f2 req-316ae12f-0f87-41c8-a8fa-69edb36c3088 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124303 Oct 01 21:10:42.196014 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2785/4055] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:42.210808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:42.211786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:42.227251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:42.228199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:42.228873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:42.229921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:42.233264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:42.234471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:43.947949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:43.965812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:43.973059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:43.974429 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b3f0766-e076-4f68-81b7-f1804baf3fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 1.776984 Oct 01 21:10:43.995615 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2786/4056] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:42 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:45.024571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:45.024571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:45.044469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:45.051308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:45.054122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:45.060484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:45.061230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:45.068427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:45.983609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:46.009602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:46.014887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:46.016614 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0318320d-d784-4ea0-a74a-78161558c604 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 1.003518 Oct 01 21:10:46.018922 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2787/4057] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:45 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:46.258949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4bbe7f8-2143-4fa9-9705-aa33a012753b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:46.261941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a4bbe7f8-2143-4fa9-9705-aa33a012753b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:46.288896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4bbe7f8-2143-4fa9-9705-aa33a012753b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:46.290958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4bbe7f8-2143-4fa9-9705-aa33a012753b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:46.294682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4bbe7f8-2143-4fa9-9705-aa33a012753b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:46.299558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4bbe7f8-2143-4fa9-9705-aa33a012753b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:46.300357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4bbe7f8-2143-4fa9-9705-aa33a012753b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:46.302511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4bbe7f8-2143-4fa9-9705-aa33a012753b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:46.405233 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a4bbe7f8-2143-4fa9-9705-aa33a012753b tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151074 Oct 01 21:10:46.411136 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2788/4058] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:10:46 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:10:46.422517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-315cceba-f75c-4445-8686-298ac9e8e2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:46.423117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-315cceba-f75c-4445-8686-298ac9e8e2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:46.431668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-315cceba-f75c-4445-8686-298ac9e8e2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:46.432672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-315cceba-f75c-4445-8686-298ac9e8e2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:46.433770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-315cceba-f75c-4445-8686-298ac9e8e2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:46.434945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-315cceba-f75c-4445-8686-298ac9e8e2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:46.435957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-315cceba-f75c-4445-8686-298ac9e8e2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:46.436806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-315cceba-f75c-4445-8686-298ac9e8e2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:46.501441 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-315cceba-f75c-4445-8686-298ac9e8e2c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/092a001a-07c1-4c2a-9b64-59c4a913b699" status: 200 len: 194 microversion: 2.1 time: 0.082218 Oct 01 21:10:46.504257 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2789/4059] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Oct 1 21:10:46 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/092a001a-07c1-4c2a-9b64-59c4a913b699 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:10:47.050634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:47.051854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:47.077625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:47.078000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:47.088112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:47.088904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:47.089393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:47.090782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:47.094112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:47.601670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:47.619082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:47.620951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:47.622383 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20acaf4b-df93-4afd-b345-29ccb5b5a3d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.579109 Oct 01 21:10:47.643842 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2790/4060] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:47 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:48.225977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b35ecf38-a38a-4254-bd25-64da4a28c9be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c71b7f5d-5340-4105-9d8d-c2c46de550a4"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:48.228471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b35ecf38-a38a-4254-bd25-64da4a28c9be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:48.243859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b35ecf38-a38a-4254-bd25-64da4a28c9be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:48.246185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b35ecf38-a38a-4254-bd25-64da4a28c9be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:48.247455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b35ecf38-a38a-4254-bd25-64da4a28c9be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:48.257694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b35ecf38-a38a-4254-bd25-64da4a28c9be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:48.259241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b35ecf38-a38a-4254-bd25-64da4a28c9be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:48.259888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b35ecf38-a38a-4254-bd25-64da4a28c9be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:48.766306 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b35ecf38-a38a-4254-bd25-64da4a28c9be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "POST /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.524864 Oct 01 21:10:48.774145 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2791/4061] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:10:48 2022] POST /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:10:48.834390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:48.835895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:48.868009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:48.874103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:48.877659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:48.882289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:48.889896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:48.890700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:49.234325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:49.245832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:49.248442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:49.250936 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7843413d-746f-4930-b590-27a90f0dace5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.442694 Oct 01 21:10:49.272371 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2792/4062] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:48 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:50.291902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:50.293299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:50.303725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:50.305014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:50.306147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:50.308742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:50.309757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:50.311078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:50.566273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:50.581464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:50.583321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:50.588871 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e463bf37-3425-4bcd-91ad-3980bf73e9f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.301666 Oct 01 21:10:50.593130 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2793/4063] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:50 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:51.027220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1db5bb97-650c-4191-935f-b83c9b55994d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Action: 'create', calling method: .version_select at 0x7f4172b62700>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1230943975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpNM02ElpJRwO7YFnsk8UfdjXrV4RZYBXbMagJrbXqyBXLI3Jsz0vJQ+Ox6MznJHPEYUw32gCYlj8ywEa62YU3r1k7o7NcH/+0RuIJ/dKeZsHpnBVAiM+5L+uaXT/WBew=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:51.051442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1db5bb97-650c-4191-935f-b83c9b55994d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Getting quotas for project 6d1eb39d09ce4a87960e258ac890e32c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:10:51.058789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1db5bb97-650c-4191-935f-b83c9b55994d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Getting quotas for user 484ee8f965604fa9b7f7f5a25a81d0ef and project 6d1eb39d09ce4a87960e258ac890e32c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:10:51.093399 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1db5bb97-650c-4191-935f-b83c9b55994d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.443373 Oct 01 21:10:51.101464 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2794/4064] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:10:50 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:51.626870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:51.628006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:51.639660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:51.640205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:51.640833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:51.642310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:51.642813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:51.644230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:51.954700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:51.969294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:51.971498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:51.973473 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15b0ace2-3941-433f-8655-d9d8c72201d3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.356382 Oct 01 21:10:51.974480 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2795/4065] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:51 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:52.332382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f08d161d-2ae8-489b-be45-00764baf46a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:52.344225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f08d161d-2ae8-489b-be45-00764baf46a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:52.368981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08d161d-2ae8-489b-be45-00764baf46a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:52.369511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08d161d-2ae8-489b-be45-00764baf46a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:52.370956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08d161d-2ae8-489b-be45-00764baf46a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:52.371995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08d161d-2ae8-489b-be45-00764baf46a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:52.373141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08d161d-2ae8-489b-be45-00764baf46a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:52.377680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f08d161d-2ae8-489b-be45-00764baf46a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:52.428542 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f08d161d-2ae8-489b-be45-00764baf46a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/ips" status: 200 len: 150 microversion: 2.1 time: 0.104077 Oct 01 21:10:52.442957 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2796/4066] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:10:52 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/ips => generated 150 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:52.459470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d5db5924-d37a-44c5-9ccf-645e28951846 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:52.467305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d5db5924-d37a-44c5-9ccf-645e28951846 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:52.478100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5db5924-d37a-44c5-9ccf-645e28951846 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:52.478988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5db5924-d37a-44c5-9ccf-645e28951846 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:52.479678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5db5924-d37a-44c5-9ccf-645e28951846 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:52.480638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5db5924-d37a-44c5-9ccf-645e28951846 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:52.481272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5db5924-d37a-44c5-9ccf-645e28951846 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:52.482368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5db5924-d37a-44c5-9ccf-645e28951846 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:52.544993 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d5db5924-d37a-44c5-9ccf-645e28951846 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.097964 Oct 01 21:10:52.546794 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2797/4067] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:10:52 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments => generated 371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:52.699606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49e32f5a-5e2a-40cd-9a07-c092563e82f8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:52.700369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49e32f5a-5e2a-40cd-9a07-c092563e82f8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:52.716325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e32f5a-5e2a-40cd-9a07-c092563e82f8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:52.718155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e32f5a-5e2a-40cd-9a07-c092563e82f8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:52.721522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e32f5a-5e2a-40cd-9a07-c092563e82f8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:52.722896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e32f5a-5e2a-40cd-9a07-c092563e82f8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:52.724096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e32f5a-5e2a-40cd-9a07-c092563e82f8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:52.729067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e32f5a-5e2a-40cd-9a07-c092563e82f8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:52.792530 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49e32f5a-5e2a-40cd-9a07-c092563e82f8 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/092a001a-07c1-4c2a-9b64-59c4a913b699" status: 200 len: 194 microversion: 2.1 time: 0.096915 Oct 01 21:10:52.797735 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2798/4068] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Oct 1 21:10:52 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/092a001a-07c1-4c2a-9b64-59c4a913b699 => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:52.820675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:52.821327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:52.828284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:52.829659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:52.830362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:52.831575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:52.832584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:52.833254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:52.981423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lazy-loading 'services' on Instance uuid 20a24a06-58b4-49d3-a715-257d1d18c9f6 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:10:53.143355 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2ea4d2af-bf7a-42cc-aa2d-052f4d53a142 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/092a001a-07c1-4c2a-9b64-59c4a913b699" status: 202 len: 0 microversion: 2.1 time: 0.322769 Oct 01 21:10:53.150290 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2799/4069] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:10:52 2022] DELETE /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/092a001a-07c1-4c2a-9b64-59c4a913b699 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:10:53.164299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:53.165241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:53.182755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:53.185995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:53.186656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:53.187598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:53.189019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:53.190595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:53.677978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:53.693613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:53.696649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:53.698457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b1fb482-2c0c-478a-a694-9405d3f25adc tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.539994 Oct 01 21:10:53.699225 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2800/4070] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:53 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:54.128716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06be777c-c138-4b3d-81d4-37e2b5211061 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07294dd9-ac7c-41ee-a684-07fa45f5d09a"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:54.133278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06be777c-c138-4b3d-81d4-37e2b5211061 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:54.142151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06be777c-c138-4b3d-81d4-37e2b5211061 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:54.143247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06be777c-c138-4b3d-81d4-37e2b5211061 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:54.143868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06be777c-c138-4b3d-81d4-37e2b5211061 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:54.144778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06be777c-c138-4b3d-81d4-37e2b5211061 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:54.145424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06be777c-c138-4b3d-81d4-37e2b5211061 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:54.146018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06be777c-c138-4b3d-81d4-37e2b5211061 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:54.541366 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06be777c-c138-4b3d-81d4-37e2b5211061 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416729 Oct 01 21:10:54.564865 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2801/4071] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:10:54 2022] POST /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:54.600018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-323cfec2-ad02-4a24-8a87-1332cbd88908 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:54.600893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-323cfec2-ad02-4a24-8a87-1332cbd88908 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:54.613261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323cfec2-ad02-4a24-8a87-1332cbd88908 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:54.615549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323cfec2-ad02-4a24-8a87-1332cbd88908 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:54.616199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323cfec2-ad02-4a24-8a87-1332cbd88908 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:54.617145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323cfec2-ad02-4a24-8a87-1332cbd88908 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:54.617943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323cfec2-ad02-4a24-8a87-1332cbd88908 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:54.618998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323cfec2-ad02-4a24-8a87-1332cbd88908 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:54.665227 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-323cfec2-ad02-4a24-8a87-1332cbd88908 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/c71b7f5d-5340-4105-9d8d-c2c46de550a4" status: 200 len: 194 microversion: 2.1 time: 0.098109 Oct 01 21:10:54.666883 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2802/4072] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Oct 1 21:10:54 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/c71b7f5d-5340-4105-9d8d-c2c46de550a4 => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:54.696544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:54.698435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:54.710201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:54.710766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:54.712362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:54.713652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:54.714134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:54.714850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:54.864162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lazy-loading 'services' on Instance uuid 20a24a06-58b4-49d3-a715-257d1d18c9f6 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:10:54.982350 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef673124-4e52-4976-961d-8d9f5764b5b0 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/c71b7f5d-5340-4105-9d8d-c2c46de550a4" status: 202 len: 0 microversion: 2.1 time: 0.304101 Oct 01 21:10:54.983803 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2803/4073] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:10:54 2022] DELETE /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments/c71b7f5d-5340-4105-9d8d-c2c46de550a4 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:10:55.007067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:55.008157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:55.016641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:55.017414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:55.018028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:55.018968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:55.019593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:55.020188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:55.026100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:55.562626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:55.575171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:55.576631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:55.577963 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-14021d6b-6687-4661-8f9b-1977f44fe904 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.592705 Oct 01 21:10:55.578395 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2804/4074] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:54 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:56.302729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc011bc5-f638-4f7b-9bda-89423f9a43e2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:56.305780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cc011bc5-f638-4f7b-9bda-89423f9a43e2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:56.313063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc011bc5-f638-4f7b-9bda-89423f9a43e2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:56.313778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc011bc5-f638-4f7b-9bda-89423f9a43e2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:56.314621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc011bc5-f638-4f7b-9bda-89423f9a43e2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:56.315510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc011bc5-f638-4f7b-9bda-89423f9a43e2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:56.316135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc011bc5-f638-4f7b-9bda-89423f9a43e2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:56.316728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc011bc5-f638-4f7b-9bda-89423f9a43e2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:56.363330 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc011bc5-f638-4f7b-9bda-89423f9a43e2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066301 Oct 01 21:10:56.372877 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2805/4075] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:10:56 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:10:56.425078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-52836223-a4b3-4216-9cb3-5a5e3d410189 req-53b12f78-017c-4192-a1e8-db1501c25220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97be5f25-216d-464d-944b-3d6108312f20", "name": "network-vif-plugged", "status": "completed", "tag": "a4d6a1de-27d2-4876-8b56-131f6ba7888d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:56.444952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-52836223-a4b3-4216-9cb3-5a5e3d410189 req-53b12f78-017c-4192-a1e8-db1501c25220 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:56.445856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-52836223-a4b3-4216-9cb3-5a5e3d410189 req-53b12f78-017c-4192-a1e8-db1501c25220 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:56.446694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-52836223-a4b3-4216-9cb3-5a5e3d410189 req-53b12f78-017c-4192-a1e8-db1501c25220 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:56.470017 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-52836223-a4b3-4216-9cb3-5a5e3d410189 req-53b12f78-017c-4192-a1e8-db1501c25220 service nova] Creating event network-vif-plugged:a4d6a1de-27d2-4876-8b56-131f6ba7888d for instance 97be5f25-216d-464d-944b-3d6108312f20 on nch2-master-1 Oct 01 21:10:56.488982 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-52836223-a4b3-4216-9cb3-5a5e3d410189 req-53b12f78-017c-4192-a1e8-db1501c25220 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067500 Oct 01 21:10:56.508249 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2806/4076] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:10:56.599143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0936dc70-0c31-4e2f-a089-98cbc4912b23 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:56.603196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0936dc70-0c31-4e2f-a089-98cbc4912b23 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:56.645434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0936dc70-0c31-4e2f-a089-98cbc4912b23 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:56.648686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0936dc70-0c31-4e2f-a089-98cbc4912b23 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:56.657117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0936dc70-0c31-4e2f-a089-98cbc4912b23 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:56.713859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0936dc70-0c31-4e2f-a089-98cbc4912b23 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:56.716129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0936dc70-0c31-4e2f-a089-98cbc4912b23 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.058s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:56.718063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0936dc70-0c31-4e2f-a089-98cbc4912b23 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:56.771426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0936dc70-0c31-4e2f-a089-98cbc4912b23 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.187677 Oct 01 21:10:56.772708 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2807/4077] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:10:56 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6/os-volume_attachments => generated 25 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 01 21:10:56.779772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:56.780919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:56.789535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:56.790277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:56.791057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:56.792061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:56.792690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:56.793286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:57.230858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:57.278763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:57.283713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:57.290232 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19aa1063-4d6e-460e-87e2-5060f0b38f29 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.515637 Oct 01 21:10:57.328214 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2808/4078] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:56 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:57.348351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:57.348923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:57.352965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:10:57.373394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:57.373906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:57.374356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:57.375123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:57.382538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:57.383161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:57.446569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:10:57.604386 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e089019d-db23-4853-8a63-1f2ecc824890 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 204 len: 0 microversion: 2.1 time: 0.272540 Oct 01 21:10:57.606364 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2809/4079] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:10:57 2022] DELETE /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:10:57.616846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:57.617955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:57.627991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:57.628895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:57.630622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:57.631860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:57.632625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:57.633235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:57.964564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:57.973946 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-065fc20e-5de7-4ff0-9e80-d9644527f885 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1673 microversion: 2.1 time: 0.362523 Oct 01 21:10:57.994766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2810/4080] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:57 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1673 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:58.223338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b510379-0ae5-41ef-880e-c6a542eaaf44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: .version_select at 0x7f41728db4c0>, body: {"keypair": {"name": "tempest-keypair-682733507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJh4dWII1w4u558b1kQIIXRN8TdiGYDry6DHD3bP94fUM09p67yn4AJ9Fw6eRFaXjc2PUOfWCx1j8tjGyBc4824W7bqAWMyBdMFcH9LMbioiSQDBP9nl3w4MJUTEvBmL4w=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:10:58.287123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3b510379-0ae5-41ef-880e-c6a542eaaf44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:10:58.309293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3b510379-0ae5-41ef-880e-c6a542eaaf44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for user 902ba44d318d4a01a510f732d27467c9 and project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:10:58.381258 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b510379-0ae5-41ef-880e-c6a542eaaf44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166648 Oct 01 21:10:58.381922 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2811/4081] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:10:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:10:58.390640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:58.390640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:58.402470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:58.403176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:58.403825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:58.404765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:58.405406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:58.406183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:58.624282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:58.641933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:58.646376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:58.648953 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb672ae5-e574-4131-aa0c-a21b0da1c62a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.264857 Oct 01 21:10:58.652191 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2812/4082] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:58 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:10:58.998798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:58.999607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:59.021261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:59.023275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:59.023755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:59.027333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:59.029938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:59.030479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:59.744157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:10:59.753701 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab19afeb-1f7a-4e69-ace3-cffc9f8110c2 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1673 microversion: 2.1 time: 0.759528 Oct 01 21:10:59.756187 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2813/4083] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:10:58 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1673 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:10:59.770838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:10:59.771825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:10:59.794706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:59.795254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:59.795712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:10:59.796515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:10:59.797166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:10:59.798294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:00.369225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:00.412873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:00.414423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:00.415762 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8c53f4e-b224-4a62-acbe-630e1bd4ab86 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1807 microversion: 2.20 time: 0.658308 Oct 01 21:11:00.416808 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2814/4084] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:10:59 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1807 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:00.783138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:00.784048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:00.796703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:00.798013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:00.798846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:00.801253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:00.802061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:00.802839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:01.153176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:01.163324 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98dafb5a-fd5f-4009-aa25-eb463582a6be tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1673 microversion: 2.1 time: 0.385348 Oct 01 21:11:01.164229 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2815/4085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:00 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1673 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:01.449559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:01.450233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:01.461482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:01.461992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:01.462446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:01.471473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:01.473533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:01.476378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:02.212264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:02.247414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:02.251713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:02.259076 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-579d86bb-fa6e-48a9-9604-c811b2a52fb2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1794 microversion: 2.20 time: 0.809328 Oct 01 21:11:02.261898 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2816/4086] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:01 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1794 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:02.277921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e1267c6e-6f90-446d-987f-c37abf1380bf req-9399e6a2-69f2-469a-b6be-9ee2b722a0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a24a06-58b4-49d3-a715-257d1d18c9f6", "name": "network-vif-deleted", "tag": "d5c6efba-d090-42c1-8f91-3691cef16e27"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:02.304395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e1267c6e-6f90-446d-987f-c37abf1380bf req-9399e6a2-69f2-469a-b6be-9ee2b722a0dd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:02.305057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e1267c6e-6f90-446d-987f-c37abf1380bf req-9399e6a2-69f2-469a-b6be-9ee2b722a0dd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:02.306226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e1267c6e-6f90-446d-987f-c37abf1380bf req-9399e6a2-69f2-469a-b6be-9ee2b722a0dd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:02.350391 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e1267c6e-6f90-446d-987f-c37abf1380bf req-9399e6a2-69f2-469a-b6be-9ee2b722a0dd service nova] Creating event network-vif-deleted:d5c6efba-d090-42c1-8f91-3691cef16e27 for instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 on nch1-master-1 Oct 01 21:11:02.368928 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e1267c6e-6f90-446d-987f-c37abf1380bf req-9399e6a2-69f2-469a-b6be-9ee2b722a0dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094762 Oct 01 21:11:02.370377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2817/4087] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:02.379690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:02.381376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:02.393466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:02.394319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:02.395109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:02.416638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:02.418957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:02.420721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:02.508482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:02.508988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:02.511206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:02.511829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lazy-loading 'fault' on Instance uuid 20a24a06-58b4-49d3-a715-257d1d18c9f6 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:11:02.662814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74f251052ee4c9a99db0c43bc00da9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5bb0c08a5145369fc64e13d190c988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:02.673490 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b9ffc51-9e5d-451d-ba2e-73321a8bd59e tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 200 len: 1327 microversion: 2.1 time: 0.301390 Oct 01 21:11:02.721288 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2818/4088] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:02 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 1327 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:03.612062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1144834840", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aff7b153-98c7-4cda-8b6f-d6403aba7e87"}], "security_groups": [{"name": "tempest-securitygroup--410448163"}], "key_name": "tempest-keypair-682733507", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:03.930280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] validate_networks() for [('aff7b153-98c7-4cda-8b6f-d6403aba7e87', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:11:04.720347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:11:04.721001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:11:04.721398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:11:04.721893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:11:04.722377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:11:04.739594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:04.747175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:04.747937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:04.748881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:04.749430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:04.749933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:04.788547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:11:04.798654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for user 902ba44d318d4a01a510f732d27467c9 and project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:11:04.817740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:11:04.820651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:11:04.889796 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eeee57be-4f24-4689-bcb6-9ca410e91381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.284117 Oct 01 21:11:04.891571 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2819/4089] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:11:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:11:04.903721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:04.904625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:04.912003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:04.912507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:04.913162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:04.914149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:04.914838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:04.915728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:04.944775 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] HTTP exception thrown: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Request method failure captured: Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 HTTP/1.1 Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKvVk2kJdyVuz5yaTY_r2J_eMSW4OkZpTN6bbG8Zj22NsbMRj_SWX0jInlKYcNM-hc_HTOiv7El7-Uj8Z9cBapkipS7g52LKnijPEOTt8SPpx2L7W3708T1-KHaUyIQZZFOLxlRRr5gPWdVdivLs9XiX4s8q-hxRMjnq-QZDSJdkxEU Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0b5bb0c08a5145369fc64e13d190c988", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}] Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f74f251052ee4c9a99db0c43bc00da9f Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '20a24a06-58b4-49d3-a715-257d1d18c9f6'} Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:04.948189 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:04.954756 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:04.954756 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:04.954756 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:04.954756 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:11:04.954756 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:11:04.954756 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:04.954756 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:04.956341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Returning 404 to user: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:11:04.957394 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0e8a5b8-1466-4e3d-a4ef-4994d983280d tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 404 len: 111 microversion: 2.1 time: 0.063398 Oct 01 21:11:04.958603 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2820/4090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:04 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:11:04.966762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1364365555-access_point-1484631424", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "01292077-d4d5-442e-833b-a4595a8ab34c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1230943975", "security_groups": [{"name": "tempest-secgroup_access--1132622791"}, {"name": "tempest-secgroup_general--732110480"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:05.319534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] validate_networks() for [('01292077-d4d5-442e-833b-a4595a8ab34c', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:11:06.138481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:11:06.139126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:11:06.139897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:11:06.140362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:11:06.141361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:11:06.161813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:06.162971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:06.163579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:06.165272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:06.170699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:06.172729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:06.214672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Getting quotas for project 6d1eb39d09ce4a87960e258ac890e32c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:11:06.221730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Getting quotas for user 484ee8f965604fa9b7f7f5a25a81d0ef and project 6d1eb39d09ce4a87960e258ac890e32c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:11:06.238961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:11:06.241210 ncdv-master-1 devstack@n-api.service[140438]: WARNING nova.utils [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1364365555-access_point-1484631424 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1364365555-ac Oct 01 21:11:06.244860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:11:06.328043 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df69be72-9667-45bd-a98a-1df1d45b3408 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.367103 Oct 01 21:11:06.330214 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2821/4091] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:11:04 2022] POST /compute/v2.1/servers => generated 457 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:11:06.337159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:06.338433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:06.346037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:06.347032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:06.347770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:06.348844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:06.349514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:06.350184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:06.445564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:06.457846 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc584031-a2fe-4ead-b629-7f0b2ff11c30 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1293 microversion: 2.1 time: 0.126280 Oct 01 21:11:06.462342 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2822/4092] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:06 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:06.472201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a81c84d2-27cd-46d2-853b-cc275bf103eb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '.version_select at 0x7f4172b62af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:06.524810 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a81c84d2-27cd-46d2-853b-cc275bf103eb tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288050708" status: 202 len: 0 microversion: 2.1 time: 0.060218 Oct 01 21:11:06.525774 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2823/4093] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 21:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288050708 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:11:06.541757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e9888767-2d22-4311-8011-7974526673a9 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:06.544770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e9888767-2d22-4311-8011-7974526673a9 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:06.701111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e9888767-2d22-4311-8011-7974526673a9 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:06.717935 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e9888767-2d22-4311-8011-7974526673a9 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1295 microversion: 2.1 time: 0.183573 Oct 01 21:11:06.719690 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2824/4094] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:06 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:07.490249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:07.491840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:07.501420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:07.503470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:07.504365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:07.505528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:07.517988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:07.520992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:07.529039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:07.682357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:07.698056 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd183498-2cfb-487c-80e4-469b18ead616 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1299 microversion: 2.1 time: 0.213209 Oct 01 21:11:07.702819 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2825/4095] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:07 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1299 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:07.744077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:07.745123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:07.756225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:07.758869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:07.759588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:07.760347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:07.760820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:07.761307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:07.873218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:07.885962 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-46fc146f-bce1-4475-ab5f-bdb5e4ada01e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1347 microversion: 2.1 time: 0.146008 Oct 01 21:11:07.888455 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2826/4096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:07 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1347 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:08.733448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:08.735455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:08.751904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:08.754280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:08.754784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:08.759443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:08.760201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:08.760874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:09.078776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:09.097288 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f50c735-3fca-43c2-8865-940b8431e3f0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1366 microversion: 2.1 time: 0.369256 Oct 01 21:11:09.097941 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2827/4097] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:08 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:09.102894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:09.103707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:09.112599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:09.117007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:09.119133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:09.119915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:09.120408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:09.120850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:09.351283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:09.366196 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-43ed5cb8-6231-49cb-9c41-5ea38c1b5663 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1353 microversion: 2.1 time: 0.265334 Oct 01 21:11:09.367560 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2828/4098] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:09 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:10.126304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:10.130121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:10.142862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:10.145664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:10.146853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:10.149940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:10.150777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:10.154159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:10.671844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:10.686737 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5e0f64d4-d651-42f3-b4f6-fe2229fcf16f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1366 microversion: 2.1 time: 0.564167 Oct 01 21:11:10.695922 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2829/4099] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:10 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1366 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:10.708287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:10.711267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:10.730438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:10.739203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:10.739883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:10.740817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:10.741730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:10.742340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:11.027182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:11.041820 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-44803d17-a03b-4e46-aac2-4154cdbe3705 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1472 microversion: 2.1 time: 0.343479 Oct 01 21:11:11.050361 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2830/4100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:10 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:11.064907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-694ffc81-096d-47ab-bceb-76903d8b6fa3 req-0276ccc5-9449-4726-af5e-476513fee64b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7d7745-f988-4b08-8f7d-4899f2da6f47", "tag": "c1469e2a-2380-4e0f-bce7-68915f2ebc54"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:11.089931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-694ffc81-096d-47ab-bceb-76903d8b6fa3 req-0276ccc5-9449-4726-af5e-476513fee64b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:11.090788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-694ffc81-096d-47ab-bceb-76903d8b6fa3 req-0276ccc5-9449-4726-af5e-476513fee64b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:11.092468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-694ffc81-096d-47ab-bceb-76903d8b6fa3 req-0276ccc5-9449-4726-af5e-476513fee64b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:11.141424 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-694ffc81-096d-47ab-bceb-76903d8b6fa3 req-0276ccc5-9449-4726-af5e-476513fee64b service nova] Creating event network-changed:c1469e2a-2380-4e0f-bce7-68915f2ebc54 for instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 on nch1-master-1 Oct 01 21:11:11.147189 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-694ffc81-096d-47ab-bceb-76903d8b6fa3 req-0276ccc5-9449-4726-af5e-476513fee64b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095044 Oct 01 21:11:11.148280 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2831/4101] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:11.154359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:11.155300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:11.158810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:11.167467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:11.168194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:11.169427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:11.183931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:11.185508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:11.187868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:11.210477 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] HTTP exception thrown: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Request method failure captured: Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 HTTP/1.1 Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKvVk2kJdyVuz5yaTY_r2J_eMSW4OkZpTN6bbG8Zj22NsbMRj_SWX0jInlKYcNM-hc_HTOiv7El7-Uj8Z9cBapkipS7g52LKnijPEOTt8SPpx2L7W3708T1-KHaUyIQZZFOLxlRRr5gPWdVdivLs9XiX4s8q-hxRMjnq-QZDSJdkxEU Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0b5bb0c08a5145369fc64e13d190c988", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}] Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f74f251052ee4c9a99db0c43bc00da9f Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '20a24a06-58b4-49d3-a715-257d1d18c9f6'} Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:11:11.215374 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.221447 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.223825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Returning 404 to user: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:11:11.226018 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-08ad73e5-bb31-4af1-8e37-acbdf9a61060 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 404 len: 111 microversion: 2.1 time: 0.075706 Oct 01 21:11:11.226865 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2832/4102] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:11:11 2022] DELETE /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:11:11.247549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:11.251444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: 20a24a06-58b4-49d3-a715-257d1d18c9f6] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:11.267941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:11.270543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:11.271128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:11.274560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:11.275188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:11.276274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:11.323924 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] HTTP exception thrown: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Request method failure captured: Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 HTTP/1.1 Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKvVk2kJdyVuz5yaTY_r2J_eMSW4OkZpTN6bbG8Zj22NsbMRj_SWX0jInlKYcNM-hc_HTOiv7El7-Uj8Z9cBapkipS7g52LKnijPEOTt8SPpx2L7W3708T1-KHaUyIQZZFOLxlRRr5gPWdVdivLs9XiX4s8q-hxRMjnq-QZDSJdkxEU Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0b5bb0c08a5145369fc64e13d190c988", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}] Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f74f251052ee4c9a99db0c43bc00da9f Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '20a24a06-58b4-49d3-a715-257d1d18c9f6'} Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:11.329826 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.334247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:11.334247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:11.334247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:11.334247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:11:11.334247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:11:11.334247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. Oct 01 21:11:11.334247 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:11.337064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Returning 404 to user: Instance 20a24a06-58b4-49d3-a715-257d1d18c9f6 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:11:11.338284 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5a4dac4b-d0f8-4c4b-a4f1-50ba7c7abecc tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6" status: 404 len: 111 microversion: 2.1 time: 0.104536 Oct 01 21:11:11.342899 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2833/4103] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:11 2022] GET /compute/v2.1/servers/20a24a06-58b4-49d3-a715-257d1d18c9f6 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:11:11.355141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8482c852-536a-40bb-afc8-4b92e1354634 req-8de9c870-1450-4ded-b178-1fa85e383eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0ab80b-299d-4091-a247-22550b0a89ed", "tag": "41fd256d-b2fc-4486-a305-577fce1c18c5"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:11.385519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8482c852-536a-40bb-afc8-4b92e1354634 req-8de9c870-1450-4ded-b178-1fa85e383eeb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:11.386258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8482c852-536a-40bb-afc8-4b92e1354634 req-8de9c870-1450-4ded-b178-1fa85e383eeb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:11.386884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8482c852-536a-40bb-afc8-4b92e1354634 req-8de9c870-1450-4ded-b178-1fa85e383eeb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:11.412556 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8482c852-536a-40bb-afc8-4b92e1354634 req-8de9c870-1450-4ded-b178-1fa85e383eeb service nova] Creating event network-changed:41fd256d-b2fc-4486-a305-577fce1c18c5 for instance 8d0ab80b-299d-4091-a247-22550b0a89ed on nch2-master-1 Oct 01 21:11:11.418600 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8482c852-536a-40bb-afc8-4b92e1354634 req-8de9c870-1450-4ded-b178-1fa85e383eeb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070301 Oct 01 21:11:11.419891 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2834/4104] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:11.725163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:11.725918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:11.740746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:11.741317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:11.741762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:11.742740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:11.742982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:11.743415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:12.048329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:12.060582 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9442bc3d-cf22-4029-a896-65da604aa038 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1366 microversion: 2.1 time: 0.339785 Oct 01 21:11:12.062127 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2835/4105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:11 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:12.072661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:12.073291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:12.081908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:12.083482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:12.084120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:12.085117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:12.085744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:12.086505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:12.286878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:12.298097 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64d2402f-2956-45fb-a853-3150fcf1b989 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1472 microversion: 2.1 time: 0.232350 Oct 01 21:11:12.299054 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2836/4106] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:12 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:12.557214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:12.557758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:12.566099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:12.566672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:12.567326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:12.575466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:12.576214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:12.576835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:12.612036 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] HTTP exception thrown: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Request method failure captured: Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea HTTP/1.1 Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKvVk2kJdyVuz5yaTY_r2J_eMSW4OkZpTN6bbG8Zj22NsbMRj_SWX0jInlKYcNM-hc_HTOiv7El7-Uj8Z9cBapkipS7g52LKnijPEOTt8SPpx2L7W3708T1-KHaUyIQZZFOLxlRRr5gPWdVdivLs9XiX4s8q-hxRMjnq-QZDSJdkxEU Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0b5bb0c08a5145369fc64e13d190c988", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}] Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f74f251052ee4c9a99db0c43bc00da9f Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'fa4461cf-b0a2-40ed-9edb-ad64e615d2ea'} Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:11:12.613796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Returning 404 to user: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20e9c961-2e34-4957-ad58-b3a83c473d61 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 404 len: 111 microversion: 2.1 time: 0.062164 Oct 01 21:11:12.619073 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2837/4107] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:11:12 2022] DELETE /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:11:12.628568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:12.632292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] [instance: fa4461cf-b0a2-40ed-9edb-ad64e615d2ea] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:12.640351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:12.641542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:12.641984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:12.642739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:12.643200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:12.643656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:12.669330 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] HTTP exception thrown: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Request method failure captured: Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea HTTP/1.1 Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKvVk2kJdyVuz5yaTY_r2J_eMSW4OkZpTN6bbG8Zj22NsbMRj_SWX0jInlKYcNM-hc_HTOiv7El7-Uj8Z9cBapkipS7g52LKnijPEOTt8SPpx2L7W3708T1-KHaUyIQZZFOLxlRRr5gPWdVdivLs9XiX4s8q-hxRMjnq-QZDSJdkxEU Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0b5bb0c08a5145369fc64e13d190c988", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0b5bb0c08a5145369fc64e13d190c988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0b5bb0c08a5145369fc64e13d190c988"}]}] Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0b5bb0c08a5145369fc64e13d190c988 Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1725633688 Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f74f251052ee4c9a99db0c43bc00da9f Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeTestJSON-1725633688-project Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'fa4461cf-b0a2-40ed-9edb-ad64e615d2ea'} Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:12.671069 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.676787 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:12.676787 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:12.676787 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:12.676787 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:11:12.676787 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:11:12.676787 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. Oct 01 21:11:12.676787 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:12.676787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] Returning 404 to user: Instance fa4461cf-b0a2-40ed-9edb-ad64e615d2ea could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:11:12.676787 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a9ec5b5-766e-4e3d-8769-e331f80a4204 tempest-AttachVolumeTestJSON-1725633688 tempest-AttachVolumeTestJSON-1725633688-project] 10.222.0.17 "GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea" status: 404 len: 111 microversion: 2.1 time: 0.050339 Oct 01 21:11:12.678536 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2838/4108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:12 2022] GET /compute/v2.1/servers/fa4461cf-b0a2-40ed-9edb-ad64e615d2ea => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:11:13.092795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:13.093948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:13.115808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:13.116579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:13.117203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:13.118162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:13.118830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:13.127319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:13.574819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:13.595910 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2f01d0a-8e35-499b-94f6-b7967736651f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1366 microversion: 2.1 time: 0.508185 Oct 01 21:11:13.596767 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2839/4109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:13 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1366 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:13.608777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:13.609447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:13.616807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:13.617321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:13.617772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:13.618657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:13.619016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:13.619513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:13.959993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:13.972133 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-847569ba-1c21-461e-8a24-962f347ce5b5 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1472 microversion: 2.1 time: 0.371911 Oct 01 21:11:13.974790 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2840/4110] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:13 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1472 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:14.636134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:14.639499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:14.656980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:14.657490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:14.671021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:14.671863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:14.672356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:14.672806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:14.996512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:15.009483 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-33d61879-c2bd-4b49-867f-1af7eaed9e3b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1366 microversion: 2.1 time: 0.392662 Oct 01 21:11:15.027731 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2841/4111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:14 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:15.035038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:15.036633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:15.050960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:15.054070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:15.055323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:15.056318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:15.057054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:15.057871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:15.320526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:15.331655 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e7b56b5-1a31-4211-8db5-69e2c81cd33c tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1472 microversion: 2.1 time: 0.302403 Oct 01 21:11:15.333323 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2842/4112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:15 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1472 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:16.041181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:16.041824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:16.072833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:16.074362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:16.074362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:16.074645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:16.075036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:16.075483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:16.200888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:16.449225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:16.461195 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c3c1b1e-0fac-4635-8d5e-af59343f7f8b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1366 microversion: 2.1 time: 0.424944 Oct 01 21:11:16.470307 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2843/4113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:16 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:16.483240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:16.489859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:16.508991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:16.510631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:16.511295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:16.526243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:16.527154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:16.528555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:16.709345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=22 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:16.736305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:16.745106 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd45ab49-e369-4627-a68f-ea661bf3fbf0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1472 microversion: 2.1 time: 0.273535 Oct 01 21:11:16.747527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2844/4114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:16 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1472 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:17.492127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:17.493526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:17.504995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:17.505596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:17.510060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:17.511100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:17.511919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:17.514205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:17.795750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:17.798054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:17.809988 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23f40978-c737-43a2-bc75-368f5708b21a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1366 microversion: 2.1 time: 0.322016 Oct 01 21:11:17.810656 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2845/4115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:17 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:18.098397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-789679101", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "2060ddd6-21aa-409a-9dc3-2b7740b09a02"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:18.193987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] validate_networks() for [('2060ddd6-21aa-409a-9dc3-2b7740b09a02', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:11:18.824905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:11:18.830162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:11:18.832148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:11:18.832928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:11:18.833641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:11:18.852451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:18.854250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:18.855165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:18.856273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:18.857026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:18.857727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:18.903601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Getting quotas for project e763f5a0a739414b96c9346b82154f41. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:11:18.913693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Getting quotas for user f91d413b46d44b2ba9257de2f6b54955 and project e763f5a0a739414b96c9346b82154f41. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:11:18.938204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Going to run 2 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:11:18.941522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 3fae82d8-3dbf-480d-af10-b853fd503a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:11:19.011303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=3fae82d8-3dbf-480d-af10-b853fd503a47,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:11:19.121162 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2f2142d-a02a-472c-8e42-472801412743 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.309055 Oct 01 21:11:19.122531 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2846/4116] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:11:19.128315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8ca58fab-a9ef-47a4-b3ca-0dced04e0231 req-39e7ef15-e756-4ad6-9408-e6b01ee779b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7d7745-f988-4b08-8f7d-4899f2da6f47", "name": "network-vif-plugged", "status": "completed", "tag": "c1469e2a-2380-4e0f-bce7-68915f2ebc54"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:19.139771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8ca58fab-a9ef-47a4-b3ca-0dced04e0231 req-39e7ef15-e756-4ad6-9408-e6b01ee779b4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:19.141044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8ca58fab-a9ef-47a4-b3ca-0dced04e0231 req-39e7ef15-e756-4ad6-9408-e6b01ee779b4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:19.141584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8ca58fab-a9ef-47a4-b3ca-0dced04e0231 req-39e7ef15-e756-4ad6-9408-e6b01ee779b4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:19.155651 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8ca58fab-a9ef-47a4-b3ca-0dced04e0231 req-39e7ef15-e756-4ad6-9408-e6b01ee779b4 service nova] Creating event network-vif-plugged:c1469e2a-2380-4e0f-bce7-68915f2ebc54 for instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 on nch1-master-1 Oct 01 21:11:19.168927 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8ca58fab-a9ef-47a4-b3ca-0dced04e0231 req-39e7ef15-e756-4ad6-9408-e6b01ee779b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044763 Oct 01 21:11:19.169979 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2847/4117] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:19.185481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:19.202291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:19.214786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:19.215263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:19.216215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:19.216956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:19.217420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:19.221240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:19.762850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:19.776987 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5a9ccdc5-bbea-4c1c-8bfd-ca18ca0fc480 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1472 microversion: 2.1 time: 0.604592 Oct 01 21:11:19.781046 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2848/4118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:19 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1472 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:19.793697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:19.795410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:19.819517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:19.821561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:19.823094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:19.826097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:19.827068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:19.830138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:20.145163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:20.157477 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07ad1716-0ed8-464e-b4f0-00ce6439d57a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1366 microversion: 2.1 time: 0.373743 Oct 01 21:11:20.163282 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2849/4119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:19 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:20.180878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:20.195340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:20.198984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Searching by: {'deleted': False, 'project_id': 'e763f5a0a739414b96c9346b82154f41'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 21:11:20.237111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:20.237686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:20.238439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:20.240752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:20.242432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:20.244720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:20.316497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 21:11:20.388308 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8b6e11e5-7676-44b6-9bd4-13c2095ae1a5 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.218364 Oct 01 21:11:20.388961 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2850/4120] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 21:11:20 2022] GET /compute/v2.1/servers => generated 675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:20.404650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9992859b-8258-4dcb-b31c-553b35cab29b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:20.404650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9992859b-8258-4dcb-b31c-553b35cab29b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:20.559862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9992859b-8258-4dcb-b31c-553b35cab29b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:20.579252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9992859b-8258-4dcb-b31c-553b35cab29b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 200 len: 1219 microversion: 2.1 time: 0.181231 Oct 01 21:11:20.581007 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2851/4121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:20 2022] GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:20.807685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:20.808631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:20.821531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:20.822328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:20.822964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:20.824032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:20.824780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:20.825463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:21.158382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:21.193423 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8cbe7e99-f68d-44f7-9ddd-f96bc0653e59 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1472 microversion: 2.1 time: 0.389478 Oct 01 21:11:21.219101 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2852/4122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:20 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1472 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:21.230560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:21.231499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:21.241522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:21.242235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:21.246244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:21.247728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:21.250685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:21.251674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:21.547474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:21.559564 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b32a09e3-a7f6-4182-bc84-e1847be419ce tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1555 microversion: 2.1 time: 0.337471 Oct 01 21:11:21.560549 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2853/4123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:21 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1555 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:21.566278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-39bbe232-325e-40e9-91d4-a686c1be7709 req-f719183c-e382-4651-b421-c10271144763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0ab80b-299d-4091-a247-22550b0a89ed", "name": "network-vif-plugged", "status": "completed", "tag": "41fd256d-b2fc-4486-a305-577fce1c18c5"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:21.593772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-39bbe232-325e-40e9-91d4-a686c1be7709 req-f719183c-e382-4651-b421-c10271144763 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:21.594316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-39bbe232-325e-40e9-91d4-a686c1be7709 req-f719183c-e382-4651-b421-c10271144763 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:21.616316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-39bbe232-325e-40e9-91d4-a686c1be7709 req-f719183c-e382-4651-b421-c10271144763 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:21.633401 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-39bbe232-325e-40e9-91d4-a686c1be7709 req-f719183c-e382-4651-b421-c10271144763 service nova] Creating event network-vif-plugged:41fd256d-b2fc-4486-a305-577fce1c18c5 for instance 8d0ab80b-299d-4091-a247-22550b0a89ed on nch2-master-1 Oct 01 21:11:21.652222 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-39bbe232-325e-40e9-91d4-a686c1be7709 req-f719183c-e382-4651-b421-c10271144763 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090001 Oct 01 21:11:21.655505 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2854/4124] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:21.673152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fb02b3ce-8e20-40dd-9b3d-52195fe3d60c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:21.673790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fb02b3ce-8e20-40dd-9b3d-52195fe3d60c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:21.692318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb02b3ce-8e20-40dd-9b3d-52195fe3d60c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:21.693645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb02b3ce-8e20-40dd-9b3d-52195fe3d60c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:21.693970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb02b3ce-8e20-40dd-9b3d-52195fe3d60c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:21.694754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb02b3ce-8e20-40dd-9b3d-52195fe3d60c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:21.695232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb02b3ce-8e20-40dd-9b3d-52195fe3d60c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:21.695673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb02b3ce-8e20-40dd-9b3d-52195fe3d60c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:22.140660 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fb02b3ce-8e20-40dd-9b3d-52195fe3d60c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.482237 Oct 01 21:11:22.143654 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2855/4125] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:11:21 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47/os-interface => generated 284 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:22.160720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:22.162028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:22.171143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:22.172960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:22.173861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:22.176165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:22.179204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:22.179877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:22.383047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:22.405599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-74740ad1-c7f6-4d10-bce9-e41386d39a1b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 200 len: 1279 microversion: 2.1 time: 0.250511 Oct 01 21:11:22.431523 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2856/4126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:22 2022] GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 1279 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:22.440634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:22.443533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:22.453503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:22.454883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:22.455599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:22.457172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:22.458898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:22.459896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:22.812993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:22.830241 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bdbceb66-4622-4fcd-b8ef-96d500b44fae tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1472 microversion: 2.1 time: 0.395768 Oct 01 21:11:22.845290 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2857/4127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:22 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:23.437935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:23.438638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:23.449125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:23.449645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:23.450090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:23.455598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:23.460089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:23.460560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:24.157804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:24.176015 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1f4f6af0-65e6-460e-a6e0-96740cdf8d4b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 200 len: 1319 microversion: 2.1 time: 0.741665 Oct 01 21:11:24.177980 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2858/4128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:23 2022] GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:24.183987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:24.185019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:24.206570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:24.207537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:24.208881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:24.209841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:24.210550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:24.211651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:24.624071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:24.646357 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d9098dd6-cbde-4fe9-8e9e-8858b210a8d4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1643 microversion: 2.1 time: 0.466677 Oct 01 21:11:24.649443 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2859/4129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:24 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1643 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:24.678432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:24.679103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:24.697987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:24.698744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:24.699348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:24.700292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:24.700756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:24.701198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:25.299251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:25.318848 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-43bb3f55-685f-4314-ae01-b7bc12d091f4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1643 microversion: 2.1 time: 0.644693 Oct 01 21:11:25.327345 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2860/4130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:24 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1643 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:25.343901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-eee871d2-75db-4520-bf1e-ed183e4acd83 req-8a4f5d24-504a-4626-b593-41f6fc79bc29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7d7745-f988-4b08-8f7d-4899f2da6f47", "tag": "c1469e2a-2380-4e0f-bce7-68915f2ebc54"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:25.361616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-eee871d2-75db-4520-bf1e-ed183e4acd83 req-8a4f5d24-504a-4626-b593-41f6fc79bc29 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:25.362380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-eee871d2-75db-4520-bf1e-ed183e4acd83 req-8a4f5d24-504a-4626-b593-41f6fc79bc29 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:25.369658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-eee871d2-75db-4520-bf1e-ed183e4acd83 req-8a4f5d24-504a-4626-b593-41f6fc79bc29 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:25.402652 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-eee871d2-75db-4520-bf1e-ed183e4acd83 req-8a4f5d24-504a-4626-b593-41f6fc79bc29 service nova] Creating event network-changed:c1469e2a-2380-4e0f-bce7-68915f2ebc54 for instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 on nch1-master-1 Oct 01 21:11:25.414901 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-eee871d2-75db-4520-bf1e-ed183e4acd83 req-8a4f5d24-504a-4626-b593-41f6fc79bc29 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085634 Oct 01 21:11:25.421518 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2861/4131] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:25.443681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:25.445914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:25.458316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:25.462649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:25.463666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:25.465330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:25.471919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:25.473958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:26.569015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:26.604040 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fcdcb970-9a0b-4092-8779-cdf30855e813 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 200 len: 1319 microversion: 2.1 time: 1.180728 Oct 01 21:11:26.604664 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2862/4132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:25 2022] GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 1319 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:26.613930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2a83ece0-08b7-4bfd-b93c-ec662318b327 req-5cdef3c0-72d3-4dd6-9b49-e60a588ec0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179b11b7-2202-453c-9719-50805bdcf098", "tag": "a0b57816-4cd8-4c81-a674-61f100b5b127"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:26.643515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2a83ece0-08b7-4bfd-b93c-ec662318b327 req-5cdef3c0-72d3-4dd6-9b49-e60a588ec0f4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:26.644943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2a83ece0-08b7-4bfd-b93c-ec662318b327 req-5cdef3c0-72d3-4dd6-9b49-e60a588ec0f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:26.645706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2a83ece0-08b7-4bfd-b93c-ec662318b327 req-5cdef3c0-72d3-4dd6-9b49-e60a588ec0f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:26.665661 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2a83ece0-08b7-4bfd-b93c-ec662318b327 req-5cdef3c0-72d3-4dd6-9b49-e60a588ec0f4 service nova] Creating event network-changed:a0b57816-4cd8-4c81-a674-61f100b5b127 for instance 179b11b7-2202-453c-9719-50805bdcf098 on nch2-master-1 Oct 01 21:11:26.682883 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2a83ece0-08b7-4bfd-b93c-ec662318b327 req-5cdef3c0-72d3-4dd6-9b49-e60a588ec0f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065219 Oct 01 21:11:26.685040 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2863/4133] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:26.696289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51d0ede1-021c-44d3-8d4a-1d7e03153ff4 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:26.697768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-51d0ede1-021c-44d3-8d4a-1d7e03153ff4 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:26.710913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51d0ede1-021c-44d3-8d4a-1d7e03153ff4 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:26.711704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51d0ede1-021c-44d3-8d4a-1d7e03153ff4 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:26.713794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51d0ede1-021c-44d3-8d4a-1d7e03153ff4 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:26.714962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51d0ede1-021c-44d3-8d4a-1d7e03153ff4 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:26.715593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51d0ede1-021c-44d3-8d4a-1d7e03153ff4 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:26.717646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51d0ede1-021c-44d3-8d4a-1d7e03153ff4 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:27.557112 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-51d0ede1-021c-44d3-8d4a-1d7e03153ff4 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1794 microversion: 2.1 time: 0.870469 Oct 01 21:11:27.570799 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2864/4134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:26 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1794 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:27.641192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:27.643325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:27.653687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:27.653687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:27.653687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:27.653687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:27.654201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:27.655426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:27.897783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:27.913113 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2aeea975-8866-482e-bc96-83e246643d53 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 200 len: 1319 microversion: 2.1 time: 0.277941 Oct 01 21:11:27.914028 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2865/4135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:27 2022] GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:28.279959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1d84be00-e8de-47db-bd6c-4f3996ccc67d req-509576dd-1b0c-4174-bda5-a1295087f521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fae82d8-3dbf-480d-af10-b853fd503a47", "tag": "77f215a1-22f0-4976-bc88-dcb08c8f6362"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:28.333534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d84be00-e8de-47db-bd6c-4f3996ccc67d req-509576dd-1b0c-4174-bda5-a1295087f521 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:28.334444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d84be00-e8de-47db-bd6c-4f3996ccc67d req-509576dd-1b0c-4174-bda5-a1295087f521 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:28.337063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d84be00-e8de-47db-bd6c-4f3996ccc67d req-509576dd-1b0c-4174-bda5-a1295087f521 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:28.353534 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1d84be00-e8de-47db-bd6c-4f3996ccc67d req-509576dd-1b0c-4174-bda5-a1295087f521 service nova] Creating event network-changed:77f215a1-22f0-4976-bc88-dcb08c8f6362 for instance 3fae82d8-3dbf-480d-af10-b853fd503a47 on nch1-master-1 Oct 01 21:11:28.363478 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1d84be00-e8de-47db-bd6c-4f3996ccc67d req-509576dd-1b0c-4174-bda5-a1295087f521 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095497 Oct 01 21:11:28.365903 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2866/4136] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:28.942711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:28.944697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:28.951798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:28.953128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:28.953818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:28.955041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:28.956772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:28.957418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:28.976826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:29.112796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:29.127343 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-659d0eed-7b0d-4b96-a530-346bb9af4e29 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 200 len: 1319 microversion: 2.1 time: 0.190584 Oct 01 21:11:29.127935 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2867/4137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:28 2022] GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:29.690175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-bfc814c8-d1a3-4fac-87a6-fef9ae2f459f req-afb7dd72-8694-4f81-9b2f-9ea3a20f8b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0ab80b-299d-4091-a247-22550b0a89ed", "tag": "41fd256d-b2fc-4486-a305-577fce1c18c5"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:29.701811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bfc814c8-d1a3-4fac-87a6-fef9ae2f459f req-afb7dd72-8694-4f81-9b2f-9ea3a20f8b80 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:29.702640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bfc814c8-d1a3-4fac-87a6-fef9ae2f459f req-afb7dd72-8694-4f81-9b2f-9ea3a20f8b80 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:29.703259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bfc814c8-d1a3-4fac-87a6-fef9ae2f459f req-afb7dd72-8694-4f81-9b2f-9ea3a20f8b80 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:29.719474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-bfc814c8-d1a3-4fac-87a6-fef9ae2f459f req-afb7dd72-8694-4f81-9b2f-9ea3a20f8b80 service nova] Creating event network-changed:41fd256d-b2fc-4486-a305-577fce1c18c5 for instance 8d0ab80b-299d-4091-a247-22550b0a89ed on nch2-master-1 Oct 01 21:11:29.731634 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-bfc814c8-d1a3-4fac-87a6-fef9ae2f459f req-afb7dd72-8694-4f81-9b2f-9ea3a20f8b80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041827 Oct 01 21:11:29.734600 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2868/4138] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:30.152954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:30.154633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:30.172880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:30.173396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:30.173851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:30.185875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:30.186387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:30.187400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:30.268306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:30.531520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:30.539982 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71a93cda-2954-4b2c-96fd-afc375230461 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 200 len: 1319 microversion: 2.1 time: 0.391682 Oct 01 21:11:30.540596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2869/4139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:30 2022] GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:30.744477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:30.750269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-12402932-6ca5-4dd4-95ac-72a81caf5ab1 req-96527d7d-ad69-4b8d-be89-551ec4fabb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b11b7-2202-453c-9719-50805bdcf098", "name": "network-vif-plugged", "status": "completed", "tag": "a0b57816-4cd8-4c81-a674-61f100b5b127"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:30.792730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-12402932-6ca5-4dd4-95ac-72a81caf5ab1 req-96527d7d-ad69-4b8d-be89-551ec4fabb80 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:30.794142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-12402932-6ca5-4dd4-95ac-72a81caf5ab1 req-96527d7d-ad69-4b8d-be89-551ec4fabb80 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:30.794864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-12402932-6ca5-4dd4-95ac-72a81caf5ab1 req-96527d7d-ad69-4b8d-be89-551ec4fabb80 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:30.817622 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-12402932-6ca5-4dd4-95ac-72a81caf5ab1 req-96527d7d-ad69-4b8d-be89-551ec4fabb80 service nova] Creating event network-vif-plugged:a0b57816-4cd8-4c81-a674-61f100b5b127 for instance 179b11b7-2202-453c-9719-50805bdcf098 on nch2-master-1 Oct 01 21:11:30.841020 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-12402932-6ca5-4dd4-95ac-72a81caf5ab1 req-96527d7d-ad69-4b8d-be89-551ec4fabb80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097052 Oct 01 21:11:30.843933 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2870/4140] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:11:31.568030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:31.568731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:31.575381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:31.576112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:31.576761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:31.579685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:31.580332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:31.581038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:31.746240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:31.755388 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-098eb4e7-2b9b-4f3c-bd7a-08f0a7b6182a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 200 len: 1319 microversion: 2.1 time: 0.194142 Oct 01 21:11:31.756007 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2871/4141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:31 2022] GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:32.754807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b11bcc9-ae92-42e7-81cd-e85fa96a0e45 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:32.757291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b11bcc9-ae92-42e7-81cd-e85fa96a0e45 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:32.760442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:32.769461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b11bcc9-ae92-42e7-81cd-e85fa96a0e45 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:32.770221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b11bcc9-ae92-42e7-81cd-e85fa96a0e45 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:32.770699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b11bcc9-ae92-42e7-81cd-e85fa96a0e45 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:32.771700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b11bcc9-ae92-42e7-81cd-e85fa96a0e45 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:32.772282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b11bcc9-ae92-42e7-81cd-e85fa96a0e45 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:32.773184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b11bcc9-ae92-42e7-81cd-e85fa96a0e45 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:32.823674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b11bcc9-ae92-42e7-81cd-e85fa96a0e45 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments/45c8ab81-bd0c-4e31-bf20-a283c57ecdab" status: 200 len: 194 microversion: 2.20 time: 0.074666 Oct 01 21:11:32.824929 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2872/4142] 10.222.0.17 () {60 vars in 1454 bytes} [Sat Oct 1 21:11:32 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments/45c8ab81-bd0c-4e31-bf20-a283c57ecdab => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 21:11:32.831844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:32.833104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:32.840162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:32.840983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:32.841759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:32.842661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:32.845589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:32.846390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:33.038176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:33.049346 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-93e4fe06-96d5-4934-9f24-b54a8243090e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 200 len: 1506 microversion: 2.1 time: 0.223253 Oct 01 21:11:33.050946 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2873/4143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:32 2022] GET /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:33.056910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:33.057730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:33.064615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:33.065528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:33.066362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:33.068389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:33.069618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:33.070276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:33.179376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lazy-loading 'services' on Instance uuid 97be5f25-216d-464d-944b-3d6108312f20 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:11:33.307112 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d35cfde7-20af-4434-9ca1-020dfdbefef7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "DELETE /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments/45c8ab81-bd0c-4e31-bf20-a283c57ecdab" status: 202 len: 0 microversion: 2.20 time: 0.253398 Oct 01 21:11:33.308060 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2874/4144] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Oct 1 21:11:33 2022] DELETE /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments/45c8ab81-bd0c-4e31-bf20-a283c57ecdab => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:11:33.313883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:33.315080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 3fae82d8-3dbf-480d-af10-b853fd503a47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:33.325187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:33.325986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:33.326717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:33.328207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:33.329068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:33.330047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:33.512688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:33.524033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f294b2f9-1622-412f-8a1e-0f5b998a8f7e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47" status: 200 len: 1319 microversion: 2.1 time: 0.214490 Oct 01 21:11:33.527545 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2875/4145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:33 2022] GET /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:33.556646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a8638737-dbcf-43f2-a571-afa7d83ad255 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:33.562599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a8638737-dbcf-43f2-a571-afa7d83ad255 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:33.570760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8638737-dbcf-43f2-a571-afa7d83ad255 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:33.571551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8638737-dbcf-43f2-a571-afa7d83ad255 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:33.572271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8638737-dbcf-43f2-a571-afa7d83ad255 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:33.573740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8638737-dbcf-43f2-a571-afa7d83ad255 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:33.574213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8638737-dbcf-43f2-a571-afa7d83ad255 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:33.574682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8638737-dbcf-43f2-a571-afa7d83ad255 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:33.609080 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a8638737-dbcf-43f2-a571-afa7d83ad255 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079926 Oct 01 21:11:33.609977 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2876/4146] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Oct 1 21:11:33 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:11:34.551866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:34.553378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 3fae82d8-3dbf-480d-af10-b853fd503a47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:34.561291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:34.562324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:34.562989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:34.563699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:34.564328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:34.564970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:34.763688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:34.779548 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ab374a2-d69c-4816-aca6-58a491f5dccf tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47" status: 200 len: 1319 microversion: 2.1 time: 0.234009 Oct 01 21:11:34.780972 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2877/4147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:34 2022] GET /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:34.793836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4b4e3a2-06d1-4a53-9cf9-646d910361ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:34.798359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4b4e3a2-06d1-4a53-9cf9-646d910361ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:34.815024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b4e3a2-06d1-4a53-9cf9-646d910361ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:34.816022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b4e3a2-06d1-4a53-9cf9-646d910361ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:34.816675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b4e3a2-06d1-4a53-9cf9-646d910361ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:34.817751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b4e3a2-06d1-4a53-9cf9-646d910361ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:34.818485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b4e3a2-06d1-4a53-9cf9-646d910361ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:34.819144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4b4e3a2-06d1-4a53-9cf9-646d910361ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:34.855511 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4b4e3a2-06d1-4a53-9cf9-646d910361ab tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071629 Oct 01 21:11:34.856096 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2878/4148] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Oct 1 21:11:34 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:34.865126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7f320df8-3b78-46a4-913d-3e95723856e1 req-1f1dd2cb-d25f-448c-b8da-23fdcbf6ce02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fae82d8-3dbf-480d-af10-b853fd503a47", "name": "network-vif-plugged", "status": "completed", "tag": "77f215a1-22f0-4976-bc88-dcb08c8f6362"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:34.879648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7f320df8-3b78-46a4-913d-3e95723856e1 req-1f1dd2cb-d25f-448c-b8da-23fdcbf6ce02 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:34.880375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7f320df8-3b78-46a4-913d-3e95723856e1 req-1f1dd2cb-d25f-448c-b8da-23fdcbf6ce02 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:34.880816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7f320df8-3b78-46a4-913d-3e95723856e1 req-1f1dd2cb-d25f-448c-b8da-23fdcbf6ce02 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:34.897298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7f320df8-3b78-46a4-913d-3e95723856e1 req-1f1dd2cb-d25f-448c-b8da-23fdcbf6ce02 service nova] Creating event network-vif-plugged:77f215a1-22f0-4976-bc88-dcb08c8f6362 for instance 3fae82d8-3dbf-480d-af10-b853fd503a47 on nch1-master-1 Oct 01 21:11:34.904915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7f320df8-3b78-46a4-913d-3e95723856e1 req-1f1dd2cb-d25f-448c-b8da-23fdcbf6ce02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044404 Oct 01 21:11:34.905905 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2879/4149] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:34.940445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:34.941176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:34.948099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:34.948864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:34.949535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:34.950631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:34.951257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:34.951693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:34.982465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:11:35.134612 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6399fd7-6479-446f-8e5c-1db1464c2289 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "DELETE /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 204 len: 0 microversion: 2.20 time: 0.200305 Oct 01 21:11:35.135495 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2880/4150] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:11:34 2022] DELETE /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:11:35.149305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:35.150581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:35.160724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:35.161428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:35.161941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:35.166212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:35.167065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:35.167893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:35.340752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:35.351254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:35.354458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:35.356090 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37788acf-5de1-4780-92d3-fd4eee065363 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1722 microversion: 2.20 time: 0.215471 Oct 01 21:11:35.357000 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2881/4151] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:35 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:35.806182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:35.806855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 3fae82d8-3dbf-480d-af10-b853fd503a47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:35.814690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:35.814795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:35.815285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:35.816006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:35.816496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:35.816881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:35.973579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:35.981418 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-63068036-3cb7-4cca-a354-3a2b37699c9a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47" status: 200 len: 1319 microversion: 2.1 time: 0.180946 Oct 01 21:11:35.982001 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2882/4152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:35 2022] GET /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:36.385514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:36.386315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:36.394723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:36.395723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:36.396275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:36.397075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:36.398075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:36.398344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:36.593340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:36.597353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:36.606962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:36.609231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:36.611405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0e3eb5e7-7aec-48b5-92e6-691004f88b62 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1722 microversion: 2.20 time: 0.231875 Oct 01 21:11:36.612822 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2883/4153] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:36 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:11:37.006976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:37.008132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 3fae82d8-3dbf-480d-af10-b853fd503a47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:37.018783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.019276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.019921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.020796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.021366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.021801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.161276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:37.169557 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d205d0a-506c-4fa2-9059-f94793d7fa3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47" status: 200 len: 1506 microversion: 2.1 time: 0.167492 Oct 01 21:11:37.170482 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2884/4154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:37 2022] GET /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:37.192856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:37.193530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 3fae82d8-3dbf-480d-af10-b853fd503a47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:37.200741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.201332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.202523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.203247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.203716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.204195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.239912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 3fae82d8-3dbf-480d-af10-b853fd503a47] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:11:37.323954 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05a65b5a-add4-499f-9626-1ca8d9a02616 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47" status: 204 len: 0 microversion: 2.1 time: 0.134994 Oct 01 21:11:37.324783 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2885/4155] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:11:37 2022] DELETE /compute/v2.1/servers/3fae82d8-3dbf-480d-af10-b853fd503a47 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:11:37.335600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:37.336038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:37.346307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.346929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.347375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.348654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.350926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.351369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.399598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 179b11b7-2202-453c-9719-50805bdcf098] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:11:37.512936 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b1ddd3f3-5383-4a82-93a2-c891b1408b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098" status: 204 len: 0 microversion: 2.1 time: 0.181731 Oct 01 21:11:37.513838 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2886/4156] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:11:37 2022] DELETE /compute/v2.1/servers/179b11b7-2202-453c-9719-50805bdcf098 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:11:37.529524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:37.551155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:37.552021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Searching by: {'deleted': False, 'project_id': '1215f2e4b926472794f0e60cefa2d90e'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 21:11:37.562474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.563126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.563756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.564838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.565289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.565788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.601600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 21:11:37.655766 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5636a8a9-c8dc-43e7-8868-8f77612c79ce tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.131094 Oct 01 21:11:37.656412 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2887/4157] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 21:11:37 2022] GET /compute/v2.1/servers => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:11:37.671493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:37.674851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:37.681666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.682163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.682633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.697256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.698815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.699301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.788564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:37.798798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:37.800859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:37.802264 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e83a86e7-8d06-4fa6-957f-e294c7161364 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 200 len: 1654 microversion: 2.20 time: 0.142913 Oct 01 21:11:37.802991 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2888/4158] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:37 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 1654 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:37.808244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:37.813546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:37.814406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Searching by: {'deleted': False, 'project_id': '1215f2e4b926472794f0e60cefa2d90e'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 21:11:37.820572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.821319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.821799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.822781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.823537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.824068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:37.866812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 21:11:37.924742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:37.933440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:37.934116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:37.934689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:38.179669 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc568c83-f46d-4611-9997-4aa96fec8634 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.375176 Oct 01 21:11:38.190773 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2889/4159] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 21:11:37 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:38.190773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1618824867", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "2060ddd6-21aa-409a-9dc3-2b7740b09a02"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:38.284120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] validate_networks() for [('2060ddd6-21aa-409a-9dc3-2b7740b09a02', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:11:39.114123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:11:39.115127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:11:39.116125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:11:39.117186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:11:39.118352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:11:39.149967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:39.151573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:39.154642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:39.159577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:39.160830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:39.162277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:39.214578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Getting quotas for project e763f5a0a739414b96c9346b82154f41. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:11:39.248734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Getting quotas for user f91d413b46d44b2ba9257de2f6b54955 and project e763f5a0a739414b96c9346b82154f41. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:11:39.278938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Going to run 2 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:11:39.286843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 2a393074-f6b7-45d0-a9d3-a74de8ade959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:11:39.357004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=2a393074-f6b7-45d0-a9d3-a74de8ade959,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:11:39.494674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7dfa8349-d8d9-4b42-b95d-7753f1efe7fd tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.312693 Oct 01 21:11:39.499447 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2890/4160] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:11:38 2022] POST /compute/v2.1/servers => generated 32 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 01 21:11:39.509354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b46d21c9-37b9-496e-bcac-4b18814cc8f7 req-175fa22d-eecb-4079-b083-ba9955ae8ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97be5f25-216d-464d-944b-3d6108312f20", "name": "network-vif-deleted", "tag": "a4d6a1de-27d2-4876-8b56-131f6ba7888d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:39.534636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b46d21c9-37b9-496e-bcac-4b18814cc8f7 req-175fa22d-eecb-4079-b083-ba9955ae8ae9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:39.535432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b46d21c9-37b9-496e-bcac-4b18814cc8f7 req-175fa22d-eecb-4079-b083-ba9955ae8ae9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:39.536659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b46d21c9-37b9-496e-bcac-4b18814cc8f7 req-175fa22d-eecb-4079-b083-ba9955ae8ae9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:39.556657 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b46d21c9-37b9-496e-bcac-4b18814cc8f7 req-175fa22d-eecb-4079-b083-ba9955ae8ae9 service nova] Creating event network-vif-deleted:a4d6a1de-27d2-4876-8b56-131f6ba7888d for instance 97be5f25-216d-464d-944b-3d6108312f20 on nch2-master-1 Oct 01 21:11:39.564251 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b46d21c9-37b9-496e-bcac-4b18814cc8f7 req-175fa22d-eecb-4079-b083-ba9955ae8ae9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060843 Oct 01 21:11:39.567603 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2891/4161] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:39.573322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05a22fb5-4c14-40d6-924b-2f58e303d30d tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:39.590518 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05a22fb5-4c14-40d6-924b-2f58e303d30d tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020673 Oct 01 21:11:39.591958 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2892/4162] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Oct 1 21:11:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:39.599768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:39.604363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:39.642465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:39.644332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:39.644995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:39.645990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:39.647472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:39.647973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:39.675234 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] HTTP exception thrown: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Request method failure captured: Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 HTTP/1.1 Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxXERhLbaQJrSxlUyqH4KUqwCnpzZeKyftuClfYCQAhDpvGC5wKlbCqJzUkF6UbP65JUKZM5rkvqsak_BbVmRwXbkrV7Sz1q49wWYT4jDVIxrOz5XAbY-DzS_Xg9jqs5PUZlZIzoLw56Kwxy25tmP72uP-gDZa_uqFc2CI-Bk7bVPg Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa37082733634ec688c9d6272a0d9b1d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}] Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 8d79dff848bf40fc89377e13736c527b Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '97be5f25-216d-464d-944b-3d6108312f20'} Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:39.677453 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Returning 404 to user: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fbc1163-dfeb-4b6f-83a3-c448a94c4303 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 404 len: 111 microversion: 2.20 time: 0.086289 Oct 01 21:11:39.684370 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2893/4163] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:39 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:11:39.693955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:39.700746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:39.702561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Searching by: {'deleted': False, 'project_id': 'e763f5a0a739414b96c9346b82154f41'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 21:11:39.753466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:39.753974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:39.756948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:39.759057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:39.761427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:39.761929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:39.861111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 21:11:39.934827 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aad6180c-f0b6-4bdf-b81e-dabe96d9ee1a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.250375 Oct 01 21:11:39.935504 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2894/4164] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 21:11:39 2022] GET /compute/v2.1/servers => generated 1335 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:39.941746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5bb7954d-5ca8-4fb6-baaf-a30b5e38580f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '.version_select at 0x7f4172869550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:39.974751 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5bb7954d-5ca8-4fb6-baaf-a30b5e38580f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-13264243" status: 204 len: 0 microversion: 2.20 time: 0.037810 Oct 01 21:11:39.975697 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2895/4165] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:11:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-13264243 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:11:39.987687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-87aee195-dce0-4644-854c-095201c9ceb2 req-a135cf73-f00d-4483-8949-f6239827d256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fae82d8-3dbf-480d-af10-b853fd503a47", "name": "network-vif-deleted", "tag": "77f215a1-22f0-4976-bc88-dcb08c8f6362"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:40.003035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-87aee195-dce0-4644-854c-095201c9ceb2 req-a135cf73-f00d-4483-8949-f6239827d256 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:40.004077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-87aee195-dce0-4644-854c-095201c9ceb2 req-a135cf73-f00d-4483-8949-f6239827d256 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:40.004917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-87aee195-dce0-4644-854c-095201c9ceb2 req-a135cf73-f00d-4483-8949-f6239827d256 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:40.064829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-87aee195-dce0-4644-854c-095201c9ceb2 req-a135cf73-f00d-4483-8949-f6239827d256 service nova] Creating event network-vif-deleted:77f215a1-22f0-4976-bc88-dcb08c8f6362 for instance 3fae82d8-3dbf-480d-af10-b853fd503a47 on nch1-master-1 Oct 01 21:11:40.083947 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-87aee195-dce0-4644-854c-095201c9ceb2 req-a135cf73-f00d-4483-8949-f6239827d256 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104346 Oct 01 21:11:40.085715 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2896/4166] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:40.105664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:40.106423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:40.126432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:40.128757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:40.130251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:40.134017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:40.135011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:40.136744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:40.335941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:11:40.599893 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac7ae38f-d33e-41cf-97e6-67af8efd0e43 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "DELETE /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 204 len: 0 microversion: 2.1 time: 0.510655 Oct 01 21:11:40.602416 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2897/4167] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:11:40 2022] DELETE /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:11:40.608728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b961a264-22c2-4b4e-9ed5-5c23cb7b20a4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:40.610158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b961a264-22c2-4b4e-9ed5-5c23cb7b20a4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:40.624267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:40.723907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b961a264-22c2-4b4e-9ed5-5c23cb7b20a4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:40.737784 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b961a264-22c2-4b4e-9ed5-5c23cb7b20a4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1218 microversion: 2.1 time: 0.135090 Oct 01 21:11:40.754292 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2898/4168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:40 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:40.754292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:40.754292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:40.755238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:40.755899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:40.756686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:40.757958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:40.758882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:40.759380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:41.020215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:41.024472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:41.042426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b7833d9b-0018-4497-b513-1343412331c4 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1606 microversion: 2.1 time: 0.300957 Oct 01 21:11:41.043414 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2899/4169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:40 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1606 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:41.378399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e5016e0-396e-4725-9d3b-3b9ebdf5e84a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'create', calling method: .version_select at 0x7f41727a3430>, body: {"keypair": {"name": "tempest-keypair-2138461293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKaqaBIPtFFnOxn6Cci3utkwh2pPGXL4hZs+c2RwnfjuOLyKB7IPu3A1YUC3liC3VpnNPJmWe/4l5mgbVqUDZOTNtfhV9ZcHM3ODcikJiE3r4anHBFVvF3asZXUraOOiA=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:41.405763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4e5016e0-396e-4725-9d3b-3b9ebdf5e84a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Getting quotas for project fa37082733634ec688c9d6272a0d9b1d. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:11:41.413746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4e5016e0-396e-4725-9d3b-3b9ebdf5e84a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Getting quotas for user 8d79dff848bf40fc89377e13736c527b and project fa37082733634ec688c9d6272a0d9b1d. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:11:41.443940 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4e5016e0-396e-4725-9d3b-3b9ebdf5e84a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.083440 Oct 01 21:11:41.444871 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2900/4170] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Oct 1 21:11:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 01 21:11:41.619117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e8bf7887-e655-4b0e-9b15-c6e0a65b8955 req-4ea805c5-e668-4d83-8922-0888e4bd045a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b11b7-2202-453c-9719-50805bdcf098", "name": "network-vif-deleted", "tag": "a0b57816-4cd8-4c81-a674-61f100b5b127"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:41.631920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e8bf7887-e655-4b0e-9b15-c6e0a65b8955 req-4ea805c5-e668-4d83-8922-0888e4bd045a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:41.632429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e8bf7887-e655-4b0e-9b15-c6e0a65b8955 req-4ea805c5-e668-4d83-8922-0888e4bd045a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:41.632881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e8bf7887-e655-4b0e-9b15-c6e0a65b8955 req-4ea805c5-e668-4d83-8922-0888e4bd045a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:41.646856 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e8bf7887-e655-4b0e-9b15-c6e0a65b8955 req-4ea805c5-e668-4d83-8922-0888e4bd045a service nova] Creating event network-vif-deleted:a0b57816-4cd8-4c81-a674-61f100b5b127 for instance 179b11b7-2202-453c-9719-50805bdcf098 on nch2-master-1 Oct 01 21:11:41.653355 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e8bf7887-e655-4b0e-9b15-c6e0a65b8955 req-4ea805c5-e668-4d83-8922-0888e4bd045a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039314 Oct 01 21:11:41.654306 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2901/4171] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:11:41.770132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:41.771345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:41.778748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:41.779585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:41.780482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:41.782667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:41.783408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:41.784097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:41.876309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:41.888343 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2779f89-aa97-41f2-99d1-f281a7029347 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1214 microversion: 2.1 time: 0.123272 Oct 01 21:11:41.892395 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2902/4172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:41 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:42.068261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:42.068884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:42.076640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:42.080331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:42.081047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:42.083631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:42.084277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:42.086657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:42.311933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:42.340387 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1f981e96-00a8-4504-a7cc-c547c12ea497 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1606 microversion: 2.1 time: 0.273375 Oct 01 21:11:42.343440 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2903/4173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:42 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1606 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:42.726280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ef840a65-73d5-41e3-8b3d-c8c1813a8ce4 req-1ba88046-249c-4e3d-a257-2dff4fda658d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b2a4a7-e75d-4129-bf34-21a4f58cbf58", "name": "network-vif-unplugged", "status": "completed", "tag": "e46336fe-2927-4294-8c44-23c99c640bb6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:42.754241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ef840a65-73d5-41e3-8b3d-c8c1813a8ce4 req-1ba88046-249c-4e3d-a257-2dff4fda658d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:42.754753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ef840a65-73d5-41e3-8b3d-c8c1813a8ce4 req-1ba88046-249c-4e3d-a257-2dff4fda658d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:42.755465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ef840a65-73d5-41e3-8b3d-c8c1813a8ce4 req-1ba88046-249c-4e3d-a257-2dff4fda658d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:42.777500 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ef840a65-73d5-41e3-8b3d-c8c1813a8ce4 req-1ba88046-249c-4e3d-a257-2dff4fda658d service nova] Creating event network-vif-unplugged:e46336fe-2927-4294-8c44-23c99c640bb6 for instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 on nch1-master-1 Oct 01 21:11:42.788859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ef840a65-73d5-41e3-8b3d-c8c1813a8ce4 req-1ba88046-249c-4e3d-a257-2dff4fda658d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066524 Oct 01 21:11:42.790586 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2904/4174] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:11:42.917306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:42.919154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:42.937385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:42.937954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:42.938415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:42.939455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:42.940144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:42.940903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:43.151907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:43.165541 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d1b5f48-3084-4ce7-b574-4e64528b2a71 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1276 microversion: 2.1 time: 0.251298 Oct 01 21:11:43.178648 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2905/4175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:42 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:43.369623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:43.370327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:43.381893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:43.382608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:43.383935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:43.387387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:43.387976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:43.388521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:43.724697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:43.735164 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-840d091f-e8b8-4e6c-804d-134387f25ef0 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1606 microversion: 2.1 time: 0.369498 Oct 01 21:11:43.736494 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2906/4176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:43 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1606 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:43.953081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-55289048", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "331d621d-8c17-4a0b-842e-0a1a9b8bb154"}], "security_groups": [{"name": "tempest-securitygroup--938014439"}], "key_name": "tempest-keypair-2138461293", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:44.203646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] validate_networks() for [('331d621d-8c17-4a0b-842e-0a1a9b8bb154', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:11:45.418294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:11:45.418942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:11:45.419240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:11:45.419645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:11:45.420068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:11:45.465221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:45.465730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:45.466177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:45.483392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:45.483944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:45.485035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:45.509828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Getting quotas for project fa37082733634ec688c9d6272a0d9b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:11:45.524551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Getting quotas for user 8d79dff848bf40fc89377e13736c527b and project fa37082733634ec688c9d6272a0d9b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:11:45.553235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:11:45.559866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:11:45.847770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-66d4bc22-3cfb-4080-8c9c-f8d426e46a5a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.895856 Oct 01 21:11:45.850910 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2907/4177] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 21:11:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 21:11:45.868048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:45.870062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:45.892211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:45.893149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:45.893893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:45.894825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:45.895464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:45.896061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:47.167063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:47.180219 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cade7800-7eba-401d-8f67-da235ea03dba tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1318 microversion: 2.1 time: 1.327860 Oct 01 21:11:47.195402 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2908/4178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:45 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1318 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:47.211259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:47.212353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:47.224705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:47.225651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:47.226432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:47.234389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:47.236010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:47.237521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:47.299990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:47.302069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:47.302825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:47.303403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lazy-loading 'fault' on Instance uuid 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:11:47.409303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3c9d35f6b843ef905f43d758a9bb25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1215f2e4b926472794f0e60cefa2d90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:47.423061 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e77212b5-1481-4ec7-bb17-1f4e74ae631f tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 200 len: 1258 microversion: 2.1 time: 0.224531 Oct 01 21:11:47.435027 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2909/4179] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:47 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:47.445680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9ee721a8-3bda-4734-a790-3a2c9f9f82de req-20f58151-6e2c-4726-9f70-030659412dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b2a4a7-e75d-4129-bf34-21a4f58cbf58", "name": "network-vif-deleted", "tag": "e46336fe-2927-4294-8c44-23c99c640bb6"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:47.459550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9ee721a8-3bda-4734-a790-3a2c9f9f82de req-20f58151-6e2c-4726-9f70-030659412dcc service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:47.460358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9ee721a8-3bda-4734-a790-3a2c9f9f82de req-20f58151-6e2c-4726-9f70-030659412dcc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:47.461211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9ee721a8-3bda-4734-a790-3a2c9f9f82de req-20f58151-6e2c-4726-9f70-030659412dcc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:47.478919 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9ee721a8-3bda-4734-a790-3a2c9f9f82de req-20f58151-6e2c-4726-9f70-030659412dcc service nova] Creating event network-vif-deleted:e46336fe-2927-4294-8c44-23c99c640bb6 for instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 on nch1-master-1 Oct 01 21:11:47.488485 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9ee721a8-3bda-4734-a790-3a2c9f9f82de req-20f58151-6e2c-4726-9f70-030659412dcc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048311 Oct 01 21:11:47.489479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2910/4180] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:47.497540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:47.499751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:47.507230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:47.507984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:47.508697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:47.510339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:47.511004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:47.511614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:47.604810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:47.614560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:47.616569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:47.617854 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef7b2427-386a-4d41-ba77-5b3becf6105c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1276 microversion: 2.20 time: 0.125700 Oct 01 21:11:47.618416 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2911/4181] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:47 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:47.623071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-59f12825-ffd8-4c1f-8cca-01e9dd2ed4b1 req-ab6b9ef6-4b8d-465b-8996-24eb719cf64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4fb6803-5b87-42ac-b005-b41c304ef5f1", "tag": "391b4ca4-b2a2-4966-b5d2-722f9d4f66bc"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:47.634035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-59f12825-ffd8-4c1f-8cca-01e9dd2ed4b1 req-ab6b9ef6-4b8d-465b-8996-24eb719cf64e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:47.634544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-59f12825-ffd8-4c1f-8cca-01e9dd2ed4b1 req-ab6b9ef6-4b8d-465b-8996-24eb719cf64e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:47.635155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-59f12825-ffd8-4c1f-8cca-01e9dd2ed4b1 req-ab6b9ef6-4b8d-465b-8996-24eb719cf64e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:47.648570 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-59f12825-ffd8-4c1f-8cca-01e9dd2ed4b1 req-ab6b9ef6-4b8d-465b-8996-24eb719cf64e service nova] Creating event network-changed:391b4ca4-b2a2-4966-b5d2-722f9d4f66bc for instance f4fb6803-5b87-42ac-b005-b41c304ef5f1 on nch2-master-1 Oct 01 21:11:47.653504 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-59f12825-ffd8-4c1f-8cca-01e9dd2ed4b1 req-ab6b9ef6-4b8d-465b-8996-24eb719cf64e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033732 Oct 01 21:11:47.654231 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2912/4182] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:48.224089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:48.224951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:48.231583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:48.234374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:48.235205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:48.236243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:48.237069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:48.237837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:48.902482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:48.912241 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4988227c-b885-4664-8bc8-0084cb4b3556 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1318 microversion: 2.1 time: 0.692780 Oct 01 21:11:48.924471 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2913/4183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:48 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:48.933859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:48.935146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] [instance: 62b2a4a7-e75d-4129-bf34-21a4f58cbf58] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:48.943318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:48.944459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:48.945142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:48.946338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:48.947133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:48.947582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:48.968541 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] HTTP exception thrown: Instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 could not be found. Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Request method failure captured: Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 HTTP/1.1 Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyp5n9leYmcUXyG53P-TxeR29zE3jCpu-fPkQf7TZF4TGyAg4n0PAEa4MB5g-wW1EWF-adRCEvX2-mlo6xCBsD7D3WBOYYYe6So_gJ2uIHYnkujxV8qO1DnHcRdm4fFFaEsegPPcMKQQ4Td1beCCXUbwn3Y-PWZfw4jo-pmuzVSCcQ Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 1215f2e4b926472794f0e60cefa2d90e Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersTestBootFromVolume-1669384068 Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1215f2e4b926472794f0e60cefa2d90e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1215f2e4b926472794f0e60cefa2d90e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1215f2e4b926472794f0e60cefa2d90e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1215f2e4b926472794f0e60cefa2d90e"}]}] Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersTestBootFromVolume-1669384068 Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 1215f2e4b926472794f0e60cefa2d90e Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1669384068 Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersTestBootFromVolume-1669384068-project Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 4f3c9d35f6b843ef905f43d758a9bb25 Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersTestBootFromVolume-1669384068-project Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 could not be found. Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '62b2a4a7-e75d-4129-bf34-21a4f58cbf58'} Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 could not be found. Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 could not be found. Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:11:48.970885 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:48.976119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:11:48.976119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:11:48.976119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:11:48.976119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:11:48.976119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:11:48.976119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 could not be found. Oct 01 21:11:48.976119 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:11:48.978020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Returning 404 to user: Instance 62b2a4a7-e75d-4129-bf34-21a4f58cbf58 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:11:48.979126 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3144e74b-8da8-4989-b071-878a6f1b3e22 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58" status: 404 len: 111 microversion: 2.1 time: 0.052757 Oct 01 21:11:48.979880 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2914/4184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:48 2022] GET /compute/v2.1/servers/62b2a4a7-e75d-4129-bf34-21a4f58cbf58 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:11:48.986659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:48.987790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:48.995991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:48.996786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:48.997659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:48.999182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:49.000714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:49.001446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:49.107260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:49.127776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:49.129403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:49.130631 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c0535b0-4572-45ec-8c15-9a456d58073c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1338 microversion: 2.20 time: 0.149597 Oct 01 21:11:49.135706 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2915/4185] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:48 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1338 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:49.140846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-872d67fa-0414-4375-85f6-af5c42a13383 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] Calling method '.version_select at 0x7f41727a31f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:49.184539 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-872d67fa-0414-4375-85f6-af5c42a13383 tempest-ServersTestBootFromVolume-1669384068 tempest-ServersTestBootFromVolume-1669384068-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032331356" status: 202 len: 0 microversion: 2.1 time: 0.046581 Oct 01 21:11:49.185823 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2916/4186] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 21:11:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032331356 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:11:49.508910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e0a3b550-02fc-482a-9abd-b92fc13ae2c1 req-45054e6d-83de-4e2b-af1e-5a0172bb3ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a393074-f6b7-45d0-a9d3-a74de8ade959", "tag": "7a27a9df-59e8-432f-8ccf-ba5c9fed823f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:49.528125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e0a3b550-02fc-482a-9abd-b92fc13ae2c1 req-45054e6d-83de-4e2b-af1e-5a0172bb3ae4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:49.528879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e0a3b550-02fc-482a-9abd-b92fc13ae2c1 req-45054e6d-83de-4e2b-af1e-5a0172bb3ae4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:49.529936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e0a3b550-02fc-482a-9abd-b92fc13ae2c1 req-45054e6d-83de-4e2b-af1e-5a0172bb3ae4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:49.545889 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e0a3b550-02fc-482a-9abd-b92fc13ae2c1 req-45054e6d-83de-4e2b-af1e-5a0172bb3ae4 service nova] Creating event network-changed:7a27a9df-59e8-432f-8ccf-ba5c9fed823f for instance 2a393074-f6b7-45d0-a9d3-a74de8ade959 on nch1-master-1 Oct 01 21:11:49.552289 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e0a3b550-02fc-482a-9abd-b92fc13ae2c1 req-45054e6d-83de-4e2b-af1e-5a0172bb3ae4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049795 Oct 01 21:11:49.553506 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2917/4187] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:11:49.937774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:49.938474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:49.949966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:49.951547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:49.952259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:49.953223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:49.953924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:49.954770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:50.464786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:50.487597 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-32e6f636-1988-4345-b78e-3c598ee82711 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1318 microversion: 2.1 time: 0.552797 Oct 01 21:11:50.491133 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2918/4188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:49 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:50.500890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:50.506663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:50.535414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:50.535996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:50.536410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:50.537206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:50.538392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:50.549402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:50.731824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:50.744555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:50.746151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:50.747440 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2d21277-731a-4449-a47d-76de0e38101a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1338 microversion: 2.20 time: 0.255294 Oct 01 21:11:50.763351 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2919/4189] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:50 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1338 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:51.520044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:51.524685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:51.545703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:51.545703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:51.545703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:51.545703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:51.545703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:51.545703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:51.944265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:51.969832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eae7bfcd-3acb-458f-be5a-35373ad7bd3f tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1318 microversion: 2.1 time: 0.459905 Oct 01 21:11:51.970842 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2920/4190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:51 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:51.991907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:51.992618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:52.017792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:52.018644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:52.019312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:52.020224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:52.020863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:52.021458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:52.339480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:52.349533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:52.362704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:52.366538 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e78168e0-8d37-469d-8274-6a3a5732980d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1405 microversion: 2.20 time: 0.394557 Oct 01 21:11:52.382519 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2921/4191] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:51 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:52.486206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-73e4cdfc-3b8a-49b9-b4f9-d2169b6807e2 req-bd99ac6a-d04c-4d3d-91c6-4f80e27cfdae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fb6803-5b87-42ac-b005-b41c304ef5f1", "name": "network-vif-plugged", "status": "completed", "tag": "391b4ca4-b2a2-4966-b5d2-722f9d4f66bc"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:52.512184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-73e4cdfc-3b8a-49b9-b4f9-d2169b6807e2 req-bd99ac6a-d04c-4d3d-91c6-4f80e27cfdae service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:52.512682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-73e4cdfc-3b8a-49b9-b4f9-d2169b6807e2 req-bd99ac6a-d04c-4d3d-91c6-4f80e27cfdae service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:52.513121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-73e4cdfc-3b8a-49b9-b4f9-d2169b6807e2 req-bd99ac6a-d04c-4d3d-91c6-4f80e27cfdae service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:52.556455 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-73e4cdfc-3b8a-49b9-b4f9-d2169b6807e2 req-bd99ac6a-d04c-4d3d-91c6-4f80e27cfdae service nova] Creating event network-vif-plugged:391b4ca4-b2a2-4966-b5d2-722f9d4f66bc for instance f4fb6803-5b87-42ac-b005-b41c304ef5f1 on nch2-master-1 Oct 01 21:11:52.566034 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-73e4cdfc-3b8a-49b9-b4f9-d2169b6807e2 req-bd99ac6a-d04c-4d3d-91c6-4f80e27cfdae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083554 Oct 01 21:11:52.572249 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2922/4192] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:11:52.996333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:52.997331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:53.011837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:53.011978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:53.012333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:53.013149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:53.013553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:53.014596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:53.069381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:53.374149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:53.390342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-47f8b099-c66a-4a96-a1f6-765faa217483 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1318 microversion: 2.1 time: 0.398054 Oct 01 21:11:53.395978 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2923/4193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:52 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:53.403642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:53.404874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:53.425110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:53.427652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:53.429829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:53.430918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:53.432790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:53.433802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:53.907095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:53.927783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:53.930612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:53.936729 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1ce43ef0-d023-4de4-b652-ec1c568fcf42 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1405 microversion: 2.20 time: 0.536508 Oct 01 21:11:53.937723 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2924/4194] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:53 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:53.943226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-40ab49c5-c69f-4748-aa9b-addf9b30e96d req-c1a2c88b-88a8-4067-b375-27056e4caf05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7620a7c8-10dc-46b4-ba02-f5397ddb1a13", "tag": "a4548064-3301-41dc-8a77-f87fc32359d1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:53.956530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-40ab49c5-c69f-4748-aa9b-addf9b30e96d req-c1a2c88b-88a8-4067-b375-27056e4caf05 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:53.957308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-40ab49c5-c69f-4748-aa9b-addf9b30e96d req-c1a2c88b-88a8-4067-b375-27056e4caf05 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:53.957744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-40ab49c5-c69f-4748-aa9b-addf9b30e96d req-c1a2c88b-88a8-4067-b375-27056e4caf05 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:54.002889 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-40ab49c5-c69f-4748-aa9b-addf9b30e96d req-c1a2c88b-88a8-4067-b375-27056e4caf05 service nova] Creating event network-changed:a4548064-3301-41dc-8a77-f87fc32359d1 for instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 on nch1-master-1 Oct 01 21:11:54.018392 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-40ab49c5-c69f-4748-aa9b-addf9b30e96d req-c1a2c88b-88a8-4067-b375-27056e4caf05 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078377 Oct 01 21:11:54.021223 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2925/4195] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:54.428270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:54.430810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:54.441510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:54.442083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:54.442584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:54.443500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:54.444971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:54.445668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:54.754327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:54.769231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-368a11e4-7876-4e83-9e2a-6c40cecc5dc1 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1505 microversion: 2.1 time: 0.344362 Oct 01 21:11:54.769231 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2926/4196] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:54 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:11:54.811303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:54.813066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 2a393074-f6b7-45d0-a9d3-a74de8ade959] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:54.827700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:54.828212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:54.830205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:54.831179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:54.831821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:54.832700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:55.123970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:55.134037 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6405fef5-95e0-4795-a354-db529eb1733d tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959" status: 200 len: 1318 microversion: 2.1 time: 0.328086 Oct 01 21:11:55.135783 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2927/4197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:54 2022] GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:55.141853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:55.142578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:55.150876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:55.151641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:55.152614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:55.153559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:55.154263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:55.155591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:55.491682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:55.494940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:55.509969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:55.511476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:55.512638 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-051ccb54-9130-4f44-9cc8-1113370fccc6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1405 microversion: 2.20 time: 0.375355 Oct 01 21:11:55.513218 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2928/4198] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:55 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1405 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:55.529934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-891305d2-a241-4c27-a608-f8fdbffe1f22 req-182b7a3f-5778-456a-b3ca-4850dfb9b460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a393074-f6b7-45d0-a9d3-a74de8ade959", "name": "network-vif-plugged", "status": "completed", "tag": "7a27a9df-59e8-432f-8ccf-ba5c9fed823f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:11:55.535376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=20 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:55.561456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-891305d2-a241-4c27-a608-f8fdbffe1f22 req-182b7a3f-5778-456a-b3ca-4850dfb9b460 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:55.561960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-891305d2-a241-4c27-a608-f8fdbffe1f22 req-182b7a3f-5778-456a-b3ca-4850dfb9b460 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:55.562654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-891305d2-a241-4c27-a608-f8fdbffe1f22 req-182b7a3f-5778-456a-b3ca-4850dfb9b460 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:55.589703 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-891305d2-a241-4c27-a608-f8fdbffe1f22 req-182b7a3f-5778-456a-b3ca-4850dfb9b460 service nova] Creating event network-vif-plugged:7a27a9df-59e8-432f-8ccf-ba5c9fed823f for instance 2a393074-f6b7-45d0-a9d3-a74de8ade959 on nch1-master-1 Oct 01 21:11:55.598197 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-891305d2-a241-4c27-a608-f8fdbffe1f22 req-182b7a3f-5778-456a-b3ca-4850dfb9b460 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082641 Oct 01 21:11:55.599327 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2929/4199] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:11:56.159813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:56.160626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 2a393074-f6b7-45d0-a9d3-a74de8ade959] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:56.173613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:56.174096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:56.174678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:56.175723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:56.178266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:56.178821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:56.363681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:56.374556 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f3ad867-7f1c-4976-a611-2b46c374cb3a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959" status: 200 len: 1318 microversion: 2.1 time: 0.219093 Oct 01 21:11:56.375666 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2930/4200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:56 2022] GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:56.540338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:56.541255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:56.550918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:56.551416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:56.551858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:56.552577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:56.553032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:56.553461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:56.817292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:56.826529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:56.828025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:56.831539 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-769cc847-fc50-42ec-aed3-7006be632077 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1405 microversion: 2.20 time: 0.296813 Oct 01 21:11:56.832352 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2931/4201] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:56 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:57.406632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:57.408051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 2a393074-f6b7-45d0-a9d3-a74de8ade959] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:57.429215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:57.429737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:57.430196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:57.437796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:57.439163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:57.439749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:57.660174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:57.682893 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2a6cb4a4-709d-4b9f-9836-f6dfd445214c tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959" status: 200 len: 1506 microversion: 2.1 time: 0.289436 Oct 01 21:11:57.683835 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2932/4202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:57 2022] GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:57.714069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:57.715119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 2a393074-f6b7-45d0-a9d3-a74de8ade959] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:57.729830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:57.731443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:57.734422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:57.734955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:57.735729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:57.736749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:57.737406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:57.778448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 2a393074-f6b7-45d0-a9d3-a74de8ade959] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:11:57.895884 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bcc2571b-fe70-4f64-8a13-96abea2f7d30 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959" status: 204 len: 0 microversion: 2.1 time: 0.188156 Oct 01 21:11:57.896600 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2933/4203] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:11:57 2022] DELETE /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:11:57.906570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:57.907549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:57.919010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:57.919973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:57.920422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:57.921151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:57.921672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:57.922254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:58.182023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:58.194932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:58.196481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:58.197839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-218b3e1c-f45a-47aa-a476-295e97ebcff3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1405 microversion: 2.20 time: 0.296817 Oct 01 21:11:58.199010 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2934/4204] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:57 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:11:58.220535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:58.221409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:58.230831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:58.233034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:58.234151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:58.235862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:58.236998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:58.238554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:58.289482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:11:58.410096 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6d3593ce-97d7-4c7b-bff6-2e4955052e5b tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 204 len: 0 microversion: 2.1 time: 0.209686 Oct 01 21:11:58.413482 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2935/4205] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:11:58 2022] DELETE /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:11:58.425966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:58.427109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 2a393074-f6b7-45d0-a9d3-a74de8ade959] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:58.435041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:58.435550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:58.436205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:58.436921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:58.437386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:58.437816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:58.663802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:58.680366 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b88a704a-fa94-45f7-904e-4191fa1bd776 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959" status: 200 len: 1512 microversion: 2.1 time: 0.260144 Oct 01 21:11:58.688764 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2936/4206] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:58 2022] GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:11:59.224978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:59.225669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:59.238269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:59.239564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:59.240292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:59.242146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:59.243790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:59.244707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:59.570553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:59.584081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:59.586991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:59.588811 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8dbb3d8f-dfbb-4877-bb8c-5addab14e4b6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1405 microversion: 2.20 time: 0.369070 Oct 01 21:11:59.590971 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2937/4207] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:11:59 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1405 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:11:59.705757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:11:59.706727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 2a393074-f6b7-45d0-a9d3-a74de8ade959] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:11:59.716266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:59.716871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:59.717272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:59.718023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:11:59.718718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:11:59.719150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:11:59.741906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:11:59.974210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:11:59.986717 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3feff885-0103-4ce6-8782-ef28c1ec143e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959" status: 200 len: 1512 microversion: 2.1 time: 0.284712 Oct 01 21:11:59.990143 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2938/4208] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:11:59 2022] GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959 => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:00.225755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-60b2e519-1e89-42b9-ae6b-d8046c499ad7 req-84d3e201-49e2-4248-9bcf-cca4f5a21bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a393074-f6b7-45d0-a9d3-a74de8ade959", "name": "network-vif-deleted", "tag": "7a27a9df-59e8-432f-8ccf-ba5c9fed823f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:00.237752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60b2e519-1e89-42b9-ae6b-d8046c499ad7 req-84d3e201-49e2-4248-9bcf-cca4f5a21bfd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:00.240406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60b2e519-1e89-42b9-ae6b-d8046c499ad7 req-84d3e201-49e2-4248-9bcf-cca4f5a21bfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:00.241034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60b2e519-1e89-42b9-ae6b-d8046c499ad7 req-84d3e201-49e2-4248-9bcf-cca4f5a21bfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:00.288770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-60b2e519-1e89-42b9-ae6b-d8046c499ad7 req-84d3e201-49e2-4248-9bcf-cca4f5a21bfd service nova] Creating event network-vif-deleted:7a27a9df-59e8-432f-8ccf-ba5c9fed823f for instance 2a393074-f6b7-45d0-a9d3-a74de8ade959 on nch1-master-1 Oct 01 21:12:00.294329 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-60b2e519-1e89-42b9-ae6b-d8046c499ad7 req-84d3e201-49e2-4248-9bcf-cca4f5a21bfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072499 Oct 01 21:12:00.298735 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2939/4209] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:00.692253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:00.693062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:00.705117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:00.705675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:00.706136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:00.706947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:00.707757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:00.708375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.074399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:01.088866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:01.091124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:01.092378 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-28b8e3db-34d0-40d5-a158-40d312d0ba9d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1405 microversion: 2.20 time: 0.407842 Oct 01 21:12:01.093157 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2940/4210] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:00 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:12:01.104461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cbd451b1-f995-49fe-b33c-8e615741b2ff req-9ef415dc-3335-4dd7-bcf6-58fad03b6a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7620a7c8-10dc-46b4-ba02-f5397ddb1a13", "name": "network-vif-plugged", "status": "completed", "tag": "a4548064-3301-41dc-8a77-f87fc32359d1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:01.148032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cbd451b1-f995-49fe-b33c-8e615741b2ff req-9ef415dc-3335-4dd7-bcf6-58fad03b6a8d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.148555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cbd451b1-f995-49fe-b33c-8e615741b2ff req-9ef415dc-3335-4dd7-bcf6-58fad03b6a8d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.149004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cbd451b1-f995-49fe-b33c-8e615741b2ff req-9ef415dc-3335-4dd7-bcf6-58fad03b6a8d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.185905 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cbd451b1-f995-49fe-b33c-8e615741b2ff req-9ef415dc-3335-4dd7-bcf6-58fad03b6a8d service nova] Creating event network-vif-plugged:a4548064-3301-41dc-8a77-f87fc32359d1 for instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 on nch1-master-1 Oct 01 21:12:01.202135 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cbd451b1-f995-49fe-b33c-8e615741b2ff req-9ef415dc-3335-4dd7-bcf6-58fad03b6a8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097077 Oct 01 21:12:01.203385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2941/4211] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:01.214057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:01.215183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: 2a393074-f6b7-45d0-a9d3-a74de8ade959] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:01.233105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.233936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.235109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.236527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.237231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.237937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.258098 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] HTTP exception thrown: Instance 2a393074-f6b7-45d0-a9d3-a74de8ade959 could not be found. Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Request method failure captured: Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959 HTTP/1.1 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKz1e05WnrQ-hjWsKRBQ-gD5_kbx3Qj9B3zOG-X41yrIne70vR8768_JL4orHXVIfcmznkkTRFin3ST7b8c8UBMMRc3c9f5CCfXeVaAZzeQwgo80aXehwaGENaNrVaNU6DMtB090tOceP-VU5aAjRu57rdnFGIdgcWJWe_1iEvUZSUw Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e763f5a0a739414b96c9346b82154f41 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-MultipleCreateTestJSON-241889334 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e763f5a0a739414b96c9346b82154f41", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e763f5a0a739414b96c9346b82154f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e763f5a0a739414b96c9346b82154f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e763f5a0a739414b96c9346b82154f41"}]}] Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-MultipleCreateTestJSON-241889334 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e763f5a0a739414b96c9346b82154f41 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-MultipleCreateTestJSON-241889334 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-MultipleCreateTestJSON-241889334-project Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f91d413b46d44b2ba9257de2f6b54955 Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-MultipleCreateTestJSON-241889334-project Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 2a393074-f6b7-45d0-a9d3-a74de8ade959 could not be found. Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2a393074-f6b7-45d0-a9d3-a74de8ade959'} Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a393074-f6b7-45d0-a9d3-a74de8ade959 could not be found. Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a393074-f6b7-45d0-a9d3-a74de8ade959 could not be found. Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:01.261226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:01.269208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:01.269208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:01.269208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:01.269208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:12:01.269208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:12:01.269208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a393074-f6b7-45d0-a9d3-a74de8ade959 could not be found. Oct 01 21:12:01.269208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:01.272672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Returning 404 to user: Instance 2a393074-f6b7-45d0-a9d3-a74de8ade959 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:12:01.273911 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-54c0502a-e1fd-44cd-9ad7-ba645818c5b4 tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959" status: 404 len: 111 microversion: 2.1 time: 0.068900 Oct 01 21:12:01.281337 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2942/4212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:01 2022] GET /compute/v2.1/servers/2a393074-f6b7-45d0-a9d3-a74de8ade959 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:12:01.290892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1858d33d-955e-4afe-a3f0-8d96a6136765 req-c0a8470f-8907-485c-8e42-f95ee94ebaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fb6803-5b87-42ac-b005-b41c304ef5f1", "name": "network-vif-deleted", "tag": "391b4ca4-b2a2-4966-b5d2-722f9d4f66bc"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:01.302357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1858d33d-955e-4afe-a3f0-8d96a6136765 req-c0a8470f-8907-485c-8e42-f95ee94ebaf8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.302912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1858d33d-955e-4afe-a3f0-8d96a6136765 req-c0a8470f-8907-485c-8e42-f95ee94ebaf8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.303503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1858d33d-955e-4afe-a3f0-8d96a6136765 req-c0a8470f-8907-485c-8e42-f95ee94ebaf8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.322864 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1858d33d-955e-4afe-a3f0-8d96a6136765 req-c0a8470f-8907-485c-8e42-f95ee94ebaf8 service nova] Creating event network-vif-deleted:391b4ca4-b2a2-4966-b5d2-722f9d4f66bc for instance f4fb6803-5b87-42ac-b005-b41c304ef5f1 on nch2-master-1 Oct 01 21:12:01.329361 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1858d33d-955e-4afe-a3f0-8d96a6136765 req-c0a8470f-8907-485c-8e42-f95ee94ebaf8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045018 Oct 01 21:12:01.330361 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2943/4213] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:01.336641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:01.337689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:01.348083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.348605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.349153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.350301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.351000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.352014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.397642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.398402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.399044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.400015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lazy-loading 'fault' on Instance uuid f4fb6803-5b87-42ac-b005-b41c304ef5f1 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:12:01.506607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d413b46d44b2ba9257de2f6b54955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e763f5a0a739414b96c9346b82154f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:01.518924 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f3067d53-5fe6-4a30-a4eb-75edf2ccd15e tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 200 len: 1308 microversion: 2.1 time: 0.187156 Oct 01 21:12:01.541851 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2944/4214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:01 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:01.701964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92194547-daf9-4d66-bea6-593aaab81108 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:01.702684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-92194547-daf9-4d66-bea6-593aaab81108 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:01.735812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92194547-daf9-4d66-bea6-593aaab81108 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.736376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92194547-daf9-4d66-bea6-593aaab81108 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.740941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92194547-daf9-4d66-bea6-593aaab81108 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.745678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92194547-daf9-4d66-bea6-593aaab81108 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.747043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92194547-daf9-4d66-bea6-593aaab81108 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.749859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92194547-daf9-4d66-bea6-593aaab81108 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.835687 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92194547-daf9-4d66-bea6-593aaab81108 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47/ips" status: 200 len: 149 microversion: 2.1 time: 0.141092 Oct 01 21:12:01.836683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2945/4215] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:12:01 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47/ips => generated 149 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:01.855495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07294dd9-ac7c-41ee-a684-07fa45f5d09a"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:01.866170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:01.885325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.885930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.887306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:01.888115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:01.888655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:01.889105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:02.069590 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Invalid volume: volume 07294dd9-ac7c-41ee-a684-07fa45f5d09a is already attached to instances: ec205c2f-e515-4a25-a372-64bdb58ac51b Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47/os-volume_attachments HTTP/1.1 Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 74 Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: {"volumeAttachment": {"volumeId": "07294dd9-ac7c-41ee-a684-07fa45f5d09a"}} Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid volume: volume 07294dd9-ac7c-41ee-a684-07fa45f5d09a is already attached to instances: ec205c2f-e515-4a25-a372-64bdb58ac51b Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': '2a7d7745-f988-4b08-8f7d-4899f2da6f47', 'body': {'volumeAttachment': {'volumeId': '07294dd9-ac7c-41ee-a684-07fa45f5d09a'}}} Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 07294dd9-ac7c-41ee-a684-07fa45f5d09a is already attached to instances: ec205c2f-e515-4a25-a372-64bdb58ac51b Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:12:02.074559 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 07294dd9-ac7c-41ee-a684-07fa45f5d09a is already attached to instances: ec205c2f-e515-4a25-a372-64bdb58ac51b Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 07294dd9-ac7c-41ee-a684-07fa45f5d09a is already attached to instances: ec205c2f-e515-4a25-a372-64bdb58ac51b Oct 01 21:12:02.083973 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:02.094413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 400 to user: Invalid volume: volume 07294dd9-ac7c-41ee-a684-07fa45f5d09a is already attached to instances: ec205c2f-e515-4a25-a372-64bdb58ac51b {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:12:02.097956 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71c69ae8-d086-4305-8992-521593b609be tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.252474 Oct 01 21:12:02.100933 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2946/4216] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:12:01 2022] POST /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47/os-volume_attachments => generated 174 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:12:02.112478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:02.113453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:02.123519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:02.124343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:02.124825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:02.125931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:02.126410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:02.127412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:02.170152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:12:02.319311 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b6958362-d660-497a-a227-03edb66714ac tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 204 len: 0 microversion: 2.1 time: 0.213671 Oct 01 21:12:02.325326 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2947/4217] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:12:02 2022] DELETE /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:02.334694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:02.335913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:02.348186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:02.348978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:02.350558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:02.353376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:02.354448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:02.355088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:02.621705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:02.635172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:02.638250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:02.640837 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6e654c1d-7784-4789-9087-a1b2005f83c1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1405 microversion: 2.20 time: 0.313224 Oct 01 21:12:02.658327 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2948/4218] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:02 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:02.658327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:02.658327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:02.663510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:02.667802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:02.668545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:02.670834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:02.671438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:02.672490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:03.024617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:03.055160 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8e0025ae-c315-4496-a29b-3723ef56eccf tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1680 microversion: 2.1 time: 0.411708 Oct 01 21:12:03.056655 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2949/4219] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:02 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1680 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:03.069547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:03.070176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] [instance: f4fb6803-5b87-42ac-b005-b41c304ef5f1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:03.125949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:03.127326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:03.139328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:03.140701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:03.141863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:03.162887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:03.180432 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] HTTP exception thrown: Instance f4fb6803-5b87-42ac-b005-b41c304ef5f1 could not be found. Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Request method failure captured: Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 HTTP/1.1 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKz1e05WnrQ-hjWsKRBQ-gD5_kbx3Qj9B3zOG-X41yrIne70vR8768_JL4orHXVIfcmznkkTRFin3ST7b8c8UBMMRc3c9f5CCfXeVaAZzeQwgo80aXehwaGENaNrVaNU6DMtB090tOceP-VU5aAjRu57rdnFGIdgcWJWe_1iEvUZSUw Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: e763f5a0a739414b96c9346b82154f41 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-MultipleCreateTestJSON-241889334 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e763f5a0a739414b96c9346b82154f41", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e763f5a0a739414b96c9346b82154f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e763f5a0a739414b96c9346b82154f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e763f5a0a739414b96c9346b82154f41"}]}] Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-MultipleCreateTestJSON-241889334 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: e763f5a0a739414b96c9346b82154f41 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-MultipleCreateTestJSON-241889334 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-MultipleCreateTestJSON-241889334-project Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f91d413b46d44b2ba9257de2f6b54955 Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-MultipleCreateTestJSON-241889334-project Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance f4fb6803-5b87-42ac-b005-b41c304ef5f1 could not be found. Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f4fb6803-5b87-42ac-b005-b41c304ef5f1'} Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4fb6803-5b87-42ac-b005-b41c304ef5f1 could not be found. Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4fb6803-5b87-42ac-b005-b41c304ef5f1 could not be found. Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:03.182351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:03.191420 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:03.191420 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:03.191420 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:03.191420 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:12:03.191420 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:12:03.191420 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4fb6803-5b87-42ac-b005-b41c304ef5f1 could not be found. Oct 01 21:12:03.191420 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:03.191420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] Returning 404 to user: Instance f4fb6803-5b87-42ac-b005-b41c304ef5f1 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:12:03.191420 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a8e46b9-443b-4922-93d6-a75aa88d6b8a tempest-MultipleCreateTestJSON-241889334 tempest-MultipleCreateTestJSON-241889334-project] 10.222.0.17 "GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1" status: 404 len: 111 microversion: 2.1 time: 0.129726 Oct 01 21:12:03.196353 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2950/4220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:03 2022] GET /compute/v2.1/servers/f4fb6803-5b87-42ac-b005-b41c304ef5f1 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:12:03.674417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:03.674824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:03.702448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:03.702981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:03.703431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:03.704156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:03.704622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:03.705054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:04.081778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:04.103689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:04.105467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:04.106913 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf44c072-45c9-435c-bf64-e26c2f66a4e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1597 microversion: 2.20 time: 0.437573 Oct 01 21:12:04.119916 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2951/4221] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:03 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1597 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:12:04.135798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:04.136520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:04.146211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:04.146770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:04.147224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:04.148013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:04.148489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:04.148957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:04.741136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:04.754277 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0d9f97fb-7204-4e68-8b46-84f2e6d84bd0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1680 microversion: 2.1 time: 0.629837 Oct 01 21:12:04.755438 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2952/4222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:04 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1680 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:04.769075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe2878d9-a205-47dc-8ac7-9c6066972728 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:04.771041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fe2878d9-a205-47dc-8ac7-9c6066972728 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:04.788742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe2878d9-a205-47dc-8ac7-9c6066972728 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:04.789378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe2878d9-a205-47dc-8ac7-9c6066972728 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:04.790225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe2878d9-a205-47dc-8ac7-9c6066972728 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:04.792150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe2878d9-a205-47dc-8ac7-9c6066972728 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:04.792725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe2878d9-a205-47dc-8ac7-9c6066972728 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:04.794002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe2878d9-a205-47dc-8ac7-9c6066972728 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:05.075539 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe2878d9-a205-47dc-8ac7-9c6066972728 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.318818 Oct 01 21:12:05.076818 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2953/4223] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Oct 1 21:12:04 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:12:05.605966 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:12:05.606537 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:12:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:12:05.693713 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:12:05.693901 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:12:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:12:05.782951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:05.784663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:05.796321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:05.802711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:05.804074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:05.806954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:05.810865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:05.812293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:06.243926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:06.252814 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5bdcf358-174d-4a7e-8574-2ea8d402ea99 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1613 microversion: 2.1 time: 0.475780 Oct 01 21:12:06.259407 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2954/4224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:05 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1613 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:12:07.292600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:07.293267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:07.306473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:07.309556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:07.312796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:07.313792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:07.315478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:07.315943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:07.727580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:07.741957 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4897219-084a-431d-92cd-2b9c77277a90 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1613 microversion: 2.1 time: 0.453986 Oct 01 21:12:07.742585 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2955/4225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:07 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1613 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:12:08.544009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d07128df-5394-4aad-823c-6446914db596 req-74bfd32a-cdf2-4b57-a79c-55b842b0d19c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7d7745-f988-4b08-8f7d-4899f2da6f47", "name": "network-vif-deleted", "tag": "c1469e2a-2380-4e0f-bce7-68915f2ebc54"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:08.570450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d07128df-5394-4aad-823c-6446914db596 req-74bfd32a-cdf2-4b57-a79c-55b842b0d19c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:08.571059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d07128df-5394-4aad-823c-6446914db596 req-74bfd32a-cdf2-4b57-a79c-55b842b0d19c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:08.571699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d07128df-5394-4aad-823c-6446914db596 req-74bfd32a-cdf2-4b57-a79c-55b842b0d19c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:08.601729 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d07128df-5394-4aad-823c-6446914db596 req-74bfd32a-cdf2-4b57-a79c-55b842b0d19c service nova] Creating event network-vif-deleted:c1469e2a-2380-4e0f-bce7-68915f2ebc54 for instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 on nch1-master-1 Oct 01 21:12:08.614340 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d07128df-5394-4aad-823c-6446914db596 req-74bfd32a-cdf2-4b57-a79c-55b842b0d19c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074606 Oct 01 21:12:08.621712 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2956/4226] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:12:08.774767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:08.775917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:08.788766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:08.791069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:08.793574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:08.794845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:08.795699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:08.797523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:08.835652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:08.891688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:08.892467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:08.893069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:08.893687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lazy-loading 'fault' on Instance uuid 2a7d7745-f988-4b08-8f7d-4899f2da6f47 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:12:09.165512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:09.184216 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-11a0be25-f701-4412-8002-d1792e6b999f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 200 len: 1331 microversion: 2.1 time: 0.413330 Oct 01 21:12:09.212609 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2957/4227] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:08 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 1331 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:12:10.212104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:10.213389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:10.222643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:10.223329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:10.226933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:10.228090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:10.228534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:10.228994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:10.260072 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 HTTP/1.1 Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2a7d7745-f988-4b08-8f7d-4899f2da6f47'} Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:10.261781 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:10.266776 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:10.266776 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:10.266776 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:10.266776 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:12:10.266776 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:12:10.266776 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:12:10.266776 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:10.272221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:12:10.277067 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5b8ceb16-241a-43f0-9235-8a5afc4fd5dc tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 404 len: 111 microversion: 2.1 time: 0.067129 Oct 01 21:12:10.281863 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2958/4228] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:10 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:12:10.299563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eee60c85-f27f-42c4-bad0-4702f4c8d881 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '.version_select at 0x7f41726c0ee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:10.355298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eee60c85-f27f-42c4-bad0-4702f4c8d881 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-682733507" status: 202 len: 0 microversion: 2.1 time: 0.071713 Oct 01 21:12:10.360313 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2959/4229] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 21:12:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-682733507 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:12:10.711629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b1b3268b-645e-4ab1-ac86-d6a563185c81 req-d4dd8d59-a288-47eb-884d-f4ea070c6c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7620a7c8-10dc-46b4-ba02-f5397ddb1a13", "tag": "a4548064-3301-41dc-8a77-f87fc32359d1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:10.726597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b1b3268b-645e-4ab1-ac86-d6a563185c81 req-d4dd8d59-a288-47eb-884d-f4ea070c6c68 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:10.729504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b1b3268b-645e-4ab1-ac86-d6a563185c81 req-d4dd8d59-a288-47eb-884d-f4ea070c6c68 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:10.731686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b1b3268b-645e-4ab1-ac86-d6a563185c81 req-d4dd8d59-a288-47eb-884d-f4ea070c6c68 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:10.755832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b1b3268b-645e-4ab1-ac86-d6a563185c81 req-d4dd8d59-a288-47eb-884d-f4ea070c6c68 service nova] Creating event network-changed:a4548064-3301-41dc-8a77-f87fc32359d1 for instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 on nch1-master-1 Oct 01 21:12:10.768132 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b1b3268b-645e-4ab1-ac86-d6a563185c81 req-d4dd8d59-a288-47eb-884d-f4ea070c6c68 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065386 Oct 01 21:12:10.769895 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2960/4230] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:12.056600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:12.057314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:12.067328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:12.068125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:12.068748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:12.069740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:12.070462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:12.071137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:12.207194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lazy-loading 'services' on Instance uuid ec205c2f-e515-4a25-a372-64bdb58ac51b {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:12:12.340831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb958ee2-35a8-4059-872c-7485c7e6bf45 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-volume_attachments/07294dd9-ac7c-41ee-a684-07fa45f5d09a" status: 202 len: 0 microversion: 2.1 time: 0.288779 Oct 01 21:12:12.341840 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2961/4231] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:12:12 2022] DELETE /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-volume_attachments/07294dd9-ac7c-41ee-a684-07fa45f5d09a => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:12:12.361656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c7a8b51-3016-47b3-a509-8392ec5d5660 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:12.365500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c7a8b51-3016-47b3-a509-8392ec5d5660 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:12.379483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c7a8b51-3016-47b3-a509-8392ec5d5660 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:12.382091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c7a8b51-3016-47b3-a509-8392ec5d5660 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:12.383221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c7a8b51-3016-47b3-a509-8392ec5d5660 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:12.384229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c7a8b51-3016-47b3-a509-8392ec5d5660 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:12.384918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c7a8b51-3016-47b3-a509-8392ec5d5660 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:12.385658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c7a8b51-3016-47b3-a509-8392ec5d5660 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:12.449433 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c7a8b51-3016-47b3-a509-8392ec5d5660 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102592 Oct 01 21:12:12.450795 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2962/4232] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:12:12 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:13.462703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4068dc9a-b3f5-4e31-9a29-08984e4e2380 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:13.466828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4068dc9a-b3f5-4e31-9a29-08984e4e2380 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:13.474602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4068dc9a-b3f5-4e31-9a29-08984e4e2380 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:13.475461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4068dc9a-b3f5-4e31-9a29-08984e4e2380 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:13.476253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4068dc9a-b3f5-4e31-9a29-08984e4e2380 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:13.477380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4068dc9a-b3f5-4e31-9a29-08984e4e2380 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:13.478417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4068dc9a-b3f5-4e31-9a29-08984e4e2380 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:13.479689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4068dc9a-b3f5-4e31-9a29-08984e4e2380 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:13.545109 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4068dc9a-b3f5-4e31-9a29-08984e4e2380 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085641 Oct 01 21:12:13.546070 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2963/4233] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:12:13 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:12:13.650117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:13.650919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:13.663457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:13.665806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:13.666565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:13.667807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:13.668567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:13.669482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:13.708405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:12:13.933533 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5fb090f2-85e4-41ed-9a42-6c4cd00791a0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 204 len: 0 microversion: 2.1 time: 0.289173 Oct 01 21:12:13.950974 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2964/4234] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:12:13 2022] DELETE /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:13.957300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:13.958027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:13.972045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:13.972554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:13.975652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:13.979982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:13.980666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:13.982999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:14.400388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:14.408919 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-837bcacd-a8a0-4d34-98ea-027432187e5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1683 microversion: 2.1 time: 0.456537 Oct 01 21:12:14.414961 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2965/4235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:13 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1683 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:15.158434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2022985902", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "2d91bbe6-1b56-400a-a72b-6645bb360bd3"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:15.268837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] validate_networks() for [('2d91bbe6-1b56-400a-a72b-6645bb360bd3', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:12:16.811967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:12:16.812655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:12:16.813046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:12:16.813567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:12:16.814590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:12:16.837281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:16.838186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:16.838973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:16.839966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:16.840685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:16.841405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:16.881014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:16.907566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:16.915671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for user a2745d6923e347939e2c67015aefadda and project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:16.956810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:12:16.971962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:12:17.089062 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-432514b4-7e81-4f38-abb0-7a92054f114e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.148921 Oct 01 21:12:17.093399 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2966/4236] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:12:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:12:17.105739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:17.112949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:17.129617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:17.133939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:17.134577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:17.135450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:17.138823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:17.140401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:17.455660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:17.469137 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1aefef3a-6388-4ca1-8158-9f2efd125b36 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1615 microversion: 2.1 time: 0.374485 Oct 01 21:12:17.473029 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2967/4237] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:17 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1615 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:17.509166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a3c8dca-8077-4c51-88c0-5d84ec4a9f94 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:17.510991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a3c8dca-8077-4c51-88c0-5d84ec4a9f94 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:18.284909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3a3c8dca-8077-4c51-88c0-5d84ec4a9f94 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:18.305781 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a3c8dca-8077-4c51-88c0-5d84ec4a9f94 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1215 microversion: 2.1 time: 0.816674 Oct 01 21:12:18.309742 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2968/4238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:17 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1215 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:18.339130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6576b9a7-0ff4-438b-9e52-62681d4417e6 req-0b327b47-a6c6-4272-a621-496cb7db225a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec205c2f-e515-4a25-a372-64bdb58ac51b", "name": "network-vif-deleted", "tag": "52eec226-a379-4f11-8bbe-ce0482e41158"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:18.425795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6576b9a7-0ff4-438b-9e52-62681d4417e6 req-0b327b47-a6c6-4272-a621-496cb7db225a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:18.432388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6576b9a7-0ff4-438b-9e52-62681d4417e6 req-0b327b47-a6c6-4272-a621-496cb7db225a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:18.434725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6576b9a7-0ff4-438b-9e52-62681d4417e6 req-0b327b47-a6c6-4272-a621-496cb7db225a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:18.487009 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6576b9a7-0ff4-438b-9e52-62681d4417e6 req-0b327b47-a6c6-4272-a621-496cb7db225a service nova] Creating event network-vif-deleted:52eec226-a379-4f11-8bbe-ce0482e41158 for instance ec205c2f-e515-4a25-a372-64bdb58ac51b on nch2-master-1 Oct 01 21:12:18.508563 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6576b9a7-0ff4-438b-9e52-62681d4417e6 req-0b327b47-a6c6-4272-a621-496cb7db225a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189836 Oct 01 21:12:18.509676 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2969/4239] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:18.535603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:18.536741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:18.556083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:18.558751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:18.563122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:18.565358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:18.568228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:18.568994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:18.671846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:18.675171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:18.678294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:18.678938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lazy-loading 'fault' on Instance uuid ec205c2f-e515-4a25-a372-64bdb58ac51b {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:12:19.264641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:19.274585 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8de854db-aa23-47fa-a7c9-444b6eaf0e14 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 200 len: 1332 microversion: 2.1 time: 0.758642 Oct 01 21:12:19.277740 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2970/4240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:18 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 1332 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:19.337312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:19.338015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:19.351537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:19.352463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:19.353118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:19.354050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:19.354740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:19.355374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:19.971943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:19.981542 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-276dea16-369c-446f-af5a-58b3eecafc1a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1267 microversion: 2.1 time: 0.648033 Oct 01 21:12:19.982428 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2971/4241] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:19 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1267 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:20.305436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:20.306617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:20.318927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:20.320477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:20.323536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:20.326384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:20.328424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:20.330092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:20.374517 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b HTTP/1.1 Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'ec205c2f-e515-4a25-a372-64bdb58ac51b'} Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:20.378149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:20.385264 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:20.385264 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:20.385264 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:20.385264 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:12:20.385264 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:12:20.385264 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:12:20.385264 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:20.393111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:12:20.395465 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b36e09a-ff61-4595-9970-59315a32861d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 404 len: 111 microversion: 2.1 time: 0.097798 Oct 01 21:12:20.398554 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2972/4242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:20 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:12:20.411559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48c5a1e4-c599-43b5-a041-c00ce44a55a7 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '.version_select at 0x7f4172ef3a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:20.469002 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48c5a1e4-c599-43b5-a041-c00ce44a55a7 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075809194" status: 202 len: 0 microversion: 2.1 time: 0.065150 Oct 01 21:12:20.473536 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2973/4243] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 21:12:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075809194 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:12:21.014857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:21.017306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:21.081654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:21.083282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:21.084065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:21.085309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:21.086112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:21.086917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:21.293758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:21.326679 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a4f360e-011e-42c2-a68c-548aa29b78e1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1273 microversion: 2.1 time: 0.321118 Oct 01 21:12:21.330075 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2974/4244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:21 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:22.295952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-31270209", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "d50186f0-72f5-4802-9058-1c086a9759bf"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:22.398746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] validate_networks() for [('d50186f0-72f5-4802-9058-1c086a9759bf', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:12:24.392951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:12:24.393539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:12:24.394559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:12:24.395766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:12:24.396653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:12:24.477159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:24.477665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:24.478115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:24.478891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:24.479354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:24.479782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:24.563551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Getting quotas for project 55864f798646443bbdfe30f8b9fbefb1. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:24.577150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Getting quotas for user 78cc9dbf1b344a35b9be09ad32549a62 and project 55864f798646443bbdfe30f8b9fbefb1. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:24.683408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:12:24.700677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:12:24.864999 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebb6ff81-b308-410b-936c-b4be8b2126fd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.866542 Oct 01 21:12:24.865804 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2975/4245] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:12:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:12:24.878933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:24.879793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:24.894840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:24.895594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:24.896233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:24.897158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:24.898620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:24.900637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:25.323540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:25.332338 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1085875d-8b74-4429-b1bd-8122bac4aa0b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1315 microversion: 2.1 time: 0.463535 Oct 01 21:12:25.336457 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2976/4246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:24 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:25.347295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-efeee2c8-3034-443d-a798-ddeeef078e9a req-733c6caa-d796-4ba7-8f4e-3657bfc06601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0228eadd-4179-4ae5-8e65-06a5d536549b", "tag": "2264f13a-b74d-49e9-a8bd-9bf1ad27d998"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:25.385778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-efeee2c8-3034-443d-a798-ddeeef078e9a req-733c6caa-d796-4ba7-8f4e-3657bfc06601 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:25.386323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-efeee2c8-3034-443d-a798-ddeeef078e9a req-733c6caa-d796-4ba7-8f4e-3657bfc06601 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:25.387263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-efeee2c8-3034-443d-a798-ddeeef078e9a req-733c6caa-d796-4ba7-8f4e-3657bfc06601 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:25.426697 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-efeee2c8-3034-443d-a798-ddeeef078e9a req-733c6caa-d796-4ba7-8f4e-3657bfc06601 service nova] Creating event network-changed:2264f13a-b74d-49e9-a8bd-9bf1ad27d998 for instance 0228eadd-4179-4ae5-8e65-06a5d536549b on nch2-master-1 Oct 01 21:12:25.440911 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-efeee2c8-3034-443d-a798-ddeeef078e9a req-733c6caa-d796-4ba7-8f4e-3657bfc06601 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102872 Oct 01 21:12:25.443744 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2977/4247] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:25.448581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c9beef1-89e1-4201-b414-0ea7bc465758 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: .version_select at 0x7f41726f2670>, body: {"keypair": {"name": "tempest-keypair-307727817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRJx5S5lckQJaYfxjt6noc2vNgUtjB9VaRZ7+//bOwMLYE7pdr/4m2tg/+n2Y4YZ6aAx/qfHh6K0DBhsd+oharnDnwBH63Lc6WZb4yQ3x+yEDpG7ZLZXdQDLFlqmW+/SQ=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:25.479454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1c9beef1-89e1-4201-b414-0ea7bc465758 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:25.504903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1c9beef1-89e1-4201-b414-0ea7bc465758 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for user 902ba44d318d4a01a510f732d27467c9 and project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:25.560253 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c9beef1-89e1-4201-b414-0ea7bc465758 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115591 Oct 01 21:12:25.561466 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2978/4248] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:12:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:25.566339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a74d9dde-5e78-49b6-8984-f5f007ee09a8 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:25.567374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a74d9dde-5e78-49b6-8984-f5f007ee09a8 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:25.688296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a74d9dde-5e78-49b6-8984-f5f007ee09a8 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:25.699363 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a74d9dde-5e78-49b6-8984-f5f007ee09a8 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1212 microversion: 2.1 time: 0.136531 Oct 01 21:12:25.700644 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2979/4249] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:25 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1212 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:25.712725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-906332308", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "62dd2b9d-9158-4d16-9ef5-ad13901cb1d2"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1230943975", "security_groups": []}, "os:scheduler_hints": {"different_host": ["8d0ab80b-299d-4091-a247-22550b0a89ed"]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:25.856606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] validate_networks() for [('62dd2b9d-9158-4d16-9ef5-ad13901cb1d2', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:12:26.076721 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:12:26.077318 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:12:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:12:27.996692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:12:28.002527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:12:28.003831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:12:28.004569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:12:28.005616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:12:28.079692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:28.080371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:28.083231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:28.084740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:28.085519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:28.086211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:28.159231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Getting quotas for project 6d1eb39d09ce4a87960e258ac890e32c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:28.178075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Getting quotas for user 484ee8f965604fa9b7f7f5a25a81d0ef and project 6d1eb39d09ce4a87960e258ac890e32c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:28.225414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:12:28.243677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:12:28.375409 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d7903fb-5468-4bb9-a80c-e887dedaf60e tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.670228 Oct 01 21:12:28.381011 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2980/4250] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:12:25 2022] POST /compute/v2.1/servers => generated 361 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:12:28.409956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:28.410638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:28.423063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:28.433117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:28.434074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:28.439224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:28.440443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:28.444454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:28.484892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:29.479067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:29.493712 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49e24c84-eebf-45ec-869c-0407be4fe8b2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1315 microversion: 2.1 time: 1.111073 Oct 01 21:12:29.494766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2981/4251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:28 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1315 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:29.515335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:29.516257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:29.526920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:29.527530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:29.527939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:29.528675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:29.533415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:29.533995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:30.659545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:30.681109 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d81acd1e-258b-4879-8c34-e6fd8e042fad tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1312 microversion: 2.1 time: 1.181122 Oct 01 21:12:30.682545 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2982/4252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:29 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1312 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:30.691973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:30.693398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:30.703627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:30.704533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:30.705251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:30.707504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:30.708251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:30.709055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:30.918073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:30.929610 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd0f4c55-8fe3-4e2b-a9aa-4c8a8c8a4566 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1299 microversion: 2.1 time: 0.245665 Oct 01 21:12:30.933533 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2983/4253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:30 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1299 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:30.953189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1904499430", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aff7b153-98c7-4cda-8b6f-d6403aba7e87"}], "security_groups": [{"name": "tempest-securitygroup--998416313"}], "key_name": "tempest-keypair-307727817", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:31.350867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] validate_networks() for [('aff7b153-98c7-4cda-8b6f-d6403aba7e87', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:12:33.479254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:12:33.479819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:12:33.480141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:12:33.480762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:12:33.481389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:12:33.493617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:33.494407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:33.495230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:33.496148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:33.497830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:33.498446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:33.531770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:33.542892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:33.556534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for user 902ba44d318d4a01a510f732d27467c9 and project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:33.581364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:12:33.584043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:12:33.696344 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d312c311-a90a-466e-b798-afaac2cbe315 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.760216 Oct 01 21:12:33.697046 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2984/4254] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:12:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:12:33.702271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:33.702958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:33.728057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:33.728574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:33.729030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:33.743218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:33.744365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:33.744947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:34.355145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:34.367819 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-692c22f5-0d2a-4704-8bb3-90cde20d7b8c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1315 microversion: 2.1 time: 0.669395 Oct 01 21:12:34.369464 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2985/4255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:33 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:34.394229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:34.394948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:34.404634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:34.406679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:34.409217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:34.412908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:34.413600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:34.416697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:35.211244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:35.243200 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c016fe01-5637-41dd-990d-87c18998395b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1312 microversion: 2.1 time: 0.868935 Oct 01 21:12:35.267588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2986/4256] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:34 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1312 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:35.280546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:35.281601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:35.289315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:35.290061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:35.290909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:35.291825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:35.292455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:35.293624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:35.441026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:35.453215 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-efc968bb-82ad-4497-847e-41c47a682b0a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1299 microversion: 2.1 time: 0.184210 Oct 01 21:12:35.454859 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2987/4257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:35 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:35.478958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-931a3669-1070-4ce3-8958-9eb9c8b78566 req-641152b8-ec2c-4203-aa1e-1d54e151d800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0228eadd-4179-4ae5-8e65-06a5d536549b", "name": "network-vif-plugged", "status": "completed", "tag": "2264f13a-b74d-49e9-a8bd-9bf1ad27d998"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:35.507250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-931a3669-1070-4ce3-8958-9eb9c8b78566 req-641152b8-ec2c-4203-aa1e-1d54e151d800 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:35.508344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-931a3669-1070-4ce3-8958-9eb9c8b78566 req-641152b8-ec2c-4203-aa1e-1d54e151d800 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:35.509476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-931a3669-1070-4ce3-8958-9eb9c8b78566 req-641152b8-ec2c-4203-aa1e-1d54e151d800 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:35.567905 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-931a3669-1070-4ce3-8958-9eb9c8b78566 req-641152b8-ec2c-4203-aa1e-1d54e151d800 service nova] Creating event network-vif-plugged:2264f13a-b74d-49e9-a8bd-9bf1ad27d998 for instance 0228eadd-4179-4ae5-8e65-06a5d536549b on nch2-master-1 Oct 01 21:12:35.583345 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-931a3669-1070-4ce3-8958-9eb9c8b78566 req-641152b8-ec2c-4203-aa1e-1d54e151d800 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123974 Oct 01 21:12:35.584786 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2988/4258] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:35.603952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-933b353a-0eb4-4f20-8a94-c937c838af4e req-972f8056-c5b8-4927-a345-7b00f0d73e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ddf335-7d36-4c99-959e-1d281a427fb4", "tag": "384a6458-4f5b-4a08-b75d-9688a5589cb7"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:35.638152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-933b353a-0eb4-4f20-8a94-c937c838af4e req-972f8056-c5b8-4927-a345-7b00f0d73e46 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:35.640087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-933b353a-0eb4-4f20-8a94-c937c838af4e req-972f8056-c5b8-4927-a345-7b00f0d73e46 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:35.643189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-933b353a-0eb4-4f20-8a94-c937c838af4e req-972f8056-c5b8-4927-a345-7b00f0d73e46 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:35.675522 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-933b353a-0eb4-4f20-8a94-c937c838af4e req-972f8056-c5b8-4927-a345-7b00f0d73e46 service nova] Creating event network-changed:384a6458-4f5b-4a08-b75d-9688a5589cb7 for instance e7ddf335-7d36-4c99-959e-1d281a427fb4 on nch1-master-1 Oct 01 21:12:35.695439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-933b353a-0eb4-4f20-8a94-c937c838af4e req-972f8056-c5b8-4927-a345-7b00f0d73e46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105744 Oct 01 21:12:35.696078 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2989/4259] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:35.701457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:35.702178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:35.725173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:35.725691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:35.726242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:35.733543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:35.734753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:35.735642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:35.869877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:35.878114 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-641a73d6-e155-4e39-bc0a-a14eae7b6487 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1299 microversion: 2.1 time: 0.180776 Oct 01 21:12:35.878770 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2990/4260] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:35 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:35.952986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2d9053ab-99a7-4eae-af2c-57292529490c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Action: 'create', calling method: .version_select at 0x7f41726d4280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1201608168", "policies": ["affinity"]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:35.973173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2d9053ab-99a7-4eae-af2c-57292529490c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:35.978758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2d9053ab-99a7-4eae-af2c-57292529490c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:36.040445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2d9053ab-99a7-4eae-af2c-57292529490c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:36.048982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-2d9053ab-99a7-4eae-af2c-57292529490c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:36.065831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2d9053ab-99a7-4eae-af2c-57292529490c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.170265 Oct 01 21:12:36.073000 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2991/4261] 10.222.0.17 () {60 vars in 1174 bytes} [Sat Oct 1 21:12:35 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:36.078864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:36.080215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:36.089096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:36.089600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:36.090603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:36.091414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:36.092109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:36.092526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:36.445738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:36.454190 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06b62380-ccbd-4a6f-8d56-91a083101769 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1315 microversion: 2.1 time: 0.379945 Oct 01 21:12:36.467150 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2992/4262] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:36 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:36.467150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76178366-ea37-410c-a266-3453820a5c07 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:36.467150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76178366-ea37-410c-a266-3453820a5c07 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:36.472574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76178366-ea37-410c-a266-3453820a5c07 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:36.472792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76178366-ea37-410c-a266-3453820a5c07 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:36.473171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76178366-ea37-410c-a266-3453820a5c07 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:36.474526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76178366-ea37-410c-a266-3453820a5c07 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:36.474526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76178366-ea37-410c-a266-3453820a5c07 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:36.474758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76178366-ea37-410c-a266-3453820a5c07 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:36.518862 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76178366-ea37-410c-a266-3453820a5c07 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/ips" status: 200 len: 152 microversion: 2.20 time: 0.059888 Oct 01 21:12:36.526114 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2993/4263] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Oct 1 21:12:36 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/ips => generated 152 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:12:36.531257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-762566c4-192e-42d1-9ecc-be60622d4b3e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Action: 'create', calling method: .version_select at 0x7f41726d4b80>, body: {"server_group": {"name": "tempest-server-group-209179922", "policies": ["affinity"]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:36.572805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-762566c4-192e-42d1-9ecc-be60622d4b3e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:36.581669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-762566c4-192e-42d1-9ecc-be60622d4b3e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:36.658981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-762566c4-192e-42d1-9ecc-be60622d4b3e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:36.665950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-762566c4-192e-42d1-9ecc-be60622d4b3e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:36.683671 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-762566c4-192e-42d1-9ecc-be60622d4b3e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.156322 Oct 01 21:12:36.685220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2994/4264] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Oct 1 21:12:36 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:36.690830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:36.691751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:36.699671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:36.700896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:36.701672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:36.702787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:36.703492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:36.704422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:37.238382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:37.251363 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c537848e-9e77-4747-a662-50d3eed14fe0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1312 microversion: 2.1 time: 0.564049 Oct 01 21:12:37.252377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2995/4265] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:36 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1312 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:37.300302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:37.301248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:37.320042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:37.320561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:37.321025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:37.324773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:37.326315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:37.326830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:37.732403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:37.744386 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-09f2779e-2e43-47ee-8a0b-bbfcbfa06d5d tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1299 microversion: 2.1 time: 0.490788 Oct 01 21:12:37.747696 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2996/4266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:37 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1299 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:37.759377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95b8a638-117b-4bd0-aaf4-37e4aa955e08 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Action: 'create', calling method: .version_select at 0x7f41726c0b80>, body: {"server_group": {"name": "tempest-server-group-209179922", "policies": ["affinity"]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:37.807824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-95b8a638-117b-4bd0-aaf4-37e4aa955e08 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:37.821648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-95b8a638-117b-4bd0-aaf4-37e4aa955e08 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:37.871746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:37.911726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-95b8a638-117b-4bd0-aaf4-37e4aa955e08 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:37.919924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-95b8a638-117b-4bd0-aaf4-37e4aa955e08 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:37.954973 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95b8a638-117b-4bd0-aaf4-37e4aa955e08 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.205726 Oct 01 21:12:37.956390 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2997/4267] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Oct 1 21:12:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:37.961496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:37.962448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:37.974909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:37.975847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:37.976543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:37.977696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:37.978403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:37.979784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:38.437340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:38.445829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb2ab6d6-2990-450d-9e67-899839419458 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1366 microversion: 2.1 time: 0.488037 Oct 01 21:12:38.446564 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2998/4268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:37 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1366 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:38.452320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:38.453156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:38.459299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:38.459912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:38.460463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:38.461312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:38.461904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:38.462457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:38.636893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:38.649721 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2a083c6b-5301-47e7-aa54-0c6470ac1d29 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1503 microversion: 2.1 time: 0.201933 Oct 01 21:12:38.651816 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 2999/4269] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:38 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:38.656567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9db28e91-ee24-4c85-97c5-5874d2dbfd4f req-ac909779-cdb5-4da9-90ca-d2861fbce98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b5b192-8cbb-40a1-b00d-495d2b0345ac", "tag": "6db8f139-04ab-45b3-9590-30349d600672"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:38.666963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9db28e91-ee24-4c85-97c5-5874d2dbfd4f req-ac909779-cdb5-4da9-90ca-d2861fbce98a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:38.667669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9db28e91-ee24-4c85-97c5-5874d2dbfd4f req-ac909779-cdb5-4da9-90ca-d2861fbce98a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:38.668721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9db28e91-ee24-4c85-97c5-5874d2dbfd4f req-ac909779-cdb5-4da9-90ca-d2861fbce98a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:38.681954 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9db28e91-ee24-4c85-97c5-5874d2dbfd4f req-ac909779-cdb5-4da9-90ca-d2861fbce98a service nova] Creating event network-changed:6db8f139-04ab-45b3-9590-30349d600672 for instance 87b5b192-8cbb-40a1-b00d-495d2b0345ac on nch1-master-1 Oct 01 21:12:38.688110 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9db28e91-ee24-4c85-97c5-5874d2dbfd4f req-ac909779-cdb5-4da9-90ca-d2861fbce98a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034978 Oct 01 21:12:38.689430 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3000/4270] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:38.695597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-009c24d7-1fc4-4dc6-8db6-061af2dae2d5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:38.720996 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-009c24d7-1fc4-4dc6-8db6-061af2dae2d5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5" status: 204 len: 0 microversion: 2.1 time: 0.030529 Oct 01 21:12:38.721900 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3001/4271] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 21:12:38 2022] DELETE /compute/v2.1/os-server-groups/b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:38.729355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:38.730088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:38.737598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:38.738222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:38.738361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:38.739282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:38.739742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:38.740717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:38.988195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:39.001070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df0942d7-59b5-4623-8f9e-265ac5aa3083 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1312 microversion: 2.1 time: 0.275137 Oct 01 21:12:39.002760 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3002/4272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:38 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1312 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:39.009061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:39.009876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:39.021987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:39.023552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:39.024279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:39.025296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:39.034103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:39.035612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:39.095471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:12:39.181109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:39.239490 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3e6e92fb-6379-4316-b0ed-471341e82c62 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 204 len: 0 microversion: 2.1 time: 0.233551 Oct 01 21:12:39.239490 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3003/4273] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:12:39 2022] DELETE /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:39.246758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2b1f508-c5d3-471e-b724-2f94f4fd3a2d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:39.258594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2b1f508-c5d3-471e-b724-2f94f4fd3a2d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.017868 Oct 01 21:12:39.259375 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3004/4274] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 21:12:39 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:39.268527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:39.269746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:39.277075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:39.278304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:39.278867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:39.279665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:39.280207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:39.280748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:39.458270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:39.469544 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9dc276ae-6763-4b7c-a8ae-caa329127c81 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1299 microversion: 2.1 time: 0.205759 Oct 01 21:12:39.470296 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3005/4275] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:39 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:39.476256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-fb937ba7-94fb-4f13-9b95-3396b1800cf1 req-987ffa57-3bdb-478f-9aa9-f538b763f0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db78d504-5f23-477e-9dd6-a9914e53bb8f", "tag": "fb2f11d4-c8b2-4492-94c0-9845161b595c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:39.489798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fb937ba7-94fb-4f13-9b95-3396b1800cf1 req-987ffa57-3bdb-478f-9aa9-f538b763f0a6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:39.490293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fb937ba7-94fb-4f13-9b95-3396b1800cf1 req-987ffa57-3bdb-478f-9aa9-f538b763f0a6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:39.499044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fb937ba7-94fb-4f13-9b95-3396b1800cf1 req-987ffa57-3bdb-478f-9aa9-f538b763f0a6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:39.525897 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-fb937ba7-94fb-4f13-9b95-3396b1800cf1 req-987ffa57-3bdb-478f-9aa9-f538b763f0a6 service nova] Creating event network-changed:fb2f11d4-c8b2-4492-94c0-9845161b595c for instance db78d504-5f23-477e-9dd6-a9914e53bb8f on nch2-master-1 Oct 01 21:12:39.538089 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-fb937ba7-94fb-4f13-9b95-3396b1800cf1 req-987ffa57-3bdb-478f-9aa9-f538b763f0a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066495 Oct 01 21:12:39.541618 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3006/4276] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:39.554258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:39.555015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:39.578333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:39.578879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:39.579322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:39.580198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:39.580665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:39.581093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:39.900222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:39.913406 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1f1e500-cfb1-4b68-a12b-69ffa95d4987 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1509 microversion: 2.1 time: 0.370504 Oct 01 21:12:39.914111 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3007/4277] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:39 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:39.930844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f43d63bc-c67d-4073-ba02-0b898dd59f5c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:39.978916 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f43d63bc-c67d-4073-ba02-0b898dd59f5c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/c16733f2-9f6e-43a7-9812-c46cf9e51482" status: 204 len: 0 microversion: 2.1 time: 0.059005 Oct 01 21:12:39.979707 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3008/4278] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 21:12:39 2022] DELETE /compute/v2.1/os-server-groups/c16733f2-9f6e-43a7-9812-c46cf9e51482 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:39.986527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:39.987077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:40.000674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:40.001774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:40.001774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:40.002416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:40.002776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:40.003252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:40.055229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lazy-loading 'flavor' on Instance uuid 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:12:40.286625 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ece0b6e0-829d-492b-b86a-a1e9e123e0a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/action" status: 202 len: 0 microversion: 2.20 time: 0.305259 Oct 01 21:12:40.290259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3009/4279] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 21:12:39 2022] POST /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:40.293863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:40.294610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:40.339655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:40.340833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:40.341312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:40.342065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:40.342608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:40.343045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:40.499240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:40.507566 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-41f2654c-77cd-4b5d-a632-619a367a0607 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1366 microversion: 2.1 time: 0.219130 Oct 01 21:12:40.508470 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3010/4280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:40 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:40.513593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a8e00ded-2d86-4364-8499-466b3e995b3c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:40.528723 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a8e00ded-2d86-4364-8499-466b3e995b3c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.014629 Oct 01 21:12:40.529533 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3011/4281] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 21:12:40 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:40.534511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:40.537418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:40.544254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:40.544978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:40.545621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:40.550446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:40.551236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:40.551960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:40.713795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:40.723716 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5903213d-f6bc-4093-b646-227088dfb59b tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1312 microversion: 2.1 time: 0.192723 Oct 01 21:12:40.724587 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3012/4282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:40 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:40.729670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:40.730373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:40.742207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:40.742966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:40.743520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:40.744347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:40.744932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:40.745462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:40.969652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:40.981747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:40.983240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:40.984487 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c9b65c06-eaca-48fe-9c1b-b3b5eaa5436f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1722 microversion: 2.20 time: 0.258419 Oct 01 21:12:40.985487 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3013/4283] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:40 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:40.990294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:40.990931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:40.998574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:40.999365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.000107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:41.001078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:41.001748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.002343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:41.107956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:41.116236 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9dfe0a22-23d1-44d6-86cd-96d15a89cdd1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1299 microversion: 2.1 time: 0.129511 Oct 01 21:12:41.120931 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3014/4284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:40 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:41.127060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-645cd2fc-9a97-4905-9f05-9c32376c8cc3 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Action: 'create', calling method: .version_select at 0x7f41726c71f0>, body: {"server_group": {"name": "tempest-server-group-432754175", "policies": ["affinity"]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:41.152124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-645cd2fc-9a97-4905-9f05-9c32376c8cc3 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:41.159745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-645cd2fc-9a97-4905-9f05-9c32376c8cc3 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:41.205159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-645cd2fc-9a97-4905-9f05-9c32376c8cc3 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:41.216070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-645cd2fc-9a97-4905-9f05-9c32376c8cc3 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:41.239282 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-645cd2fc-9a97-4905-9f05-9c32376c8cc3 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.116882 Oct 01 21:12:41.239983 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3015/4285] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Oct 1 21:12:41 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:41.245597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:41.246568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:41.254593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:41.255535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.256219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:41.257371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:41.258610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.259808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:41.347972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:41.359652 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f8224313-a8c5-4136-a8e3-6b06df6bf697 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 200 len: 1467 microversion: 2.1 time: 0.117618 Oct 01 21:12:41.360459 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3016/4286] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:41 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 1467 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:41.366801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-366843d1-a94a-4228-87fc-1cee2e6cb50c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:41.398526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=8,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:41.408881 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-366843d1-a94a-4228-87fc-1cee2e6cb50c tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/218c9ca1-a408-45ad-bebe-97ce964c538b" status: 204 len: 0 microversion: 2.1 time: 0.047104 Oct 01 21:12:41.409494 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3017/4287] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 21:12:41 2022] DELETE /compute/v2.1/os-server-groups/218c9ca1-a408-45ad-bebe-97ce964c538b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:41.421630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-982ecbad-6758-45a9-a984-36ab61b50b0e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:41.437438 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-982ecbad-6758-45a9-a984-36ab61b50b0e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.021007 Oct 01 21:12:41.442669 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3018/4288] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 21:12:41 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:12:41.453557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-823234d0-4464-4218-982b-a1308853711a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Action: 'create', calling method: .version_select at 0x7f417264c550>, body: {"server_group": {"name": "tempest-server-group-1181200799", "policies": ["anti-affinity"]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:41.482261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-823234d0-4464-4218-982b-a1308853711a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:41.488953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-823234d0-4464-4218-982b-a1308853711a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:41.543794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-823234d0-4464-4218-982b-a1308853711a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:41.549996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-823234d0-4464-4218-982b-a1308853711a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_groups'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:41.567011 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-823234d0-4464-4218-982b-a1308853711a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.120096 Oct 01 21:12:41.567728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3019/4289] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Oct 1 21:12:41 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:41.572873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:41.573693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:41.581210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:41.581778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.582222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:41.582968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:41.583426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.583850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:41.740090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:41.755348 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-643478af-8196-4672-a31f-87e01e2def00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1366 microversion: 2.1 time: 0.185962 Oct 01 21:12:41.757778 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3020/4290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:41 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:41.771176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-631145c4-83cb-48ab-ba03-2e718dfb55bc req-5154fcd7-7a61-4af8-abbc-e1f0a0958ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0228eadd-4179-4ae5-8e65-06a5d536549b", "name": "network-vif-deleted", "tag": "2264f13a-b74d-49e9-a8bd-9bf1ad27d998"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:41.784554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-631145c4-83cb-48ab-ba03-2e718dfb55bc req-5154fcd7-7a61-4af8-abbc-e1f0a0958ae8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:41.785475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-631145c4-83cb-48ab-ba03-2e718dfb55bc req-5154fcd7-7a61-4af8-abbc-e1f0a0958ae8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.786028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-631145c4-83cb-48ab-ba03-2e718dfb55bc req-5154fcd7-7a61-4af8-abbc-e1f0a0958ae8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:41.823466 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-631145c4-83cb-48ab-ba03-2e718dfb55bc req-5154fcd7-7a61-4af8-abbc-e1f0a0958ae8 service nova] Creating event network-vif-deleted:2264f13a-b74d-49e9-a8bd-9bf1ad27d998 for instance 0228eadd-4179-4ae5-8e65-06a5d536549b on nch2-master-1 Oct 01 21:12:41.831584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-631145c4-83cb-48ab-ba03-2e718dfb55bc req-5154fcd7-7a61-4af8-abbc-e1f0a0958ae8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072273 Oct 01 21:12:41.832290 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3021/4291] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:41.849179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1445cd36-1012-4435-8d59-ab1ffd36ffc6 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:41.897324 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1445cd36-1012-4435-8d59-ab1ffd36ffc6 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/6df8344a-f84c-40ac-a626-01e7a2b27433" status: 204 len: 0 microversion: 2.1 time: 0.058840 Oct 01 21:12:41.898601 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3022/4292] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 21:12:41 2022] DELETE /compute/v2.1/os-server-groups/6df8344a-f84c-40ac-a626-01e7a2b27433 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:41.905431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4031c5e4-bed4-424a-ab79-7b9a40eb4c9f req-725fd99e-0956-43dd-9219-18e820fe2dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ddf335-7d36-4c99-959e-1d281a427fb4", "name": "network-vif-plugged", "status": "completed", "tag": "384a6458-4f5b-4a08-b75d-9688a5589cb7"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:41.918887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4031c5e4-bed4-424a-ab79-7b9a40eb4c9f req-725fd99e-0956-43dd-9219-18e820fe2dfd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:41.919481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4031c5e4-bed4-424a-ab79-7b9a40eb4c9f req-725fd99e-0956-43dd-9219-18e820fe2dfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.919985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4031c5e4-bed4-424a-ab79-7b9a40eb4c9f req-725fd99e-0956-43dd-9219-18e820fe2dfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:41.936856 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4031c5e4-bed4-424a-ab79-7b9a40eb4c9f req-725fd99e-0956-43dd-9219-18e820fe2dfd service nova] Creating event network-vif-plugged:384a6458-4f5b-4a08-b75d-9688a5589cb7 for instance e7ddf335-7d36-4c99-959e-1d281a427fb4 on nch1-master-1 Oct 01 21:12:41.946832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4031c5e4-bed4-424a-ab79-7b9a40eb4c9f req-725fd99e-0956-43dd-9219-18e820fe2dfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046225 Oct 01 21:12:41.947873 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3023/4293] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:41.958853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:41.959499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:41.980311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:41.980311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.981475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:41.981987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:41.982688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:41.983282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:42.271746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:42.281007 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc7f1296-4bcd-48a0-9470-408d3f24697e tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1312 microversion: 2.1 time: 0.331636 Oct 01 21:12:42.281986 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3024/4294] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:41 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:42.287062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c12621f7-069d-41f1-8c38-b7a051bbd504 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:42.307673 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c12621f7-069d-41f1-8c38-b7a051bbd504 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.024390 Oct 01 21:12:42.308274 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3025/4295] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 21:12:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:42.313234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:42.314046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:42.320597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:42.321340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:42.322181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:42.323166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:42.325061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:42.325897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:42.493280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:42.503248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:42.509784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:42.511107 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ed1f99d6-fb2b-47ca-abcd-6274a627206b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1722 microversion: 2.20 time: 0.201551 Oct 01 21:12:42.512925 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3026/4296] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:42 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:42.519321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:42.520153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:42.526903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:42.528236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:42.528861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:42.529766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:42.530229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:42.530890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:42.622600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:42.631079 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b94dc743-56a2-403c-aebb-40892eb50f98 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1299 microversion: 2.1 time: 0.116580 Oct 01 21:12:42.632276 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3027/4297] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:42 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:42.639126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1937302368", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "957df364-4f5a-49b9-8983-629df50e901d"}]}, "os:scheduler_hints": {"group": "5fe3fa01-7270-40b0-bdfa-df28f3fe48fc"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:42.696620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] validate_networks() for [('957df364-4f5a-49b9-8983-629df50e901d', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:12:43.164542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:12:43.165151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:12:43.165521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:12:43.165972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:12:43.166398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:12:43.184533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:43.185380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:43.185822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:43.186650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:43.187188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:43.187618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:43.208449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:43.213976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:43.232452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:12:43.235292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:12:43.351426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:43.362704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:43.407144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:43.415845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Getting quotas for user 3ba55fd90c52436d96ceaa933cf78a26 and project 6548b7e8d5a244f58fabbd12126808ac. Resources: {'server_group_members'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:43.444428 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87492a41-3386-4884-8bfb-9707ed026c56 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810698 Oct 01 21:12:43.445436 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3028/4298] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:12:43.450714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:43.451509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:43.459697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:43.460265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:43.460860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:43.461669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:43.462231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:43.462856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:43.478130 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b HTTP/1.1 Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0228eadd-4179-4ae5-8e65-06a5d536549b'} Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:43.479992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:43.485829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:43.485829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:43.485829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:43.485829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:12:43.485829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:12:43.485829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:12:43.485829 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:43.485829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:12:43.485829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-73bc58aa-5755-42e4-bd2e-fb36626b7afa tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 404 len: 111 microversion: 2.1 time: 0.037719 Oct 01 21:12:43.487520 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3029/4299] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:43 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:12:43.492527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:43.493281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:43.501106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:43.501696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:43.502231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:43.503421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:43.503717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:43.504324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:43.521203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:43.770914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:43.778849 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3354eebf-9a0d-4458-94a2-0f56bbf085fd tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1366 microversion: 2.1 time: 0.290416 Oct 01 21:12:43.779630 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3030/4300] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:43 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:43.784737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:43.785349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:43.788169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:43.791739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:43.792226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:43.792660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:43.793902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:43.794593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:43.795241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:43.956050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:43.966668 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef6e8d69-0259-4cb1-a5cd-3fbf7fb8bed7 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1496 microversion: 2.1 time: 0.185804 Oct 01 21:12:43.967852 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3031/4301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:43 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1496 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:43.972898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-17d6f8d5-b3e9-4ac1-b82a-ff04ed5c5a19 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:43.973519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-17d6f8d5-b3e9-4ac1-b82a-ff04ed5c5a19 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:44.045053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-17d6f8d5-b3e9-4ac1-b82a-ff04ed5c5a19 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:44.058983 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-17d6f8d5-b3e9-4ac1-b82a-ff04ed5c5a19 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1213 microversion: 2.1 time: 0.089493 Oct 01 21:12:44.060882 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3032/4302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:43 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:44.075698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:44.076642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:44.096533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:44.097183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:44.097776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:44.098644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:44.099200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:44.099718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:44.330444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:44.341639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:44.343689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:44.345941 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60647e8d-664f-4e19-839b-c7b563cc34e1 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1722 microversion: 2.20 time: 0.283629 Oct 01 21:12:44.346732 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3033/4303] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:44 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:44.372050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1211026688", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "2d91bbe6-1b56-400a-a72b-6645bb360bd3"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:44.436141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] validate_networks() for [('2d91bbe6-1b56-400a-a72b-6645bb360bd3', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:12:45.168757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:12:45.169498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:12:45.170274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:12:45.170857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:12:45.171606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:12:45.181308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:45.182000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:45.182663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:45.183943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:45.184708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:45.185283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:45.204017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:12:45.209295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for user a2745d6923e347939e2c67015aefadda and project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:12:45.223325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:12:45.225512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:12:45.285431 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-09f2dc20-309a-4ba9-9da0-63ea76cfadc4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924360 Oct 01 21:12:45.293098 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3034/4304] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:12:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:12:45.293098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:45.293098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:45.301105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:45.301608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:45.302060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:45.303346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:45.303836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:45.304367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:45.436336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:45.444767 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a62e16af-c17f-4809-87bb-169d47079cd4 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1299 microversion: 2.1 time: 0.157189 Oct 01 21:12:45.445453 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3035/4305] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:45 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:45.450835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9b5162c1-bbf0-4217-9060-757853c83083 req-e092fe8a-ca1a-4138-a1c4-7528fa2d77da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b5b192-8cbb-40a1-b00d-495d2b0345ac", "name": "network-vif-plugged", "status": "completed", "tag": "6db8f139-04ab-45b3-9590-30349d600672"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:45.460867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9b5162c1-bbf0-4217-9060-757853c83083 req-e092fe8a-ca1a-4138-a1c4-7528fa2d77da service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:45.461681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9b5162c1-bbf0-4217-9060-757853c83083 req-e092fe8a-ca1a-4138-a1c4-7528fa2d77da service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:45.462236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9b5162c1-bbf0-4217-9060-757853c83083 req-e092fe8a-ca1a-4138-a1c4-7528fa2d77da service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:45.474752 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9b5162c1-bbf0-4217-9060-757853c83083 req-e092fe8a-ca1a-4138-a1c4-7528fa2d77da service nova] Creating event network-vif-plugged:6db8f139-04ab-45b3-9590-30349d600672 for instance 87b5b192-8cbb-40a1-b00d-495d2b0345ac on nch1-master-1 Oct 01 21:12:45.481031 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9b5162c1-bbf0-4217-9060-757853c83083 req-e092fe8a-ca1a-4138-a1c4-7528fa2d77da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033791 Oct 01 21:12:45.481867 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3036/4306] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:45.487754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:45.488479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:45.497712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:45.498259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:45.498699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:45.499474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:45.500047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:45.500369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:45.802672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:45.812533 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24a25091-a007-4055-bdd1-482185fa7472 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1366 microversion: 2.1 time: 0.328933 Oct 01 21:12:45.816887 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3037/4307] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:45 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:45.823622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:45.827022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:45.839033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:45.841610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:45.842089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:45.842833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:45.847261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:45.847717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:46.290680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:46.302264 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-61598fe8-716f-4352-ab58-131a4044b3e5 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1313 microversion: 2.1 time: 0.484060 Oct 01 21:12:46.303258 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3038/4308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:45 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:46.315964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:46.316619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:46.332195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:46.333176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:46.336434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:46.337392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:46.337870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:46.352426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:46.501761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:46.514116 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5a9f9e36-a113-426a-948d-80e253cfe8bd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1211 microversion: 2.1 time: 0.208266 Oct 01 21:12:46.518019 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3039/4309] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:46 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1211 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:46.539290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:46.543926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:46.566374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:46.566898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:46.567714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:46.568445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:46.568904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:46.569330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:46.877544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:46.893099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:46.896538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:46.897952 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5857443c-f429-4376-9f14-fcdeae158898 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1722 microversion: 2.20 time: 0.378934 Oct 01 21:12:46.898727 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3040/4310] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:46 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:46.903886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:46.904727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:46.912501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:46.913202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:46.913892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:46.914875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:46.915505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:46.916100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:47.146623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:47.160834 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4ee9a5c-f3d4-4d58-8c51-ab6285f97ca6 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1471 microversion: 2.1 time: 0.258356 Oct 01 21:12:47.161464 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3041/4311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:46 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:47.175008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:47.175008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:47.195160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:47.196235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:47.196818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:47.205597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:47.206115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:47.206600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:47.429207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:47.444985 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d634b4b-0a05-40e5-a6b6-ab9fcd94854f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1366 microversion: 2.1 time: 0.281078 Oct 01 21:12:47.446334 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3042/4312] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:47 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:47.453100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:47.456615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:47.464046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:47.464861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:47.465550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:47.466962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:47.467655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:47.469559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:47.611078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:47.624492 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6d5fff19-dc92-4f52-9f5d-c7a2cbf29b67 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1471 microversion: 2.1 time: 0.176728 Oct 01 21:12:47.634968 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3043/4313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:47 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:47.634968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:47.635307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:47.645045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:47.645577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:47.646025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:47.646983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:47.647972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:47.648420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:47.944510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:47.953966 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a20a1b3b-d5c6-47bb-aff2-a9a3641dadef tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1313 microversion: 2.1 time: 0.325487 Oct 01 21:12:47.954885 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3044/4314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:47 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:47.959737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cb8f9e31-a252-44bd-adbc-2b5b380f4e85 req-89d0bfa5-fe31-4591-9015-b13ad86fbd04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca59f9e-8fc1-40b4-b69b-af6fa375612f", "tag": "9ed995be-8e7c-4bb3-8a0f-587ae2b47a7c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:47.972476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cb8f9e31-a252-44bd-adbc-2b5b380f4e85 req-89d0bfa5-fe31-4591-9015-b13ad86fbd04 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:47.973096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cb8f9e31-a252-44bd-adbc-2b5b380f4e85 req-89d0bfa5-fe31-4591-9015-b13ad86fbd04 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:47.973943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cb8f9e31-a252-44bd-adbc-2b5b380f4e85 req-89d0bfa5-fe31-4591-9015-b13ad86fbd04 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:47.986551 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cb8f9e31-a252-44bd-adbc-2b5b380f4e85 req-89d0bfa5-fe31-4591-9015-b13ad86fbd04 service nova] Creating event network-changed:9ed995be-8e7c-4bb3-8a0f-587ae2b47a7c for instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f on nch2-master-1 Oct 01 21:12:47.996880 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cb8f9e31-a252-44bd-adbc-2b5b380f4e85 req-89d0bfa5-fe31-4591-9015-b13ad86fbd04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035599 Oct 01 21:12:47.997847 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3045/4315] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:48.003887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:48.004946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:48.012687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.013424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.014040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.014794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.015445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.016042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.054779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:12:48.151888 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64d7bc2f-5011-443e-8165-0a4e6bb4dd07 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 204 len: 0 microversion: 2.1 time: 0.151058 Oct 01 21:12:48.156372 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3046/4316] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:12:47 2022] DELETE /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:48.165093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-96ae8baf-12fb-4bb6-b95b-c38276e35de8 req-b88525d1-7276-4fc7-9b83-62f6ebcb889f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db78d504-5f23-477e-9dd6-a9914e53bb8f", "name": "network-vif-plugged", "status": "completed", "tag": "fb2f11d4-c8b2-4492-94c0-9845161b595c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:48.179625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-96ae8baf-12fb-4bb6-b95b-c38276e35de8 req-b88525d1-7276-4fc7-9b83-62f6ebcb889f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.180126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-96ae8baf-12fb-4bb6-b95b-c38276e35de8 req-b88525d1-7276-4fc7-9b83-62f6ebcb889f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.180625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-96ae8baf-12fb-4bb6-b95b-c38276e35de8 req-b88525d1-7276-4fc7-9b83-62f6ebcb889f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.195515 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-96ae8baf-12fb-4bb6-b95b-c38276e35de8 req-b88525d1-7276-4fc7-9b83-62f6ebcb889f service nova] Creating event network-vif-plugged:fb2f11d4-c8b2-4492-94c0-9845161b595c for instance db78d504-5f23-477e-9dd6-a9914e53bb8f on nch2-master-1 Oct 01 21:12:48.201583 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-96ae8baf-12fb-4bb6-b95b-c38276e35de8 req-b88525d1-7276-4fc7-9b83-62f6ebcb889f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043549 Oct 01 21:12:48.202258 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3047/4317] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:48.208033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:48.208799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:48.215915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.216417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.216877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.217593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.218062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.218588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.300561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:48.309587 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-802a7c74-d131-4314-95a4-c8a6f225410b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1273 microversion: 2.1 time: 0.105826 Oct 01 21:12:48.329025 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3048/4318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:48 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:48.334247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33c7dfc3-f952-459b-a65e-04671ac94706 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:48.334896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-33c7dfc3-f952-459b-a65e-04671ac94706 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:48.342175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33c7dfc3-f952-459b-a65e-04671ac94706 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.342733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33c7dfc3-f952-459b-a65e-04671ac94706 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.343196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33c7dfc3-f952-459b-a65e-04671ac94706 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.343966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33c7dfc3-f952-459b-a65e-04671ac94706 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.344446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33c7dfc3-f952-459b-a65e-04671ac94706 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.345356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33c7dfc3-f952-459b-a65e-04671ac94706 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.348204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:48.731229 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-33c7dfc3-f952-459b-a65e-04671ac94706 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1622 microversion: 2.1 time: 0.400589 Oct 01 21:12:48.734541 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3049/4319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:48 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1622 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:48.737036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:48.737691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:48.743884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.744377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.745025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.745720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.746911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.747338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.883612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:48.892820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:48.894295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:48.895631 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc7a20b4-9d10-44a2-9e13-febd23c53e06 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1722 microversion: 2.20 time: 0.162621 Oct 01 21:12:48.896232 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3050/4320] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:48 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:48.900586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:48.901348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:48.907034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.907525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.908147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:48.908844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:48.909302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:48.909727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:49.129528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:49.137828 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-929fe428-f2d3-437c-88b5-190de0160fde tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1502 microversion: 2.1 time: 0.240591 Oct 01 21:12:49.140739 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3051/4321] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:48 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:49.144757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:49.145366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:49.151533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:49.152405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:49.152537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:49.153380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:49.153845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:49.154530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:49.414352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:49.425948 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dfc433e3-ec5b-4ee6-8e76-4f59015c7352 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1366 microversion: 2.1 time: 0.285891 Oct 01 21:12:49.427216 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3052/4322] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:49 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:49.432986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87669ba7-c886-40b6-9a8e-07480386ff53 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:49.434444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87669ba7-c886-40b6-9a8e-07480386ff53 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:49.451299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87669ba7-c886-40b6-9a8e-07480386ff53 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:49.452007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87669ba7-c886-40b6-9a8e-07480386ff53 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:49.452630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87669ba7-c886-40b6-9a8e-07480386ff53 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:49.453840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87669ba7-c886-40b6-9a8e-07480386ff53 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:49.454478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87669ba7-c886-40b6-9a8e-07480386ff53 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:49.455102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87669ba7-c886-40b6-9a8e-07480386ff53 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:49.737496 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87669ba7-c886-40b6-9a8e-07480386ff53 tempest-TestSecurityGroupsBasicOps-379546270 tempest-TestSecurityGroupsBasicOps-379546270-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1913 microversion: 2.1 time: 0.308549 Oct 01 21:12:49.738278 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3053/4323] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:49 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1913 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:49.743315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:49.744037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:49.750941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:49.751543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:49.752669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:49.753867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:49.754602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:49.755259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:50.192226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:50.200857 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f47eefad-902d-4755-9dea-5d49d820eb79 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1313 microversion: 2.1 time: 0.461442 Oct 01 21:12:50.201631 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3054/4324] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:49 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:50.220559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:50.221189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:50.227670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:50.228167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:50.228663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:50.229369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:50.229827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:50.230423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:50.530988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:50.539078 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f6ae534-56be-4a82-9bc5-5f536361af2d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1315 microversion: 2.1 time: 0.323382 Oct 01 21:12:50.554594 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3055/4325] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:50 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:50.558340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:50.558955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:50.567984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:50.568647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:50.569151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:50.570129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:50.570814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:50.571448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:50.625371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:12:50.744865 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6976a798-6c25-4aaf-af9e-963cc8f8d9e2 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "DELETE /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 204 len: 0 microversion: 2.1 time: 0.193256 Oct 01 21:12:50.747364 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3056/4326] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:12:50 2022] DELETE /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:50.762145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:50.763326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:50.770857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:50.771573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:50.772484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:50.774355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:50.775070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:50.775512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:50.963187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:50.977872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:50.980666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:50.983231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a9b34de-f9e6-4622-bd9b-a149346718a3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1743 microversion: 2.20 time: 0.229388 Oct 01 21:12:50.984024 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3057/4327] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:50 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1743 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:50.989867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c51a562f-ad2b-45df-8c77-25d7925bba18 req-7116b1d9-022f-4541-ae29-a85defa4b06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4888d15-cd1d-4900-9b7d-508b742e3807", "tag": "89994420-1f10-4906-8be5-99a59bcab3ec"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:51.002565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c51a562f-ad2b-45df-8c77-25d7925bba18 req-7116b1d9-022f-4541-ae29-a85defa4b06c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.003745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c51a562f-ad2b-45df-8c77-25d7925bba18 req-7116b1d9-022f-4541-ae29-a85defa4b06c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.004748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c51a562f-ad2b-45df-8c77-25d7925bba18 req-7116b1d9-022f-4541-ae29-a85defa4b06c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.019700 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c51a562f-ad2b-45df-8c77-25d7925bba18 req-7116b1d9-022f-4541-ae29-a85defa4b06c service nova] Creating event network-changed:89994420-1f10-4906-8be5-99a59bcab3ec for instance e4888d15-cd1d-4900-9b7d-508b742e3807 on nch2-master-1 Oct 01 21:12:51.035697 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c51a562f-ad2b-45df-8c77-25d7925bba18 req-7116b1d9-022f-4541-ae29-a85defa4b06c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049515 Oct 01 21:12:51.036435 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3058/4328] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:51.048506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:51.049393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:51.057448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.057956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.059179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.059896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.060558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.060991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.142815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:51.153004 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f92b827-a41f-477e-bc75-2ccae68e49a0 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1297 microversion: 2.1 time: 0.115093 Oct 01 21:12:51.166622 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3059/4329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:51 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:51.166622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:51.166622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:51.166622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.166622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.168070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.168070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.168556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.168556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.313275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:51.318907 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b833b16d-df73-44eb-a93b-3c39a017ba85 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1555 microversion: 2.1 time: 0.163606 Oct 01 21:12:51.330566 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3060/4330] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:51 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:51.330566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4844419f-3435-457a-9eab-268d8db33f4f req-768c327f-a213-40cc-b3fe-4207ffab8bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ddf335-7d36-4c99-959e-1d281a427fb4", "name": "network-vif-deleted", "tag": "384a6458-4f5b-4a08-b75d-9688a5589cb7"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:51.336979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4844419f-3435-457a-9eab-268d8db33f4f req-768c327f-a213-40cc-b3fe-4207ffab8bab service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.337415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4844419f-3435-457a-9eab-268d8db33f4f req-768c327f-a213-40cc-b3fe-4207ffab8bab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.337833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4844419f-3435-457a-9eab-268d8db33f4f req-768c327f-a213-40cc-b3fe-4207ffab8bab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.352819 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4844419f-3435-457a-9eab-268d8db33f4f req-768c327f-a213-40cc-b3fe-4207ffab8bab service nova] Creating event network-vif-deleted:384a6458-4f5b-4a08-b75d-9688a5589cb7 for instance e7ddf335-7d36-4c99-959e-1d281a427fb4 on nch1-master-1 Oct 01 21:12:51.359398 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4844419f-3435-457a-9eab-268d8db33f4f req-768c327f-a213-40cc-b3fe-4207ffab8bab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038731 Oct 01 21:12:51.360016 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3061/4331] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:51.366194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:51.366949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:51.375035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.375603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.376183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.376822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.377657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.378169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.475729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:51.484698 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a9940f8-78c2-40e7-a705-427f7464af1a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1477 microversion: 2.1 time: 0.123368 Oct 01 21:12:51.485368 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3062/4332] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:51 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1477 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:51.489927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:51.490989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:51.497175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.497672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.498113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.499042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.499507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.499936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.637304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:51.646177 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9601461c-0ff9-4c9c-ac7a-f70d9a3ebf7b tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1313 microversion: 2.1 time: 0.159821 Oct 01 21:12:51.646792 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3063/4333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:51 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:51.651630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34f0b57a-abcf-4e91-a26d-af1373b3dc20 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:51.652123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34f0b57a-abcf-4e91-a26d-af1373b3dc20 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:51.658844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f0b57a-abcf-4e91-a26d-af1373b3dc20 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.659333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f0b57a-abcf-4e91-a26d-af1373b3dc20 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.659775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f0b57a-abcf-4e91-a26d-af1373b3dc20 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.660467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f0b57a-abcf-4e91-a26d-af1373b3dc20 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.660924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f0b57a-abcf-4e91-a26d-af1373b3dc20 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.661478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34f0b57a-abcf-4e91-a26d-af1373b3dc20 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.743204 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34f0b57a-abcf-4e91-a26d-af1373b3dc20 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095298 Oct 01 21:12:51.744253 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3064/4334] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:12:51 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:51.750700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:51.752602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:51.759229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.759730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.760179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.760926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:51.762126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:51.762631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:51.935998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:51.940043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:51.948056 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-83139c18-372a-4a25-8499-5993c3368cfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1315 microversion: 2.1 time: 0.202779 Oct 01 21:12:51.949358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3065/4335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:51 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:52.015801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:52.016464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:52.025122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:52.026262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:52.026867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:52.028291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:52.028832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:52.029384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:52.234469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:52.243321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:52.244874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:52.246112 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1702be12-5590-472a-b1ea-6979b4b3d1d8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1743 microversion: 2.20 time: 0.237854 Oct 01 21:12:52.246906 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3066/4336] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:52 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1743 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:12:52.269267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:52.269898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:52.273214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:52.277626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:52.278380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:52.279007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:52.280106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:52.280106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:52.280432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:52.318058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:52.318868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:52.319465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:52.320075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lazy-loading 'fault' on Instance uuid e7ddf335-7d36-4c99-959e-1d281a427fb4 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:12:52.505166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cc9dbf1b344a35b9be09ad32549a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55864f798646443bbdfe30f8b9fbefb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:52.518198 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0c01bbfe-be2b-42cc-bd04-ce1a6d775cfd tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 200 len: 1302 microversion: 2.1 time: 0.254228 Oct 01 21:12:52.519786 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3067/4337] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:52 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 1302 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:52.529804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:52.530772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:52.538188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:52.538914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:52.539521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:52.540619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:52.541251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:52.541885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:52.679821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:52.696804 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7fdc15bc-37cb-42ff-895e-2033de585df3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1477 microversion: 2.1 time: 0.175546 Oct 01 21:12:52.697823 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3068/4338] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:52 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1477 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:52.715519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:52.716548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:52.723328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:52.724628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:52.725277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:52.726222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:52.726927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:52.727564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.148310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:53.177352 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9242238a-5c4c-485a-b4a9-df775e68590a tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1313 microversion: 2.1 time: 0.474663 Oct 01 21:12:53.179003 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3069/4339] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:52 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:53.194845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:53.196093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:53.216438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.217188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.217658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.218402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.223766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.224262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.451363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:53.462398 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7738483f-7694-4fb4-81c1-ca34755e4e21 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1315 microversion: 2.1 time: 0.281476 Oct 01 21:12:53.475851 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3070/4340] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:53 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:53.507882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:53.514982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:53.523223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.523949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.524618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.525536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.526394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.527084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.737903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:53.752186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:53.754153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:53.757061 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dd79f3fd-c3e5-4589-8c11-4d012fa3e916 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1743 microversion: 2.20 time: 0.267124 Oct 01 21:12:53.757817 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3071/4341] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:53 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1743 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:53.765998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2a88fea5-e57d-43c2-9d65-a8f45e5d9d54 req-fbbe1566-52e8-45bb-a123-98646af7a5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca59f9e-8fc1-40b4-b69b-af6fa375612f", "name": "network-vif-plugged", "status": "completed", "tag": "9ed995be-8e7c-4bb3-8a0f-587ae2b47a7c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:53.784245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2a88fea5-e57d-43c2-9d65-a8f45e5d9d54 req-fbbe1566-52e8-45bb-a123-98646af7a5b4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.785067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2a88fea5-e57d-43c2-9d65-a8f45e5d9d54 req-fbbe1566-52e8-45bb-a123-98646af7a5b4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.785735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2a88fea5-e57d-43c2-9d65-a8f45e5d9d54 req-fbbe1566-52e8-45bb-a123-98646af7a5b4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.799836 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2a88fea5-e57d-43c2-9d65-a8f45e5d9d54 req-fbbe1566-52e8-45bb-a123-98646af7a5b4 service nova] Creating event network-vif-plugged:9ed995be-8e7c-4bb3-8a0f-587ae2b47a7c for instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f on nch2-master-1 Oct 01 21:12:53.805098 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2a88fea5-e57d-43c2-9d65-a8f45e5d9d54 req-fbbe1566-52e8-45bb-a123-98646af7a5b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045176 Oct 01 21:12:53.805708 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3072/4342] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:53.811637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d94d0f95-8c5d-4e84-aded-1ce8a326606e req-e0e24908-9e7e-4072-ae99-1f01703ee4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b5b192-8cbb-40a1-b00d-495d2b0345ac", "name": "network-vif-deleted", "tag": "6db8f139-04ab-45b3-9590-30349d600672"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:53.825157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d94d0f95-8c5d-4e84-aded-1ce8a326606e req-e0e24908-9e7e-4072-ae99-1f01703ee4f0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.825990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d94d0f95-8c5d-4e84-aded-1ce8a326606e req-e0e24908-9e7e-4072-ae99-1f01703ee4f0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.826644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d94d0f95-8c5d-4e84-aded-1ce8a326606e req-e0e24908-9e7e-4072-ae99-1f01703ee4f0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.845265 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d94d0f95-8c5d-4e84-aded-1ce8a326606e req-e0e24908-9e7e-4072-ae99-1f01703ee4f0 service nova] Creating event network-vif-deleted:6db8f139-04ab-45b3-9590-30349d600672 for instance 87b5b192-8cbb-40a1-b00d-495d2b0345ac on nch1-master-1 Oct 01 21:12:53.857584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d94d0f95-8c5d-4e84-aded-1ce8a326606e req-e0e24908-9e7e-4072-ae99-1f01703ee4f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047122 Oct 01 21:12:53.861666 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3073/4343] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:53.872331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:53.876049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] [instance: e7ddf335-7d36-4c99-959e-1d281a427fb4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:53.896947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.899185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.899652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.900426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.900946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.901890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.923438 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] HTTP exception thrown: Instance e7ddf335-7d36-4c99-959e-1d281a427fb4 could not be found. Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Request method failure captured: Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 HTTP/1.1 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0vRx_lcwRXeSgL_BMacpV0aBGbvW7bz3LaeBBCkgBRzFBmZKINtw-ETBIRHQ_BfZdYqsqpkn4ohThzSBVImeAvXYfduAfHHEAqjOMF23r7r4dKglXZcLDZNxfSMX3gjsripQFUhhs1mVgdbZ2-CoYOH5CZZ9YgFrBpbxYd0x4snzM Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 55864f798646443bbdfe30f8b9fbefb1 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesActionsTest-1835404292 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55864f798646443bbdfe30f8b9fbefb1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55864f798646443bbdfe30f8b9fbefb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55864f798646443bbdfe30f8b9fbefb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55864f798646443bbdfe30f8b9fbefb1"}]}] Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesActionsTest-1835404292 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 55864f798646443bbdfe30f8b9fbefb1 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesActionsTest-1835404292 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesActionsTest-1835404292-project Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 78cc9dbf1b344a35b9be09ad32549a62 Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesActionsTest-1835404292-project Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e7ddf335-7d36-4c99-959e-1d281a427fb4 could not be found. Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e7ddf335-7d36-4c99-959e-1d281a427fb4'} Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ddf335-7d36-4c99-959e-1d281a427fb4 could not be found. Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ddf335-7d36-4c99-959e-1d281a427fb4 could not be found. Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:53.926055 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:53.931738 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:53.931738 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:53.931738 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:53.931738 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:12:53.931738 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:12:53.931738 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ddf335-7d36-4c99-959e-1d281a427fb4 could not be found. Oct 01 21:12:53.931738 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:53.934481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] Returning 404 to user: Instance e7ddf335-7d36-4c99-959e-1d281a427fb4 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:12:53.935912 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-58022bd3-a697-4195-8788-7df276b8f468 tempest-VolumesActionsTest-1835404292 tempest-VolumesActionsTest-1835404292-project] 10.222.0.17 "GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4" status: 404 len: 111 microversion: 2.1 time: 0.072798 Oct 01 21:12:53.941603 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3074/4344] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:53 2022] GET /compute/v2.1/servers/e7ddf335-7d36-4c99-959e-1d281a427fb4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:12:53.949672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:53.950518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:53.959065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.959624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.960927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:53.961883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:53.962539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:53.963776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:54.033039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:54.033937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:54.034974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:54.035616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lazy-loading 'fault' on Instance uuid 87b5b192-8cbb-40a1-b00d-495d2b0345ac {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:12:54.145665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:54.155707 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cdce7050-dca8-4bce-9826-5718bf119be0 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 200 len: 1331 microversion: 2.1 time: 0.212741 Oct 01 21:12:54.156358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3075/4345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:53 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 1331 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:54.164078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5cff0123-5593-40bf-9a04-7adb456e191b req-f57a36f1-d5b3-46ea-af3e-35d8e611fc10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db78d504-5f23-477e-9dd6-a9914e53bb8f", "tag": "fb2f11d4-c8b2-4492-94c0-9845161b595c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:54.184887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5cff0123-5593-40bf-9a04-7adb456e191b req-f57a36f1-d5b3-46ea-af3e-35d8e611fc10 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:54.185381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5cff0123-5593-40bf-9a04-7adb456e191b req-f57a36f1-d5b3-46ea-af3e-35d8e611fc10 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:54.189399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5cff0123-5593-40bf-9a04-7adb456e191b req-f57a36f1-d5b3-46ea-af3e-35d8e611fc10 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:54.211329 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5cff0123-5593-40bf-9a04-7adb456e191b req-f57a36f1-d5b3-46ea-af3e-35d8e611fc10 service nova] Creating event network-changed:fb2f11d4-c8b2-4492-94c0-9845161b595c for instance db78d504-5f23-477e-9dd6-a9914e53bb8f on nch2-master-1 Oct 01 21:12:54.217229 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5cff0123-5593-40bf-9a04-7adb456e191b req-f57a36f1-d5b3-46ea-af3e-35d8e611fc10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059679 Oct 01 21:12:54.218190 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3076/4346] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:54.223678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:54.224692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:54.231940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:54.232988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:54.232988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:54.234062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:54.234768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:54.235291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:54.640917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:54.656472 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-209ff4ed-8176-41dc-a144-0b24f096b43d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1313 microversion: 2.1 time: 0.433522 Oct 01 21:12:54.674273 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3077/4347] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:54 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:54.691111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:54.693277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:54.710897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:54.712455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:54.715451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:54.716798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:54.718368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:54.719566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:55.103725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:55.112801 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c5cf8a6-456c-46c1-a2ec-0b38be605087 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1315 microversion: 2.1 time: 0.430577 Oct 01 21:12:55.113396 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3078/4348] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:54 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:55.125998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:55.128626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:55.138455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:55.143209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:55.143859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:55.144770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:55.147238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:55.147880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:55.200909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:55.218112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=94 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:55.523484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:55.539369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:55.548884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:55.550446 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f3fb4ff2-3e89-45cc-9967-d0c85f63136c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.432607 Oct 01 21:12:55.559377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3079/4349] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:55 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:55.565989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:55.566643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 87b5b192-8cbb-40a1-b00d-495d2b0345ac] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:55.581132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:55.583513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:55.585401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:55.588780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:55.590258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:55.591105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:55.626342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] HTTP exception thrown: Instance 87b5b192-8cbb-40a1-b00d-495d2b0345ac could not be found. Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Request method failure captured: Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac HTTP/1.1 Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKzYdJyeLiD2NeYU7fI73flbQ4aBA2xN8_bsb6C6Mk7ikV4FqumUfhBfIeJrZODUqv9iryKTh1Yp7tCT9yBL4y8fdLhM7NGaNQqtJVWv_ipv7eKs5tx3OKYkhgXh1R7PlAkBv6BBy-I9uceNDKf_L4DhK9-GqvAGV7TNlFFK0P8gcP8 Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6d1eb39d09ce4a87960e258ac890e32c Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1364365555 Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6d1eb39d09ce4a87960e258ac890e32c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6d1eb39d09ce4a87960e258ac890e32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6d1eb39d09ce4a87960e258ac890e32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6d1eb39d09ce4a87960e258ac890e32c"}]}] Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1364365555 Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6d1eb39d09ce4a87960e258ac890e32c Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1364365555 Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestSecurityGroupsBasicOps-1364365555-project Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 484ee8f965604fa9b7f7f5a25a81d0ef Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1364365555-project Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 87b5b192-8cbb-40a1-b00d-495d2b0345ac could not be found. Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '87b5b192-8cbb-40a1-b00d-495d2b0345ac'} Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b5b192-8cbb-40a1-b00d-495d2b0345ac could not be found. Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b5b192-8cbb-40a1-b00d-495d2b0345ac could not be found. Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:55.628345 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:12:55.633721 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:55.633721 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:12:55.633721 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:12:55.633721 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:12:55.633721 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:12:55.633721 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:12:55.633721 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b5b192-8cbb-40a1-b00d-495d2b0345ac could not be found. Oct 01 21:12:55.633721 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:12:55.637278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Returning 404 to user: Instance 87b5b192-8cbb-40a1-b00d-495d2b0345ac could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:12:55.638388 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1271f8be-ee27-4e65-99a8-381e145e6df1 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac" status: 404 len: 111 microversion: 2.1 time: 0.086373 Oct 01 21:12:55.641506 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3080/4350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:55 2022] GET /compute/v2.1/servers/87b5b192-8cbb-40a1-b00d-495d2b0345ac => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:12:55.681676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:55.682303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:55.692039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:55.693252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:55.694272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:55.695817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:55.696290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:55.696725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:56.036429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:56.056255 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6cd4743a-df24-47ff-869c-a18bc2841981 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1497 microversion: 2.1 time: 0.378312 Oct 01 21:12:56.060509 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3081/4351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:55 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:56.069181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e161fe91-a427-483b-b41b-fea00fb2ae9c req-31a6c8b6-db20-481a-9efe-dece4246d24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7620a7c8-10dc-46b4-ba02-f5397ddb1a13", "name": "network-vif-plugged", "status": "completed", "tag": "a4548064-3301-41dc-8a77-f87fc32359d1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:56.104797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e161fe91-a427-483b-b41b-fea00fb2ae9c req-31a6c8b6-db20-481a-9efe-dece4246d24e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:56.105635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e161fe91-a427-483b-b41b-fea00fb2ae9c req-31a6c8b6-db20-481a-9efe-dece4246d24e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:56.106533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e161fe91-a427-483b-b41b-fea00fb2ae9c req-31a6c8b6-db20-481a-9efe-dece4246d24e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:56.123167 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e161fe91-a427-483b-b41b-fea00fb2ae9c req-31a6c8b6-db20-481a-9efe-dece4246d24e service nova] Creating event network-vif-plugged:a4548064-3301-41dc-8a77-f87fc32359d1 for instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 on nch1-master-1 Oct 01 21:12:56.130956 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e161fe91-a427-483b-b41b-fea00fb2ae9c req-31a6c8b6-db20-481a-9efe-dece4246d24e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067204 Oct 01 21:12:56.132575 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3082/4352] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:56.139037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ba26063-afa1-4501-bcb5-fca767ca1b69 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:56.159725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.server_groups [None req-9ba26063-afa1-4501-bcb5-fca767ca1b69 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Querying cell 2663fce6-13d1-4945-900e-d818f7f389c0(cell1) for 1 instances {{(pid=140438) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 01 21:12:56.160703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ba26063-afa1-4501-bcb5-fca767ca1b69 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:56.161395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ba26063-afa1-4501-bcb5-fca767ca1b69 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:56.162021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ba26063-afa1-4501-bcb5-fca767ca1b69 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:56.197890 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ba26063-afa1-4501-bcb5-fca767ca1b69 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/5fe3fa01-7270-40b0-bdfa-df28f3fe48fc" status: 200 len: 222 microversion: 2.1 time: 0.063821 Oct 01 21:12:56.205463 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3083/4353] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 21:12:56 2022] GET /compute/v2.1/os-server-groups/5fe3fa01-7270-40b0-bdfa-df28f3fe48fc => generated 222 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:56.212536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:56.213622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:56.222119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:56.223668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:56.224378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:56.225283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:56.225929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:56.226603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:56.478653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:56.488081 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4234aeb-07a0-4d94-8b69-ccad91f61ea7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1315 microversion: 2.1 time: 0.279804 Oct 01 21:12:56.494436 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3084/4354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:56 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:56.500811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:56.501953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:56.508585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:56.509082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:56.509708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:56.510430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:56.511720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:56.512548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:56.571211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:12:56.598590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:12:56.748014 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ca3434b-0501-4f55-a217-18c74a02ce8f tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 204 len: 0 microversion: 2.1 time: 0.251980 Oct 01 21:12:56.748886 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3085/4355] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:12:56 2022] DELETE /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:12:56.764197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:56.764925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:56.777664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:56.779131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:56.779783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:56.780740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:56.781379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:56.781984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:57.085653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:57.096145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:57.097690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:57.113016 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1dda0c6-516c-41ed-a3e8-924d145e1e27 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.359797 Oct 01 21:12:57.118247 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3086/4356] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:56 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:57.127325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:57.128142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:57.139945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:57.141889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:57.145003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:57.146216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:57.148503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:57.149114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:57.405154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:57.418081 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6852857-6ad1-4996-b27e-2966107382ba tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1503 microversion: 2.1 time: 0.298676 Oct 01 21:12:57.442780 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3087/4357] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:57 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:57.518785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:57.519508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:57.533882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:57.535242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:57.537070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:57.538026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:57.539122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:57.540769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:57.890253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:57.899889 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2e32dd2-47e1-44af-91a3-3f126c23dea1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1315 microversion: 2.1 time: 0.387989 Oct 01 21:12:57.901336 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3088/4358] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:57 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:58.140444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:58.141421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:58.161632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:58.163253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:58.165225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:58.166368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:58.167042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:58.167718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:58.388521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:58.401262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:58.402801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:58.404527 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d0be887-8434-4cf3-b3c6-3b1e39d1dbe4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.268857 Oct 01 21:12:58.405478 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3089/4359] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:58 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:12:58.411129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-33ffea87-33f5-45be-ae43-9b58ab108557 req-2f3bc04d-f0cf-4275-8dfc-e609c156529f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4888d15-cd1d-4900-9b7d-508b742e3807", "name": "network-vif-plugged", "status": "completed", "tag": "89994420-1f10-4906-8be5-99a59bcab3ec"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:58.423358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-33ffea87-33f5-45be-ae43-9b58ab108557 req-2f3bc04d-f0cf-4275-8dfc-e609c156529f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:58.423936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-33ffea87-33f5-45be-ae43-9b58ab108557 req-2f3bc04d-f0cf-4275-8dfc-e609c156529f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:58.424729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-33ffea87-33f5-45be-ae43-9b58ab108557 req-2f3bc04d-f0cf-4275-8dfc-e609c156529f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:58.439217 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-33ffea87-33f5-45be-ae43-9b58ab108557 req-2f3bc04d-f0cf-4275-8dfc-e609c156529f service nova] Creating event network-vif-plugged:89994420-1f10-4906-8be5-99a59bcab3ec for instance e4888d15-cd1d-4900-9b7d-508b742e3807 on nch2-master-1 Oct 01 21:12:58.448534 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-33ffea87-33f5-45be-ae43-9b58ab108557 req-2f3bc04d-f0cf-4275-8dfc-e609c156529f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040836 Oct 01 21:12:58.449820 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3090/4360] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:12:58.465353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:58.468058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:58.491185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:58.491771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:58.492121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:58.493087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:58.493498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:58.493926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:58.821597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:58.851974 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23e37661-03b4-4420-9832-52a7dace1c57 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1503 microversion: 2.1 time: 0.400465 Oct 01 21:12:58.852605 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3091/4361] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:58 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1503 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:12:58.926031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:58.926690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:58.938525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:58.939439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:58.940086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:58.941068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:58.941708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:58.942314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:59.188129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:59.202960 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9d2fa106-9f67-4d95-80e4-968034be0284 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1315 microversion: 2.1 time: 0.281546 Oct 01 21:12:59.205334 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3092/4362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:12:58 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:12:59.437479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:12:59.439055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:12:59.446965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:59.447819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:59.448817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:59.450088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:59.451179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:59.452535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:12:59.750156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:59.765530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:59.767568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:12:59.769149 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8e779953-aadc-48d3-8fd8-d722441c2a0d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.335723 Oct 01 21:12:59.771113 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3093/4363] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:12:59 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:12:59.875113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d8f28212-7a9d-49f9-833f-8ba06f22b52c req-0950190a-3070-41da-9b1b-d9fe1ec7a48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca59f9e-8fc1-40b4-b69b-af6fa375612f", "name": "network-vif-deleted", "tag": "9ed995be-8e7c-4bb3-8a0f-587ae2b47a7c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:12:59.896204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8f28212-7a9d-49f9-833f-8ba06f22b52c req-0950190a-3070-41da-9b1b-d9fe1ec7a48b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:12:59.925753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8f28212-7a9d-49f9-833f-8ba06f22b52c req-0950190a-3070-41da-9b1b-d9fe1ec7a48b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:12:59.925753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8f28212-7a9d-49f9-833f-8ba06f22b52c req-0950190a-3070-41da-9b1b-d9fe1ec7a48b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:00.007610 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d8f28212-7a9d-49f9-833f-8ba06f22b52c req-0950190a-3070-41da-9b1b-d9fe1ec7a48b service nova] Creating event network-vif-deleted:9ed995be-8e7c-4bb3-8a0f-587ae2b47a7c for instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f on nch2-master-1 Oct 01 21:13:00.028232 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d8f28212-7a9d-49f9-833f-8ba06f22b52c req-0950190a-3070-41da-9b1b-d9fe1ec7a48b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157314 Oct 01 21:13:00.036333 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3094/4364] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:00.053713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:00.054816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:00.074430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:00.075219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:00.075920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:00.076974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:00.077679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:00.078356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:00.725627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba55fd90c52436d96ceaa933cf78a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548b7e8d5a244f58fabbd12126808ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:00.743328 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c70641aa-4f9c-4783-98bf-025edc9bfa49 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 200 len: 1298 microversion: 2.1 time: 0.702344 Oct 01 21:13:00.745396 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3095/4365] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:00 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 1298 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:00.755474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:00.756413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:00.772869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:00.774409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:00.775154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:00.776153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:00.780433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:00.781459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:01.020589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:01.037507 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-14bad5a9-9361-44af-acf1-1d8dd17397df tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1502 microversion: 2.1 time: 0.290268 Oct 01 21:13:01.064934 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3096/4366] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:00 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1502 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:01.070959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:01.072076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:01.088734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:01.089528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:01.090139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:01.091226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:01.093047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:01.093438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:01.541111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:01.569587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:01.575565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:01.576929 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-53ecf349-0d2a-4ff0-9820-3cd3587659cb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.510683 Oct 01 21:13:01.580824 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3097/4367] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:01 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:01.771471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:01.772082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:01.788801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:01.805678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:01.809204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:01.812903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:01.814320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:01.815162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:01.851111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] HTTP exception thrown: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Request method failure captured: Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f HTTP/1.1 Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK1DiWgVAIC2tE0qg51FkeyW_1jZtyMNpulkNkW0A9M2jJtOlaykLZkbhD3v4YqjNDXfmkSsAHow0BreDb4lkYtG1RLFYRMBqKkjyhzr-zU-xyK1eaVS0mx0mSSYCdqNZT5dDktKPF5xcrq1rNV1I3Wr02HIauyg0z2vbvtQ2ne_0XE Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6548b7e8d5a244f58fabbd12126808ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}] Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3ba55fd90c52436d96ceaa933cf78a26 Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1ca59f9e-8fc1-40b4-b69b-af6fa375612f'} Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:01.857481 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:01.862963 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:01.862963 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:01.862963 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:01.862963 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:01.862963 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:01.862963 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:01.862963 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:01.865943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Returning 404 to user: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:01.867036 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-323f5bbe-5491-4f1f-aafb-798e1471bba9 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 404 len: 111 microversion: 2.1 time: 0.100787 Oct 01 21:13:01.871735 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3098/4368] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:01 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:13:01.884670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-353a5e32-1eda-46a3-8225-1e8828284acb tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:01.937808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.server_groups [None req-353a5e32-1eda-46a3-8225-1e8828284acb tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Querying cell 2663fce6-13d1-4945-900e-d818f7f389c0(cell1) for 1 instances {{(pid=140438) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 01 21:13:01.947955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-353a5e32-1eda-46a3-8225-1e8828284acb tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:01.949129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-353a5e32-1eda-46a3-8225-1e8828284acb tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:01.949786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-353a5e32-1eda-46a3-8225-1e8828284acb tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:01.994509 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-353a5e32-1eda-46a3-8225-1e8828284acb tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.115531 Oct 01 21:13:02.000568 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3099/4369] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 21:13:01 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:02.033759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe1e1278-fb06-4055-a0df-88228a3aa95e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:02.096685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.server_groups [None req-fe1e1278-fb06-4055-a0df-88228a3aa95e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Querying cell 2663fce6-13d1-4945-900e-d818f7f389c0(cell1) for 1 instances {{(pid=140438) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 01 21:13:02.098860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe1e1278-fb06-4055-a0df-88228a3aa95e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:02.100377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe1e1278-fb06-4055-a0df-88228a3aa95e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:02.106862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe1e1278-fb06-4055-a0df-88228a3aa95e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:02.148604 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe1e1278-fb06-4055-a0df-88228a3aa95e tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/5fe3fa01-7270-40b0-bdfa-df28f3fe48fc" status: 200 len: 184 microversion: 2.1 time: 0.139788 Oct 01 21:13:02.154195 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3100/4370] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Oct 1 21:13:02 2022] GET /compute/v2.1/os-server-groups/5fe3fa01-7270-40b0-bdfa-df28f3fe48fc => generated 184 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:02.166006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:02.166540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:02.190767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:02.194220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:02.194803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:02.195574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:02.199846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:02.200673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:02.247615 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] HTTP exception thrown: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Request method failure captured: Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f HTTP/1.1 Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK1DiWgVAIC2tE0qg51FkeyW_1jZtyMNpulkNkW0A9M2jJtOlaykLZkbhD3v4YqjNDXfmkSsAHow0BreDb4lkYtG1RLFYRMBqKkjyhzr-zU-xyK1eaVS0mx0mSSYCdqNZT5dDktKPF5xcrq1rNV1I3Wr02HIauyg0z2vbvtQ2ne_0XE Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6548b7e8d5a244f58fabbd12126808ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}] Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3ba55fd90c52436d96ceaa933cf78a26 Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1ca59f9e-8fc1-40b4-b69b-af6fa375612f'} Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:13:02.252772 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Returning 404 to user: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:02.258298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-041b798b-2fcd-4e32-bfff-f224384a8a05 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 404 len: 111 microversion: 2.1 time: 0.093678 Oct 01 21:13:02.267078 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3101/4371] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:13:02 2022] DELETE /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:13:02.280650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:02.281312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] [instance: 1ca59f9e-8fc1-40b4-b69b-af6fa375612f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:02.292279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:02.292903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:02.293524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:02.295365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:02.296521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:02.297487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:02.321789 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] HTTP exception thrown: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Request method failure captured: Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f HTTP/1.1 Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK1DiWgVAIC2tE0qg51FkeyW_1jZtyMNpulkNkW0A9M2jJtOlaykLZkbhD3v4YqjNDXfmkSsAHow0BreDb4lkYtG1RLFYRMBqKkjyhzr-zU-xyK1eaVS0mx0mSSYCdqNZT5dDktKPF5xcrq1rNV1I3Wr02HIauyg0z2vbvtQ2ne_0XE Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6548b7e8d5a244f58fabbd12126808ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}] Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3ba55fd90c52436d96ceaa933cf78a26 Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '1ca59f9e-8fc1-40b4-b69b-af6fa375612f'} Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.328993 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.333618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.333618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.333618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.333618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:02.333618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:02.333618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. Oct 01 21:13:02.333618 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.335724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Returning 404 to user: Instance 1ca59f9e-8fc1-40b4-b69b-af6fa375612f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:02.336870 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a5ab512-ff3f-468b-adbd-e44a8a9a4292 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f" status: 404 len: 111 microversion: 2.1 time: 0.067220 Oct 01 21:13:02.338236 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3102/4372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:02 2022] GET /compute/v2.1/servers/1ca59f9e-8fc1-40b4-b69b-af6fa375612f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:13:02.348900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95821cef-a99e-40ad-950b-7148953cc5ee tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:02.358673 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-95821cef-a99e-40ad-950b-7148953cc5ee tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] HTTP exception thrown: Instance group 6df8344a-f84c-40ac-a626-01e7a2b27433 could not be found. Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95821cef-a99e-40ad-950b-7148953cc5ee tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Request method failure captured: Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-server-groups/6df8344a-f84c-40ac-a626-01e7a2b27433 HTTP/1.1 Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK1DiWgVAIC2tE0qg51FkeyW_1jZtyMNpulkNkW0A9M2jJtOlaykLZkbhD3v4YqjNDXfmkSsAHow0BreDb4lkYtG1RLFYRMBqKkjyhzr-zU-xyK1eaVS0mx0mSSYCdqNZT5dDktKPF5xcrq1rNV1I3Wr02HIauyg0z2vbvtQ2ne_0XE Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6548b7e8d5a244f58fabbd12126808ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}] Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3ba55fd90c52436d96ceaa933cf78a26 Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance group 6df8344a-f84c-40ac-a626-01e7a2b27433 could not be found. Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '6df8344a-f84c-40ac-a626-01e7a2b27433'} Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6df8344a-f84c-40ac-a626-01e7a2b27433 could not be found. Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6df8344a-f84c-40ac-a626-01e7a2b27433 could not be found. Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.361064 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.365542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.365542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.365542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:02.365542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:02.365542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6df8344a-f84c-40ac-a626-01e7a2b27433 could not be found. Oct 01 21:13:02.365542 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.369622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95821cef-a99e-40ad-950b-7148953cc5ee tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Returning 404 to user: Instance group 6df8344a-f84c-40ac-a626-01e7a2b27433 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:02.371601 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95821cef-a99e-40ad-950b-7148953cc5ee tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/6df8344a-f84c-40ac-a626-01e7a2b27433" status: 404 len: 117 microversion: 2.1 time: 0.028738 Oct 01 21:13:02.372972 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3103/4373] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 21:13:02 2022] DELETE /compute/v2.1/os-server-groups/6df8344a-f84c-40ac-a626-01e7a2b27433 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:13:02.400280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b86eb311-8722-4779-af4c-0e8698d8f5db tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:02.411838 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b86eb311-8722-4779-af4c-0e8698d8f5db tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] HTTP exception thrown: Instance group 218c9ca1-a408-45ad-bebe-97ce964c538b could not be found. Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b86eb311-8722-4779-af4c-0e8698d8f5db tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Request method failure captured: Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-server-groups/218c9ca1-a408-45ad-bebe-97ce964c538b HTTP/1.1 Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK1DiWgVAIC2tE0qg51FkeyW_1jZtyMNpulkNkW0A9M2jJtOlaykLZkbhD3v4YqjNDXfmkSsAHow0BreDb4lkYtG1RLFYRMBqKkjyhzr-zU-xyK1eaVS0mx0mSSYCdqNZT5dDktKPF5xcrq1rNV1I3Wr02HIauyg0z2vbvtQ2ne_0XE Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6548b7e8d5a244f58fabbd12126808ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}] Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3ba55fd90c52436d96ceaa933cf78a26 Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance group 218c9ca1-a408-45ad-bebe-97ce964c538b could not be found. Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '218c9ca1-a408-45ad-bebe-97ce964c538b'} Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 218c9ca1-a408-45ad-bebe-97ce964c538b could not be found. Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 218c9ca1-a408-45ad-bebe-97ce964c538b could not be found. Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.417168 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.421636 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.421636 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.421636 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:02.421636 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:02.421636 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 218c9ca1-a408-45ad-bebe-97ce964c538b could not be found. Oct 01 21:13:02.421636 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.421636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b86eb311-8722-4779-af4c-0e8698d8f5db tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Returning 404 to user: Instance group 218c9ca1-a408-45ad-bebe-97ce964c538b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:02.421636 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b86eb311-8722-4779-af4c-0e8698d8f5db tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/218c9ca1-a408-45ad-bebe-97ce964c538b" status: 404 len: 117 microversion: 2.1 time: 0.041463 Oct 01 21:13:02.421636 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3104/4374] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 21:13:02 2022] DELETE /compute/v2.1/os-server-groups/218c9ca1-a408-45ad-bebe-97ce964c538b => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:13:02.431916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e3b4be7-15ce-4ad3-b957-ab7109f32a46 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:02.475009 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-0e3b4be7-15ce-4ad3-b957-ab7109f32a46 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] HTTP exception thrown: Instance group c16733f2-9f6e-43a7-9812-c46cf9e51482 could not be found. Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e3b4be7-15ce-4ad3-b957-ab7109f32a46 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Request method failure captured: Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-server-groups/c16733f2-9f6e-43a7-9812-c46cf9e51482 HTTP/1.1 Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK1DiWgVAIC2tE0qg51FkeyW_1jZtyMNpulkNkW0A9M2jJtOlaykLZkbhD3v4YqjNDXfmkSsAHow0BreDb4lkYtG1RLFYRMBqKkjyhzr-zU-xyK1eaVS0mx0mSSYCdqNZT5dDktKPF5xcrq1rNV1I3Wr02HIauyg0z2vbvtQ2ne_0XE Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6548b7e8d5a244f58fabbd12126808ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}] Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3ba55fd90c52436d96ceaa933cf78a26 Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance group c16733f2-9f6e-43a7-9812-c46cf9e51482 could not be found. Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'c16733f2-9f6e-43a7-9812-c46cf9e51482'} Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c16733f2-9f6e-43a7-9812-c46cf9e51482 could not be found. Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c16733f2-9f6e-43a7-9812-c46cf9e51482 could not be found. Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.482478 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.487788 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.487788 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.487788 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:02.487788 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:02.487788 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c16733f2-9f6e-43a7-9812-c46cf9e51482 could not be found. Oct 01 21:13:02.487788 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.488303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e3b4be7-15ce-4ad3-b957-ab7109f32a46 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Returning 404 to user: Instance group c16733f2-9f6e-43a7-9812-c46cf9e51482 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:02.489111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0e3b4be7-15ce-4ad3-b957-ab7109f32a46 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/c16733f2-9f6e-43a7-9812-c46cf9e51482" status: 404 len: 117 microversion: 2.1 time: 0.061770 Oct 01 21:13:02.489705 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3105/4375] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 21:13:02 2022] DELETE /compute/v2.1/os-server-groups/c16733f2-9f6e-43a7-9812-c46cf9e51482 => generated 117 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:13:02.500790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b324b0d-4767-4b67-8335-acdc6273d479 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:02.538872 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-2b324b0d-4767-4b67-8335-acdc6273d479 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] HTTP exception thrown: Instance group b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5 could not be found. Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b324b0d-4767-4b67-8335-acdc6273d479 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Request method failure captured: Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/os-server-groups/b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5 HTTP/1.1 Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK1DiWgVAIC2tE0qg51FkeyW_1jZtyMNpulkNkW0A9M2jJtOlaykLZkbhD3v4YqjNDXfmkSsAHow0BreDb4lkYtG1RLFYRMBqKkjyhzr-zU-xyK1eaVS0mx0mSSYCdqNZT5dDktKPF5xcrq1rNV1I3Wr02HIauyg0z2vbvtQ2ne_0XE Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6548b7e8d5a244f58fabbd12126808ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6548b7e8d5a244f58fabbd12126808ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6548b7e8d5a244f58fabbd12126808ac"}]}] Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6548b7e8d5a244f58fabbd12126808ac Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerGroupTestJSON-688801042 Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3ba55fd90c52436d96ceaa933cf78a26 Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerGroupTestJSON-688801042-project Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance group b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5 could not be found. Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5'} Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5 could not be found. Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5 could not be found. Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.544605 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:02.550439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:02.550439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:02.550439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:02.550439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:02.550439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5 could not be found. Oct 01 21:13:02.550439 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:02.552322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b324b0d-4767-4b67-8335-acdc6273d479 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Returning 404 to user: Instance group b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:02.553552 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b324b0d-4767-4b67-8335-acdc6273d479 tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5" status: 404 len: 117 microversion: 2.1 time: 0.058773 Oct 01 21:13:02.554700 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3106/4376] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 21:13:02 2022] DELETE /compute/v2.1/os-server-groups/b05c2fcc-0fcb-4b76-91b3-eaebc087a7f5 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:13:02.571062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48935c11-f5b9-474e-a6a3-646025d0b46d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:02.612061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:02.635599 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48935c11-f5b9-474e-a6a3-646025d0b46d tempest-ServerGroupTestJSON-688801042 tempest-ServerGroupTestJSON-688801042-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/5fe3fa01-7270-40b0-bdfa-df28f3fe48fc" status: 204 len: 0 microversion: 2.1 time: 0.073586 Oct 01 21:13:02.637104 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3107/4377] 10.222.0.17 () {58 vars in 1266 bytes} [Sat Oct 1 21:13:02 2022] DELETE /compute/v2.1/os-server-groups/5fe3fa01-7270-40b0-bdfa-df28f3fe48fc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:13:02.642735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:02.643828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:02.657636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:02.658159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:02.658696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:02.659428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:02.659889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:02.660320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:03.283001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:03.305917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:03.314040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:03.319110 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a990767e-cfd9-47b9-8572-bd94000866d2 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.679943 Oct 01 21:13:03.334784 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3108/4378] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:02 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:03.354165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f601e57f-ded9-41ce-87b5-46aed4c87cf4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e46ec4a-c69b-4a8d-b661-2d1bc20ed360"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:03.366371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f601e57f-ded9-41ce-87b5-46aed4c87cf4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:03.390469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f601e57f-ded9-41ce-87b5-46aed4c87cf4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:03.395720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f601e57f-ded9-41ce-87b5-46aed4c87cf4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:03.396523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f601e57f-ded9-41ce-87b5-46aed4c87cf4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:03.399966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f601e57f-ded9-41ce-87b5-46aed4c87cf4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:03.402889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f601e57f-ded9-41ce-87b5-46aed4c87cf4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:03.403382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f601e57f-ded9-41ce-87b5-46aed4c87cf4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:03.873879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:03.921164 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f601e57f-ded9-41ce-87b5-46aed4c87cf4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584942 Oct 01 21:13:03.925256 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3109/4379] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:13:03 2022] POST /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807/os-volume_attachments => generated 194 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:04.351323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:04.352225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:04.384611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:04.387229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:04.387704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:04.391403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:04.394862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:04.398127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:04.751770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:04.769680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:04.772548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:04.779419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9eca4328-ff95-4369-8f8c-807ebf02b6f7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.431203 Oct 01 21:13:04.781571 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3110/4380] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:04 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:13:05.811690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:05.813098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:05.829813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:05.831786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:05.834050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:05.836064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:05.836727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:05.840391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:06.258959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:06.276160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:06.277780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:06.279053 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8a1706b1-0e77-4b62-8d8d-ebf51f0a5705 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.471537 Oct 01 21:13:06.279633 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3111/4381] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:05 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:06.295939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:06.296718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:06.314876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:06.316059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:06.316921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:06.317925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:06.319173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:06.319790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:06.378347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:13:06.639070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-46e5f3ac-272a-4796-875e-e44dcd282ec3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 204 len: 0 microversion: 2.1 time: 0.357571 Oct 01 21:13:06.640016 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3112/4382] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:13:06 2022] DELETE /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:13:06.653776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1d5c8ca2-22b5-431a-b48e-c04372297f1d req-5337cd2b-ec56-4509-b058-9790d7604d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0ab80b-299d-4091-a247-22550b0a89ed", "tag": "41fd256d-b2fc-4486-a305-577fce1c18c5"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:06.678768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d5c8ca2-22b5-431a-b48e-c04372297f1d req-5337cd2b-ec56-4509-b058-9790d7604d8a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:06.683020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d5c8ca2-22b5-431a-b48e-c04372297f1d req-5337cd2b-ec56-4509-b058-9790d7604d8a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:06.683716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d5c8ca2-22b5-431a-b48e-c04372297f1d req-5337cd2b-ec56-4509-b058-9790d7604d8a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:06.724152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1d5c8ca2-22b5-431a-b48e-c04372297f1d req-5337cd2b-ec56-4509-b058-9790d7604d8a service nova] Creating event network-changed:41fd256d-b2fc-4486-a305-577fce1c18c5 for instance 8d0ab80b-299d-4091-a247-22550b0a89ed on nch2-master-1 Oct 01 21:13:06.741113 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1d5c8ca2-22b5-431a-b48e-c04372297f1d req-5337cd2b-ec56-4509-b058-9790d7604d8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096851 Oct 01 21:13:06.744322 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3113/4383] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:06.755562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:06.760332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:06.770045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:06.773915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:06.774641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:06.778905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:06.779698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:06.780426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:07.669223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:07.685868 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc0e95a3-5226-466c-9cfc-9248bc5e78b8 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1768 microversion: 2.1 time: 0.939583 Oct 01 21:13:07.687021 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3114/4384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:06 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1768 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:07.700226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:07.701307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:07.715318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:07.715825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:07.716274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:07.716989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:07.717451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:07.717878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:08.581117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:08.590299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:08.597688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:08.606945 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb6b2f60-8b83-46d0-91ef-e1da725ed06f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.918645 Oct 01 21:13:08.619012 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3115/4385] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:07 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:08.715325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:08.717358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:08.731402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:08.731905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:08.732349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:08.733074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:08.733534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:08.733977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:09.189520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:09.211221 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-59df6298-b363-45cf-82f1-09bc71476c8a tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1768 microversion: 2.1 time: 0.493691 Oct 01 21:13:09.212563 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3116/4386] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:08 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1768 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:09.640366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:09.641298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:09.649520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:09.654158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:09.655122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:09.657424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:09.659039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:09.659504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:10.037703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:10.054641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:10.064812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:10.066060 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9025fa9e-e931-458a-8b34-67b9eccbb79b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.430638 Oct 01 21:13:10.090423 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3117/4387] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:09 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:10.095589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2c37c666-0299-4d9e-badf-c71442c5612d req-3b77dacc-1cdb-488d-bc38-d3c42ad27a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0ab80b-299d-4091-a247-22550b0a89ed", "name": "network-vif-deleted", "tag": "41fd256d-b2fc-4486-a305-577fce1c18c5"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:10.108415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2c37c666-0299-4d9e-badf-c71442c5612d req-3b77dacc-1cdb-488d-bc38-d3c42ad27a4e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:10.117674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2c37c666-0299-4d9e-badf-c71442c5612d req-3b77dacc-1cdb-488d-bc38-d3c42ad27a4e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:10.118382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2c37c666-0299-4d9e-badf-c71442c5612d req-3b77dacc-1cdb-488d-bc38-d3c42ad27a4e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:10.145899 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2c37c666-0299-4d9e-badf-c71442c5612d req-3b77dacc-1cdb-488d-bc38-d3c42ad27a4e service nova] Creating event network-vif-deleted:41fd256d-b2fc-4486-a305-577fce1c18c5 for instance 8d0ab80b-299d-4091-a247-22550b0a89ed on nch2-master-1 Oct 01 21:13:10.159852 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2c37c666-0299-4d9e-badf-c71442c5612d req-3b77dacc-1cdb-488d-bc38-d3c42ad27a4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067873 Oct 01 21:13:10.163081 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3118/4388] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:10.247870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:10.248595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:10.271381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:10.271898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:10.275183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:10.281109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:10.282371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:10.284159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:10.387493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:10.388071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:10.388526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:10.388998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lazy-loading 'fault' on Instance uuid 8d0ab80b-299d-4091-a247-22550b0a89ed {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:13:10.501862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ee8f965604fa9b7f7f5a25a81d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1eb39d09ce4a87960e258ac890e32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:10.540429 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff0dd688-4a7e-48f8-9930-9529fc852ad3 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 200 len: 1385 microversion: 2.1 time: 0.282710 Oct 01 21:13:10.563743 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3119/4389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:10 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 1385 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:10.582793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:10.586088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:10.618019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:10.622022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:10.622811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:10.624626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:10.627319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:10.630433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:10.736609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:13:11.002097 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f16eeeab-67a5-4ce2-b352-c6245906dbfb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 204 len: 0 microversion: 2.1 time: 0.434318 Oct 01 21:13:11.007969 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3120/4390] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:13:10 2022] DELETE /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:13:11.016590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:11.018189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:11.030950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:11.032353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:11.033047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:11.034023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:11.034769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:11.036200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:11.525122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:11.539626 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0d8df12d-2353-4f3c-9bcd-4b0058a4f7e5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1554 microversion: 2.1 time: 0.527234 Oct 01 21:13:11.545014 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3121/4391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:11 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1554 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:11.554132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:11.555065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:11.582921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:11.586879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:11.590038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:11.591606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:11.592220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:11.595048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:11.868311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:11.889376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:11.891455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:11.904259 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-387a8b29-bb37-4148-b194-b494063ac8c0 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.348005 Oct 01 21:13:11.905383 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3122/4392] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:11 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:11.910655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:11.911524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] [instance: 8d0ab80b-299d-4091-a247-22550b0a89ed] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:11.926648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:11.927571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:11.928253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:11.929067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:11.933357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:11.933357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:11.960190 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] HTTP exception thrown: Instance 8d0ab80b-299d-4091-a247-22550b0a89ed could not be found. Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Request method failure captured: Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed HTTP/1.1 Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKzYdJyeLiD2NeYU7fI73flbQ4aBA2xN8_bsb6C6Mk7ikV4FqumUfhBfIeJrZODUqv9iryKTh1Yp7tCT9yBL4y8fdLhM7NGaNQqtJVWv_ipv7eKs5tx3OKYkhgXh1R7PlAkBv6BBy-I9uceNDKf_L4DhK9-GqvAGV7TNlFFK0P8gcP8 Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 6d1eb39d09ce4a87960e258ac890e32c Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1364365555 Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6d1eb39d09ce4a87960e258ac890e32c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6d1eb39d09ce4a87960e258ac890e32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6d1eb39d09ce4a87960e258ac890e32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6d1eb39d09ce4a87960e258ac890e32c"}]}] Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1364365555 Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 6d1eb39d09ce4a87960e258ac890e32c Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1364365555 Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestSecurityGroupsBasicOps-1364365555-project Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 484ee8f965604fa9b7f7f5a25a81d0ef Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1364365555-project Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 8d0ab80b-299d-4091-a247-22550b0a89ed could not be found. Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '8d0ab80b-299d-4091-a247-22550b0a89ed'} Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d0ab80b-299d-4091-a247-22550b0a89ed could not be found. Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d0ab80b-299d-4091-a247-22550b0a89ed could not be found. Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:11.964501 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:11.971839 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:11.971839 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:11.971839 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:11.971839 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:11.971839 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:11.971839 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:11.971839 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d0ab80b-299d-4091-a247-22550b0a89ed could not be found. Oct 01 21:13:11.971839 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:11.971839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Returning 404 to user: Instance 8d0ab80b-299d-4091-a247-22550b0a89ed could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:11.978561 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b64669c4-f020-443a-8d0d-69becf8ec1f7 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed" status: 404 len: 111 microversion: 2.1 time: 0.063700 Oct 01 21:13:11.978561 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3123/4393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:11 2022] GET /compute/v2.1/servers/8d0ab80b-299d-4091-a247-22550b0a89ed => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:13:12.574648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:12.575388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:12.586018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:12.587850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:12.589043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:12.592376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:12.593906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:12.594337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:12.616339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:13.114283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:13.124843 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a84ff58-e31e-472b-864c-83a587229d7e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1554 microversion: 2.1 time: 0.554307 Oct 01 21:13:13.139904 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3124/4394] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:12 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1554 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:13.149540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:13.156522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:13.169032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:13.170013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:13.176500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:13.178812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:13.180130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:13.181432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:13.474050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:13.487248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:13.488707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:13.489897 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5145c0b4-8473-4622-aa01-75ce26760d4a tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.348138 Oct 01 21:13:13.490752 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3125/4395] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:13 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:14.165037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:14.165639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:14.177470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:14.177979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:14.178421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:14.179169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:14.179629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:14.180062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:14.556231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:14.573496 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76594cab-a9f9-47f3-8a54-f3b4048c50bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 200 len: 1512 microversion: 2.1 time: 0.411252 Oct 01 21:13:14.574633 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3126/4396] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:14 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:14.593336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-301bc27a-3349-4e56-8cd2-95f6900aa727 req-10ebb0e4-b245-4ea0-909b-627a7768e4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4888d15-cd1d-4900-9b7d-508b742e3807", "name": "network-vif-deleted", "tag": "89994420-1f10-4906-8be5-99a59bcab3ec"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:14.634347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-301bc27a-3349-4e56-8cd2-95f6900aa727 req-10ebb0e4-b245-4ea0-909b-627a7768e4f6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:14.636684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-301bc27a-3349-4e56-8cd2-95f6900aa727 req-10ebb0e4-b245-4ea0-909b-627a7768e4f6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:14.637433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-301bc27a-3349-4e56-8cd2-95f6900aa727 req-10ebb0e4-b245-4ea0-909b-627a7768e4f6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:14.662299 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-301bc27a-3349-4e56-8cd2-95f6900aa727 req-10ebb0e4-b245-4ea0-909b-627a7768e4f6 service nova] Creating event network-vif-deleted:89994420-1f10-4906-8be5-99a59bcab3ec for instance e4888d15-cd1d-4900-9b7d-508b742e3807 on nch2-master-1 Oct 01 21:13:14.671230 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-301bc27a-3349-4e56-8cd2-95f6900aa727 req-10ebb0e4-b245-4ea0-909b-627a7768e4f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090983 Oct 01 21:13:14.672023 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3127/4397] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:14.679892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:14.681074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:14.700717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:14.701591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:14.702363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:14.703775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:14.704483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:14.705264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:14.942273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:14.957978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:14.960933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:14.964226 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-efa9f545-8ec9-454b-b90e-7d4576854a89 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.290399 Oct 01 21:13:14.966131 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3128/4398] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:14 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:15.603237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:15.603971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:15.623104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:15.624290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:15.624993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:15.625970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:15.626709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:15.627383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:15.669269 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 HTTP/1.1 Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e4888d15-cd1d-4900-9b7d-508b742e3807'} Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:15.680580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.686690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:15.686690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:15.686690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:15.686690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:15.686690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:15.686690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.686690 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.686690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:15.692073 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-854ef998-fda4-4cb0-941e-b72f331005d0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 404 len: 111 microversion: 2.1 time: 0.090244 Oct 01 21:13:15.692073 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3129/4399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:15 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:13:15.908847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:15.916369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:15.931100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:15.931601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:15.932047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:15.933061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:15.933262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:15.933682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:15.979943 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807/os-volume_attachments HTTP/1.1 Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': 'e4888d15-cd1d-4900-9b7d-508b742e3807'} Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:13:15.981552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:13:15.986338 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:15.990993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:15.990993 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37bdc5cc-6cdf-4de5-9f19-7f948b99d8ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.084838 Oct 01 21:13:15.990993 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3130/4400] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:13:15 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807/os-volume_attachments => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:13:15.997002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:15.997636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:16.006204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:16.007040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:16.007679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:16.008687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:16.009354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:16.010124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:16.420129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:16.435191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:16.439680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:16.441566 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e10dc309-8f49-4b00-85aa-c669028fde5f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.450050 Oct 01 21:13:16.445096 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3131/4401] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:15 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:16.451609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1867678800", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "2d91bbe6-1b56-400a-a72b-6645bb360bd3"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:16.554343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] validate_networks() for [('2d91bbe6-1b56-400a-a72b-6645bb360bd3', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:13:17.516179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:13:17.517297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:13:17.517943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:13:17.518595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:13:17.519194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:13:17.537955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:17.539113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:17.539795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:17.543350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:17.545416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:17.547035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:17.609508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:13:17.631277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for user a2745d6923e347939e2c67015aefadda and project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:13:17.660993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:13:17.671702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: be519138-4f90-475d-9373-d4932380ad36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:13:17.763238 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b89724f-bb06-43c7-b7e2-5f2409548d6d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.316837 Oct 01 21:13:17.766145 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3132/4402] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:13:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:13:17.782400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:17.787454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:17.816846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:17.817502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:17.818218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:17.819291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:17.821785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:17.845872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:18.203387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:18.214308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:18.217276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:18.218795 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b9131174-9bb1-48b6-a453-8b903b2de3d5 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1738 microversion: 2.20 time: 0.448006 Oct 01 21:13:18.219644 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3133/4403] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:17 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1738 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:18.238901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e947934f-bca4-447a-9418-5a9a885d99c0 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f417283a5e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:18.360860 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e947934f-bca4-447a-9418-5a9a885d99c0 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/47e1224d-e4a1-47ed-a3ce-0f9d5b65a943" status: 200 len: 343 microversion: 2.1 time: 0.139177 Oct 01 21:13:18.361714 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3134/4404] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:13:18 2022] GET /compute/v2.1/os-volumes/47e1224d-e4a1-47ed-a3ce-0f9d5b65a943 => generated 343 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:18.368827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d0571f4c-ed39-4654-b328-451704ccfc33 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:18.369449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d0571f4c-ed39-4654-b328-451704ccfc33 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: be519138-4f90-475d-9373-d4932380ad36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:18.462474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d0571f4c-ed39-4654-b328-451704ccfc33 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:18.476608 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d0571f4c-ed39-4654-b328-451704ccfc33 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36" status: 200 len: 1215 microversion: 2.1 time: 0.113635 Oct 01 21:13:18.493689 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3135/4405] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:18 2022] GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36 => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:18.503169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06d8a0f9-c517-4fe8-a7ea-d2507c3054a4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:18.503937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06d8a0f9-c517-4fe8-a7ea-d2507c3054a4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: be519138-4f90-475d-9373-d4932380ad36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:18.525899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06d8a0f9-c517-4fe8-a7ea-d2507c3054a4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: be519138-4f90-475d-9373-d4932380ad36] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:13:19.068705 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.scheduler.client.report [None req-06d8a0f9-c517-4fe8-a7ea-d2507c3054a4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Deleted allocations for instance be519138-4f90-475d-9373-d4932380ad36 Oct 01 21:13:19.078916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:19.129886 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06d8a0f9-c517-4fe8-a7ea-d2507c3054a4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36" status: 204 len: 0 microversion: 2.1 time: 0.631771 Oct 01 21:13:19.131575 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3136/4406] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:13:18 2022] DELETE /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:13:19.140397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:19.145567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: be519138-4f90-475d-9373-d4932380ad36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:19.158405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:19.159005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:19.159687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:19.160710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:19.161554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:19.162234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:19.598845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:19.607146 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02b9bf09-5d04-4287-b668-50efd1eca70e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36" status: 200 len: 1219 microversion: 2.1 time: 0.471691 Oct 01 21:13:19.612210 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3137/4407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:19 2022] GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36 => generated 1219 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:19.627052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:19.627718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:19.639007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:19.639591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:19.640042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:19.640765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:19.641233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:19.641669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:19.911794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:19.924930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:19.926470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:19.927719 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95dab4a5-bfcb-46f6-af70-b941003f303e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1720 microversion: 2.20 time: 0.313184 Oct 01 21:13:19.928282 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3138/4408] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:19 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1720 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:19.942689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e9e8255-2c5d-4fe3-8d55-0ec8129f9317 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] Calling method '.version_select at 0x7f4172636670>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:19.987589 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0e9e8255-2c5d-4fe3-8d55-0ec8129f9317 tempest-TestSecurityGroupsBasicOps-1364365555 tempest-TestSecurityGroupsBasicOps-1364365555-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1230943975" status: 202 len: 0 microversion: 2.1 time: 0.054254 Oct 01 21:13:19.988430 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3139/4409] 10.222.0.17 () {58 vars in 1278 bytes} [Sat Oct 1 21:13:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1230943975 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:13:20.134313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-75ccf584-99e4-4d8a-a730-c950b79df7cd tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f4172656dc0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:20.197269 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-75ccf584-99e4-4d8a-a730-c950b79df7cd tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/134a663b-2510-49ba-b326-77540a1d42ca" status: 200 len: 343 microversion: 2.1 time: 0.066530 Oct 01 21:13:20.199072 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3140/4410] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:13:20 2022] GET /compute/v2.1/os-volumes/134a663b-2510-49ba-b326-77540a1d42ca => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:20.631678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:20.632333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: be519138-4f90-475d-9373-d4932380ad36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:20.647461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:20.648234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:20.648901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:20.649894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:20.651982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:20.652434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:20.668342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36 HTTP/1.1 Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'be519138-4f90-475d-9373-d4932380ad36'} Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:20.670377 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:20.677277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:20.677277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:20.677277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:20.677277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:20.677277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:20.677277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:13:20.677277 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:20.678717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:20.680198 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8f2e23f0-0dd8-41d5-95c9-46dad3a4e953 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36" status: 404 len: 111 microversion: 2.1 time: 0.053194 Oct 01 21:13:20.691672 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3141/4411] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:20 2022] GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:13:20.851907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1260045908", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "2d91bbe6-1b56-400a-a72b-6645bb360bd3"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:20.939607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] validate_networks() for [('2d91bbe6-1b56-400a-a72b-6645bb360bd3', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:13:21.391471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:13:21.392151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:13:21.393112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:13:21.393661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:13:21.394310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:13:21.404245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:21.404740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:21.405184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:21.405910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:21.406588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:21.407343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:21.432094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:13:21.437694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for user a2745d6923e347939e2c67015aefadda and project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:13:21.451989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:13:21.454730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:13:21.506097 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a4d7a4fc-9e36-4b67-af5b-af0ed3ffb8c0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662437 Oct 01 21:13:21.507701 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3142/4412] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:13:21.515805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:21.517000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:21.528669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:21.529598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:21.530315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:21.531522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:21.537328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:21.537808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:21.787883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:21.798152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:21.800209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:21.802280 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82e9ffff-2137-40c3-9208-2143a9fdbf9f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1720 microversion: 2.20 time: 0.292738 Oct 01 21:13:21.803994 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3143/4413] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:21 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:21.809574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5d87c0f-75b4-4295-a785-f19413e1e034 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:21.810676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a5d87c0f-75b4-4295-a785-f19413e1e034 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:21.917818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a5d87c0f-75b4-4295-a785-f19413e1e034 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:21.926898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a5d87c0f-75b4-4295-a785-f19413e1e034 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1215 microversion: 2.1 time: 0.121110 Oct 01 21:13:21.934538 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3144/4414] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:21 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:21.935382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3bdb8060-0380-4f2a-95c3-ed88feb449a7 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f417283aa60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:22.009355 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3bdb8060-0380-4f2a-95c3-ed88feb449a7 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3e590a02-bca6-49dd-b076-2db79b6971cb" status: 200 len: 344 microversion: 2.1 time: 0.077953 Oct 01 21:13:22.009951 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3145/4415] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Oct 1 21:13:21 2022] GET /compute/v2.1/os-volumes/3e590a02-bca6-49dd-b076-2db79b6971cb => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:22.027439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b8c646e-d19d-4050-9f1d-169cb6e13b38 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f417283a790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:22.144832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b8c646e-d19d-4050-9f1d-169cb6e13b38 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.125539 Oct 01 21:13:22.154877 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3146/4416] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Oct 1 21:13:22 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:22.162909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8efb3b6f-9185-41da-9300-db766a888d90 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f41726369d0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:22.280899 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8efb3b6f-9185-41da-9300-db766a888d90 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.122293 Oct 01 21:13:22.281789 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3147/4417] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 21:13:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:13:22.296805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ecfc15df-2d7a-4ec5-ac41-73ddbb2d6351 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f4172838430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:22.420032 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ecfc15df-2d7a-4ec5-ac41-73ddbb2d6351 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.127901 Oct 01 21:13:22.421014 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3148/4418] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Oct 1 21:13:22 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:22.437198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-904a65cc-b39e-4299-a69c-8eddb6737473 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f4172639c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:22.754328 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-904a65cc-b39e-4299-a69c-8eddb6737473 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.322634 Oct 01 21:13:22.754942 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3149/4419] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Oct 1 21:13:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:13:22.771176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a7947f55-7562-40e1-9370-b68851a400a1 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f4172621160>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:22.913447 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a7947f55-7562-40e1-9370-b68851a400a1 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.147862 Oct 01 21:13:22.914837 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3150/4420] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Oct 1 21:13:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:13:22.922751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:22.924118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:22.935809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:22.936743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:22.937507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:22.938808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:22.939663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:22.940328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:23.443642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:23.458680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:23.464799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:23.469488 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8b3255da-129f-4b14-ba92-d8744b2a974e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1663 microversion: 2.20 time: 0.551130 Oct 01 21:13:23.470432 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3151/4421] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:22 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1663 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:23.499139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-be0fea9d-637f-4749-812a-088dd7061012 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f4172636700>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:23.621631 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-be0fea9d-637f-4749-812a-088dd7061012 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.139721 Oct 01 21:13:23.622254 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3152/4422] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 21:13:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:23.627762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:23.628581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:23.647827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:23.648714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:23.649448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:23.651721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:23.652387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:23.653619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:23.757784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:23.769084 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-53f10435-62e5-4c4a-8500-98e425fe9731 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1273 microversion: 2.1 time: 0.145243 Oct 01 21:13:23.769723 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3153/4423] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:23 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:23.787519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c3e36454-87cd-4e47-ba5f-0373e8c39f5e req-3ee8b1b2-25d4-4350-b4a9-9fcd4794f7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7620a7c8-10dc-46b4-ba02-f5397ddb1a13", "name": "network-vif-unplugged", "status": "completed", "tag": "a4548064-3301-41dc-8a77-f87fc32359d1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:23.807417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c3e36454-87cd-4e47-ba5f-0373e8c39f5e req-3ee8b1b2-25d4-4350-b4a9-9fcd4794f7f3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:23.808003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c3e36454-87cd-4e47-ba5f-0373e8c39f5e req-3ee8b1b2-25d4-4350-b4a9-9fcd4794f7f3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:23.808516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c3e36454-87cd-4e47-ba5f-0373e8c39f5e req-3ee8b1b2-25d4-4350-b4a9-9fcd4794f7f3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:23.834754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.server_external_events [req-c3e36454-87cd-4e47-ba5f-0373e8c39f5e req-3ee8b1b2-25d4-4350-b4a9-9fcd4794f7f3 service nova] Unable to find a host for instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13. Dropping event network-vif-unplugged {{(pid=140438) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 01 21:13:23.836706 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c3e36454-87cd-4e47-ba5f-0373e8c39f5e req-3ee8b1b2-25d4-4350-b4a9-9fcd4794f7f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055496 Oct 01 21:13:23.836852 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3154/4424] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 01 21:13:23.844203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc536b49-bc3f-41e7-863e-f5901b9af298 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e961484c-2fba-4c14-8029-87f4dd61959d"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:23.846920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bc536b49-bc3f-41e7-863e-f5901b9af298 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:23.856012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc536b49-bc3f-41e7-863e-f5901b9af298 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:23.856818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc536b49-bc3f-41e7-863e-f5901b9af298 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:23.857331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc536b49-bc3f-41e7-863e-f5901b9af298 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:23.858960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc536b49-bc3f-41e7-863e-f5901b9af298 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:23.859600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc536b49-bc3f-41e7-863e-f5901b9af298 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:23.860547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc536b49-bc3f-41e7-863e-f5901b9af298 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:24.313963 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc536b49-bc3f-41e7-863e-f5901b9af298 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.475734 Oct 01 21:13:24.315267 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3155/4425] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Oct 1 21:13:23 2022] POST /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/os-volume_attachments => generated 188 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:13:24.325122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-70fd8b92-1c29-48ea-8ebe-d86da2cf85aa tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f41725db5e0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:24.474712 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-70fd8b92-1c29-48ea-8ebe-d86da2cf85aa tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.158061 Oct 01 21:13:24.481035 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3156/4426] 10.222.0.17 () {58 vars in 1188 bytes} [Sat Oct 1 21:13:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:24.498579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d19ecd37-adbe-431d-8e03-40d48fef33f6 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] Calling method '.version_select at 0x7f417260baf0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:24.677560 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d19ecd37-adbe-431d-8e03-40d48fef33f6 tempest-VolumesTestJSON-1405758743 tempest-VolumesTestJSON-1405758743-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.187071 Oct 01 21:13:24.681584 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3157/4427] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 21:13:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:24.686973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b3f34693-17be-400d-b8fa-fd2085d89bae tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:24.687231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b3f34693-17be-400d-b8fa-fd2085d89bae tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:24.700735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f34693-17be-400d-b8fa-fd2085d89bae tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:24.701300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f34693-17be-400d-b8fa-fd2085d89bae tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:24.701745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f34693-17be-400d-b8fa-fd2085d89bae tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:24.703140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f34693-17be-400d-b8fa-fd2085d89bae tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:24.704151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f34693-17be-400d-b8fa-fd2085d89bae tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:24.705142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f34693-17be-400d-b8fa-fd2085d89bae tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:24.713635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:25.460437 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b3f34693-17be-400d-b8fa-fd2085d89bae tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/os-volume_attachments/e961484c-2fba-4c14-8029-87f4dd61959d" status: 202 len: 0 microversion: 2.20 time: 0.774288 Oct 01 21:13:25.468831 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3158/4428] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Oct 1 21:13:24 2022] DELETE /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/os-volume_attachments/e961484c-2fba-4c14-8029-87f4dd61959d => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:13:25.479426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:25.481503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:25.489619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:25.490342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:25.490990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:25.491790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:25.492158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:25.492590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:25.746373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:25.757099 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f9acae28-1c16-4cf5-8c9f-f92c291ff4dc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1315 microversion: 2.1 time: 0.283833 Oct 01 21:13:25.757686 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3159/4429] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:25 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:25.762826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-709ee7e3-1586-4d99-8bcd-57aba88771f6 req-661d562d-3548-474a-b9be-8cfb0576c32e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5", "tag": "52ad55ee-582b-4792-ad23-363ad5357b31"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:25.772715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-709ee7e3-1586-4d99-8bcd-57aba88771f6 req-661d562d-3548-474a-b9be-8cfb0576c32e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:25.773460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-709ee7e3-1586-4d99-8bcd-57aba88771f6 req-661d562d-3548-474a-b9be-8cfb0576c32e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:25.774096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-709ee7e3-1586-4d99-8bcd-57aba88771f6 req-661d562d-3548-474a-b9be-8cfb0576c32e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:25.786066 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-709ee7e3-1586-4d99-8bcd-57aba88771f6 req-661d562d-3548-474a-b9be-8cfb0576c32e service nova] Creating event network-changed:52ad55ee-582b-4792-ad23-363ad5357b31 for instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 on nch1-master-1 Oct 01 21:13:25.790986 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-709ee7e3-1586-4d99-8bcd-57aba88771f6 req-661d562d-3548-474a-b9be-8cfb0576c32e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032139 Oct 01 21:13:25.792194 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3160/4430] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:25.797763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:25.798418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:25.804911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:25.805416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:25.805856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:25.806840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:25.807482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:25.808091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:25.842848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140438) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 21:13:25.918116 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3a895c1-f1cd-4807-bdd9-a2384d2f9201 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "POST /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/action" status: 202 len: 0 microversion: 2.20 time: 0.124354 Oct 01 21:13:25.922136 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3161/4431] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 21:13:25 2022] POST /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:13:25.927340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:25.927960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:25.935761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:25.936519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:25.937362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:25.938978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:25.939669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:25.940294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:26.151855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:26.161179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:26.162845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:26.164175 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60ee087a-7926-4e8e-9f5f-26a29241c97d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1671 microversion: 2.20 time: 0.240949 Oct 01 21:13:26.164839 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3162/4432] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:25 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:26.781263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:26.781867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:26.790286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:26.791138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:26.791686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:26.792417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:26.793061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:26.793496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:27.044450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:27.080568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b06104a9-829f-403f-92bf-d75e1e65ee0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1315 microversion: 2.1 time: 0.302702 Oct 01 21:13:27.081172 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3163/4433] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:26 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:27.205541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:27.208563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:27.218947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:27.220118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:27.220933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:27.222848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:27.227148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:27.227954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:27.480645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:27.490426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:27.493536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:27.494809 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-09fa6e78-d939-496c-a714-6057e7dc148e tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.300370 Oct 01 21:13:27.495489 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3164/4434] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:27 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:28.104773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:28.107195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:28.116322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:28.116990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:28.117635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:28.119952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:28.120490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:28.121066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:28.657769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:28.668796 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-89d0a723-a456-4f34-8a0b-50f53e8fbbed tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1315 microversion: 2.1 time: 0.568962 Oct 01 21:13:28.670384 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3165/4435] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:28 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:28.690129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:28.691596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:28.701313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:28.702167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:28.703275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:28.705136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:28.706126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:28.707009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:28.938078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:28.948361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:28.949457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:28.950762 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-13da6301-899c-48ca-8eb1-c5839eda958d tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.279015 Oct 01 21:13:28.951318 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3166/4436] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:28 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:29.187849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7011fbb-5bf6-454c-9601-fc62813f902e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:29.189017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c7011fbb-5bf6-454c-9601-fc62813f902e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:29.220722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7011fbb-5bf6-454c-9601-fc62813f902e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:29.221615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7011fbb-5bf6-454c-9601-fc62813f902e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:29.222212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7011fbb-5bf6-454c-9601-fc62813f902e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:29.226161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7011fbb-5bf6-454c-9601-fc62813f902e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:29.226862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7011fbb-5bf6-454c-9601-fc62813f902e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:29.227476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7011fbb-5bf6-454c-9601-fc62813f902e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:29.277976 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7011fbb-5bf6-454c-9601-fc62813f902e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/ips" status: 200 len: 148 microversion: 2.1 time: 0.095241 Oct 01 21:13:29.281514 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3167/4437] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:13:29 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/ips => generated 148 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:13:29.707688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:29.708691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:29.727207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:29.731146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:29.731792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:29.736031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:29.739063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:29.741378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:30.185707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:30.205763 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0bcf89a8-66a8-46f8-a89c-66407713a5fb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1315 microversion: 2.1 time: 0.503438 Oct 01 21:13:30.207546 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3168/4438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:29 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:30.231626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:30.235458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:30.254906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:30.256988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:30.257864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:30.258837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:30.260265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:30.261016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:30.518170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:30.530237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:30.532156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:30.533712 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d00341bd-4de8-41bb-8185-523084baac4f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.324422 Oct 01 21:13:30.535005 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3169/4439] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:30 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:30.993011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9b9ad51e-4d69-40ea-af8f-f148298159eb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46afd2fc-5506-4c1c-8c97-203abd3a41d9"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:30.996397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9b9ad51e-4d69-40ea-af8f-f148298159eb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:31.011632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b9ad51e-4d69-40ea-af8f-f148298159eb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:31.012662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b9ad51e-4d69-40ea-af8f-f148298159eb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:31.013314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b9ad51e-4d69-40ea-af8f-f148298159eb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:31.014232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b9ad51e-4d69-40ea-af8f-f148298159eb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:31.024506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b9ad51e-4d69-40ea-af8f-f148298159eb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:31.047113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9b9ad51e-4d69-40ea-af8f-f148298159eb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:31.420127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:31.566953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:31.583240 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9b9ad51e-4d69-40ea-af8f-f148298159eb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.594615 Oct 01 21:13:31.584291 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3170/4440] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:13:30 2022] POST /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments => generated 194 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:31.591435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:31.592438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:31.600659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:31.601473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:31.602206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:31.604347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:31.606009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:31.608334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:31.922281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=18 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:31.950272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:31.976562 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-486be658-d3a9-46de-9262-07efd4aeb5e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1315 microversion: 2.1 time: 0.390461 Oct 01 21:13:31.977388 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3171/4441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:31 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:31.991648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-71e3bfe5-3b07-40ca-af9b-c34b67a012c4 req-558134f9-33ab-48a3-97c0-de1d456d0481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5", "name": "network-vif-plugged", "status": "completed", "tag": "52ad55ee-582b-4792-ad23-363ad5357b31"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:32.008145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-71e3bfe5-3b07-40ca-af9b-c34b67a012c4 req-558134f9-33ab-48a3-97c0-de1d456d0481 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:32.008928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-71e3bfe5-3b07-40ca-af9b-c34b67a012c4 req-558134f9-33ab-48a3-97c0-de1d456d0481 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:32.009531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-71e3bfe5-3b07-40ca-af9b-c34b67a012c4 req-558134f9-33ab-48a3-97c0-de1d456d0481 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:32.027695 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-71e3bfe5-3b07-40ca-af9b-c34b67a012c4 req-558134f9-33ab-48a3-97c0-de1d456d0481 service nova] Creating event network-vif-plugged:52ad55ee-582b-4792-ad23-363ad5357b31 for instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 on nch1-master-1 Oct 01 21:13:32.053533 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-71e3bfe5-3b07-40ca-af9b-c34b67a012c4 req-558134f9-33ab-48a3-97c0-de1d456d0481 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073898 Oct 01 21:13:32.054309 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3172/4442] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:32.063893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:32.087030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:32.109345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:32.111033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:32.113793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:32.118644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:32.121826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:32.131318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:32.660747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:32.676579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:32.688835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:32.690756 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02800423-df59-428b-ab84-032b291d4c1c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.634905 Oct 01 21:13:32.691327 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3173/4443] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:32 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:33.000262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:33.001538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:33.016824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:33.020049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:33.021495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:33.024269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:33.024939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:33.034266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:33.762324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:33.774733 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f6b5759-2a0c-421d-adcb-a8a72f3e0809 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1315 microversion: 2.1 time: 0.775812 Oct 01 21:13:33.776240 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3174/4444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:32 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:33.784591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:33.785602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:33.805664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:33.806369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:33.807071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:33.807984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:33.808644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:33.809250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:34.055070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:34.064158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:34.065625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:34.066867 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-422d85fe-b36e-4629-95da-c164a596e2b3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.288804 Oct 01 21:13:34.067780 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3175/4445] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:33 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:34.803609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:34.809714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:34.831243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:34.831812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:34.832276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:34.834062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:34.836277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:34.837691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:35.174748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:35.189554 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-407c244c-c4d1-4b3e-8160-f9de3fa312d7 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1503 microversion: 2.1 time: 0.390933 Oct 01 21:13:35.193621 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3176/4446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:34 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:35.206252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:35.207191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:35.240679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:35.243096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:35.243752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:35.246673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:35.250208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:35.251265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:35.594938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:35.617235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:35.621190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:35.624033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20aa20b7-30bd-4317-8ec6-cec18eb7422f tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.427904 Oct 01 21:13:35.625985 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3177/4447] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:35 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:35.643125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c8fac822-3d16-440c-a43d-9575a8763d05 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:35.643912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c8fac822-3d16-440c-a43d-9575a8763d05 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:35.658821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8fac822-3d16-440c-a43d-9575a8763d05 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:35.659760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8fac822-3d16-440c-a43d-9575a8763d05 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:35.660451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8fac822-3d16-440c-a43d-9575a8763d05 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:35.661163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8fac822-3d16-440c-a43d-9575a8763d05 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:35.661718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8fac822-3d16-440c-a43d-9575a8763d05 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:35.662144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c8fac822-3d16-440c-a43d-9575a8763d05 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:35.783351 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c8fac822-3d16-440c-a43d-9575a8763d05 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5/action" status: 202 len: 0 microversion: 2.1 time: 0.155238 Oct 01 21:13:35.784135 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3178/4448] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:13:35 2022] POST /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:13:35.796094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46afd2fc-5506-4c1c-8c97-203abd3a41d9"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:35.807394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:35.821026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:35.821524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:35.822510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:35.823231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:35.823693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:35.824127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:36.004698 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Invalid volume: volume 46afd2fc-5506-4c1c-8c97-203abd3a41d9 is already attached to instances: db78d504-5f23-477e-9dd6-a9914e53bb8f Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments HTTP/1.1 Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 74 Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: {"volumeAttachment": {"volumeId": "46afd2fc-5506-4c1c-8c97-203abd3a41d9"}} Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid volume: volume 46afd2fc-5506-4c1c-8c97-203abd3a41d9 is already attached to instances: db78d504-5f23-477e-9dd6-a9914e53bb8f Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': 'db78d504-5f23-477e-9dd6-a9914e53bb8f', 'body': {'volumeAttachment': {'volumeId': '46afd2fc-5506-4c1c-8c97-203abd3a41d9'}}} Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 46afd2fc-5506-4c1c-8c97-203abd3a41d9 is already attached to instances: db78d504-5f23-477e-9dd6-a9914e53bb8f Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:13:36.006661 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 46afd2fc-5506-4c1c-8c97-203abd3a41d9 is already attached to instances: db78d504-5f23-477e-9dd6-a9914e53bb8f Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 46afd2fc-5506-4c1c-8c97-203abd3a41d9 is already attached to instances: db78d504-5f23-477e-9dd6-a9914e53bb8f Oct 01 21:13:36.011897 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:36.019864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 400 to user: Invalid volume: volume 46afd2fc-5506-4c1c-8c97-203abd3a41d9 is already attached to instances: db78d504-5f23-477e-9dd6-a9914e53bb8f {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:36.033610 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a1992d22-1f6f-4bf1-91c9-59bd604dfd6c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.239272 Oct 01 21:13:36.042588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3179/4449] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:13:35 2022] POST /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments => generated 174 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:13:36.069690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:36.071877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:36.102466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:36.105546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:36.127481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:36.131986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:36.136181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:36.141089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:36.396580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:36.408475 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0e15969f-d7fa-40ba-8833-40aae8db4779 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1488 microversion: 2.1 time: 0.362606 Oct 01 21:13:36.432140 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3180/4450] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:36 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1488 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:36.436235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:36.437053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:36.444803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:36.445309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:36.445754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:36.446580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:36.447119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:36.447732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:36.591166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lazy-loading 'services' on Instance uuid db78d504-5f23-477e-9dd6-a9914e53bb8f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:13:36.735349 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-717980c7-8630-4b34-8982-06ca64a0f687 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments/46afd2fc-5506-4c1c-8c97-203abd3a41d9" status: 202 len: 0 microversion: 2.1 time: 0.306046 Oct 01 21:13:36.736259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3181/4451] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:13:36 2022] DELETE /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments/46afd2fc-5506-4c1c-8c97-203abd3a41d9 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:13:36.743054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:36.747143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:36.763083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:36.764188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:36.765940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:36.769375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:36.769896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:36.770350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:36.868660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:13:37.084198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:37.100096 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-910e5cb9-d6c4-4d04-bdaa-4a01b0440e36 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 204 len: 0 microversion: 2.1 time: 0.361994 Oct 01 21:13:37.101597 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3182/4452] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:13:36 2022] DELETE /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:13:37.113572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:37.117825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:37.128664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:37.129696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:37.130298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:37.131302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:37.132255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:37.133116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:37.362651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:37.373605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:37.375990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:37.378080 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9cb0b747-774a-44ba-bcea-c53b30da916c tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.273449 Oct 01 21:13:37.379207 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3183/4453] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:37 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:37.388743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba6ec3c2-e6f6-4f8f-9362-090fc866afc9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:37.391054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba6ec3c2-e6f6-4f8f-9362-090fc866afc9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:37.397594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba6ec3c2-e6f6-4f8f-9362-090fc866afc9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:37.398105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba6ec3c2-e6f6-4f8f-9362-090fc866afc9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:37.398577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba6ec3c2-e6f6-4f8f-9362-090fc866afc9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:37.399294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba6ec3c2-e6f6-4f8f-9362-090fc866afc9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:37.399758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba6ec3c2-e6f6-4f8f-9362-090fc866afc9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:37.400225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba6ec3c2-e6f6-4f8f-9362-090fc866afc9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:37.429626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:37.435801 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba6ec3c2-e6f6-4f8f-9362-090fc866afc9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055263 Oct 01 21:13:37.436377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3184/4454] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:13:37 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:37.443854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:37.444531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:37.457291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:37.457828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:37.458262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:37.459222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:37.459887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:37.460899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:37.706396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:37.717578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d9d47348-c3ea-453f-aa2f-0a9787ced7a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1494 microversion: 2.1 time: 0.279889 Oct 01 21:13:37.718607 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3185/4455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:37 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1494 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:38.406155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:38.407744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:38.421381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:38.422078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:38.422719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:38.429088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:38.429943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:38.431269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:38.625833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:38.643160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:38.646555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:38.648487 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88a73277-5747-4130-a166-ef107cbd1d80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.246985 Oct 01 21:13:38.649594 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3186/4456] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:38 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:38.669049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79ef81f6-468c-4e0d-a054-2cbb230971ea tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:38.672808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-79ef81f6-468c-4e0d-a054-2cbb230971ea tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:38.690847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ef81f6-468c-4e0d-a054-2cbb230971ea tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:38.690847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ef81f6-468c-4e0d-a054-2cbb230971ea tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:38.690847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ef81f6-468c-4e0d-a054-2cbb230971ea tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:38.690847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ef81f6-468c-4e0d-a054-2cbb230971ea tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:38.690847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ef81f6-468c-4e0d-a054-2cbb230971ea tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:38.690847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ef81f6-468c-4e0d-a054-2cbb230971ea tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:38.749439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-79ef81f6-468c-4e0d-a054-2cbb230971ea tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097881 Oct 01 21:13:38.750461 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3187/4457] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:13:38 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:13:38.768741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:38.769373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:38.778622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:38.779134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:38.779589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:38.780314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:38.780810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:38.781359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:39.088447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:39.100114 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b88a8a68-71db-4c03-befa-b02f27f0b270 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1494 microversion: 2.1 time: 0.347873 Oct 01 21:13:39.116829 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3188/4458] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:38 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1494 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:39.126803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:39.127687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:39.135109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:39.135905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:39.136523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:39.137417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:39.138135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:39.138822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:39.204211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:13:39.571348 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8cb89b97-35f9-4ec9-9a1d-b0d186db7a3c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 204 len: 0 microversion: 2.1 time: 0.452649 Oct 01 21:13:39.573810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3189/4459] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:13:39 2022] DELETE /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:13:39.595902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:39.596755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:39.619523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:39.620286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:39.620792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:39.625163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:39.625875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:39.626536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:40.048904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:40.064851 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-781e9f2c-bdd1-402f-b99d-e716efba7a15 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1679 microversion: 2.1 time: 0.484557 Oct 01 21:13:40.084616 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3190/4460] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:39 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1679 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:40.442034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:40.442735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:40.462332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:40.463803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:40.465226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:40.466198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:40.467742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:40.468531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:40.794634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:40.825254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:40.827848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:40.829356 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-69be0270-ce31-46e2-a1a0-6f1b2bea3838 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.743318 Oct 01 21:13:40.830407 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3191/4461] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:40 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:40.836268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:40.837312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:40.843951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:40.844816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:40.845555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:40.846549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:40.847242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:40.848001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:40.974877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:40.984762 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e875f186-53ff-44e4-a2d7-a225128237bf tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1285 microversion: 2.1 time: 0.153030 Oct 01 21:13:40.987696 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3192/4462] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:40 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:41.000820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4595a95d-0479-49fb-a808-2f24d63df753 req-a7cb796a-dc4d-4d66-8bba-d911f78225f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5", "name": "network-vif-deleted", "tag": "52ad55ee-582b-4792-ad23-363ad5357b31"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:41.014648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4595a95d-0479-49fb-a808-2f24d63df753 req-a7cb796a-dc4d-4d66-8bba-d911f78225f8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:41.015352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4595a95d-0479-49fb-a808-2f24d63df753 req-a7cb796a-dc4d-4d66-8bba-d911f78225f8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:41.015800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4595a95d-0479-49fb-a808-2f24d63df753 req-a7cb796a-dc4d-4d66-8bba-d911f78225f8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:41.050346 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4595a95d-0479-49fb-a808-2f24d63df753 req-a7cb796a-dc4d-4d66-8bba-d911f78225f8 service nova] Creating event network-vif-deleted:52ad55ee-582b-4792-ad23-363ad5357b31 for instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 on nch1-master-1 Oct 01 21:13:41.055574 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4595a95d-0479-49fb-a808-2f24d63df753 req-a7cb796a-dc4d-4d66-8bba-d911f78225f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058348 Oct 01 21:13:41.056515 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3193/4463] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:41.097690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:41.098808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:41.107100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:41.107925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:41.108380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:41.109225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:41.109791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:41.110128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:41.383332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:41.395435 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7493a6fa-a7ed-4153-9e34-0d320a36ac44 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1679 microversion: 2.1 time: 0.303168 Oct 01 21:13:41.418709 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3194/4464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:41 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1679 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:41.866019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:41.867880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:41.876730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:41.877472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:41.878125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:41.879061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:41.879767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:41.880995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:42.093968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:42.104633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:42.106996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:42.108570 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2851105-ae91-46dc-90ee-170cc57dcbd7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.246976 Oct 01 21:13:42.109676 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3195/4465] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:41 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:13:42.115512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:42.117388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:42.125541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:42.126881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:42.127520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:42.129874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:42.130734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:42.131401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:42.170928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:42.171706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:42.172465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:42.173227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lazy-loading 'fault' on Instance uuid e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:13:42.252777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:42.277335 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb5c077c-9a1e-49fb-9717-f366020019db tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 200 len: 1305 microversion: 2.1 time: 0.164807 Oct 01 21:13:42.278742 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3196/4466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:42 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 1305 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:42.423554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:42.424930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:42.438983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:42.441783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:42.443314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:42.444454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:42.446026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:42.448224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:42.534113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:42.545247 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e707910b-0549-4139-befd-288f971f63fa tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 200 len: 1612 microversion: 2.1 time: 0.126272 Oct 01 21:13:42.549577 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3197/4467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:42 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 1612 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:43.091644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b74d166d-91e4-44ac-b1b2-5647a9856169 req-f9fb638b-e1d6-4c72-8d19-999cdcbde427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db78d504-5f23-477e-9dd6-a9914e53bb8f", "name": "network-vif-deleted", "tag": "fb2f11d4-c8b2-4492-94c0-9845161b595c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:43.117554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b74d166d-91e4-44ac-b1b2-5647a9856169 req-f9fb638b-e1d6-4c72-8d19-999cdcbde427 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:43.119260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b74d166d-91e4-44ac-b1b2-5647a9856169 req-f9fb638b-e1d6-4c72-8d19-999cdcbde427 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:43.120388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b74d166d-91e4-44ac-b1b2-5647a9856169 req-f9fb638b-e1d6-4c72-8d19-999cdcbde427 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:43.140328 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b74d166d-91e4-44ac-b1b2-5647a9856169 req-f9fb638b-e1d6-4c72-8d19-999cdcbde427 service nova] Creating event network-vif-deleted:fb2f11d4-c8b2-4492-94c0-9845161b595c for instance db78d504-5f23-477e-9dd6-a9914e53bb8f on nch2-master-1 Oct 01 21:13:43.150940 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b74d166d-91e4-44ac-b1b2-5647a9856169 req-f9fb638b-e1d6-4c72-8d19-999cdcbde427 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063744 Oct 01 21:13:43.152298 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3198/4468] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:43.158786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:43.159778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:43.168116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:43.168621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:43.169076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:43.170884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:43.171398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:43.171869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:43.326954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:43.339403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:43.340950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:43.342405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c3e1052f-9749-455c-9162-c5b7214607e3 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.188674 Oct 01 21:13:43.343161 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3199/4469] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:43 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:43.352194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:43.353889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:43.361827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:43.362328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:43.362885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:43.363545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:43.364154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:43.364592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:43.382305 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 HTTP/1.1 Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5'} Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:43.384022 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa07e26c-735a-42cf-8402-5fd398df09e2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 404 len: 111 microversion: 2.1 time: 0.041782 Oct 01 21:13:43.391552 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3200/4470] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:43 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:13:43.544113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2063145467", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "2d91bbe6-1b56-400a-a72b-6645bb360bd3"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:43.617242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] validate_networks() for [('2d91bbe6-1b56-400a-a72b-6645bb360bd3', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:13:44.231889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:13:44.233030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:13:44.233599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:13:44.234086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:13:44.234610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:13:44.244537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:44.245022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:44.245640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:44.246439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:44.246947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:44.247382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:44.266604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:13:44.272023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for user a2745d6923e347939e2c67015aefadda and project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:13:44.285202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:13:44.288382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:13:44.370334 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a3fc75f-e8d4-476b-85f0-77a2e2fb4b9a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830529 Oct 01 21:13:44.371086 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3201/4471] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:13:44.382067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:44.382735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:44.390264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:44.390927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:44.391376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:44.392321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:44.393078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:44.393764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:44.399374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:44.412147 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f HTTP/1.1 Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'db78d504-5f23-477e-9dd6-a9914e53bb8f'} Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:13:44.413803 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:44.420062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:13:44.420062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:13:44.420062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:13:44.420062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:13:44.420062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:13:44.420062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:13:44.420062 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:13:44.435687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:13:44.436762 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7b3758a-63c7-4f90-8f8d-7197f76a9d6b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 404 len: 111 microversion: 2.1 time: 0.058707 Oct 01 21:13:44.437295 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3202/4472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:44 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:13:44.443750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:44.444341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:44.451606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:44.452098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:44.452537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:44.453246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:44.453708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:44.454150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:44.604278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:44.613854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:44.615614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:44.616995 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0531c862-e151-4ee8-b085-128ccbfbb6eb tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.178521 Oct 01 21:13:44.617773 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3203/4473] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:44 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:44.630887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae07a70c-4d75-4f7b-9697-faa9e3bd4ebe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:44.632524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae07a70c-4d75-4f7b-9697-faa9e3bd4ebe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:44.695400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ae07a70c-4d75-4f7b-9697-faa9e3bd4ebe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:44.704292 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae07a70c-4d75-4f7b-9697-faa9e3bd4ebe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1215 microversion: 2.1 time: 0.079496 Oct 01 21:13:44.705635 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3204/4474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:44 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:44.725168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe470898-8931-41db-bde1-49578c068662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '.version_select at 0x7f41725b3550>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:44.753592 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe470898-8931-41db-bde1-49578c068662 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-307727817" status: 202 len: 0 microversion: 2.1 time: 0.045580 Oct 01 21:13:44.754336 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3205/4475] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 21:13:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-307727817 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:13:45.645224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:45.646887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:45.658976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:45.659723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:45.660187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:45.666886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:45.667934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:45.668595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:46.155111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:46.170676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:46.174608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:46.176274 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-caa5bb66-2e51-4fbd-9af6-1d322e199f80 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.536140 Oct 01 21:13:46.176588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3206/4476] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:45 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:13:46.183266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:46.184080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:46.192697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:46.193818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:46.194549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:46.195730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:46.197000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:46.197729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:46.342990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:46.352810 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f03d549-bf6c-43ac-9cc5-ad7b3768331e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1273 microversion: 2.1 time: 0.174417 Oct 01 21:13:46.353708 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3207/4477] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:46 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:46.358865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-168eb689-e6a6-4a32-8cb2-377fdd8129f2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: .version_select at 0x7f4172656b80>, body: {"keypair": {"name": "tempest-keypair-818310812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu/JVRlP1Sw/A9wel+INBdQsbbB6VIxYRE+eyGLita58I3wUvOfq1eFk+M16NtpZ792zYc3Lg1Yj6QXDP/iq4jo4wDfwHtf7237VJOt7JLx0TKoIEJSVvxDPjizbd9R3w=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:46.401339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-168eb689-e6a6-4a32-8cb2-377fdd8129f2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:13:46.414231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-168eb689-e6a6-4a32-8cb2-377fdd8129f2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for user 902ba44d318d4a01a510f732d27467c9 and project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:13:46.472124 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-168eb689-e6a6-4a32-8cb2-377fdd8129f2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117036 Oct 01 21:13:46.474578 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3208/4478] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:13:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:47.204325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:47.205202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:47.220360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:47.222820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:47.223302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:47.224035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:47.224508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:47.227670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:47.566072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:47.578997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:47.582993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:47.585262 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a68f53aa-fcb7-4108-b45c-95b876b39ccf tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.386780 Oct 01 21:13:47.586073 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3209/4479] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:47 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:13:47.593157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e79ef004-1135-49f4-bc0b-03366aa62dd5 req-c46745f9-974d-4742-875d-419c675ab4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7620a7c8-10dc-46b4-ba02-f5397ddb1a13", "name": "network-vif-plugged", "status": "completed", "tag": "a4548064-3301-41dc-8a77-f87fc32359d1"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:47.606631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e79ef004-1135-49f4-bc0b-03366aa62dd5 req-c46745f9-974d-4742-875d-419c675ab4fd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:47.608159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e79ef004-1135-49f4-bc0b-03366aa62dd5 req-c46745f9-974d-4742-875d-419c675ab4fd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:47.608799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e79ef004-1135-49f4-bc0b-03366aa62dd5 req-c46745f9-974d-4742-875d-419c675ab4fd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:47.621042 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e79ef004-1135-49f4-bc0b-03366aa62dd5 req-c46745f9-974d-4742-875d-419c675ab4fd service nova] Creating event network-vif-plugged:a4548064-3301-41dc-8a77-f87fc32359d1 for instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 on nch1-master-1 Oct 01 21:13:47.626986 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e79ef004-1135-49f4-bc0b-03366aa62dd5 req-c46745f9-974d-4742-875d-419c675ab4fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039354 Oct 01 21:13:47.628111 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3210/4480] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:47.651366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:47.655647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:47.666966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:47.667693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:47.668314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:47.669257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:47.669899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:47.670535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:48.098893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:48.107923 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-30fbbdc2-1586-468d-a02a-73a0cd6c23c9 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1315 microversion: 2.1 time: 0.478259 Oct 01 21:13:48.111721 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3211/4481] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:47 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:48.613415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:48.614127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:48.627018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:48.627905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:48.629274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:48.630676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:48.632021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:48.632967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:48.997668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:49.007222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:49.012897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:49.015476 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64cabd09-4919-4504-b0e4-aca6c4cdfd23 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1729 microversion: 2.20 time: 0.407207 Oct 01 21:13:49.016981 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3212/4482] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:48 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1729 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:49.136263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:49.136962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:49.139704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:49.156839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:49.158450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:49.159629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:49.161420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:49.162585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:49.163059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:49.549919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:49.562135 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad71ec7b-eca8-43ac-a1f7-492e21940bae tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1315 microversion: 2.1 time: 0.430266 Oct 01 21:13:49.565556 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3213/4483] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:49 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:49.582904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-025db07e-e276-449b-b43d-59b925bec5c1 req-684dba7b-d439-43c1-869a-6bca51eda30f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32c1b21-13b4-48e6-8922-eccf5475dd67", "tag": "0b30c950-40ed-4a83-8927-e56eabb89e23"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:49.597235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-025db07e-e276-449b-b43d-59b925bec5c1 req-684dba7b-d439-43c1-869a-6bca51eda30f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:49.603486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-025db07e-e276-449b-b43d-59b925bec5c1 req-684dba7b-d439-43c1-869a-6bca51eda30f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:49.604227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-025db07e-e276-449b-b43d-59b925bec5c1 req-684dba7b-d439-43c1-869a-6bca51eda30f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:49.617340 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-025db07e-e276-449b-b43d-59b925bec5c1 req-684dba7b-d439-43c1-869a-6bca51eda30f service nova] Creating event network-changed:0b30c950-40ed-4a83-8927-e56eabb89e23 for instance e32c1b21-13b4-48e6-8922-eccf5475dd67 on nch2-master-1 Oct 01 21:13:49.625915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-025db07e-e276-449b-b43d-59b925bec5c1 req-684dba7b-d439-43c1-869a-6bca51eda30f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058406 Oct 01 21:13:49.627359 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3214/4484] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:13:49.633770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1559827571", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aff7b153-98c7-4cda-8b6f-d6403aba7e87"}], "security_groups": [{"name": "tempest-securitygroup--456929901"}], "key_name": "tempest-keypair-818310812", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:49.987642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] validate_networks() for [('aff7b153-98c7-4cda-8b6f-d6403aba7e87', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:13:50.522363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:13:50.522982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:13:50.523585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:13:50.524112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:13:50.524705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:13:50.534571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:50.535183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:50.535907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:50.536883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:50.537583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:50.538358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:50.559841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:13:50.567159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Getting quotas for user 902ba44d318d4a01a510f732d27467c9 and project 24a06f5da36b4488a1b8ea01729b0e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:13:50.581894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:13:50.584677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:13:50.640984 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf97ef86-e6b8-4c6b-949d-925c2702939f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.012059 Oct 01 21:13:50.642410 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3215/4485] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:13:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:13:50.647852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:50.648853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:50.657245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:50.657748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:50.658427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:50.659409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:50.660048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:50.660664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:50.865515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:50.881473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:50.883913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:50.885935 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-16319309-7290-4436-be11-f4acecbf2cb6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1716 microversion: 2.20 time: 0.242341 Oct 01 21:13:50.887017 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3216/4486] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:13:50 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1716 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:13:50.892247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:50.892873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:50.899168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:50.899856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:50.900309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:50.901690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:50.902163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:50.902819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:51.132481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:51.143501 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-41bc96a1-6de8-4935-9155-9193c8ad7857 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1315 microversion: 2.1 time: 0.255084 Oct 01 21:13:51.149784 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3217/4487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:50 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:51.163028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-738f03ed-78d8-4963-9487-cadd395025c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:51.163918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-738f03ed-78d8-4963-9487-cadd395025c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:51.269570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-738f03ed-78d8-4963-9487-cadd395025c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:51.277813 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-738f03ed-78d8-4963-9487-cadd395025c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1241 microversion: 2.1 time: 0.126462 Oct 01 21:13:51.278967 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3218/4488] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:51 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:52.174276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:52.175297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:52.189324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:52.192464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:52.193202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:52.195942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:52.196632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:52.197546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:52.538681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:52.550265 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-428f6af1-4d9f-4db1-9de4-ef4ee64d5dbe tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1315 microversion: 2.1 time: 0.380901 Oct 01 21:13:52.563878 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3219/4489] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:52 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:52.573468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:52.574099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:52.580285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:52.580984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:52.581637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:52.582348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:52.583017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:52.583454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:52.669030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:52.682847 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2838bb79-97fc-4ba0-9a69-eec3aa1f5f5a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1299 microversion: 2.1 time: 0.116991 Oct 01 21:13:52.684601 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3220/4490] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:52 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:53.576418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:53.577944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:53.589471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:53.591956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:53.592633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:53.594617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:53.596175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:53.597271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:53.941713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:53.952429 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-28d761b6-4c6e-4c3d-8e04-cbc1ed501329 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1315 microversion: 2.1 time: 0.379769 Oct 01 21:13:53.954086 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3221/4491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:53 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:53.959146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:53.959964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:53.968135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:53.968638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:53.969146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:53.969886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:53.970567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:53.971053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:54.301094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:54.311901 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8e53fe53-0ce0-43dc-8ee4-27b2604b9a9f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1366 microversion: 2.1 time: 0.355195 Oct 01 21:13:54.332020 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3222/4492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:53 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:54.872718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d18b70db-e4ce-46af-a295-133c6126761c req-623bfcb3-602a-4ede-982d-59a5564dda66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd11de4c-ab80-4e39-a22f-c7b9819cc969", "tag": "0eec32ed-1254-410a-9ffa-28306c2a9e8d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:54.890557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d18b70db-e4ce-46af-a295-133c6126761c req-623bfcb3-602a-4ede-982d-59a5564dda66 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:54.891402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d18b70db-e4ce-46af-a295-133c6126761c req-623bfcb3-602a-4ede-982d-59a5564dda66 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:54.891859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d18b70db-e4ce-46af-a295-133c6126761c req-623bfcb3-602a-4ede-982d-59a5564dda66 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:54.920318 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d18b70db-e4ce-46af-a295-133c6126761c req-623bfcb3-602a-4ede-982d-59a5564dda66 service nova] Creating event network-changed:0eec32ed-1254-410a-9ffa-28306c2a9e8d for instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 on nch1-master-1 Oct 01 21:13:54.927745 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d18b70db-e4ce-46af-a295-133c6126761c req-623bfcb3-602a-4ede-982d-59a5564dda66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059728 Oct 01 21:13:54.929015 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3223/4493] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:13:54.981669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:54.982414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:54.992025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:54.992544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:54.993367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:54.994355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:54.994876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:54.995508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:55.353586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:55.368554 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3c03d9f3-7cf8-4f8c-ae60-ba98da78ee91 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1315 microversion: 2.1 time: 0.394131 Oct 01 21:13:55.370079 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3224/4494] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:54 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:55.379960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:55.380884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:55.393960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:55.394531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:55.394973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:55.395692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:55.398841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:55.399355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:55.682918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:55.693851 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2134f71b-7c18-40c6-b1cb-2f1b8520d1c8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1366 microversion: 2.1 time: 0.321659 Oct 01 21:13:55.697892 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3225/4495] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:55 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:55.710262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-af523b3d-e910-4685-91d6-a79acb63be4c req-93e74f21-c9e6-41ba-9289-ad27677b9989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32c1b21-13b4-48e6-8922-eccf5475dd67", "name": "network-vif-plugged", "status": "completed", "tag": "0b30c950-40ed-4a83-8927-e56eabb89e23"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:55.724655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-af523b3d-e910-4685-91d6-a79acb63be4c req-93e74f21-c9e6-41ba-9289-ad27677b9989 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:55.725509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-af523b3d-e910-4685-91d6-a79acb63be4c req-93e74f21-c9e6-41ba-9289-ad27677b9989 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:55.726306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-af523b3d-e910-4685-91d6-a79acb63be4c req-93e74f21-c9e6-41ba-9289-ad27677b9989 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:55.740501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:13:55.744770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-af523b3d-e910-4685-91d6-a79acb63be4c req-93e74f21-c9e6-41ba-9289-ad27677b9989 service nova] Creating event network-vif-plugged:0b30c950-40ed-4a83-8927-e56eabb89e23 for instance e32c1b21-13b4-48e6-8922-eccf5475dd67 on nch2-master-1 Oct 01 21:13:55.750019 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-af523b3d-e910-4685-91d6-a79acb63be4c req-93e74f21-c9e6-41ba-9289-ad27677b9989 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044686 Oct 01 21:13:55.751093 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3226/4496] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:13:56.396097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:56.398225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:56.410363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:56.411249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:56.412153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:56.413778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:56.414890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:56.415809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:56.664506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:56.675587 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98611df3-ab7e-4a2f-a025-f79618dd0c1d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1315 microversion: 2.1 time: 0.285387 Oct 01 21:13:56.676367 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3227/4497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:56 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:56.721041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:56.722327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:56.730741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:56.731359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:56.732183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:56.733082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:56.733720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:56.734162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:56.888369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:56.900602 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-73384d9f-a96c-4560-833b-c7108c232f55 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1366 microversion: 2.1 time: 0.183671 Oct 01 21:13:56.901291 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3228/4498] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:56 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:57.706452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:57.707191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:57.715840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:57.716644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:57.717272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:57.717994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:57.718530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:57.719106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:58.135880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:58.147841 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebbba8a5-771e-44fb-a8bc-e7ee6a9e4c0d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1503 microversion: 2.1 time: 0.445343 Oct 01 21:13:58.148766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3229/4499] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:57 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1503 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:58.153783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:58.154480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:58.160996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:58.161494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:58.162089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:58.164489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:58.165793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:58.166438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:58.341179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:58.349767 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9196ea74-4f15-4f56-94b4-a05d3610b503 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1366 microversion: 2.1 time: 0.199877 Oct 01 21:13:58.350734 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3230/4500] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:58 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:58.356018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:13:58.356615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:58.362671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:58.363341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:58.363933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:58.364816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:58.365265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:58.365866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:58.392222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lazy-loading 'flavor' on Instance uuid e32c1b21-13b4-48e6-8922-eccf5475dd67 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:13:58.681546 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-620b9348-02a7-40d2-bdd0-ff2142632083 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67/action" status: 202 len: 0 microversion: 2.1 time: 0.328663 Oct 01 21:13:58.682573 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3231/4501] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:13:58 2022] POST /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:13:58.696624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:58.697800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:58.709020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:58.710145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:58.711358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:58.712833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:58.713562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:58.714287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:58.868736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:58.877089 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb97934a-8d22-4326-8f34-9b334fdcab01 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.189137 Oct 01 21:13:58.877673 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3232/4502] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:58 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:13:59.375155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:59.376623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:59.386256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:59.387565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:59.388481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:59.389390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:59.390082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:59.390601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:59.566388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:13:59.582881 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fc1a59b-3369-473c-89cc-7c154bccf3f8 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1366 microversion: 2.1 time: 0.212525 Oct 01 21:13:59.583892 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3233/4503] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:59 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:13:59.900944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:13:59.901616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:13:59.908842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:59.909358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:59.909814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:13:59.910562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:13:59.911030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:13:59.911630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:00.089179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:00.098805 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f9fb78f8-b21b-4c7d-ba9e-6490ac9ff05a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.202730 Oct 01 21:14:00.099546 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3234/4504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:13:59 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:00.607520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:00.608437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:00.612411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:00.618575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:00.619569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:00.620212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:00.621465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:00.622235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:00.622895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:00.786381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:00.795204 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-18297d28-0f58-456e-bb8f-6d6972176006 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1366 microversion: 2.1 time: 0.192442 Oct 01 21:14:00.796172 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3235/4505] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:00 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:01.123959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:01.124708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:01.132141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:01.132942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:01.134710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:01.135627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:01.136316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:01.136932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:01.275176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=20 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:01.353639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:01.365606 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fce4df55-14f7-40c9-8451-102abb7d26c1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.245830 Oct 01 21:14:01.367562 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3236/4506] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:01 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:01.389175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-10cd997f-8ba1-4fa7-b633-7d92ca9eb4ba req-8fa4b86b-46fc-4e5d-ae21-83ce91181382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd11de4c-ab80-4e39-a22f-c7b9819cc969", "name": "network-vif-plugged", "status": "completed", "tag": "0eec32ed-1254-410a-9ffa-28306c2a9e8d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:01.407888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-10cd997f-8ba1-4fa7-b633-7d92ca9eb4ba req-8fa4b86b-46fc-4e5d-ae21-83ce91181382 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:01.408954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-10cd997f-8ba1-4fa7-b633-7d92ca9eb4ba req-8fa4b86b-46fc-4e5d-ae21-83ce91181382 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:01.409881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-10cd997f-8ba1-4fa7-b633-7d92ca9eb4ba req-8fa4b86b-46fc-4e5d-ae21-83ce91181382 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:01.429382 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-10cd997f-8ba1-4fa7-b633-7d92ca9eb4ba req-8fa4b86b-46fc-4e5d-ae21-83ce91181382 service nova] Creating event network-vif-plugged:0eec32ed-1254-410a-9ffa-28306c2a9e8d for instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 on nch1-master-1 Oct 01 21:14:01.436660 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-10cd997f-8ba1-4fa7-b633-7d92ca9eb4ba req-8fa4b86b-46fc-4e5d-ae21-83ce91181382 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053721 Oct 01 21:14:01.440340 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3237/4507] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:01.819620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:01.820449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:01.828331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:01.829020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:01.829615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:01.830371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:01.830963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:01.831473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:01.982230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:01.990384 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d51970f-d883-42ed-bae8-9b4a15c61bb9 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1366 microversion: 2.1 time: 0.175462 Oct 01 21:14:01.991126 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3238/4508] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:01 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:02.392209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:02.392835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:02.399516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:02.400183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:02.400629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:02.401328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:02.401945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:02.402379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:02.564057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:02.572778 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea69a2b1-3d98-4b4d-a80b-60a829f81506 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.184614 Oct 01 21:14:02.573707 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3239/4509] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:02 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:03.016032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:03.016751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:03.035988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:03.038001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:03.043592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:03.046611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:03.048337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:03.049224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:03.256290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:03.268455 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a0046d76-ec66-4131-b210-902db930147a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1555 microversion: 2.1 time: 0.256015 Oct 01 21:14:03.270390 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3240/4510] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:03 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:03.295460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c3ae8d9d-e015-4fec-8310-edc1fd74c254 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:03.297974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c3ae8d9d-e015-4fec-8310-edc1fd74c254 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:03.309915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ae8d9d-e015-4fec-8310-edc1fd74c254 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:03.310600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ae8d9d-e015-4fec-8310-edc1fd74c254 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:03.313094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ae8d9d-e015-4fec-8310-edc1fd74c254 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:03.313872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ae8d9d-e015-4fec-8310-edc1fd74c254 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:03.314338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ae8d9d-e015-4fec-8310-edc1fd74c254 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:03.314886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ae8d9d-e015-4fec-8310-edc1fd74c254 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:03.419852 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c3ae8d9d-e015-4fec-8310-edc1fd74c254 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129691 Oct 01 21:14:03.420855 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3241/4511] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:14:03 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:14:03.604809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:03.605445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:03.611647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:03.612473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:03.613312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:03.614181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:03.614905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:03.615521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:03.638811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:03.873394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:03.881314 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-332fd86e-77a6-47c7-86e2-6131477d52bc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.280734 Oct 01 21:14:03.881896 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3242/4512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:03 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:04.907827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:04.908460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:04.918663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:04.919234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:04.919769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:04.921285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:04.921851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:04.922396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:05.145159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:05.161733 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-97368af8-6cbe-45e8-8f95-8c241a548c0a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.260839 Oct 01 21:14:05.162483 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3243/4513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:04 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:05.170101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-49bb1445-93d7-4042-960d-74bcb9575852 req-3c0124c7-a5ae-4586-94bc-daf15ecd7caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd11de4c-ab80-4e39-a22f-c7b9819cc969", "tag": "0eec32ed-1254-410a-9ffa-28306c2a9e8d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:05.185461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-49bb1445-93d7-4042-960d-74bcb9575852 req-3c0124c7-a5ae-4586-94bc-daf15ecd7caf service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:05.186201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-49bb1445-93d7-4042-960d-74bcb9575852 req-3c0124c7-a5ae-4586-94bc-daf15ecd7caf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:05.187189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-49bb1445-93d7-4042-960d-74bcb9575852 req-3c0124c7-a5ae-4586-94bc-daf15ecd7caf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:05.218205 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-49bb1445-93d7-4042-960d-74bcb9575852 req-3c0124c7-a5ae-4586-94bc-daf15ecd7caf service nova] Creating event network-changed:0eec32ed-1254-410a-9ffa-28306c2a9e8d for instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 on nch1-master-1 Oct 01 21:14:05.224771 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-49bb1445-93d7-4042-960d-74bcb9575852 req-3c0124c7-a5ae-4586-94bc-daf15ecd7caf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061091 Oct 01 21:14:05.225542 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3244/4514] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:06.191244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:06.192101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:06.200255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:06.200811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:06.201209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:06.201935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:06.202412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:06.202890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:06.374538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:06.387674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6b4e9a14-b4b3-49d0-abbf-398299d0b163 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.202235 Oct 01 21:14:06.405502 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3245/4515] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:06 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:07.413153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:07.414158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:07.422636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:07.423363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:07.424211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:07.425011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:07.425656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:07.426171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:07.575686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:07.586997 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ea5cd1c-9c29-42e2-9e29-b39545004a22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.178711 Oct 01 21:14:07.587651 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3246/4516] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:07 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:08.610393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:08.611641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:08.619495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:08.620180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:08.620771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:08.621657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:08.622263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:08.623353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:08.784597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:08.794891 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-00b1533b-2ce9-4756-bd28-b487eba5720d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.187604 Oct 01 21:14:08.795764 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3247/4517] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:08 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:09.819271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:09.820710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:09.835688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:09.836720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:09.837340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:09.838419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:09.838929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:09.839369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:10.015084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:10.024794 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f737a1c-8b59-4397-879c-7eeb57877d4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.209357 Oct 01 21:14:10.038595 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3248/4518] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:09 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:10.744692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b55b0e7-33bf-42d6-a65a-d7b2dec0100c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'create', calling method: .version_select at 0x7f4172795af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-328398167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl8XFlpRkTlKHk08vc9yXHbIgHhVLw5mU7hO1LBz+t/ajGv193cTa1JlbDGSKTGOP+D0+9+q6s9EGiVI/z8u5R+Ke5Kpn9x0tYCg7Wx2xJUJROzxyJgbbni81turoJ57g=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:10.761217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3b55b0e7-33bf-42d6-a65a-d7b2dec0100c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for project 71511e85c1b947e3b03501b27d70d560. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:14:10.768341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3b55b0e7-33bf-42d6-a65a-d7b2dec0100c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for user f77486ef55a0469a99c3795b626bee1a and project 71511e85c1b947e3b03501b27d70d560. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:14:10.789082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:10.795950 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b55b0e7-33bf-42d6-a65a-d7b2dec0100c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.245165 Oct 01 21:14:10.803997 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3249/4519] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:14:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:14:11.052128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:11.052788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:11.060446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:11.060960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:11.061602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:11.062482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:11.062982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:11.063595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:11.273124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:11.283231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b510872e-3100-4820-a88f-f669793a1425 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.237210 Oct 01 21:14:11.283823 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3250/4520] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:11 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:12.308202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:12.309021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:12.316922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:12.317622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:12.318178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:12.319222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:12.319803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:12.320638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:12.469944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:12.484624 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-379e9920-6542-44be-949a-4f51e74bd4ce tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.181114 Oct 01 21:14:12.499867 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3251/4521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:12 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:13.511594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:13.512299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:13.519710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:13.520422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:13.521020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:13.522037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:13.522529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:13.523157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:13.670219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:13.678706 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd18084f-24dd-41a9-b6eb-037f129e87a6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.171734 Oct 01 21:14:13.679447 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3252/4522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:13 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:14.703710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:14.704954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:14.720771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:14.721300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:14.721740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:14.722470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:14.722975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:14.723416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:15.016163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:15.037185 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-804cd65d-99d7-467f-92e7-576332fc2090 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.338505 Oct 01 21:14:15.038190 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3253/4523] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:14 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:16.069732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:16.071667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:16.079437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:16.080156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:16.080777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:16.081822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:16.082437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:16.083098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:16.378616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:16.391820 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-718a0add-32b2-4d49-b890-00119d3dee4e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.327318 Oct 01 21:14:16.392679 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3254/4524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:16 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:17.416364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:17.416980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:17.423968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:17.435878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:17.436352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:17.437116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:17.437584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:17.438019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:17.665832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:17.686775 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-63e2be89-015f-4746-af1d-34280167bf03 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.274710 Oct 01 21:14:17.688243 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3255/4525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:17 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:18.211575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1776802834", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "95dede47-152b-43ab-822e-7d8e3f4c0a58"}], "key_name": "tempest-TestNetworkAdvancedServerOps-328398167", "security_groups": [{"name": "tempest-secgroup-smoke-1444726115"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:18.352357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] validate_networks() for [('95dede47-152b-43ab-822e-7d8e3f4c0a58', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:14:18.810358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:14:18.810966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:14:18.811506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:14:18.812019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:14:18.812529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:14:18.824823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:18.825635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:18.826420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:18.827493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:18.828169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:18.828845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:18.870267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for project 71511e85c1b947e3b03501b27d70d560. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:14:18.886668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for user f77486ef55a0469a99c3795b626bee1a and project 71511e85c1b947e3b03501b27d70d560. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:14:18.909612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:14:18.913585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:14:18.995249 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3867e141-426f-4b3f-b3a7-113d44189d92 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787696 Oct 01 21:14:19.011969 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3256/4526] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:14:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:14:19.020363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:19.020942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:19.028847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:19.029556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:19.030383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:19.031266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:19.032084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:19.032783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:19.203511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:19.215465 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95c831ef-cd93-4b39-a5cb-b3e8d4472f6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.202294 Oct 01 21:14:19.216191 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3257/4527] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:19 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:19.365731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Calling method '.version_select at 0x7f41726d48b0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:19.368736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:19.369450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:19.370089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:19.386356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:19.387168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:19.387884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:19.400206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:19.400782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:19.401308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:19.407596 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e37713d5-834c-42ed-8620-0e5f80e30d29 tempest-PortsAdminExtendedAttrsTestJSON-620380373 tempest-PortsAdminExtendedAttrsTestJSON-620380373-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.189891 Oct 01 21:14:19.408418 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3258/4528] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 21:14:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:19.414014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-01f2bb7b-8076-4890-bad8-0d0a0b73b0b6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:19.419341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-01f2bb7b-8076-4890-bad8-0d0a0b73b0b6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:19.488258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-01f2bb7b-8076-4890-bad8-0d0a0b73b0b6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:19.496313 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-01f2bb7b-8076-4890-bad8-0d0a0b73b0b6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1266 microversion: 2.1 time: 0.086691 Oct 01 21:14:19.497076 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3259/4529] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:19 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:20.240580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:20.243207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:20.250761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:20.251548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:20.252430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:20.253324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:20.254069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:20.254530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:20.605175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:20.614135 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-524a9af3-cb67-49d3-becf-8d0571f84a85 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.379116 Oct 01 21:14:20.614759 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3260/4530] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:20 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:20.637846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:20.638784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:20.645164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:20.645814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:20.646393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:20.647249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:20.647819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:20.648930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:20.775438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:20.785243 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ca9f3d5-8ace-4433-bc3d-843222eb3240 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1324 microversion: 2.1 time: 0.151386 Oct 01 21:14:20.786199 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3261/4531] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:20 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1324 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:21.641482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:21.643309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:21.650824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:21.651585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:21.653148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:21.654172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:21.654888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:21.655634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:21.682320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:21.920892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:21.934143 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8e2bc41d-f1b5-4c83-b50c-fca1198140b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.296638 Oct 01 21:14:21.935261 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3262/4532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:21 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:21.942291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:21.943166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:21.951875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:21.952804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:21.953773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:21.956490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:21.958516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:21.959235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:22.443411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:22.452242 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2272c04a-29ad-4c17-bc3d-7db1dff7c844 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1392 microversion: 2.1 time: 0.515421 Oct 01 21:14:22.452837 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3263/4533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:21 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1392 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:22.801178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b0dea79a-34d7-4a11-bc5f-339ca21ff5c6 req-ced5b302-a033-4991-9356-b06d4b91d30f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05029414-2d25-49f4-9f77-3199c6a8fa80", "tag": "3b971980-8326-448b-afd2-1e2b532deb8c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:22.825525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b0dea79a-34d7-4a11-bc5f-339ca21ff5c6 req-ced5b302-a033-4991-9356-b06d4b91d30f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:22.828232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b0dea79a-34d7-4a11-bc5f-339ca21ff5c6 req-ced5b302-a033-4991-9356-b06d4b91d30f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:22.828952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b0dea79a-34d7-4a11-bc5f-339ca21ff5c6 req-ced5b302-a033-4991-9356-b06d4b91d30f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:22.844779 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b0dea79a-34d7-4a11-bc5f-339ca21ff5c6 req-ced5b302-a033-4991-9356-b06d4b91d30f service nova] Creating event network-changed:3b971980-8326-448b-afd2-1e2b532deb8c for instance 05029414-2d25-49f4-9f77-3199c6a8fa80 on nch1-master-1 Oct 01 21:14:22.851110 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b0dea79a-34d7-4a11-bc5f-339ca21ff5c6 req-ced5b302-a033-4991-9356-b06d4b91d30f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054074 Oct 01 21:14:22.852795 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3264/4534] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:14:22.966259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:22.967212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:22.974101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:22.974837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:22.975435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:22.976949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:22.977415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:22.978000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:23.230419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:23.239242 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e0672d72-260b-4b77-bfa0-27a356d5dc72 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1509 microversion: 2.1 time: 0.280288 Oct 01 21:14:23.239846 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3265/4535] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:22 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:23.475634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:23.476826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:23.482866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:23.483364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:23.483812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:23.484519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:23.484984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:23.485421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:23.628079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:23.637144 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7166dbe9-2ec4-481a-883a-15d741d1a060 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1392 microversion: 2.1 time: 0.165411 Oct 01 21:14:23.637735 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3266/4536] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:23 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:23.715547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a592a25b-beae-47ac-8562-c4bf056de177 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:23.717892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a592a25b-beae-47ac-8562-c4bf056de177 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:23.724370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a592a25b-beae-47ac-8562-c4bf056de177 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:23.724968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a592a25b-beae-47ac-8562-c4bf056de177 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:23.725499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a592a25b-beae-47ac-8562-c4bf056de177 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:23.726828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a592a25b-beae-47ac-8562-c4bf056de177 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:23.727397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a592a25b-beae-47ac-8562-c4bf056de177 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:23.727912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a592a25b-beae-47ac-8562-c4bf056de177 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:23.758617 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a592a25b-beae-47ac-8562-c4bf056de177 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047113 Oct 01 21:14:23.759380 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3267/4537] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Oct 1 21:14:23 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:23.826861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:23.828507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:23.834912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:23.835500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:23.842602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:23.843369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:23.844057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:23.845037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:23.876360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:14:23.963842 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-615d9be1-f549-463d-b462-d74e18b69fb4 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 204 len: 0 microversion: 2.20 time: 0.141793 Oct 01 21:14:23.964548 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3268/4538] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:14:23 2022] DELETE /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 01 21:14:23.973168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:23.973866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:23.980608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:23.981187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:23.981765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:23.982535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:23.983032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:23.983467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:24.122998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:24.131849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:24.133304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:24.134549 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a3f977a-eed1-4892-b1ba-edb34047f306 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1722 microversion: 2.20 time: 0.165518 Oct 01 21:14:24.135434 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3269/4539] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:14:23 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:14:24.263269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:24.264013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:24.270271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:24.270804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:24.271333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:24.271936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:24.272395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:24.272825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:24.445661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:24.453812 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-002d9e6f-a04f-4df2-b4d0-fe4dd5613be5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1530 microversion: 2.1 time: 0.194464 Oct 01 21:14:24.454412 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3270/4540] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:24 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1530 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:24.660668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:24.661274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:24.667411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:24.667907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:24.668348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:24.669053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:24.669513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:24.669946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:24.821957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:24.830159 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb582591-f85b-4e44-a294-0632b77c03ba tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1392 microversion: 2.1 time: 0.173746 Oct 01 21:14:24.830774 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3271/4541] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:24 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:25.160460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:25.161184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:25.168637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:25.169206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:25.169721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:25.170583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:25.171061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:25.171560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:25.311056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:25.321154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:25.322829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:25.324142 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9db435f9-61bc-4f60-a6a1-30adf31c3240 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1722 microversion: 2.20 time: 0.167770 Oct 01 21:14:25.324831 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3272/4542] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:14:25 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:14:25.477862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:25.478480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:25.485270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:25.485804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:25.486255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:25.487381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:25.487859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:25.488329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:25.743147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:25.752361 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f3c7af0-8bb0-4d53-844c-1f24250a54fd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1530 microversion: 2.1 time: 0.278926 Oct 01 21:14:25.752975 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3273/4543] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:25 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1530 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:25.854515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:25.855177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:25.862961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:25.866241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:25.867519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:25.868303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:25.869054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:25.869762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:26.231701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:26.242791 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f1ac2f85-ac4b-4efc-9941-f8d0d319d33c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1392 microversion: 2.1 time: 0.392686 Oct 01 21:14:26.243481 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3274/4544] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:25 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1392 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:26.352848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:26.353541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:26.364658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:26.365792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:26.367471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:26.368443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:26.369131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:26.369707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:26.589279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:26.606678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:26.608342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d79dff848bf40fc89377e13736c527b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa37082733634ec688c9d6272a0d9b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:26.609713 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d400b65e-33fe-4286-89a1-d96f9cf624e7 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 200 len: 1722 microversion: 2.20 time: 0.262248 Oct 01 21:14:26.627442 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3275/4545] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:14:26 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:14:26.776278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:26.776902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:26.782995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:26.783748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:26.784348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:26.785525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:26.786147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:26.786604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:27.026712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG neutronclient.v2_0.client [None req-1259ada0-649e-40f4-991a-ee9cde93bc82 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Error message: {"NeutronError": {"type": "NetworkNotFound", "message": "Network 9417f59c-8d13-4179-a6ee-0176ac73cf1c could not be found.", "detail": ""}} {{(pid=140437) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [None req-1259ada0-649e-40f4-991a-ee9cde93bc82 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Unexpected exception in API method: neutronclient.common.exceptions.NetworkNotFoundClient: Network 9417f59c-8d13-4179-a6ee-0176ac73cf1c could not be found. Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: Neutron server returns request_ids: ['req-22be23cf-f5f1-4553-b45b-b1cade0bd0bf'] Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2347, in create_resource_requests Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi physnet, tunneled_ = self._get_physnet_tunneled_info( Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2157, in _get_physnet_tunneled_info Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi net = neutron.show_network( Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 865, in show_network Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.get(self.network_path % (network), params=_params) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NetworkNotFoundClient: Network 9417f59c-8d13-4179-a6ee-0176ac73cf1c could not be found. Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22be23cf-f5f1-4553-b45b-b1cade0bd0bf'] Oct 01 21:14:27.029950 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.036130 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-1259ada0-649e-40f4-991a-ee9cde93bc82 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 01 21:14:27.036130 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1259ada0-649e-40f4-991a-ee9cde93bc82 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Request method failure captured: Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 230 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKoE1ZguN06TmtW63JYY_kdG4A7RNhm4nGAsGcmIwLyYRgqi5LTYu8KuTznI8m95HBepDm5jKr5_QV6UigzJhkayuUlPeTVFkAEC31ASP0w2O4-v2IJMQoAikc3S2KtNCWxT_Hd1T__9UUCvQQRP1q6HCJnM8SW8DtZBh6nP7XZzHJg Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersTestJSON-779875357 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bea57d3c53f74e3ea78e9e4bc790c434", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bea57d3c53f74e3ea78e9e4bc790c434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bea57d3c53f74e3ea78e9e4bc790c434"}]}] Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersTestJSON-779875357 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: bea57d3c53f74e3ea78e9e4bc790c434 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersTestJSON-779875357 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersTestJSON-779875357-project Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 775ff9091a794faaacc05a37550c8a72 Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersTestJSON-779875357-project Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: {"server": {"name": "tempest-ServersTestJSON-server-1557023418", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "testpassword", "networks": [{"uuid": "9417f59c-8d13-4179-a6ee-0176ac73cf1c"}]}} Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1557023418', 'imageRef': '90f3f35e-76ec-4c31-b581-329b315fe607', 'flavorRef': '452', 'adminPass': 'testpassword', 'networks': [{'uuid': '9417f59c-8d13-4179-a6ee-0176ac73cf1c'}]}}} Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2347, in create_resource_requests Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi physnet, tunneled_ = self._get_physnet_tunneled_info( Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2157, in _get_physnet_tunneled_info Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi net = neutron.show_network( Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.040195 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 865, in show_network Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.get(self.network_path % (network), params=_params) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NetworkNotFoundClient: Network 9417f59c-8d13-4179-a6ee-0176ac73cf1c could not be found. Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22be23cf-f5f1-4553-b45b-b1cade0bd0bf'] Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.043834 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.049681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1259ada0-649e-40f4-991a-ee9cde93bc82 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 01 21:14:27.049681 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:27.050447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:27.052776 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1259ada0-649e-40f4-991a-ee9cde93bc82 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 500 len: 227 microversion: 2.1 time: 902.303960 Oct 01 21:14:27.053556 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:14:27.058437 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:14:27 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.17) Oct 01 21:14:27.059985 ncdv-master-1 devstack@n-api.service[140437]: CRITICAL nova [None req-1259ada0-649e-40f4-991a-ee9cde93bc82 tempest-ServersTestJSON-779875357 tempest-ServersTestJSON-779875357-project] Unhandled error: OSError: write error Oct 01 21:14:27.059985 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova OSError: write error Oct 01 21:14:27.059985 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova Oct 01 21:14:27.060568 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1271/4546] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 20:59:24 2022] POST /compute/v2.1/servers => generated 0 bytes in 902313 msecs (HTTP/1.1 500) 9 headers in 0 bytes (0 switches on core 0) Oct 01 21:14:27.062157 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9902022a-840c-4dc4-a96d-af96d070d45b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.289865 Oct 01 21:14:27.062825 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3276/4547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:26 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:27.270736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:27.271504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:27.292338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:27.292851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:27.297993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:27.300689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:27.303871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:27.307758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:27.639902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:27.657306 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c4dabae4-e933-464f-962c-91869dcb4ed1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1392 microversion: 2.1 time: 0.388815 Oct 01 21:14:27.673942 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3277/4548] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:27 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:27.685726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:27.686355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:27.700667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:27.702092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:27.705249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:27.709526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:27.711732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:27.712373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:27.724840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:27.752191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-31b6e737-e8cc-4055-a18d-b6894b116408 req-71c9db1b-b1ea-49a0-97da-a2128b2ecb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7620a7c8-10dc-46b4-ba02-f5397ddb1a13", "name": "network-vif-deleted", "tag": "a4548064-3301-41dc-8a77-f87fc32359d1"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:27.765896 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] HTTP exception thrown: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Request method failure captured: Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 HTTP/1.1 Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxXERhLbaQJrSxlUyqH4KUqwCnpzZeKyftuClfYCQAhDpvGC5wKlbCqJzUkF6UbP65JUKZM5rkvqsak_BbVmRwXbkrV7Sz1q49wWYT4jDVIxrOz5XAbY-DzS_Xg9jqs5PUZlZIzoLw56Kwxy25tmP72uP-gDZa_uqFc2CI-Bk7bVPg Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa37082733634ec688c9d6272a0d9b1d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}] Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 8d79dff848bf40fc89377e13736c527b Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7620a7c8-10dc-46b4-ba02-f5397ddb1a13'} Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.769569 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:27.775328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.775328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:27.775328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:27.775328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:27.775328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:27.775328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:27.775328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:27.775328 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:27.776083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-31b6e737-e8cc-4055-a18d-b6894b116408 req-71c9db1b-b1ea-49a0-97da-a2128b2ecb66 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:27.776083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-31b6e737-e8cc-4055-a18d-b6894b116408 req-71c9db1b-b1ea-49a0-97da-a2128b2ecb66 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:27.776493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-31b6e737-e8cc-4055-a18d-b6894b116408 req-71c9db1b-b1ea-49a0-97da-a2128b2ecb66 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:27.778784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Returning 404 to user: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:27.780045 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-54cc9f62-7b7d-4821-9daf-8373c340c9f8 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 404 len: 111 microversion: 2.20 time: 0.104675 Oct 01 21:14:27.784677 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3278/4549] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:14:27 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:14:27.792733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30ef704a-cd27-4549-9f00-e5c9efdc5b34 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '.version_select at 0x7f41726d74c0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:27.795590 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-31b6e737-e8cc-4055-a18d-b6894b116408 req-71c9db1b-b1ea-49a0-97da-a2128b2ecb66 service nova] Creating event network-vif-deleted:a4548064-3301-41dc-8a77-f87fc32359d1 for instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 on nch1-master-1 Oct 01 21:14:27.810319 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-31b6e737-e8cc-4055-a18d-b6894b116408 req-71c9db1b-b1ea-49a0-97da-a2128b2ecb66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.607868 Oct 01 21:14:27.813557 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1272/4550] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:27.836996 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-30ef704a-cd27-4549-9f00-e5c9efdc5b34 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138461293" status: 204 len: 0 microversion: 2.20 time: 0.051155 Oct 01 21:14:27.838737 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3279/4551] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Oct 1 21:14:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138461293 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:14:28.089427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7d330ba3-2b5c-4d38-a1e9-666afee2cd77 req-7c50ca5e-afa0-48b0-90d6-bf6557f1d956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32c1b21-13b4-48e6-8922-eccf5475dd67", "name": "network-vif-plugged", "status": "completed", "tag": "0b30c950-40ed-4a83-8927-e56eabb89e23"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:28.090904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:28.092311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:28.123185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:28.125963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:28.126623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:28.128069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:28.128188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7d330ba3-2b5c-4d38-a1e9-666afee2cd77 req-7c50ca5e-afa0-48b0-90d6-bf6557f1d956 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:28.128647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7d330ba3-2b5c-4d38-a1e9-666afee2cd77 req-7c50ca5e-afa0-48b0-90d6-bf6557f1d956 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:28.132553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:28.135265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:28.137816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7d330ba3-2b5c-4d38-a1e9-666afee2cd77 req-7c50ca5e-afa0-48b0-90d6-bf6557f1d956 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:28.164853 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7d330ba3-2b5c-4d38-a1e9-666afee2cd77 req-7c50ca5e-afa0-48b0-90d6-bf6557f1d956 service nova] Creating event network-vif-plugged:0b30c950-40ed-4a83-8927-e56eabb89e23 for instance e32c1b21-13b4-48e6-8922-eccf5475dd67 on nch2-master-1 Oct 01 21:14:28.172724 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7d330ba3-2b5c-4d38-a1e9-666afee2cd77 req-7c50ca5e-afa0-48b0-90d6-bf6557f1d956 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087226 Oct 01 21:14:28.174395 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3280/4552] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:14:28.682872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:28.683886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:28.715787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:28.716373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:28.716854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:28.717617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:28.722430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:28.722931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:28.840453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:28.994225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:29.023389 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-45ce3ae5-4ee9-41a4-a14b-ad382bbe2bc1 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.937963 Oct 01 21:14:29.027403 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1273/4553] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:28 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:29.144903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:29.156531 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0d6d3bf-0680-4530-b53a-e8acc164be40 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1392 microversion: 2.1 time: 0.479210 Oct 01 21:14:29.170633 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3281/4554] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:28 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1392 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:30.058972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:30.060451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:30.068909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:30.069910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:30.070582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:30.071628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:30.072581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:30.073786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:30.185977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:30.187399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:30.189545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:30.198183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:30.198723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:30.199178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:30.200072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:30.200882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:30.201336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:30.253218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:30.263507 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f85fdb12-e687-4809-99b7-bfde19b7e1c5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.212787 Oct 01 21:14:30.265352 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1274/4555] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:30 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:30.283514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-0de6b569-6ace-4759-964f-e251779d826f req-891c1ade-1e95-4ff6-ab33-bde7db247cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05029414-2d25-49f4-9f77-3199c6a8fa80", "name": "network-vif-plugged", "status": "completed", "tag": "3b971980-8326-448b-afd2-1e2b532deb8c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:30.302070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0de6b569-6ace-4759-964f-e251779d826f req-891c1ade-1e95-4ff6-ab33-bde7db247cb6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:30.303436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0de6b569-6ace-4759-964f-e251779d826f req-891c1ade-1e95-4ff6-ab33-bde7db247cb6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:30.303925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0de6b569-6ace-4759-964f-e251779d826f req-891c1ade-1e95-4ff6-ab33-bde7db247cb6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:30.324159 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-0de6b569-6ace-4759-964f-e251779d826f req-891c1ade-1e95-4ff6-ab33-bde7db247cb6 service nova] Creating event network-vif-plugged:3b971980-8326-448b-afd2-1e2b532deb8c for instance 05029414-2d25-49f4-9f77-3199c6a8fa80 on nch1-master-1 Oct 01 21:14:30.361000 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-0de6b569-6ace-4759-964f-e251779d826f req-891c1ade-1e95-4ff6-ab33-bde7db247cb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086667 Oct 01 21:14:30.361783 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1275/4556] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:30.419291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:30.428445 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2d19cea9-944f-4571-a5c1-692d1ac80129 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1392 microversion: 2.1 time: 0.246940 Oct 01 21:14:30.433731 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3282/4557] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:30 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1392 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:30.468193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:30.468787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:30.480815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:30.481307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:30.481750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:30.483370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:30.483833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:30.484263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:30.501215 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] HTTP exception thrown: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Request method failure captured: Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 HTTP/1.1 Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKxXERhLbaQJrSxlUyqH4KUqwCnpzZeKyftuClfYCQAhDpvGC5wKlbCqJzUkF6UbP65JUKZM5rkvqsak_BbVmRwXbkrV7Sz1q49wWYT4jDVIxrOz5XAbY-DzS_Xg9jqs5PUZlZIzoLw56Kwxy25tmP72uP-gDZa_uqFc2CI-Bk7bVPg Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa37082733634ec688c9d6272a0d9b1d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}] Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 8d79dff848bf40fc89377e13736c527b Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '7620a7c8-10dc-46b4-ba02-f5397ddb1a13'} Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:30.503162 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Returning 404 to user: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:30.506998 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-067850b8-3afd-4fe5-b6ad-5e5621ba8e48 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 404 len: 111 microversion: 2.20 time: 0.040765 Oct 01 21:14:30.508660 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1276/4558] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:14:30 2022] DELETE /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:14:30.515867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:30.516592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 7620a7c8-10dc-46b4-ba02-f5397ddb1a13] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:30.528203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:30.528798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:30.529464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:30.532220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:30.532703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:30.533149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:30.566273 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] HTTP exception thrown: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Request method failure captured: Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 HTTP/1.1 Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKxXERhLbaQJrSxlUyqH4KUqwCnpzZeKyftuClfYCQAhDpvGC5wKlbCqJzUkF6UbP65JUKZM5rkvqsak_BbVmRwXbkrV7Sz1q49wWYT4jDVIxrOz5XAbY-DzS_Xg9jqs5PUZlZIzoLw56Kwxy25tmP72uP-gDZa_uqFc2CI-Bk7bVPg Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa37082733634ec688c9d6272a0d9b1d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}] Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 8d79dff848bf40fc89377e13736c527b Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7620a7c8-10dc-46b4-ba02-f5397ddb1a13'} Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.576030 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Returning 404 to user: Instance 7620a7c8-10dc-46b4-ba02-f5397ddb1a13 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:30.580054 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f8ae449-9cfa-404f-8dec-48e659aeaf52 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13" status: 404 len: 111 microversion: 2.20 time: 0.068825 Oct 01 21:14:30.586075 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3283/4559] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:14:30 2022] GET /compute/v2.1/servers/7620a7c8-10dc-46b4-ba02-f5397ddb1a13 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:14:31.290083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:31.291002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:31.309538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:31.311272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:31.311914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:31.312669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:31.315057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:31.317251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:31.452176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:31.453834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:31.465793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:31.471264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:31.472384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:31.474290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:31.477545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:31.478097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:31.727633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:31.743961 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1af2f93c-021a-4e27-8db5-5b0be92e3629 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.451228 Oct 01 21:14:31.744920 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1277/4560] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:31 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:31.764279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:31.765199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:31.776916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:31.779693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:31.780698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:31.782903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:31.783506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:31.784717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:31.812678 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] HTTP exception thrown: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Request method failure captured: Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 HTTP/1.1 Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKxXERhLbaQJrSxlUyqH4KUqwCnpzZeKyftuClfYCQAhDpvGC5wKlbCqJzUkF6UbP65JUKZM5rkvqsak_BbVmRwXbkrV7Sz1q49wWYT4jDVIxrOz5XAbY-DzS_Xg9jqs5PUZlZIzoLw56Kwxy25tmP72uP-gDZa_uqFc2CI-Bk7bVPg Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa37082733634ec688c9d6272a0d9b1d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}] Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 8d79dff848bf40fc89377e13736c527b Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '97be5f25-216d-464d-944b-3d6108312f20'} Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:31.814708 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.818085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.820419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Returning 404 to user: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:31.821664 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-03877820-2137-44d3-8870-ad48dc8dccf6 tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "DELETE /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 404 len: 111 microversion: 2.20 time: 0.061842 Oct 01 21:14:31.822376 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1278/4561] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:14:31 2022] DELETE /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 01 21:14:31.830830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:31.831919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] [instance: 97be5f25-216d-464d-944b-3d6108312f20] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:31.840214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:31.842008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:31.842811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:31.844133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:31.844837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:31.845512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:31.866293 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] HTTP exception thrown: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Request method failure captured: Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 HTTP/1.1 Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKxXERhLbaQJrSxlUyqH4KUqwCnpzZeKyftuClfYCQAhDpvGC5wKlbCqJzUkF6UbP65JUKZM5rkvqsak_BbVmRwXbkrV7Sz1q49wWYT4jDVIxrOz5XAbY-DzS_Xg9jqs5PUZlZIzoLw56Kwxy25tmP72uP-gDZa_uqFc2CI-Bk7bVPg Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa37082733634ec688c9d6272a0d9b1d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa37082733634ec688c9d6272a0d9b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa37082733634ec688c9d6272a0d9b1d"}]}] Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: fa37082733634ec688c9d6272a0d9b1d Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705121323 Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 8d79dff848bf40fc89377e13736c527b Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705121323-project Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '97be5f25-216d-464d-944b-3d6108312f20'} Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.869209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:31.872714 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.872714 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:31.872714 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:31.872714 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:31.872714 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:31.872714 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:31.872714 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. Oct 01 21:14:31.872714 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:31.875085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] Returning 404 to user: Instance 97be5f25-216d-464d-944b-3d6108312f20 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:31.876234 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-19f9d0f7-77a4-4f62-adbe-8379e855dd9b tempest-AttachVolumeShelveTestJSON-705121323 tempest-AttachVolumeShelveTestJSON-705121323-project] 10.222.0.17 "GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20" status: 404 len: 111 microversion: 2.20 time: 0.049680 Oct 01 21:14:31.877373 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1279/4562] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:14:31 2022] GET /compute/v2.1/servers/97be5f25-216d-464d-944b-3d6108312f20 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:14:32.179760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:32.191658 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-27f9728a-e05c-4895-b54d-96a02bb6ad98 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1392 microversion: 2.1 time: 0.740258 Oct 01 21:14:32.196935 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3284/4563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:31 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1392 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:32.775900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:32.777164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:32.787784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:32.789076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:32.802242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:32.805203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:32.807102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:32.808590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:33.124163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:33.136597 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-196521f5-4194-48ac-9f06-e99e3780e65d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.366782 Oct 01 21:14:33.137480 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1280/4564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:32 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:33.212128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:33.216015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:33.219031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:33.225007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:33.226853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:33.227695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:33.229908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:33.230978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:33.231652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:33.448025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:33.464456 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f5b3ef64-530a-432b-a0fe-1d8b06f458f9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1565 microversion: 2.1 time: 0.256661 Oct 01 21:14:33.480784 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3285/4565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:33 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1565 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:33.494464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:33.495181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:33.506219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:33.506751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:33.509086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:33.510705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:33.511666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:33.512966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:33.718935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:33.730282 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-438fea9a-6606-48aa-abb3-6adf7f25db89 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1565 microversion: 2.1 time: 0.243347 Oct 01 21:14:33.731130 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1281/4566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:33 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1565 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:34.163386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:34.164246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:34.172278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:34.177176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:34.177877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:34.178844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:34.179506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:34.182542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:34.495081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:34.508569 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa7709c4-a9a3-4078-a594-a509d971f169 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.349280 Oct 01 21:14:34.519623 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3286/4567] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:34 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:35.544237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:35.544838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:35.568714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:35.569140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:35.569642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:35.575972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:35.579233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:35.581203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:36.334056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:36.353613 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2270545b-acff-4bda-bcd7-54c6a057bd88 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.812843 Oct 01 21:14:36.354337 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1282/4568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:35 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:37.379343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:37.381258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:37.389028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:37.389777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:37.390462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:37.391439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:37.392244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:37.392883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:37.583324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:37.603152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-30bda1b5-dfea-454f-964c-639b691b4e59 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.227868 Oct 01 21:14:37.617814 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3287/4569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:37 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:38.629423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:38.630039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:38.645085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:38.651699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:38.657285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:38.658409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:38.659604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:38.660280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:38.665874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:38.666523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:38.683610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:38.687794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:38.691436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:38.695242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:38.696269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:38.698937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:39.033337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:39.042275 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3d1fb6c8-8b49-4973-afc9-6fdbc21f83b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.416939 Oct 01 21:14:39.059931 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1283/4570] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:38 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:39.320069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:39.328369 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-803a9e78-070b-4541-9403-252ed30b3e6a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1565 microversion: 2.1 time: 0.668129 Oct 01 21:14:39.333095 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3288/4571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:38 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1565 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:39.340591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f359a9c7-56bc-4215-ab31-ff66a8c3679b req-952befc4-bd51-4d81-99bc-5c9f22e8f98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05029414-2d25-49f4-9f77-3199c6a8fa80", "tag": "3b971980-8326-448b-afd2-1e2b532deb8c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:39.365166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f359a9c7-56bc-4215-ab31-ff66a8c3679b req-952befc4-bd51-4d81-99bc-5c9f22e8f98b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:39.365897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f359a9c7-56bc-4215-ab31-ff66a8c3679b req-952befc4-bd51-4d81-99bc-5c9f22e8f98b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:39.366756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f359a9c7-56bc-4215-ab31-ff66a8c3679b req-952befc4-bd51-4d81-99bc-5c9f22e8f98b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:39.379443 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f359a9c7-56bc-4215-ab31-ff66a8c3679b req-952befc4-bd51-4d81-99bc-5c9f22e8f98b service nova] Creating event network-changed:3b971980-8326-448b-afd2-1e2b532deb8c for instance 05029414-2d25-49f4-9f77-3199c6a8fa80 on nch1-master-1 Oct 01 21:14:39.385581 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f359a9c7-56bc-4215-ab31-ff66a8c3679b req-952befc4-bd51-4d81-99bc-5c9f22e8f98b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324244 Oct 01 21:14:39.390503 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1284/4572] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:40.083897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:40.084524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:40.095250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:40.101453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:40.107619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:40.110263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:40.113108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:40.118761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:40.711830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:40.722898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29838c16-0607-409c-8a2c-f4d004d0a812 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.642621 Oct 01 21:14:40.724105 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3289/4573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:40 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:41.759279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:41.760697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:41.776536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:41.777869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:41.779615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:41.780889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:41.781643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:41.782606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:42.071865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:42.083367 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-273561e4-cd0b-4db8-9dfe-afb37c028e0f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.338510 Oct 01 21:14:42.088089 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1285/4574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:41 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:42.807713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f364c9c6-4769-43ba-bf29-6b3d6c778544 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:42.808723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f364c9c6-4769-43ba-bf29-6b3d6c778544 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:42.818946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364c9c6-4769-43ba-bf29-6b3d6c778544 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:42.819603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364c9c6-4769-43ba-bf29-6b3d6c778544 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:42.820060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364c9c6-4769-43ba-bf29-6b3d6c778544 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:42.820949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364c9c6-4769-43ba-bf29-6b3d6c778544 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:42.821423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364c9c6-4769-43ba-bf29-6b3d6c778544 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:42.821877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f364c9c6-4769-43ba-bf29-6b3d6c778544 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:42.930958 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f364c9c6-4769-43ba-bf29-6b3d6c778544 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/ips" status: 200 len: 149 microversion: 2.1 time: 0.127374 Oct 01 21:14:42.932126 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3290/4575] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Oct 1 21:14:42 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/ips => generated 149 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:43.112428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:43.113057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:43.156825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:43.157345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:43.157794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:43.161617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:43.171759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:43.172442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:43.488930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:43.499273 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b463770-f57d-49ff-a707-79a38983ad6c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1525 microversion: 2.1 time: 0.392656 Oct 01 21:14:43.515833 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1286/4576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:43 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1525 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:44.522115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:44.523919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:44.532545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:44.533263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:44.533918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:44.534881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:44.538852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:44.539518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:44.652164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-49305d10-9446-452f-816e-8797213f7c0b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cc6c2ae-e749-490d-86dd-a079f9551aa1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:44.654709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-49305d10-9446-452f-816e-8797213f7c0b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:44.661413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49305d10-9446-452f-816e-8797213f7c0b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:44.662200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49305d10-9446-452f-816e-8797213f7c0b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:44.662688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49305d10-9446-452f-816e-8797213f7c0b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:44.663461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49305d10-9446-452f-816e-8797213f7c0b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:44.663928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49305d10-9446-452f-816e-8797213f7c0b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:44.664362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49305d10-9446-452f-816e-8797213f7c0b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:44.892746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:44.915521 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2f3a7aa-dbfc-4aa1-b336-f002ab23a268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1507 microversion: 2.1 time: 0.397069 Oct 01 21:14:44.935613 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3291/4577] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:44 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:45.033873 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-49305d10-9446-452f-816e-8797213f7c0b tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "POST /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386228 Oct 01 21:14:45.035040 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1287/4578] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:14:44 2022] POST /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:45.941618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:45.943376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:45.952567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:45.953237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:45.953684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:45.954657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:45.954890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:45.955324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:46.171045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:46.181591 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e241d3b4-646d-40f4-9879-b101b56cb40d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1507 microversion: 2.1 time: 0.244298 Oct 01 21:14:46.182202 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3292/4579] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:45 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:47.206544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:47.207237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:47.214446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:47.215008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:47.215459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:47.216173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:47.216639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:47.217075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:47.371839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:47.384826 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3bb09fa5-a9d2-475f-ab1a-7c27ed5ec0f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 200 len: 1510 microversion: 2.1 time: 0.179475 Oct 01 21:14:47.385754 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1288/4580] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:47 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:47.409856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:47.410387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:47.429505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:47.430023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:47.430460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:47.431896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:47.432439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:47.433057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:47.468685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:14:47.476882 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.compute.api [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Working on deleting snapshot 493ad5b6-bc26-4d03-8048-58b27f57ba07 from shelved instance... Oct 01 21:14:47.857952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-766378fc-978a-4924-9be9-6879d9c83ea8 req-a720bc26-7597-4852-8684-ad7dc079640a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32c1b21-13b4-48e6-8922-eccf5475dd67", "name": "network-vif-unplugged", "status": "completed", "tag": "0b30c950-40ed-4a83-8927-e56eabb89e23"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:47.884083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-766378fc-978a-4924-9be9-6879d9c83ea8 req-a720bc26-7597-4852-8684-ad7dc079640a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:47.884705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-766378fc-978a-4924-9be9-6879d9c83ea8 req-a720bc26-7597-4852-8684-ad7dc079640a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:47.885587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-766378fc-978a-4924-9be9-6879d9c83ea8 req-a720bc26-7597-4852-8684-ad7dc079640a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:47.901913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.compute.server_external_events [req-766378fc-978a-4924-9be9-6879d9c83ea8 req-a720bc26-7597-4852-8684-ad7dc079640a service nova] Unable to find a host for instance e32c1b21-13b4-48e6-8922-eccf5475dd67. Dropping event network-vif-unplugged {{(pid=140437) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 01 21:14:47.903068 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-766378fc-978a-4924-9be9-6879d9c83ea8 req-a720bc26-7597-4852-8684-ad7dc079640a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050843 Oct 01 21:14:47.903959 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1289/4581] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 01 21:14:48.304849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Doing local delete in cell 2663fce6-13d1-4945-900e-d818f7f389c0(cell1) {{(pid=140438) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 01 21:14:48.305589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:48.306110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:48.306615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:48.307055 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.compute.api [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 01 21:14:48.311897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] deallocate_for_instance() {{(pid=140438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 01 21:14:48.650912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:48.651506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:48.665203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:48.665942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:48.666694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:48.667583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:48.668299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:48.668887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:48.764179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lazy-loading 'services' on Instance uuid bd11de4c-ab80-4e39-a22f-c7b9819cc969 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:14:48.848368 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-824331d8-468a-442c-8a77-b25d4df9907f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-volume_attachments/5cc6c2ae-e749-490d-86dd-a079f9551aa1" status: 202 len: 0 microversion: 2.1 time: 0.205593 Oct 01 21:14:48.848977 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1290/4582] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:14:48 2022] DELETE /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-volume_attachments/5cc6c2ae-e749-490d-86dd-a079f9551aa1 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:14:48.858396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8b210b5e-0e8e-45ce-9e29-48d2e0beb3e5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:48.867857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8b210b5e-0e8e-45ce-9e29-48d2e0beb3e5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:48.875310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b210b5e-0e8e-45ce-9e29-48d2e0beb3e5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:48.876063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b210b5e-0e8e-45ce-9e29-48d2e0beb3e5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:48.876699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b210b5e-0e8e-45ce-9e29-48d2e0beb3e5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:48.877605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b210b5e-0e8e-45ce-9e29-48d2e0beb3e5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:48.878312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b210b5e-0e8e-45ce-9e29-48d2e0beb3e5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:48.878925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b210b5e-0e8e-45ce-9e29-48d2e0beb3e5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:48.883565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:48.936866 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8b210b5e-0e8e-45ce-9e29-48d2e0beb3e5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082726 Oct 01 21:14:48.938117 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1291/4583] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:14:48 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:49.061452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-5167fbe2-86af-416d-9c17-015c8915c487 req-9058fc6c-4012-4b0a-b179-3ab9a0fad0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32c1b21-13b4-48e6-8922-eccf5475dd67", "name": "network-vif-deleted", "tag": "0b30c950-40ed-4a83-8927-e56eabb89e23"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:49.063446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Updating instance_info_cache with network_info: [] {{(pid=140438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 21:14:49.073477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5167fbe2-86af-416d-9c17-015c8915c487 req-9058fc6c-4012-4b0a-b179-3ab9a0fad0cf service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:49.074213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5167fbe2-86af-416d-9c17-015c8915c487 req-9058fc6c-4012-4b0a-b179-3ab9a0fad0cf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:49.074874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5167fbe2-86af-416d-9c17-015c8915c487 req-9058fc6c-4012-4b0a-b179-3ab9a0fad0cf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:49.101315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.compute.server_external_events [req-5167fbe2-86af-416d-9c17-015c8915c487 req-9058fc6c-4012-4b0a-b179-3ab9a0fad0cf service nova] Unable to find a host for instance e32c1b21-13b4-48e6-8922-eccf5475dd67. Dropping event network-vif-deleted {{(pid=140437) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 01 21:14:49.102619 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-5167fbe2-86af-416d-9c17-015c8915c487 req-9058fc6c-4012-4b0a-b179-3ab9a0fad0cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.047559 Oct 01 21:14:49.103865 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1292/4584] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 01 21:14:49.302313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:49.390699 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4363aa8-5023-4612-ad3a-47f1e08e5c51 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 204 len: 0 microversion: 2.1 time: 1.984273 Oct 01 21:14:49.391490 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3293/4585] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:14:47 2022] DELETE /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 0 bytes in 1986 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:14:49.401312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:49.402365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:49.409087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:49.410138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:49.410734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:49.411554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:49.412125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:49.412890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:49.431650 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 HTTP/1.1 Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e32c1b21-13b4-48e6-8922-eccf5475dd67'} Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:49.433761 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:49.438218 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:49.438218 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:49.438218 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:49.438218 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:49.438218 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:49.438218 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:14:49.438218 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:49.438778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:49.440616 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5da90862-250a-4a30-a964-82eff1423ea0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 404 len: 111 microversion: 2.1 time: 0.044346 Oct 01 21:14:49.446639 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1293/4586] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:49 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:14:49.623752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1112295125", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "2d91bbe6-1b56-400a-a72b-6645bb360bd3"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:49.734460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] validate_networks() for [('2d91bbe6-1b56-400a-a72b-6645bb360bd3', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:14:49.950169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-15ef258f-a257-4566-a19c-669eb802b57c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:49.953435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-15ef258f-a257-4566-a19c-669eb802b57c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:49.968419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15ef258f-a257-4566-a19c-669eb802b57c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:49.969333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15ef258f-a257-4566-a19c-669eb802b57c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:49.969947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15ef258f-a257-4566-a19c-669eb802b57c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:49.971098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15ef258f-a257-4566-a19c-669eb802b57c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:49.972572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15ef258f-a257-4566-a19c-669eb802b57c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:49.973223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15ef258f-a257-4566-a19c-669eb802b57c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:50.019262 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-15ef258f-a257-4566-a19c-669eb802b57c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073125 Oct 01 21:14:50.020280 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1294/4587] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:14:49 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 01 21:14:50.095434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:50.095957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:50.113247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:50.115374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:50.115867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:50.116610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:50.117079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:50.118375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:50.146461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:14:50.275268 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0ec498ac-5377-48ab-bde5-2f629470ea00 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 204 len: 0 microversion: 2.1 time: 0.183289 Oct 01 21:14:50.276039 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1295/4588] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:14:50 2022] DELETE /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 21:14:50.290140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:50.291031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:50.299521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:50.300134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:50.300685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:50.301987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:50.302540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:50.303016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:50.531038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:50.542412 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-717f125d-5da5-43cc-85e0-c9731f084e5c tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1680 microversion: 2.1 time: 0.261446 Oct 01 21:14:50.543031 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1296/4589] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:50 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:50.563560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:14:50.564093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:14:50.564463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:14:50.564869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:14:50.565957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:14:50.581198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:50.581737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:50.582800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:50.585816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:50.586328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:50.586784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:50.633983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:14:50.642641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for user a2745d6923e347939e2c67015aefadda and project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:14:50.656914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:14:50.659641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:14:50.715596 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c91275af-9b65-44bf-b7d9-8b4c905ff56a tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095659 Oct 01 21:14:50.716592 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3294/4590] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:14:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:14:50.728370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-edc600f1-a2c3-4418-8a2b-ec32da880268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:50.728998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-edc600f1-a2c3-4418-8a2b-ec32da880268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:50.838649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-edc600f1-a2c3-4418-8a2b-ec32da880268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:50.848723 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-edc600f1-a2c3-4418-8a2b-ec32da880268 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1215 microversion: 2.1 time: 0.124622 Oct 01 21:14:50.852240 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1297/4591] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:50 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:51.875753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:51.876400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:51.891446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:51.891957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:51.892397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:51.896114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:51.897428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:51.898195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:52.035313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:52.059739 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-318f5d25-ec74-4782-aac2-f00b87b03542 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1211 microversion: 2.1 time: 0.189341 Oct 01 21:14:52.083936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:52.085388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:52.093573 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1298/4592] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:51 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1211 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:52.097488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:52.098226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:52.098946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:52.103320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:52.103892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:52.104445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:52.361363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:52.370123 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-78dc9523-a831-40dc-ae9b-79852ccbf381 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1680 microversion: 2.1 time: 0.804830 Oct 01 21:14:52.370957 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3295/4593] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:51 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1680 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:53.086397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:53.087062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:53.099277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:53.099852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:53.101205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:53.102796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:53.103289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:53.103736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:53.258961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:53.268829 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-31a30dd8-23f2-4ec3-95aa-e857ff8f7a63 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1273 microversion: 2.1 time: 0.187053 Oct 01 21:14:53.272847 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1299/4594] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:53 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:53.394147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:53.394789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:53.405803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:53.406340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:53.406883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:53.409013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:53.409504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:53.410406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:53.561083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:53.578048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95e55bae-ee2b-487f-ba88-0d8202c8ac9d tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1613 microversion: 2.1 time: 0.188694 Oct 01 21:14:53.587303 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3296/4595] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:53 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1613 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:54.293762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:54.294397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:54.304760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:54.309549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:54.310376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:54.313273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:54.313778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:54.315163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:54.611442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:54.612730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:54.629004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:54.629843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:54.630463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:54.634865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:54.635734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:54.636346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:54.664984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:54.676129 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ad8e2e37-6d64-4b19-9172-67cce2532c8d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1315 microversion: 2.1 time: 0.386498 Oct 01 21:14:54.677369 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1300/4596] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:54 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:54.712022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ed7fd8c3-98ab-4a3e-817a-5a8f5c3f5e58 req-3a90ebf1-2f0f-4378-9a90-6714839b8e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd11de4c-ab80-4e39-a22f-c7b9819cc969", "name": "network-vif-deleted", "tag": "0eec32ed-1254-410a-9ffa-28306c2a9e8d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:54.721720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ed7fd8c3-98ab-4a3e-817a-5a8f5c3f5e58 req-3a90ebf1-2f0f-4378-9a90-6714839b8e64 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:54.723011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ed7fd8c3-98ab-4a3e-817a-5a8f5c3f5e58 req-3a90ebf1-2f0f-4378-9a90-6714839b8e64 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:54.723616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ed7fd8c3-98ab-4a3e-817a-5a8f5c3f5e58 req-3a90ebf1-2f0f-4378-9a90-6714839b8e64 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:54.737528 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ed7fd8c3-98ab-4a3e-817a-5a8f5c3f5e58 req-3a90ebf1-2f0f-4378-9a90-6714839b8e64 service nova] Creating event network-vif-deleted:0eec32ed-1254-410a-9ffa-28306c2a9e8d for instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 on nch1-master-1 Oct 01 21:14:54.744494 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ed7fd8c3-98ab-4a3e-817a-5a8f5c3f5e58 req-3a90ebf1-2f0f-4378-9a90-6714839b8e64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059394 Oct 01 21:14:54.745913 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1301/4597] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:54.808832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902ba44d318d4a01a510f732d27467c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a06f5da36b4488a1b8ea01729b0e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:54.820922 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-410efb78-232c-42df-b80a-8a5b771b101a tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 200 len: 1613 microversion: 2.1 time: 0.213324 Oct 01 21:14:54.824418 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3297/4598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:54 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 1613 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:14:55.705936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:55.708063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:55.717833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:14:55.730141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:55.730981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:55.731638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:55.732812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:55.733573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:55.734321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:55.846938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:55.848321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:55.856116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:55.856864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:55.857763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:55.858689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:55.859313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:55.860450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:55.880734 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 HTTP/1.1 Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'bd11de4c-ab80-4e39-a22f-c7b9819cc969'} Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:55.883211 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-beb05018-c41d-4c51-9939-b2199d3392c5 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 404 len: 111 microversion: 2.1 time: 0.041865 Oct 01 21:14:55.887779 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3298/4599] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:55 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:14:55.895163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87e08b26-7831-4208-b6bb-9bff454bac4e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '.version_select at 0x7f417264ce50>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:55.917284 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87e08b26-7831-4208-b6bb-9bff454bac4e tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818310812" status: 202 len: 0 microversion: 2.1 time: 0.027251 Oct 01 21:14:55.917885 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3299/4600] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 21:14:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818310812 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:14:56.146062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:56.158040 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-13e2db7c-8e15-4172-af3f-98faa98eb50f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1315 microversion: 2.1 time: 0.459732 Oct 01 21:14:56.159183 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1302/4601] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:55 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:56.794549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-614b7ea3-0345-4138-9dac-c87f857a5e15 req-4acafec5-6ad5-41ab-a020-9c85080c0808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59a63d9-6deb-4ab3-ab3d-f373956af31d", "tag": "743bbf90-ec5d-4a52-832e-39b371047e28"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:56.810629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-614b7ea3-0345-4138-9dac-c87f857a5e15 req-4acafec5-6ad5-41ab-a020-9c85080c0808 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:56.813833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-614b7ea3-0345-4138-9dac-c87f857a5e15 req-4acafec5-6ad5-41ab-a020-9c85080c0808 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:56.814567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-614b7ea3-0345-4138-9dac-c87f857a5e15 req-4acafec5-6ad5-41ab-a020-9c85080c0808 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:56.830073 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-614b7ea3-0345-4138-9dac-c87f857a5e15 req-4acafec5-6ad5-41ab-a020-9c85080c0808 service nova] Creating event network-changed:743bbf90-ec5d-4a52-832e-39b371047e28 for instance b59a63d9-6deb-4ab3-ab3d-f373956af31d on nch2-master-1 Oct 01 21:14:56.836847 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-614b7ea3-0345-4138-9dac-c87f857a5e15 req-4acafec5-6ad5-41ab-a020-9c85080c0808 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046906 Oct 01 21:14:56.838148 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3300/4602] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:14:57.181854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:57.182471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:57.191065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:57.191577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:57.192021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:57.192738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:57.197562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:57.198519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:57.468885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:57.480059 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eade38e1-59e2-4dfd-820f-77948f6db962 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1315 microversion: 2.1 time: 0.302366 Oct 01 21:14:57.481189 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1303/4603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:57 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:58.069287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-748680c6-3480-4a29-a942-6f2a8691f538 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:14:58.071847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-748680c6-3480-4a29-a942-6f2a8691f538 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:58.082117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-748680c6-3480-4a29-a942-6f2a8691f538 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:58.082672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-748680c6-3480-4a29-a942-6f2a8691f538 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:58.083130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-748680c6-3480-4a29-a942-6f2a8691f538 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:58.083866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-748680c6-3480-4a29-a942-6f2a8691f538 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:58.084383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-748680c6-3480-4a29-a942-6f2a8691f538 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:58.084825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-748680c6-3480-4a29-a942-6f2a8691f538 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:58.144488 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-748680c6-3480-4a29-a942-6f2a8691f538 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action" status: 200 len: 24558 microversion: 2.1 time: 0.094180 Oct 01 21:14:58.154632 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3301/4604] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:14:58 2022] POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action => generated 24558 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:14:58.327617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:58.328122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:58.339735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:58.340071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:58.340697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:58.341427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:58.341902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:58.342523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:58.361438 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 HTTP/1.1 Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'bd11de4c-ab80-4e39-a22f-c7b9819cc969'} Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:58.363460 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c46b08ac-39d4-4916-9de5-eb7cf0be4e4f tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 404 len: 111 microversion: 2.1 time: 0.041287 Oct 01 21:14:58.367815 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1304/4605] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:14:58 2022] DELETE /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:14:58.374159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:58.374904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: bd11de4c-ab80-4e39-a22f-c7b9819cc969] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:58.383425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:58.383930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:58.384375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:58.385529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:58.386016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:58.386458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:58.406149 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 HTTP/1.1 Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'bd11de4c-ab80-4e39-a22f-c7b9819cc969'} Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:58.407888 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance bd11de4c-ab80-4e39-a22f-c7b9819cc969 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c80cf735-6a9c-4a63-8e7b-5e1a58695fe3 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969" status: 404 len: 111 microversion: 2.1 time: 0.039560 Oct 01 21:14:58.413180 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3302/4606] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:58 2022] GET /compute/v2.1/servers/bd11de4c-ab80-4e39-a22f-c7b9819cc969 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:14:58.504812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:58.505538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:58.516805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:58.517315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:58.520243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:58.520996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:58.523264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:58.523875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:58.735734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:14:58.748233 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b5c21b1-a2e4-4dd0-acbf-921efd8d3738 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1315 microversion: 2.1 time: 0.247831 Oct 01 21:14:58.749097 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1305/4607] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:58 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:14:59.598296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:59.598816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:59.608208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.608722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.609161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:59.610049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.610530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.611118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:59.630967 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f HTTP/1.1 Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'db78d504-5f23-477e-9dd6-a9914e53bb8f'} Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:59.632769 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.636841 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.638810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:59.639668 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c27093db-c0dd-4250-83dd-51d6a023aeef tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 404 len: 111 microversion: 2.1 time: 0.046440 Oct 01 21:14:59.640221 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3303/4608] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:14:59 2022] DELETE /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:14:59.649014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:59.649716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: db78d504-5f23-477e-9dd6-a9914e53bb8f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:59.657362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.657965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.658626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:59.659503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.659966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.660393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:59.679790 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f HTTP/1.1 Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'db78d504-5f23-477e-9dd6-a9914e53bb8f'} Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:59.681346 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance db78d504-5f23-477e-9dd6-a9914e53bb8f could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-07f41df3-b069-441a-b11e-418cd76422fb tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f" status: 404 len: 111 microversion: 2.1 time: 0.038380 Oct 01 21:14:59.685507 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1306/4609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:59 2022] GET /compute/v2.1/servers/db78d504-5f23-477e-9dd6-a9914e53bb8f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:14:59.691802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:59.692313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:59.699104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.699603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.700048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:59.700758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.701296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.701727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:59.716937 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 HTTP/1.1 Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2a7d7745-f988-4b08-8f7d-4899f2da6f47'} Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:59.718740 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.722992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:59.724600 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-44bc392b-a237-4f30-89f6-ab5a7008cea0 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 404 len: 111 microversion: 2.1 time: 0.036807 Oct 01 21:14:59.725789 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3304/4610] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:14:59 2022] DELETE /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:14:59.734787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:59.735435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: 2a7d7745-f988-4b08-8f7d-4899f2da6f47] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:59.743669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.744171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.744618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:59.745489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.746119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.746582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:59.764828 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 HTTP/1.1 Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '2a7d7745-f988-4b08-8f7d-4899f2da6f47'} Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:14:59.774740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.779085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:14:59.779085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:14:59.779085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:14:59.779085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:14:59.779085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:14:59.779085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. Oct 01 21:14:59.779085 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:14:59.779549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:14:59.779549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:14:59.780661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance 2a7d7745-f988-4b08-8f7d-4899f2da6f47 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:14:59.781692 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-57666951-58da-4aaf-bec1-ac48c124cd67 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47" status: 404 len: 111 microversion: 2.1 time: 0.051673 Oct 01 21:14:59.782778 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1307/4611] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:59 2022] GET /compute/v2.1/servers/2a7d7745-f988-4b08-8f7d-4899f2da6f47 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:14:59.785520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.800865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.802072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:14:59.804187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:14:59.808049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:14:59.808654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:00.011646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:00.022093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-96fedcdd-ce05-455b-94f2-2c231fe69698 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1315 microversion: 2.1 time: 0.252686 Oct 01 21:15:00.023007 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3305/4612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:14:59 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:01.018447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:01.019025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:01.023434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:01.048133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:01.049960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:01.050531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:01.050928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:01.051700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:01.052399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:01.053522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:01.055103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:01.061698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:01.062427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:01.070301 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b HTTP/1.1 Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ec205c2f-e515-4a25-a372-64bdb58ac51b'} Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:01.072090 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:01.075630 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3ea6baa5-8ae0-45e9-b554-078892746e98 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 404 len: 111 microversion: 2.1 time: 0.059419 Oct 01 21:15:01.076359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:01.076359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:01.076359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:01.076732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:01.077201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:01.077400 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1308/4613] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:15:01 2022] DELETE /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:01.078036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:01.082438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:01.083264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] [instance: ec205c2f-e515-4a25-a372-64bdb58ac51b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:01.089847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:01.090349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:01.091080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:01.095369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:01.095881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:01.096572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:01.116739 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] HTTP exception thrown: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Request method failure captured: Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b HTTP/1.1 Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOKyfq7bS-EePxdBKc6B_w23PvqUJxqvGyO3_KDmC_9meIgxY9t4YKxMZuYGNx6R_SFAlwdTSjHBogM4mZiGU_yiVHcp_x7me7-uaZUWWnc2SIU5ZKzikzq9VIXoEJXGa2bciAjbvDWBJtDGk5SK05AdhVPtSGcPGCkWLoMzV4wnBER4 Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24a06f5da36b4488a1b8ea01729b0e6c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24a06f5da36b4488a1b8ea01729b0e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24a06f5da36b4488a1b8ea01729b0e6c"}]}] Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 24a06f5da36b4488a1b8ea01729b0e6c Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855754723 Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 902ba44d318d4a01a510f732d27467c9 Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-AttachVolumeNegativeTest-855754723-project Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ec205c2f-e515-4a25-a372-64bdb58ac51b'} Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:01.118445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] Returning 404 to user: Instance ec205c2f-e515-4a25-a372-64bdb58ac51b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-60eea9f4-2f9b-4d74-99e7-99d48d5aaec2 tempest-AttachVolumeNegativeTest-855754723 tempest-AttachVolumeNegativeTest-855754723-project] 10.222.0.17 "GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b" status: 404 len: 111 microversion: 2.1 time: 0.041351 Oct 01 21:15:01.122527 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1309/4614] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:01 2022] GET /compute/v2.1/servers/ec205c2f-e515-4a25-a372-64bdb58ac51b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:01.288999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:01.299675 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9d610364-9639-44c4-86bf-efd63a709ea5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1315 microversion: 2.1 time: 0.256844 Oct 01 21:15:01.300251 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3306/4615] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:01 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:02.189539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ecc1ac4d-407f-4c2a-b0c8-a1ff682d5e87 req-15362840-07ae-4aa6-90a0-d6b9abf08a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59a63d9-6deb-4ab3-ab3d-f373956af31d", "name": "network-vif-plugged", "status": "completed", "tag": "743bbf90-ec5d-4a52-832e-39b371047e28"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:02.205784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ecc1ac4d-407f-4c2a-b0c8-a1ff682d5e87 req-15362840-07ae-4aa6-90a0-d6b9abf08a31 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:02.206571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ecc1ac4d-407f-4c2a-b0c8-a1ff682d5e87 req-15362840-07ae-4aa6-90a0-d6b9abf08a31 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:02.207192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ecc1ac4d-407f-4c2a-b0c8-a1ff682d5e87 req-15362840-07ae-4aa6-90a0-d6b9abf08a31 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:02.220960 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ecc1ac4d-407f-4c2a-b0c8-a1ff682d5e87 req-15362840-07ae-4aa6-90a0-d6b9abf08a31 service nova] Creating event network-vif-plugged:743bbf90-ec5d-4a52-832e-39b371047e28 for instance b59a63d9-6deb-4ab3-ab3d-f373956af31d on nch2-master-1 Oct 01 21:15:02.230989 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ecc1ac4d-407f-4c2a-b0c8-a1ff682d5e87 req-15362840-07ae-4aa6-90a0-d6b9abf08a31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278898 Oct 01 21:15:02.232341 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1310/4616] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:02.331775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:02.333851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:02.343556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:02.344094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:02.344596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:02.345648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:02.346675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:02.347276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:02.623289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:02.632041 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e1144596-7aa3-442e-84f2-f90e928ebdd4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1315 microversion: 2.1 time: 0.305506 Oct 01 21:15:02.632634 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3307/4617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:02 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:03.657320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:03.658153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:03.685447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:03.691725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:03.692495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:03.693462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:03.694264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:03.694954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:03.992450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:04.005979 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6b1aa6a1-c847-4e65-be89-1c4292317843 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1503 microversion: 2.1 time: 0.353950 Oct 01 21:15:04.006601 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1311/4618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:03 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:04.054292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2dcb4893-03f1-4b2b-8beb-6bad1c682627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:04.061071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:04.062646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2dcb4893-03f1-4b2b-8beb-6bad1c682627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:04.063146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2dcb4893-03f1-4b2b-8beb-6bad1c682627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:04.063816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2dcb4893-03f1-4b2b-8beb-6bad1c682627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:04.089813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2dcb4893-03f1-4b2b-8beb-6bad1c682627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Going to try to stop instance {{(pid=140438) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 21:15:04.164688 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2dcb4893-03f1-4b2b-8beb-6bad1c682627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d/action" status: 202 len: 0 microversion: 2.1 time: 0.115092 Oct 01 21:15:04.168750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3308/4619] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:15:04 2022] POST /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:15:04.174168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:04.175082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:04.183397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:04.184089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:04.184692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:04.185654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:04.186266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:04.186900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:04.465953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:04.477458 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c66e99dd-9a4b-46bf-b510-e96c592c8193 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.307283 Oct 01 21:15:04.478065 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1312/4620] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:04 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:05.506684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:05.508623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:05.530991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:05.531500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:05.531946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:05.538320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:05.539046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:05.540985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:05.856928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:05.879074 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-464f1c14-7f10-433a-9dc7-a587a2a36627 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.379647 Oct 01 21:15:05.879735 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3309/4621] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:05 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:06.905671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:06.906941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:06.913618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:06.914124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:06.914769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:06.915497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:06.916069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:06.916387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:06.920885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:07.146073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:07.156831 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-151728cf-4453-46c8-851a-a4b5513ac0ac tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.255280 Oct 01 21:15:07.157691 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1313/4622] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:06 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:08.180777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:08.181426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:08.189444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:08.190512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:08.191111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:08.192168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:08.192784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:08.193364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:08.366515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:08.377133 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64f00cf3-9f07-4332-bf5c-ea2d94cf43e0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.200218 Oct 01 21:15:08.378025 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3310/4623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:08 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:09.240503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4fdef818-49b6-4aad-b0b0-6acdba4937a7 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:09.241706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4fdef818-49b6-4aad-b0b0-6acdba4937a7 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:09.248658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdef818-49b6-4aad-b0b0-6acdba4937a7 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:09.249338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdef818-49b6-4aad-b0b0-6acdba4937a7 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:09.249778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdef818-49b6-4aad-b0b0-6acdba4937a7 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:09.250510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdef818-49b6-4aad-b0b0-6acdba4937a7 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:09.250975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdef818-49b6-4aad-b0b0-6acdba4937a7 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:09.251568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4fdef818-49b6-4aad-b0b0-6acdba4937a7 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:09.406317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:09.407029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:09.413876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:09.414632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:09.415264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:09.416160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:09.416815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:09.417505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:09.542593 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4fdef818-49b6-4aad-b0b0-6acdba4937a7 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1833 microversion: 2.1 time: 0.306286 Oct 01 21:15:09.543661 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1314/4624] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:09 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1833 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:09.566001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:09.566662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:09.579919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:09.580415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:09.582223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:09.583268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:09.584542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:09.585392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:09.597497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:09.606530 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e8a1ea9d-c4d3-4042-ae26-0e569e078156 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.205205 Oct 01 21:15:09.607122 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3311/4625] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:09 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:09.749287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:09.758719 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d9b6ad83-bd88-4b21-8a6f-3056515c0a2b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1682 microversion: 2.1 time: 0.196174 Oct 01 21:15:09.759632 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1315/4626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:09 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:09.879984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-56138d09-d8a3-4d9b-af29-a3f46cefe511 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:09.883218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-56138d09-d8a3-4d9b-af29-a3f46cefe511 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:09.894515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56138d09-d8a3-4d9b-af29-a3f46cefe511 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:09.895139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56138d09-d8a3-4d9b-af29-a3f46cefe511 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:09.895764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56138d09-d8a3-4d9b-af29-a3f46cefe511 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:09.896891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56138d09-d8a3-4d9b-af29-a3f46cefe511 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:09.897692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56138d09-d8a3-4d9b-af29-a3f46cefe511 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:09.898156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-56138d09-d8a3-4d9b-af29-a3f46cefe511 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:09.960132 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-56138d09-d8a3-4d9b-af29-a3f46cefe511 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action" status: 200 len: 32628 microversion: 2.1 time: 0.086268 Oct 01 21:15:09.960816 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3312/4627] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:15:09 2022] POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action => generated 32628 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:15:10.136311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:10.137106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:10.143242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:10.143729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:10.144171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:10.144869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:10.145393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:10.145820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:10.187656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '39e3f059dc9c4fd78a6799b5b209d710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5bb9a57014d588d6a62e872f0ec3c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:10.188511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] flavor_id is None. Assuming migration. {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 01 21:15:10.189018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:15:10.464495 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [d30ad659-3e37-4d53-adac-1d2eaa0d2e49] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 21:15:10.633423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:10.634811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:10.644027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:10.644617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:10.645158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:10.646376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:10.646958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:10.647768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:10.653770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:UPDATE=11,nova_cell1:DELETE=2,nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:10.799677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:10.812005 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06b30610-c9a6-4438-947a-bddfd66b3e8f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.184673 Oct 01 21:15:10.812596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3313/4628] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:10 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:11.474923 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [d30ad659-3e37-4d53-adac-1d2eaa0d2e49] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38306. Oct 01 21:15:11.479578 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8e2b67c1-cbdb-4f42-ae75-0a5738ffa2c8 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action" status: 202 len: 0 microversion: 2.1 time: 1.347332 Oct 01 21:15:11.485182 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1316/4629] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:15:10 2022] POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action => generated 0 bytes in 1353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:15:11.489126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:11.490652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:11.498106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:11.498866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:11.499391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:11.500321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:11.501564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:11.502204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:11.722567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:11.734061 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c2c43b52-044e-4264-b5ab-fbf9566c54b3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1691 microversion: 2.1 time: 0.248966 Oct 01 21:15:11.734713 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3314/4630] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:11 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:11.838076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:11.839012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:11.855701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:11.856619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:11.857084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:11.857863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:11.858333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:11.860653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:12.073886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:12.083057 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-09ed742a-9522-4aff-9a3b-308e21506d55 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.251668 Oct 01 21:15:12.087082 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1317/4631] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:11 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:12.762778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:12.763417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:12.774700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:12.775377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:12.775993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:12.777227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:12.777864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:12.778608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:13.076202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:13.086452 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21d43bab-b45f-4530-8d7f-625fe59ba6fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1691 microversion: 2.1 time: 0.328947 Oct 01 21:15:13.087273 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3315/4632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:12 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1691 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:13.123105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:13.125577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:13.159271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:13.163204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:13.163700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:13.165938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:13.169188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:13.171671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:13.668044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:13.682238 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-42d9ee49-9d99-40e8-924c-b337d556dc22 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.572823 Oct 01 21:15:13.696737 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1318/4633] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:13 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:14.112006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:14.119557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:14.132247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:14.135493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:14.135701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:14.136683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:14.137214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:14.137752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:14.477997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:14.492287 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ada15344-62f9-4f0b-a63c-cae67bddbb32 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1691 microversion: 2.1 time: 0.382467 Oct 01 21:15:14.498610 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3316/4634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:14 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1691 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:14.712098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:14.712764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:14.728758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:14.744414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:14.745550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:14.749615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:14.750459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:14.750776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:15.231923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:15.245871 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c96325d6-a08b-4942-a167-c1dd6875f6ba tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.539388 Oct 01 21:15:15.247897 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1319/4635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:14 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:15.520071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:15.520734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:15.528296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:15.529190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:15.529807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:15.530842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:15.531469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:15.532058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:15.738471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:15.749397 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6502a71-9434-4b99-be59-6597a87fc617 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1696 microversion: 2.1 time: 0.233478 Oct 01 21:15:15.750005 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3317/4636] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:15 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1696 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:16.277353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:16.278096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:16.285455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:16.286063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:16.286642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:16.287480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:16.288047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:16.288870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:16.575409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:16.588240 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fc365239-b9ec-4b40-b0c8-9e612395f722 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.318484 Oct 01 21:15:16.588851 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1320/4637] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:16 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:16.777476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:16.778685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:16.788002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:16.788712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:16.789721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:16.791163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:16.791906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:16.792583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:16.986010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:16.996557 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3532bacd-f475-452b-ba3d-af2850e1b984 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1696 microversion: 2.1 time: 0.223220 Oct 01 21:15:17.020758 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3318/4638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:16 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1696 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:17.613502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:17.614277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:17.621932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:17.622429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:17.622902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:17.623609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:17.624225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:17.624809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:17.870952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:17.879448 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bb7963a1-d13b-4224-af93-5fc675121f02 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.270070 Oct 01 21:15:17.881215 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1321/4639] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:17 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:18.025082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:18.026940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:18.037987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:18.038742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:18.039363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:18.040299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:18.040777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:18.041222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:18.199072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:18.208506 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4c4e86d-ff3f-4fc1-9e39-4c5cf7d5d9f7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1696 microversion: 2.1 time: 0.188580 Oct 01 21:15:18.209082 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3319/4640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:18 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:18.904263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:18.904905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:18.913092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:18.914288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:18.914776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:18.915637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:18.916834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:18.918270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:19.205228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:19.214962 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d80632ea-7e97-4bda-9e27-e0fdc3b5a321 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.314742 Oct 01 21:15:19.216088 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1322/4641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:18 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:19.235438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:19.236197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:19.243850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:19.244402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:19.244869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:19.245794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:19.246243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:19.246837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:19.511324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:19.520342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b5a9346-1c7e-4fa6-b57d-0827dd8c670a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1696 microversion: 2.1 time: 0.289004 Oct 01 21:15:19.534526 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3320/4642] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:19 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1696 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:20.237722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:20.238344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:20.247685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:20.248391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:20.249703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:20.251183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:20.251962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:20.253284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:20.496096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:20.509582 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cdb55fb3-65ad-4590-aa92-a4ced463d4b0 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.275567 Oct 01 21:15:20.510876 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1323/4643] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:20 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:20.545326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:20.545960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:20.556795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:20.557369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:20.557830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:20.559186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:20.561117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:20.562068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:20.946960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:20.965632 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d3cc7b9-0956-49a4-be9e-b5795c96320c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1696 microversion: 2.1 time: 0.424260 Oct 01 21:15:20.971877 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3321/4644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:20 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1696 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:21.533771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:21.534431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:21.549233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:21.550147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:21.551004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:21.552021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:21.552712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:21.553729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:21.827378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:21.839769 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eb7ecfdb-5a4b-4bb9-83fc-0edfac2b1551 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.310437 Oct 01 21:15:21.840409 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1324/4645] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:21 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:21.998146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:21.999493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:22.037951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:22.045206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:22.046817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:22.051491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:22.052411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:22.056152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:22.348411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:22.358797 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7e944804-af89-47ac-9334-ee07f1642dcb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1696 microversion: 2.1 time: 0.365874 Oct 01 21:15:22.360022 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3322/4646] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:21 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1696 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:22.866355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:22.867185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:22.882568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:22.883327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:22.883870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:22.885596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:22.887294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:22.890253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:23.378445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:23.388356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:23.390223 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-86da312d-315c-4ac8-a8af-532eb011fec6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.529347 Oct 01 21:15:23.391081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:23.398981 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1325/4647] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:22 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:23.400967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:23.401675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:23.402135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:23.403045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:23.408508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:23.409262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:23.688417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:23.703134 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-386bd726-19ad-44f5-8973-e3668952f2e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1696 microversion: 2.1 time: 0.321021 Oct 01 21:15:23.704588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3323/4648] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:23 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1696 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:24.416659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:24.417852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:24.430963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:24.433801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:24.434436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:24.435415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:24.437820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:24.440314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:24.731481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:24.733785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:24.748636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:24.749944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:24.750806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:24.752079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:24.752903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:24.756800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:24.764100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:24.793263 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-303669d4-7b11-4398-8680-ca1bb5fd4833 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.377091 Oct 01 21:15:24.793703 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1326/4649] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:24 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:25.299359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:25.314618 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-471df177-9aba-4950-91db-6345e21d1c35 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1696 microversion: 2.1 time: 0.590515 Oct 01 21:15:25.319346 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3324/4650] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:24 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1696 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:25.818977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:25.819665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:25.831992 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:15:25.832137 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:15:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d (ip 10.222.0.17) !!! Oct 01 21:15:25.836502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=52 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:25.860091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:25.863083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:25.867864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:25.868880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:25.870652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:25.873807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:26.198455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:26.207573 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-78f68353-0963-4a72-bdbe-9651eb4d03af tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.394459 Oct 01 21:15:26.209959 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1327/4651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:25 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:26.345947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:26.346801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:26.355091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:26.355778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:26.356222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:26.357265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:26.357899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:26.358532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:26.539310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:26.548979 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-595fd68b-61e3-44a6-874d-b1d7c327d1ea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1696 microversion: 2.1 time: 0.207378 Oct 01 21:15:26.550130 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3325/4652] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:26 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:27.233797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:27.235568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:27.253361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:27.253981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:27.254558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:27.258414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:27.259604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:27.260148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:27.312108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:27.573125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:27.573739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:27.582564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:27.590435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:27.591315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:27.592328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:27.593264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:27.593957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:27.705902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:27.715701 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7c9eff18-9e1d-4945-ae26-c2061bbc085b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.487351 Oct 01 21:15:27.716387 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1328/4653] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:27 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:28.739900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:28.740551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:28.750345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:28.750888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:28.751313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:28.752031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:28.752491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:28.752914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:28.834359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:28.851973 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06299fcc-1ef9-4646-ac8b-f6bd49c48321 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1695 microversion: 2.1 time: 1.282557 Oct 01 21:15:28.855186 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3326/4654] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:27 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1695 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:29.272841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:29.285173 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c6743794-3cef-4787-b841-cf6b5879f3dd tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1513 microversion: 2.1 time: 0.548951 Oct 01 21:15:29.299194 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1329/4655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:28 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1513 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:29.316893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-351340f9-4f4a-4a14-bb98-821e80031576 req-55604d62-798e-430c-9ce7-b1ff3360f6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05029414-2d25-49f4-9f77-3199c6a8fa80", "name": "network-vif-unplugged", "status": "completed", "tag": "3b971980-8326-448b-afd2-1e2b532deb8c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:29.329223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-351340f9-4f4a-4a14-bb98-821e80031576 req-55604d62-798e-430c-9ce7-b1ff3360f6af service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:29.329952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-351340f9-4f4a-4a14-bb98-821e80031576 req-55604d62-798e-430c-9ce7-b1ff3360f6af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:29.330609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-351340f9-4f4a-4a14-bb98-821e80031576 req-55604d62-798e-430c-9ce7-b1ff3360f6af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:29.346391 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-351340f9-4f4a-4a14-bb98-821e80031576 req-55604d62-798e-430c-9ce7-b1ff3360f6af service nova] Creating event network-vif-unplugged:3b971980-8326-448b-afd2-1e2b532deb8c for instance 05029414-2d25-49f4-9f77-3199c6a8fa80 on nch2-master-1 Oct 01 21:15:29.352741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-351340f9-4f4a-4a14-bb98-821e80031576 req-55604d62-798e-430c-9ce7-b1ff3360f6af service nova] Instance 05029414-2d25-49f4-9f77-3199c6a8fa80 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:15:29.366929 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-351340f9-4f4a-4a14-bb98-821e80031576 req-55604d62-798e-430c-9ce7-b1ff3360f6af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055733 Oct 01 21:15:29.368083 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3327/4656] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:29.885657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:29.886400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:29.896276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:29.896774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:29.897212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:29.897928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:29.898384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:29.903089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:30.104887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:30.116289 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-598303b8-3443-43ce-8717-97089c41e5a4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1695 microversion: 2.1 time: 0.235995 Oct 01 21:15:30.117487 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1330/4657] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:29 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1695 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:30.316155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:30.317817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:30.331155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:30.332277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:30.333610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:30.334683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:30.335346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:30.337509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:30.740105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:30.762290 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34819a6a-b78a-49cd-9460-7cb316264815 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1490 microversion: 2.1 time: 0.448903 Oct 01 21:15:30.779503 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3328/4658] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:30 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1490 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:30.792988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:30.795585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:30.821021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:30.821513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:30.823642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:30.824392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:30.824860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:30.825300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:30.929632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:15:31.146443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:31.154075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:31.171113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:31.173353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:31.176773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:31.178533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:31.180835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:31.181496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:31.196949 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6d8ed42b-cf53-47b6-8d29-4305dc9e69a3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 204 len: 0 microversion: 2.1 time: 0.409135 Oct 01 21:15:31.198416 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1331/4659] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:15:30 2022] DELETE /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:15:31.207507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:31.208925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:31.227596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:31.231217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:31.232193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:31.233149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:31.234279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:31.234979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:31.765453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:31.768819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:31.787176 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea723949-1b43-4d25-9cca-6414adbbf847 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1695 microversion: 2.1 time: 0.650105 Oct 01 21:15:31.787985 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ab4f5ee2-4eeb-4b07-8eae-e808f89c9705 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1496 microversion: 2.1 time: 0.583463 Oct 01 21:15:31.788588 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1332/4660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:31 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1496 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:31.799655 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3329/4661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:31 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1695 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:31.817860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-355f2c94-dcbf-499b-a15b-74c6410fbb85 req-0033addb-f8c2-42df-be42-b2b3b3f81f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05029414-2d25-49f4-9f77-3199c6a8fa80", "tag": "3b971980-8326-448b-afd2-1e2b532deb8c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:31.832126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-355f2c94-dcbf-499b-a15b-74c6410fbb85 req-0033addb-f8c2-42df-be42-b2b3b3f81f86 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:31.833531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-355f2c94-dcbf-499b-a15b-74c6410fbb85 req-0033addb-f8c2-42df-be42-b2b3b3f81f86 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:31.835318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-355f2c94-dcbf-499b-a15b-74c6410fbb85 req-0033addb-f8c2-42df-be42-b2b3b3f81f86 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:31.840549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:31.851113 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-355f2c94-dcbf-499b-a15b-74c6410fbb85 req-0033addb-f8c2-42df-be42-b2b3b3f81f86 service nova] Creating event network-changed:3b971980-8326-448b-afd2-1e2b532deb8c for instance 05029414-2d25-49f4-9f77-3199c6a8fa80 on nch2-master-1 Oct 01 21:15:31.858183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-355f2c94-dcbf-499b-a15b-74c6410fbb85 req-0033addb-f8c2-42df-be42-b2b3b3f81f86 service nova] Instance 05029414-2d25-49f4-9f77-3199c6a8fa80 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:15:31.895593 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-355f2c94-dcbf-499b-a15b-74c6410fbb85 req-0033addb-f8c2-42df-be42-b2b3b3f81f86 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094316 Oct 01 21:15:31.896300 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3330/4662] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:32.816230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:32.816792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:32.828051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:32.829361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:32.830082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:32.831171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:32.832384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:32.833601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:32.836135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:32.836869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:32.854362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:32.855086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:32.855941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:32.857159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:32.858562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:32.859302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:33.671283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:33.684268 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6846071c-0844-44a5-a1c1-7722cac2a6a5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1496 microversion: 2.1 time: 0.872368 Oct 01 21:15:33.685768 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1333/4663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:32 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1496 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:33.969708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:33.985598 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b96386a3-d87b-4743-aa31-d310a0c1c460 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1695 microversion: 2.1 time: 1.162560 Oct 01 21:15:33.999453 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3331/4664] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:32 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1695 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:34.229758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-124c5e14-c70c-4363-903e-a2b372533056 req-da3d9374-ee71-4888-807e-47c23dcafb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59a63d9-6deb-4ab3-ab3d-f373956af31d", "name": "network-vif-deleted", "tag": "743bbf90-ec5d-4a52-832e-39b371047e28"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:34.244627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-124c5e14-c70c-4363-903e-a2b372533056 req-da3d9374-ee71-4888-807e-47c23dcafb88 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:34.246422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-124c5e14-c70c-4363-903e-a2b372533056 req-da3d9374-ee71-4888-807e-47c23dcafb88 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:34.248064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-124c5e14-c70c-4363-903e-a2b372533056 req-da3d9374-ee71-4888-807e-47c23dcafb88 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:34.263275 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-124c5e14-c70c-4363-903e-a2b372533056 req-da3d9374-ee71-4888-807e-47c23dcafb88 service nova] Creating event network-vif-deleted:743bbf90-ec5d-4a52-832e-39b371047e28 for instance b59a63d9-6deb-4ab3-ab3d-f373956af31d on nch2-master-1 Oct 01 21:15:34.272357 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-124c5e14-c70c-4363-903e-a2b372533056 req-da3d9374-ee71-4888-807e-47c23dcafb88 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045704 Oct 01 21:15:34.274097 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1334/4665] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:34.711792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:34.712800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:34.725818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:34.726686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:34.727545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:34.738981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:34.740416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:34.741351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:34.837243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:34.838148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:34.838868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:34.839962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lazy-loading 'fault' on Instance uuid b59a63d9-6deb-4ab3-ab3d-f373956af31d {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:15:35.003491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:35.014482 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2be1ac0f-1ad3-4b34-aa7d-3da1509994ad tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 200 len: 1305 microversion: 2.1 time: 0.306710 Oct 01 21:15:35.022747 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3332/4666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:34 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 1305 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:35.039929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:35.040675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:35.074130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:35.085996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:35.085996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:35.086718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:35.087215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:35.087654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:35.565269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:35.573957 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-edc86c59-e31a-4d74-8294-4c94988cde82 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1695 microversion: 2.1 time: 0.562109 Oct 01 21:15:35.590729 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1335/4667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:35 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1695 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:36.045129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:36.046246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:36.052910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=52 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:36.069049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:36.072764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:36.073869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:36.075668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:36.081571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:36.082212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:36.118015 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d HTTP/1.1 Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'b59a63d9-6deb-4ab3-ab3d-f373956af31d'} Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:36.121143 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:36.125110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:36.125110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:36.125110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:36.125110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:36.125110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:36.125110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:36.125110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:36.127895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:36.130552 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a4d8cd11-3df7-412d-8d5a-244650eb3423 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 404 len: 111 microversion: 2.1 time: 0.089629 Oct 01 21:15:36.133206 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3333/4668] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:36 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:36.281015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1301629552", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "2d91bbe6-1b56-400a-a72b-6645bb360bd3"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:36.347841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] validate_networks() for [('2d91bbe6-1b56-400a-a72b-6645bb360bd3', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:15:36.602250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:36.603765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:36.618830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:36.619853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:36.621276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:36.625166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:36.627228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:36.628559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:36.996801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:15:36.997269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:15:36.998995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:15:36.999434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:15:36.999860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:15:37.021679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:37.022706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:37.024025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:37.025063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:37.025742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:37.026415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:37.078772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:15:37.098587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Getting quotas for user a2745d6923e347939e2c67015aefadda and project 8f92b50dc0364842980ce41af830ba1a. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:15:37.120115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:15:37.124909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:15:37.181682 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2243986a-4545-43e2-95d6-7d369aacdf07 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904499 Oct 01 21:15:37.183480 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1336/4669] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:15:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:15:37.203529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4998e9b8-e4c9-417f-afa4-974b5f2a00f2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:37.204360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4998e9b8-e4c9-417f-afa4-974b5f2a00f2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:37.306916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4998e9b8-e4c9-417f-afa4-974b5f2a00f2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:37.315752 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4998e9b8-e4c9-417f-afa4-974b5f2a00f2 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1215 microversion: 2.1 time: 0.124002 Oct 01 21:15:37.339539 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1337/4670] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:37 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:37.528536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:37.542629 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba3eb8e8-1c7d-44dc-9818-1b3a0428301c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1693 microversion: 2.1 time: 0.947138 Oct 01 21:15:37.543956 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3334/4671] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:36 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1693 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:38.365941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:38.371232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:38.385947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:38.388572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:38.389202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:38.390801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:38.397002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:38.397699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:38.511531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:38.521086 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cccc317d-0eae-4b8a-8838-cac91036b1ef tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1267 microversion: 2.1 time: 0.175143 Oct 01 21:15:38.534700 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1338/4672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:38 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:38.574424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:38.575723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:38.583884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:38.584877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:38.585579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:38.586868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:38.587554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:38.588197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:39.453112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:39.464681 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bac9ddd3-ded4-4966-96c8-22abb278d107 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1690 microversion: 2.1 time: 0.894902 Oct 01 21:15:39.465596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3335/4673] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:38 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1690 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:39.488251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2f46541d-6e78-4bc0-a4c7-fbc107d3b6ed tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:39.489744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2f46541d-6e78-4bc0-a4c7-fbc107d3b6ed tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:39.496839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f46541d-6e78-4bc0-a4c7-fbc107d3b6ed tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:39.497625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f46541d-6e78-4bc0-a4c7-fbc107d3b6ed tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:39.498308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f46541d-6e78-4bc0-a4c7-fbc107d3b6ed tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:39.499158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f46541d-6e78-4bc0-a4c7-fbc107d3b6ed tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:39.500046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f46541d-6e78-4bc0-a4c7-fbc107d3b6ed tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:39.500553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f46541d-6e78-4bc0-a4c7-fbc107d3b6ed tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:39.546567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:39.547203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:39.555288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:39.556046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:39.556657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:39.557389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:39.557938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:39.558776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:39.585122 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2f46541d-6e78-4bc0-a4c7-fbc107d3b6ed tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action" status: 204 len: 0 microversion: 2.1 time: 0.100339 Oct 01 21:15:39.586532 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1339/4674] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:15:39 2022] POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:15:39.596520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:39.597553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:39.606719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:39.607669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:39.608452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:39.609489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:39.610336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:39.611125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:39.773284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:39.782117 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-939c8232-d553-4897-87f1-b0e39789e49d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1690 microversion: 2.1 time: 0.190656 Oct 01 21:15:39.783059 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1340/4675] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:39 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:39.805059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:39.820413 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2765676-d1a1-4e66-9c25-42aa4859f40e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1273 microversion: 2.1 time: 0.277632 Oct 01 21:15:39.821242 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3336/4676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:39 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:40.224931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3c64dce1-503c-4690-b76d-540bed5621f3 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1748884108", "availability_zone": "foo_zone"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:40.257712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.aggregate [None req-3c64dce1-503c-4690-b76d-540bed5621f3 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Generated uuid d356a57f-79b6-4a8a-839f-8fce89822dcc for aggregate {{(pid=140437) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 01 21:15:40.329849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c382bc41-92df-494f-853e-b419104cac62 req-9ed096a7-e840-46a4-848d-b583ae66e793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05029414-2d25-49f4-9f77-3199c6a8fa80", "name": "network-vif-plugged", "status": "completed", "tag": "3b971980-8326-448b-afd2-1e2b532deb8c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:40.333935 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3c64dce1-503c-4690-b76d-540bed5621f3 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.301446 Oct 01 21:15:40.335213 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1341/4677] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Oct 1 21:15:40 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:15:40.351756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-549a0c5a-cbe9-4d0c-a4e9-b238669b7adc tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:40.367824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c382bc41-92df-494f-853e-b419104cac62 req-9ed096a7-e840-46a4-848d-b583ae66e793 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:40.369083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c382bc41-92df-494f-853e-b419104cac62 req-9ed096a7-e840-46a4-848d-b583ae66e793 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:40.371004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c382bc41-92df-494f-853e-b419104cac62 req-9ed096a7-e840-46a4-848d-b583ae66e793 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:40.398959 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-549a0c5a-cbe9-4d0c-a4e9-b238669b7adc tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.055200 Oct 01 21:15:40.400183 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1342/4678] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 21:15:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:40.417707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-069029f8-6088-4f48-8dcd-9fa8546f585f tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:40.418956 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c382bc41-92df-494f-853e-b419104cac62 req-9ed096a7-e840-46a4-848d-b583ae66e793 service nova] Creating event network-vif-plugged:3b971980-8326-448b-afd2-1e2b532deb8c for instance 05029414-2d25-49f4-9f77-3199c6a8fa80 on nch2-master-1 Oct 01 21:15:40.424025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-069029f8-6088-4f48-8dcd-9fa8546f585f tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:40.424607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-069029f8-6088-4f48-8dcd-9fa8546f585f tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:40.425862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-069029f8-6088-4f48-8dcd-9fa8546f585f tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:40.426768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-069029f8-6088-4f48-8dcd-9fa8546f585f tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:40.427447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-069029f8-6088-4f48-8dcd-9fa8546f585f tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:40.428201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-069029f8-6088-4f48-8dcd-9fa8546f585f tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:40.441586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-c382bc41-92df-494f-853e-b419104cac62 req-9ed096a7-e840-46a4-848d-b583ae66e793 service nova] Instance 05029414-2d25-49f4-9f77-3199c6a8fa80 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:15:40.468336 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c382bc41-92df-494f-853e-b419104cac62 req-9ed096a7-e840-46a4-848d-b583ae66e793 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142187 Oct 01 21:15:40.481648 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3337/4679] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:40.512888 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-069029f8-6088-4f48-8dcd-9fa8546f585f tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.103836 Oct 01 21:15:40.513859 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1343/4680] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Oct 1 21:15:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:40.526578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2ea5cd1e-5af1-4d12-af43-ddb3ba8a2e60 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:40.539570 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2ea5cd1e-5af1-4d12-af43-ddb3ba8a2e60 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.016991 Oct 01 21:15:40.541644 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3338/4681] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Oct 1 21:15:40 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:40.557023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-67664098-cd1d-4431-92bd-6ef4e8eef997 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:40.578351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67664098-cd1d-4431-92bd-6ef4e8eef997 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:40.585066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67664098-cd1d-4431-92bd-6ef4e8eef997 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:40.585554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67664098-cd1d-4431-92bd-6ef4e8eef997 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:40.790153 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-67664098-cd1d-4431-92bd-6ef4e8eef997 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.239352 Oct 01 21:15:40.791964 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1344/4682] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 21:15:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:40.804359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-358b19aa-62b3-4f5e-8a36-bb9e786364f7 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:40.807996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:40.810057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:40.824054 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-358b19aa-62b3-4f5e-8a36-bb9e786364f7 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.024052 Oct 01 21:15:40.824610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:40.824708 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3339/4683] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 21:15:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:40.825142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:40.825781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:40.826700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:40.831928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:40.832773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:40.838901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33c89c98-9498-4c81-b609-36c2e5840e34 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-800548306", "availability_zone": "foo_zone"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:40.969473 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-33c89c98-9498-4c81-b609-36c2e5840e34 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.136028 Oct 01 21:15:40.970729 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3340/4684] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Oct 1 21:15:40 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:15:40.977389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:40.991478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:41.006233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:41.007559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:41.010218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:41.012262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:41.014201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:41.015672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:41.143638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:41.163583 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8d24ac6a-e9d1-43eb-bf22-f47ffeeda219 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1690 microversion: 2.1 time: 0.356673 Oct 01 21:15:41.164828 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1345/4685] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:40 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1690 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:41.170904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c389e3a7-07e5-4e58-b147-641c1a8ec6df tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:41.211265 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c389e3a7-07e5-4e58-b147-641c1a8ec6df tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.045030 Oct 01 21:15:41.214258 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1346/4686] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 21:15:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:41.225472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bba3213b-a45b-41be-bcd2-5eee42f94172 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:41.236266 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bba3213b-a45b-41be-bcd2-5eee42f94172 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.014908 Oct 01 21:15:41.239918 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1347/4687] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Oct 1 21:15:41 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:41.252935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bd772140-e3ef-4675-b6e8-bf8c47e81c71 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:41.269598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd772140-e3ef-4675-b6e8-bf8c47e81c71 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:41.270674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd772140-e3ef-4675-b6e8-bf8c47e81c71 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:41.271122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd772140-e3ef-4675-b6e8-bf8c47e81c71 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:41.329291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:41.338924 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7cb4e6f-f988-41b3-8e8b-94d3c263c6b5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1273 microversion: 2.1 time: 0.366738 Oct 01 21:15:41.339514 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3341/4688] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:40 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1273 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:41.479494 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bd772140-e3ef-4675-b6e8-bf8c47e81c71 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.231163 Oct 01 21:15:41.494714 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1348/4689] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Oct 1 21:15:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:15:41.495123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-890ec98b-d06c-459a-b698-269303cabde9 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:41.541962 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-890ec98b-d06c-459a-b698-269303cabde9 tempest-TestAggregatesBasicOps-659451901 tempest-TestAggregatesBasicOps-659451901-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.051620 Oct 01 21:15:41.542593 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3342/4690] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 21:15:41 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 01 21:15:42.193049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:42.194303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:42.205677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:42.208874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:42.210399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:42.213206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:42.213999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:42.227248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:42.383068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:42.385975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:42.407582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:42.408550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:42.409407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:42.411561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:42.412514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:42.413189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:42.844996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:42.847891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:42.855931 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7ed9c676-69b9-4610-8586-88503b659770 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1690 microversion: 2.1 time: 0.668454 Oct 01 21:15:42.863016 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1349/4691] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:42 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1690 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:42.884279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:42.899963 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-322811bd-9fb9-4add-ad1e-9f17f38b3d25 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1315 microversion: 2.1 time: 0.538673 Oct 01 21:15:42.902250 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3343/4692] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:42 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:43.796452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b23099dd-5165-46cb-9da8-85c400179bef req-acb5a26b-8227-4f2a-88ea-f0eafaa4b1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d", "tag": "64d0a7de-3e2e-4aa3-a226-eb4aa259cc28"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:43.815956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b23099dd-5165-46cb-9da8-85c400179bef req-acb5a26b-8227-4f2a-88ea-f0eafaa4b1aa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:43.816723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b23099dd-5165-46cb-9da8-85c400179bef req-acb5a26b-8227-4f2a-88ea-f0eafaa4b1aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:43.817308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b23099dd-5165-46cb-9da8-85c400179bef req-acb5a26b-8227-4f2a-88ea-f0eafaa4b1aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:43.843709 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b23099dd-5165-46cb-9da8-85c400179bef req-acb5a26b-8227-4f2a-88ea-f0eafaa4b1aa service nova] Creating event network-changed:64d0a7de-3e2e-4aa3-a226-eb4aa259cc28 for instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d on nch2-master-1 Oct 01 21:15:43.857120 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b23099dd-5165-46cb-9da8-85c400179bef req-acb5a26b-8227-4f2a-88ea-f0eafaa4b1aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065232 Oct 01 21:15:43.857759 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1350/4693] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:15:43.892259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:43.892623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:43.908044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:43.908571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:43.911192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:43.911972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:43.912616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:43.914008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:43.927976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:43.928642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:43.937749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:43.939433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:43.939938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:43.946272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:43.947083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:43.947570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:43.948007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:44.221568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:44.233123 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d8b4939f-9451-4cf9-96f9-f60ec368d67e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1315 microversion: 2.1 time: 0.310581 Oct 01 21:15:44.235160 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1351/4694] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:43 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:44.381011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:44.389353 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-baf5dbf0-cdf5-4e4e-9803-c1ece01dc53b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1682 microversion: 2.1 time: 0.504177 Oct 01 21:15:44.403082 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3344/4695] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:43 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1682 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:45.275172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:45.275842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:45.287251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:45.289042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:45.293403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:45.294565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:45.295394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:45.296054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:45.695116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:45.707541 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9d7b5e07-adc9-43b9-854b-a8fee45eaed4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1315 microversion: 2.1 time: 0.450542 Oct 01 21:15:45.709127 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1352/4696] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:45 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:46.734218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:46.734997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:46.756617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:46.758003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:46.764863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:46.767505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:46.769623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:46.770844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:47.218401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:47.239773 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd3363e0-98c9-4125-a922-9752c4a3a20d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1315 microversion: 2.1 time: 0.509877 Oct 01 21:15:47.241509 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3345/4697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:46 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:48.263357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:48.264389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:48.267541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:48.284571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:48.285888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:48.286443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:48.287368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:48.291621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:48.292206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:48.873887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:48.888759 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e4faec88-5ff0-4586-aea5-1029350a4e7b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1315 microversion: 2.1 time: 0.627948 Oct 01 21:15:48.889396 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1353/4698] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:48 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:15:49.914682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:49.915305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:49.927903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:49.929677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:49.930334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:49.931945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:49.932946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:49.935383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:50.304951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:50.316263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4e88edb7-050f-49a3-9e40-a387efa7687d tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1315 microversion: 2.1 time: 0.406674 Oct 01 21:15:50.317499 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3346/4699] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:49 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:50.607868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:50.613618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7697fd8a-e255-4668-9fef-5fbb56cfbc23 req-a1f01b18-05c9-477b-907a-39df8beb6ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d", "name": "network-vif-plugged", "status": "completed", "tag": "64d0a7de-3e2e-4aa3-a226-eb4aa259cc28"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:50.634951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7697fd8a-e255-4668-9fef-5fbb56cfbc23 req-a1f01b18-05c9-477b-907a-39df8beb6ece service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:50.639151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7697fd8a-e255-4668-9fef-5fbb56cfbc23 req-a1f01b18-05c9-477b-907a-39df8beb6ece service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:50.639740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7697fd8a-e255-4668-9fef-5fbb56cfbc23 req-a1f01b18-05c9-477b-907a-39df8beb6ece service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:50.667134 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7697fd8a-e255-4668-9fef-5fbb56cfbc23 req-a1f01b18-05c9-477b-907a-39df8beb6ece service nova] Creating event network-vif-plugged:64d0a7de-3e2e-4aa3-a226-eb4aa259cc28 for instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d on nch2-master-1 Oct 01 21:15:50.683143 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7697fd8a-e255-4668-9fef-5fbb56cfbc23 req-a1f01b18-05c9-477b-907a-39df8beb6ece service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076248 Oct 01 21:15:50.684348 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1354/4700] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:15:51.343303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:51.344235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:51.361970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:51.362540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:51.363107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:51.364047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:51.364514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:51.365131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:51.708383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:51.721035 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae771687-a7fe-452b-86b5-2a667ff08110 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1315 microversion: 2.1 time: 0.381586 Oct 01 21:15:51.723452 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3347/4701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:51 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:52.746236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:52.747766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:52.760410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:52.761085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:52.761746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:52.762650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:52.763298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:52.764026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:53.190355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:53.201321 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d8456b19-1ed3-4a7d-b7b4-242b59ce908e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1502 microversion: 2.1 time: 0.459469 Oct 01 21:15:53.201930 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1355/4702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:52 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1502 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:53.225949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:53.226641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:53.263792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:53.266100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:53.269060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:53.271962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:53.274223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:53.274905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:53.331669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lazy-loading 'flavor' on Instance uuid 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:15:53.452492 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a54396b3-eed9-4e44-ab76-86701634a272 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "POST /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d/action" status: 202 len: 0 microversion: 2.1 time: 0.231493 Oct 01 21:15:53.453622 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3348/4703] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:15:53 2022] POST /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:15:53.461950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:53.462609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:53.476447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:53.478288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:53.479405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:53.480491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:53.481219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:53.482149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:53.837241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:53.853654 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8bf33f0d-506d-40d4-9fd0-a1187d027215 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1510 microversion: 2.1 time: 0.395492 Oct 01 21:15:53.855310 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1356/4704] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:53 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:54.878094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:54.879453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:54.892606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:54.894065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:54.895230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:54.898651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:54.899486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:54.900655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:55.124378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:55.133069 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9960736c-6c17-4c56-95c6-f0957b3ae042 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1493 microversion: 2.1 time: 0.259290 Oct 01 21:15:55.133986 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3349/4705] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:54 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1493 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:55.157894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:55.159138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:55.169530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:55.174433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:55.174961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:55.178071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:55.178591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:55.179044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:55.236958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:15:55.384661 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7f7f302f-17f3-4789-b2e7-26fd264afceb tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 204 len: 0 microversion: 2.1 time: 0.230673 Oct 01 21:15:55.385267 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1357/4706] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:15:55 2022] DELETE /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:15:55.397007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:55.398141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:55.413656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:55.414446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:55.415176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:55.418688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:55.420098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:55.420968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:55.428648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:15:55.617443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:55.627419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-53d394a6-2cd1-48cc-8356-d6f6c4d7b46f tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1499 microversion: 2.1 time: 0.237648 Oct 01 21:15:55.627999 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3350/4707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:55 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1499 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:56.649846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:56.651136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:56.661615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:56.662336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:56.663066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:56.663986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:56.665202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:56.666742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:56.884826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:56.895694 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e7953135-8232-457e-912c-f8bf71c9af1c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1499 microversion: 2.1 time: 0.249997 Oct 01 21:15:56.897035 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1358/4708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:56 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1499 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:57.936357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:57.937707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:57.955025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:57.955590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:57.956056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:57.958303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:57.958822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:57.960683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:58.383182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2745d6923e347939e2c67015aefadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f92b50dc0364842980ce41af830ba1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:15:58.395316 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d088b2ef-ff00-42eb-99a5-fd26a3cb1f45 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 200 len: 1499 microversion: 2.1 time: 0.475950 Oct 01 21:15:58.415259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3351/4709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:57 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 1499 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:15:58.513828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ae8c49c7-eb77-4ab6-a44f-6ca6c7666f4e req-9dabf6f8-5061-47de-8e71-0d15bb0dd7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d", "name": "network-vif-deleted", "tag": "64d0a7de-3e2e-4aa3-a226-eb4aa259cc28"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:15:58.544730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ae8c49c7-eb77-4ab6-a44f-6ca6c7666f4e req-9dabf6f8-5061-47de-8e71-0d15bb0dd7aa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:58.545815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ae8c49c7-eb77-4ab6-a44f-6ca6c7666f4e req-9dabf6f8-5061-47de-8e71-0d15bb0dd7aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:58.546448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ae8c49c7-eb77-4ab6-a44f-6ca6c7666f4e req-9dabf6f8-5061-47de-8e71-0d15bb0dd7aa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:58.571065 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ae8c49c7-eb77-4ab6-a44f-6ca6c7666f4e req-9dabf6f8-5061-47de-8e71-0d15bb0dd7aa service nova] Creating event network-vif-deleted:64d0a7de-3e2e-4aa3-a226-eb4aa259cc28 for instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d on nch2-master-1 Oct 01 21:15:58.576252 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ae8c49c7-eb77-4ab6-a44f-6ca6c7666f4e req-9dabf6f8-5061-47de-8e71-0d15bb0dd7aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066021 Oct 01 21:15:58.593733 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1359/4710] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:15:59.421460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.422014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.443553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.444012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.444463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.445308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.445659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.446446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.467510 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d HTTP/1.1 Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d'} Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.469633 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.475198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.475198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.475198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.475198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.475198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.475198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.475198 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.476468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.477513 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-188ea3cd-2a9c-45f5-8863-47fc485deb3c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 404 len: 111 microversion: 2.1 time: 0.060342 Oct 01 21:15:59.478670 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3352/4711] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:59 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:59.493516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.494598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.502983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.503703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.504524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.505433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.506068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.506711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.528008 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d HTTP/1.1 Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d'} Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.531012 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fff89a17-b091-4bba-bd20-69f1c04ed361 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 404 len: 111 microversion: 2.1 time: 0.046408 Oct 01 21:15:59.548008 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1360/4712] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:15:59 2022] DELETE /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:59.551914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.551914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.558617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.559036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.559996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.560311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.560812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.561263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.577796 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d HTTP/1.1 Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d'} Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.579423 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.583221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.583221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.583221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.583221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.583221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.583221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. Oct 01 21:15:59.583221 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.583221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance 2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.583221 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba0199d3-28e3-484b-aa2a-5e4f35667bd3 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d" status: 404 len: 111 microversion: 2.1 time: 0.038958 Oct 01 21:15:59.590939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.591461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.598361 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3353/4713] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:59 2022] GET /compute/v2.1/servers/2e3a2608-759f-4dfd-ab56-6bd6a53a0c3d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:59.599982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.600510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.601066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.601805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.603107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.603566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.630674 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d HTTP/1.1 Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'b59a63d9-6deb-4ab3-ab3d-f373956af31d'} Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.635906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.639896 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.641256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.642197 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ea866309-870a-42e0-b03d-56be7dcafab4 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 404 len: 111 microversion: 2.1 time: 0.055827 Oct 01 21:15:59.642823 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1361/4714] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:15:59 2022] DELETE /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:59.652517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.654296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: b59a63d9-6deb-4ab3-ab3d-f373956af31d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.668859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.669391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.671491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.673680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.674368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.675350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.697629 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d HTTP/1.1 Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'b59a63d9-6deb-4ab3-ab3d-f373956af31d'} Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.700479 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.704184 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.704184 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.704184 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.704184 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.704184 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.704184 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. Oct 01 21:15:59.704184 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.704184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance b59a63d9-6deb-4ab3-ab3d-f373956af31d could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.706642 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b378bdc4-a10c-4533-98e4-bd5cb16ad6ec tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d" status: 404 len: 111 microversion: 2.1 time: 0.057262 Oct 01 21:15:59.708162 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3354/4715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:59 2022] GET /compute/v2.1/servers/b59a63d9-6deb-4ab3-ab3d-f373956af31d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:59.718683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.718949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.725694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.726200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.726685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.727611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.728244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.728847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.745983 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 HTTP/1.1 Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e32c1b21-13b4-48e6-8922-eccf5475dd67'} Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.747580 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-edd3bcfb-fcf8-4b7b-b660-dba23f09751b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 404 len: 111 microversion: 2.1 time: 0.035918 Oct 01 21:15:59.752995 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1362/4716] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:15:59 2022] DELETE /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:15:59.757818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.758451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e32c1b21-13b4-48e6-8922-eccf5475dd67] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.764596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.765099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.765545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.766475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.767282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.767913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.783247 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 HTTP/1.1 Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e32c1b21-13b4-48e6-8922-eccf5475dd67'} Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.786574 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.790608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.790608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.790608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.790608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.790608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.790608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. Oct 01 21:15:59.790608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.792194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e32c1b21-13b4-48e6-8922-eccf5475dd67 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.793242 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4bfc930-502c-4940-8bfa-f35dbee9c74b tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67" status: 404 len: 111 microversion: 2.1 time: 0.039531 Oct 01 21:15:59.794283 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3355/4717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:59 2022] GET /compute/v2.1/servers/e32c1b21-13b4-48e6-8922-eccf5475dd67 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:59.807067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.807858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.823353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.824314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.824931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.825760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.826548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.827259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.868589 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 HTTP/1.1 Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5'} Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.870089 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4067a29a-0206-47ec-927a-999eab3190f5 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 404 len: 111 microversion: 2.1 time: 0.072245 Oct 01 21:15:59.873893 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1363/4718] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:15:59 2022] DELETE /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:59.880320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.880946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.890153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.890700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.891164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.891885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.892349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.894775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.917976 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 HTTP/1.1 Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5'} Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.919613 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.924640 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.924640 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.924640 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.924640 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.924640 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.924640 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. Oct 01 21:15:59.924640 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.924640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.924640 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62368fd4-8ee2-4bf2-93f6-d5dfd447742c tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5" status: 404 len: 111 microversion: 2.1 time: 0.044709 Oct 01 21:15:59.926633 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3356/4719] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:59 2022] GET /compute/v2.1/servers/e24c85e7-b5c1-4983-b9ab-9a0b2f01fad5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:59.930243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.930810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: be519138-4f90-475d-9373-d4932380ad36] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:15:59.937734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.938691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.939340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.940319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:15:59.940715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:15:59.941196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:15:59.964675 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36 HTTP/1.1 Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'be519138-4f90-475d-9373-d4932380ad36'} Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:15:59.967363 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:15:59.971908 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:15:59.975068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:15:59.976259 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bbb4e47a-9e65-4897-95fe-f550d54b44b6 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36" status: 404 len: 111 microversion: 2.1 time: 0.049750 Oct 01 21:15:59.977337 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1364/4720] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:15:59 2022] DELETE /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:15:59.985418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:15:59.986435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: be519138-4f90-475d-9373-d4932380ad36] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:00.001042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:00.001703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:00.002246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:00.003251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:00.004032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:00.005045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:00.031089 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36 HTTP/1.1 Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'be519138-4f90-475d-9373-d4932380ad36'} Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:00.033403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:00.037719 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:00.037719 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:00.037719 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:00.037719 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:16:00.037719 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:16:00.037719 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. Oct 01 21:16:00.037719 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:00.039844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance be519138-4f90-475d-9373-d4932380ad36 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:16:00.040947 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-79fd0c96-8f77-4d8a-94ea-d65c9dd124de tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36" status: 404 len: 111 microversion: 2.1 time: 0.059803 Oct 01 21:16:00.041751 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3357/4721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:15:59 2022] GET /compute/v2.1/servers/be519138-4f90-475d-9373-d4932380ad36 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:16:01.251050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:01.252967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:01.271877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:01.272585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:01.273205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:01.274504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:01.275178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:01.277767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:01.310564 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 HTTP/1.1 Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e4888d15-cd1d-4900-9b7d-508b742e3807'} Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:16:01.314367 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.321258 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.324233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:16:01.325411 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-24785c6c-50a2-4fdf-98d1-144d14846cdc tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 404 len: 111 microversion: 2.1 time: 0.083339 Oct 01 21:16:01.326656 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1365/4722] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:16:01 2022] DELETE /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:16:01.335847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:01.336451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: e4888d15-cd1d-4900-9b7d-508b742e3807] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:01.347260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:01.348068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:01.354056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:01.355113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:01.355597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:01.356046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:01.371528 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 HTTP/1.1 Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e4888d15-cd1d-4900-9b7d-508b742e3807'} Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:01.373011 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.377263 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.377263 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:01.377263 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:01.377263 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:16:01.377263 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:16:01.377263 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. Oct 01 21:16:01.377263 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.377263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance e4888d15-cd1d-4900-9b7d-508b742e3807 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:16:01.377263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-18e94bfe-4f12-4e84-b8d3-ebe06123589e tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807" status: 404 len: 111 microversion: 2.1 time: 0.044078 Oct 01 21:16:01.384784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:01.385485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:01.391354 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3358/4723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:01 2022] GET /compute/v2.1/servers/e4888d15-cd1d-4900-9b7d-508b742e3807 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:16:01.392992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:01.393500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:01.393949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:01.394744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:01.395386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:01.395975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:01.412093 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b HTTP/1.1 Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '0228eadd-4179-4ae5-8e65-06a5d536549b'} Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:16:01.413672 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:16:01.418737 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6c351fea-0daa-4e8c-a703-669e7f2a7945 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 404 len: 111 microversion: 2.1 time: 0.034346 Oct 01 21:16:01.424591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:01.426659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] [instance: 0228eadd-4179-4ae5-8e65-06a5d536549b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:01.429582 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1366/4724] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:16:01 2022] DELETE /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:16:01.433105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:01.433690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:01.434241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:01.435133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:01.435717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:01.436252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:01.452402 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] HTTP exception thrown: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Request method failure captured: Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b HTTP/1.1 Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK0umggYjv0U2ezmi1sDqHed_pyC83sPMf4Hp6fntWE3-mMHYHopztdvLLh9AFOW7JptN3mmmOfEJqNmW8W4MkWX5GvIR-9-TRT4fc8BmPUXL7C_Edg10fYLFvTYigRMRdZ7L-MLQuq6pueBXx5qJ7k27IiMa_Y6cCqrmmLeKrJoIVI Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8f92b50dc0364842980ce41af830ba1a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8f92b50dc0364842980ce41af830ba1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8f92b50dc0364842980ce41af830ba1a"}]}] Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 8f92b50dc0364842980ce41af830ba1a Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-611460547 Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: a2745d6923e347939e2c67015aefadda Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-611460547-project Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0228eadd-4179-4ae5-8e65-06a5d536549b'} Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:01.454110 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.458628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:01.458628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:01.458628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:01.458628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:16:01.458628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:16:01.458628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. Oct 01 21:16:01.458628 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:01.459299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] Returning 404 to user: Instance 0228eadd-4179-4ae5-8e65-06a5d536549b could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:16:01.461198 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b1bd56d0-760b-4ebe-be1a-04f1316ce789 tempest-DeleteServersTestJSON-611460547 tempest-DeleteServersTestJSON-611460547-project] 10.222.0.17 "GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b" status: 404 len: 111 microversion: 2.1 time: 0.041175 Oct 01 21:16:01.466153 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3359/4725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:01 2022] GET /compute/v2.1/servers/0228eadd-4179-4ae5-8e65-06a5d536549b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:16:02.640198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c83e84e3-1ae6-47aa-a0ad-efe9a7c65f05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:02.642553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c83e84e3-1ae6-47aa-a0ad-efe9a7c65f05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:02.659069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c83e84e3-1ae6-47aa-a0ad-efe9a7c65f05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:02.659069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c83e84e3-1ae6-47aa-a0ad-efe9a7c65f05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:02.659069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c83e84e3-1ae6-47aa-a0ad-efe9a7c65f05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:02.659069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c83e84e3-1ae6-47aa-a0ad-efe9a7c65f05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:02.659069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c83e84e3-1ae6-47aa-a0ad-efe9a7c65f05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:02.659069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c83e84e3-1ae6-47aa-a0ad-efe9a7c65f05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:02.782752 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c83e84e3-1ae6-47aa-a0ad-efe9a7c65f05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action" status: 200 len: 24568 microversion: 2.1 time: 0.148278 Oct 01 21:16:02.785517 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1367/4726] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:16:02 2022] POST /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80/action => generated 24568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:16:06.459144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6e1f92b-d53d-4540-abb4-1041487acbb1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Action: 'create', calling method: .version_select at 0x7f4173c41c10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-807730869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOUHpyaWrN5g9vjDL7GB8PA55h1bBewZUjNU7gWVjPmR1JZNWM53VXDe6/FZoVkoNpFlMbtvu6rmfNYkLIJIdtoD631AYxQavK5Tx9Ue/y7ROmib1T0/NwJTXe7INYM6g=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:06.487104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:06.501188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a6e1f92b-d53d-4540-abb4-1041487acbb1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:16:06.507423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a6e1f92b-d53d-4540-abb4-1041487acbb1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for user 3066b652821f47f6909892c9b04f4236 and project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:16:06.538965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a6e1f92b-d53d-4540-abb4-1041487acbb1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.084419 Oct 01 21:16:06.540288 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3360/4727] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:16:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:09.046939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dfdcdbff-1838-4c52-b813-b8dddc6befb3 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:09.049412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dfdcdbff-1838-4c52-b813-b8dddc6befb3 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:09.093141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdbff-1838-4c52-b813-b8dddc6befb3 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:09.093749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdbff-1838-4c52-b813-b8dddc6befb3 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:09.094598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdbff-1838-4c52-b813-b8dddc6befb3 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:09.098946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdbff-1838-4c52-b813-b8dddc6befb3 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:09.104327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdbff-1838-4c52-b813-b8dddc6befb3 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:09.105569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdbff-1838-4c52-b813-b8dddc6befb3 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:09.807795 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dfdcdbff-1838-4c52-b813-b8dddc6befb3 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1833 microversion: 2.1 time: 0.762731 Oct 01 21:16:09.825355 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1368/4728] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:09 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1833 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:10.225464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1584784816", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "e54bc8e6-00a0-4f5f-9c5f-90c2b20c9ab3"}], "key_name": "tempest-TestNetworkBasicOps-807730869", "security_groups": [{"name": "tempest-secgroup-smoke-1969392094"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:10.580041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] validate_networks() for [('e54bc8e6-00a0-4f5f-9c5f-90c2b20c9ab3', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:16:11.454258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=26 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:12.189159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:16:12.189592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:16:12.190076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:16:12.191115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:16:12.191548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:16:12.214165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:12.214932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:12.215536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:12.216475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:12.217103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:12.217715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:12.240487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:16:12.254713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for user 3066b652821f47f6909892c9b04f4236 and project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:16:12.295751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:16:12.299348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:16:12.387119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:12.387628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:12.399114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:12.399614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:12.400054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:12.400771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:12.401232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:12.401661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:12.409806 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb0e6355-c23e-4b73-8231-3bb50edeb840 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.190411 Oct 01 21:16:12.413010 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3361/4729] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:16:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:16:12.423802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0fb89f85-e51b-4dd1-bb5a-959fdaabb636 req-0b68b37b-1c14-4161-ae27-4462d9275033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05029414-2d25-49f4-9f77-3199c6a8fa80", "tag": "3b971980-8326-448b-afd2-1e2b532deb8c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:12.471276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0fb89f85-e51b-4dd1-bb5a-959fdaabb636 req-0b68b37b-1c14-4161-ae27-4462d9275033 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:12.473174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0fb89f85-e51b-4dd1-bb5a-959fdaabb636 req-0b68b37b-1c14-4161-ae27-4462d9275033 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:12.473855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0fb89f85-e51b-4dd1-bb5a-959fdaabb636 req-0b68b37b-1c14-4161-ae27-4462d9275033 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:12.479492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:16:12.508646 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0fb89f85-e51b-4dd1-bb5a-959fdaabb636 req-0b68b37b-1c14-4161-ae27-4462d9275033 service nova] Creating event network-changed:3b971980-8326-448b-afd2-1e2b532deb8c for instance 05029414-2d25-49f4-9f77-3199c6a8fa80 on nch2-master-1 Oct 01 21:16:12.520620 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0fb89f85-e51b-4dd1-bb5a-959fdaabb636 req-0b68b37b-1c14-4161-ae27-4462d9275033 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105646 Oct 01 21:16:12.521834 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3362/4730] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:12.532374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-08bac6e3-4c6d-470d-af54-535d2c3dd728 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:12.533473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-08bac6e3-4c6d-470d-af54-535d2c3dd728 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:12.685025 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-af5a9667-74cc-4d3c-ab02-2515e1eb9e25 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "DELETE /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 204 len: 0 microversion: 2.1 time: 0.303730 Oct 01 21:16:12.702240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-08bac6e3-4c6d-470d-af54-535d2c3dd728 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:12.709391 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1369/4731] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:16:12 2022] DELETE /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 21:16:12.718823 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-08bac6e3-4c6d-470d-af54-535d2c3dd728 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1248 microversion: 2.1 time: 0.195425 Oct 01 21:16:12.719509 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3363/4732] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:12 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1248 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:12.723198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:12.724571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:12.732692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:12.733496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:12.734878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:12.736366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:12.738142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:12.738764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:12.745180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:13.062140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:13.077111 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c8020025-235d-417e-9c0d-67e3f224b6df tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1688 microversion: 2.1 time: 0.362556 Oct 01 21:16:13.077820 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1370/4733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:12 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1688 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:13.749258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:13.750588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:13.759759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:13.760714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:13.761418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:13.762314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:13.762980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:13.763784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:14.002528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:14.019961 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fab0a5ff-9678-4bfb-8313-bda5d27c29d2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1300 microversion: 2.1 time: 0.273050 Oct 01 21:16:14.022235 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3364/4734] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:13 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1300 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:14.103340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:14.104049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:14.118097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:14.127983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:14.128907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:14.130158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:14.131808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:14.132620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:14.133387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:14.825211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:14.835671 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dc452dfb-f67b-48ad-a1fd-d9f14f308310 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1688 microversion: 2.1 time: 0.736744 Oct 01 21:16:14.836259 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1371/4735] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:14 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1688 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:16:15.055598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:15.057130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:15.065526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:15.066547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:15.067171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:15.068067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:15.068699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:15.069298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:15.188822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:15.213565 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-67d2e4c6-0f59-4155-81a1-f5159d66843b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1306 microversion: 2.1 time: 0.163599 Oct 01 21:16:15.215399 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3365/4736] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:15 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1306 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:15.866235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:15.867056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-26f702d7-b8d6-4b20-ac1e-5e89eb9572b2 req-c4e7940b-13eb-4e26-bb94-509507eef4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05029414-2d25-49f4-9f77-3199c6a8fa80", "name": "network-vif-deleted", "tag": "3b971980-8326-448b-afd2-1e2b532deb8c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:15.869602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:15.926736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-26f702d7-b8d6-4b20-ac1e-5e89eb9572b2 req-c4e7940b-13eb-4e26-bb94-509507eef4a6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:15.927939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:15.929622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:15.930331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:15.931558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:15.932494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-26f702d7-b8d6-4b20-ac1e-5e89eb9572b2 req-c4e7940b-13eb-4e26-bb94-509507eef4a6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:15.933065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:15.933342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-26f702d7-b8d6-4b20-ac1e-5e89eb9572b2 req-c4e7940b-13eb-4e26-bb94-509507eef4a6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:15.933718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:15.949725 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-26f702d7-b8d6-4b20-ac1e-5e89eb9572b2 req-c4e7940b-13eb-4e26-bb94-509507eef4a6 service nova] Creating event network-vif-deleted:3b971980-8326-448b-afd2-1e2b532deb8c for instance 05029414-2d25-49f4-9f77-3199c6a8fa80 on nch2-master-1 Oct 01 21:16:15.968698 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-26f702d7-b8d6-4b20-ac1e-5e89eb9572b2 req-c4e7940b-13eb-4e26-bb94-509507eef4a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104741 Oct 01 21:16:15.969402 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1372/4737] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:16.185978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:16.214643 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3417086a-f5c2-471f-a60b-ee12e0d1c098 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 200 len: 1351 microversion: 2.1 time: 0.346790 Oct 01 21:16:16.216877 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3366/4738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:15 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 1351 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:16:16.240597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:16.241539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:16.267286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:16.267921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:16.269888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:16.270900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:16.273459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:16.274290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:16.805056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:16.814216 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-74396fb0-6cfc-4d22-a63a-cebc378491e1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1374 microversion: 2.1 time: 0.579654 Oct 01 21:16:16.820747 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1373/4739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:16 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1374 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:17.243058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:17.243986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 05029414-2d25-49f4-9f77-3199c6a8fa80] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:17.257836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:17.260260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:17.262048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:17.267447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:17.268845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:17.270414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:17.316343 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] HTTP exception thrown: Instance 05029414-2d25-49f4-9f77-3199c6a8fa80 could not be found. Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Request method failure captured: Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 HTTP/1.1 Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK2hiQttiLqFpU-8rCQHHvV-cPgSq6Vp7kVdJek3nn6F4H5vFTWS4FtOgvdjDYM3WBqdjC3p_4jg80-mVN1iU7Nu4N7YA8dsPbVHGGQ6Xlb8LUviJ4SX_YgNzxd91nA6MQskQH_9HYu8UoC5fzsj_amZuTPDVfcZvtzydTfTYeoAqCM Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 71511e85c1b947e3b03501b27d70d560 Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_71511e85c1b947e3b03501b27d70d560", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/71511e85c1b947e3b03501b27d70d560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/71511e85c1b947e3b03501b27d70d560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/71511e85c1b947e3b03501b27d70d560"}]}] Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 71511e85c1b947e3b03501b27d70d560 Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestNetworkAdvancedServerOps-1998630134-project Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f77486ef55a0469a99c3795b626bee1a Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1998630134-project Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 05029414-2d25-49f4-9f77-3199c6a8fa80 could not be found. Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '05029414-2d25-49f4-9f77-3199c6a8fa80'} Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05029414-2d25-49f4-9f77-3199c6a8fa80 could not be found. Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05029414-2d25-49f4-9f77-3199c6a8fa80 could not be found. Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:17.318580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:17.324024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:17.324024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:17.324024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:17.324024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:17.324024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:16:17.324024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:16:17.324024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05029414-2d25-49f4-9f77-3199c6a8fa80 could not be found. Oct 01 21:16:17.324024 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:16:17.330553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Returning 404 to user: Instance 05029414-2d25-49f4-9f77-3199c6a8fa80 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:16:17.332463 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-20186844-9ebd-4a63-9b89-c1c3f8533ba0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80" status: 404 len: 111 microversion: 2.1 time: 0.094736 Oct 01 21:16:17.333822 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3367/4740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:17 2022] GET /compute/v2.1/servers/05029414-2d25-49f4-9f77-3199c6a8fa80 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:16:17.841008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:17.841648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:17.854864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:17.855374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:17.858787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:17.859597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:17.860010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:17.863198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:18.464361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:18.479868 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c3501a8d-5136-4bac-b964-fa4a95459aa8 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1374 microversion: 2.1 time: 0.644241 Oct 01 21:16:18.481981 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1374/4741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:17 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1374 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:19.505578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:19.506481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:19.517971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:19.518911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:19.519668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:19.520721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:19.521520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:19.522181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:19.713741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-9a9cf0e6-5762-435b-9ab5-62fd7b98732a req-66d3b6cf-c818-42d4-9b29-4153d415e124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7958cd56-0c66-403d-9b91-c9ef4262620a", "tag": "a384fd08-6237-4013-8248-4dcd07071291"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:19.760328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9a9cf0e6-5762-435b-9ab5-62fd7b98732a req-66d3b6cf-c818-42d4-9b29-4153d415e124 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:19.765745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9a9cf0e6-5762-435b-9ab5-62fd7b98732a req-66d3b6cf-c818-42d4-9b29-4153d415e124 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:19.766241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9a9cf0e6-5762-435b-9ab5-62fd7b98732a req-66d3b6cf-c818-42d4-9b29-4153d415e124 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:19.792464 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-9a9cf0e6-5762-435b-9ab5-62fd7b98732a req-66d3b6cf-c818-42d4-9b29-4153d415e124 service nova] Creating event network-changed:a384fd08-6237-4013-8248-4dcd07071291 for instance 7958cd56-0c66-403d-9b91-c9ef4262620a on nch1-master-1 Oct 01 21:16:19.798558 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-9a9cf0e6-5762-435b-9ab5-62fd7b98732a req-66d3b6cf-c818-42d4-9b29-4153d415e124 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091500 Oct 01 21:16:19.800809 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1375/4742] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:16:20.055812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:20.067362 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bb38f920-097b-4059-95b7-5706991fecda tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1374 microversion: 2.1 time: 0.567547 Oct 01 21:16:20.068885 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3368/4743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:19 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1374 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:21.094188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:21.094957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:21.113641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:21.114170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:21.115947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:21.119101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:21.119926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:21.121969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:21.659006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:21.683565 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3289f6e5-8e33-42ce-a1d4-796d4d21de94 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1374 microversion: 2.1 time: 0.593884 Oct 01 21:16:21.685033 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1376/4744] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:21 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1374 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:21.823227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-548170343", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "a669869d-7123-4c96-860a-1b7e12405849"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:21.910612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] validate_networks() for [('a669869d-7123-4c96-860a-1b7e12405849', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:16:22.236308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:22.712629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:22.714399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:22.715880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:22.725614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:22.732510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:22.733224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:22.734276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:22.735268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:22.735881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:23.208747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:23.224559 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-91530b6d-8f0e-4a7d-ab5a-34922dc855dd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1374 microversion: 2.1 time: 0.517238 Oct 01 21:16:23.225505 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1377/4745] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:22 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1374 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:16:23.244650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:16:23.246257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:16:23.247035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:16:23.247794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:16:23.248937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:16:23.268979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:23.276486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:23.277299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:23.279896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:23.285712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:23.287469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:23.327306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Getting quotas for project ee4f57ea97c64af5958543447819ce8d. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:16:23.341775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Getting quotas for user a554c62c88c94526aea50fe59333aa29 and project ee4f57ea97c64af5958543447819ce8d. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:16:23.378259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:16:23.386861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:16:23.543632 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-263291ad-9f86-4e27-bb8e-f83865d4736e tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.950354 Oct 01 21:16:23.551140 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3369/4746] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:16:23.564232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-82bba0d9-17dc-4b1e-b9a3-3450a4dd5a5b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:23.566087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-82bba0d9-17dc-4b1e-b9a3-3450a4dd5a5b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:23.790451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-82bba0d9-17dc-4b1e-b9a3-3450a4dd5a5b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:23.804019 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-82bba0d9-17dc-4b1e-b9a3-3450a4dd5a5b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1216 microversion: 2.1 time: 0.244973 Oct 01 21:16:23.817921 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1378/4747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:23 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1216 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:24.251077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:24.253298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:24.269421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:24.272015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:24.274596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:24.277084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:24.278952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:24.279558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:24.830294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:24.830992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:24.842940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:24.851886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:24.854386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:24.855243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:24.855736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:24.856190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:24.857464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:24.874306 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d32dda9d-8296-49c3-86f9-b4a1a3c71030 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1374 microversion: 2.1 time: 0.629834 Oct 01 21:16:24.878612 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3370/4748] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:24 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1374 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:25.093550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:25.105465 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2306b055-3051-4c4d-9905-154b2ba8abe5 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1268 microversion: 2.1 time: 0.278963 Oct 01 21:16:25.123038 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1379/4749] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:24 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1268 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:16:25.900449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:25.901904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:25.914236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:25.915243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:25.921755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:25.923310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:25.923911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:25.925052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:26.136319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:26.137121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:26.156523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:26.157192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:26.157820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:26.159024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:26.159663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:26.160284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:26.572067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:26.580462 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3192841a-ff33-4cb9-a402-e7bfc26d3289 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1274 microversion: 2.1 time: 0.450323 Oct 01 21:16:26.582726 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1380/4750] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:26 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1274 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:16:26.598999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-598df7c1-ef52-4ded-a1ea-5e22e5e011f9 req-7a05a165-b656-473d-9c97-299b68b3917b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7958cd56-0c66-403d-9b91-c9ef4262620a", "name": "network-vif-plugged", "status": "completed", "tag": "a384fd08-6237-4013-8248-4dcd07071291"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:26.619958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-598df7c1-ef52-4ded-a1ea-5e22e5e011f9 req-7a05a165-b656-473d-9c97-299b68b3917b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:26.624904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-598df7c1-ef52-4ded-a1ea-5e22e5e011f9 req-7a05a165-b656-473d-9c97-299b68b3917b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:26.625618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-598df7c1-ef52-4ded-a1ea-5e22e5e011f9 req-7a05a165-b656-473d-9c97-299b68b3917b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:26.639616 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-598df7c1-ef52-4ded-a1ea-5e22e5e011f9 req-7a05a165-b656-473d-9c97-299b68b3917b service nova] Creating event network-vif-plugged:a384fd08-6237-4013-8248-4dcd07071291 for instance 7958cd56-0c66-403d-9b91-c9ef4262620a on nch1-master-1 Oct 01 21:16:26.649844 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-598df7c1-ef52-4ded-a1ea-5e22e5e011f9 req-7a05a165-b656-473d-9c97-299b68b3917b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065648 Oct 01 21:16:26.653604 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1381/4751] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:26.715192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:26.740645 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5a8c8467-4bf6-410e-9a3f-1126487f3ed7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1374 microversion: 2.1 time: 0.839843 Oct 01 21:16:26.744089 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3371/4752] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:25 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1374 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:27.610632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:27.611916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:27.627435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:27.628122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:27.628747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:27.629644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:27.630411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:27.631233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:27.655565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-700f192e-8c31-4945-8e8e-8bab95c67326 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '.version_select at 0x7f4172efc310>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:27.723890 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-700f192e-8c31-4945-8e8e-8bab95c67326 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-328398167" status: 202 len: 0 microversion: 2.1 time: 0.073942 Oct 01 21:16:27.724509 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3372/4753] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Oct 1 21:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-328398167 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:16:27.757003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-207b87d2-a924-45e3-8bec-b8647745e71c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'create', calling method: .version_select at 0x7f417c29a3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1666881393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrtCo05AvqL7EeKBUzv0Z6uVt/iCMHB3xDojBn01Hs0QKR7mpuOUI6WKpO8Cd4uO8KIo5MDwn2nGpRwl2/5W+mEEJjUQ27sKrrtNasAc5hWSEinIIfJXpXvbEeeZnxbWw=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:27.797543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-207b87d2-a924-45e3-8bec-b8647745e71c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for project 71511e85c1b947e3b03501b27d70d560. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:16:27.807958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-207b87d2-a924-45e3-8bec-b8647745e71c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for user f77486ef55a0469a99c3795b626bee1a and project 71511e85c1b947e3b03501b27d70d560. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:16:27.866829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-207b87d2-a924-45e3-8bec-b8647745e71c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.114779 Oct 01 21:16:27.867819 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3373/4754] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:16:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:27.872715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:27.873431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:27.895574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:27.896390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:27.896997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:27.897890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:27.898550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:27.899145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:28.162428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:28.174921 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e0f7c726-3c07-4b3f-a262-8a5e8be78f93 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1316 microversion: 2.1 time: 0.570261 Oct 01 21:16:28.197667 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1382/4755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:27 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1316 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:28.499680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:28.521132 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e1a4d1c3-3937-4aaf-a6bd-b22ec6f15b19 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1374 microversion: 2.1 time: 0.652097 Oct 01 21:16:28.536036 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3374/4756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:27 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1374 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:29.198954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:29.199762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:29.207671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:29.208729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:29.209315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:29.210138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:29.210744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:29.211280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:29.523711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:29.539632 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d83acf08-1db1-40de-8b1d-9570851b3993 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1316 microversion: 2.1 time: 0.345294 Oct 01 21:16:29.548572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:29.549979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:29.555018 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1383/4757] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:29 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:29.561254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:29.570233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:29.570864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:29.571658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:29.577098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:29.577878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:29.665285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-70f96f90-68ad-4db8-916c-f3957544be12 req-be12afdf-7186-41d4-a1ec-302d84462b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c0a18bd-060b-492a-9ee6-c26df9386695", "tag": "6df0a485-3d9e-4d8a-91fb-e7911daed25d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:29.686252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-70f96f90-68ad-4db8-916c-f3957544be12 req-be12afdf-7186-41d4-a1ec-302d84462b4e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:29.688493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-70f96f90-68ad-4db8-916c-f3957544be12 req-be12afdf-7186-41d4-a1ec-302d84462b4e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:29.691338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-70f96f90-68ad-4db8-916c-f3957544be12 req-be12afdf-7186-41d4-a1ec-302d84462b4e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:29.718794 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-70f96f90-68ad-4db8-916c-f3957544be12 req-be12afdf-7186-41d4-a1ec-302d84462b4e service nova] Creating event network-changed:6df0a485-3d9e-4d8a-91fb-e7911daed25d for instance 3c0a18bd-060b-492a-9ee6-c26df9386695 on nch2-master-1 Oct 01 21:16:29.734679 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-70f96f90-68ad-4db8-916c-f3957544be12 req-be12afdf-7186-41d4-a1ec-302d84462b4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073852 Oct 01 21:16:29.736099 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1384/4758] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:30.037049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:30.062195 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23fe61fe-b0e5-4866-aec9-cc3fc4c379b9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1546 microversion: 2.1 time: 0.519501 Oct 01 21:16:30.067078 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3375/4759] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:29 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1546 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:30.093978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:30.095219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:30.109400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:30.110079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:30.112314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:30.113346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:30.115130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:30.117058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:30.575130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:30.576949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:30.590038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:30.591057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:30.601841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:30.606831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:30.609964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:30.611467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:30.613253 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-777f4fc4-2b95-4112-be9c-941524e42139 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1546 microversion: 2.1 time: 0.523355 Oct 01 21:16:30.614916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:30.616375 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1385/4760] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:30 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1546 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:31.186594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:31.195070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0b630bb-9720-4945-8d8b-53d0b0386a5c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1316 microversion: 2.1 time: 0.634281 Oct 01 21:16:31.211206 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3376/4761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:30 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1316 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:32.219116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:32.219753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:32.228806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:32.229740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:32.230436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:32.232527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:32.233276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:32.244143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:32.856388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:32.874104 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1d8fb5b0-0b54-45cf-9ce4-2e913459baeb tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1316 microversion: 2.1 time: 0.659454 Oct 01 21:16:32.875097 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1386/4762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:32 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:33.824883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:33.830295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-f42165b7-2ab8-466f-ac02-c3d241e1a0c2 req-2c9c0dd0-7aa9-430b-a7ea-7b3e341777d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7958cd56-0c66-403d-9b91-c9ef4262620a", "tag": "a384fd08-6237-4013-8248-4dcd07071291"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:33.840543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f42165b7-2ab8-466f-ac02-c3d241e1a0c2 req-2c9c0dd0-7aa9-430b-a7ea-7b3e341777d8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:33.859464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f42165b7-2ab8-466f-ac02-c3d241e1a0c2 req-2c9c0dd0-7aa9-430b-a7ea-7b3e341777d8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:33.860300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f42165b7-2ab8-466f-ac02-c3d241e1a0c2 req-2c9c0dd0-7aa9-430b-a7ea-7b3e341777d8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:33.894871 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-f42165b7-2ab8-466f-ac02-c3d241e1a0c2 req-2c9c0dd0-7aa9-430b-a7ea-7b3e341777d8 service nova] Creating event network-changed:a384fd08-6237-4013-8248-4dcd07071291 for instance 7958cd56-0c66-403d-9b91-c9ef4262620a on nch1-master-1 Oct 01 21:16:33.896983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:33.897614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:33.900748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:33.904993 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-f42165b7-2ab8-466f-ac02-c3d241e1a0c2 req-2c9c0dd0-7aa9-430b-a7ea-7b3e341777d8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081153 Oct 01 21:16:33.905723 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3377/4763] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:33.914800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:33.915591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:33.916188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:33.917086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:33.917958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:33.918850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:34.115887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:34.128013 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-055425ed-8710-494b-897e-88701bdcd700 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1316 microversion: 2.1 time: 0.234188 Oct 01 21:16:34.129323 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1387/4764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:33 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:35.161780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:35.164380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:35.191737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:35.192952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:35.194854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:35.196368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:35.199160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:35.199582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:35.563724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:35.577650 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c39b8bcf-e186-49c3-a2b1-d21f594334c4 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1316 microversion: 2.1 time: 0.425117 Oct 01 21:16:35.579450 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3378/4765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:35 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:36.602714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:36.603363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:36.622834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:36.625944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:36.628673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:36.629747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:36.633142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:36.634026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:36.989913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:37.004490 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-59f9e3c8-1664-4bff-bc49-b388b2de373c tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1316 microversion: 2.1 time: 0.406325 Oct 01 21:16:37.005102 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1388/4766] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:36 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:37.201732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3c40411f-a71b-46d8-95ed-4fd981de6319 req-52316ecb-dc12-42bd-85a2-b004745fb325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0a18bd-060b-492a-9ee6-c26df9386695", "name": "network-vif-plugged", "status": "completed", "tag": "6df0a485-3d9e-4d8a-91fb-e7911daed25d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:37.214198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:37.229102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3c40411f-a71b-46d8-95ed-4fd981de6319 req-52316ecb-dc12-42bd-85a2-b004745fb325 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:37.229607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3c40411f-a71b-46d8-95ed-4fd981de6319 req-52316ecb-dc12-42bd-85a2-b004745fb325 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:37.230054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3c40411f-a71b-46d8-95ed-4fd981de6319 req-52316ecb-dc12-42bd-85a2-b004745fb325 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:37.260611 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3c40411f-a71b-46d8-95ed-4fd981de6319 req-52316ecb-dc12-42bd-85a2-b004745fb325 service nova] Creating event network-vif-plugged:6df0a485-3d9e-4d8a-91fb-e7911daed25d for instance 3c0a18bd-060b-492a-9ee6-c26df9386695 on nch2-master-1 Oct 01 21:16:37.266845 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3c40411f-a71b-46d8-95ed-4fd981de6319 req-52316ecb-dc12-42bd-85a2-b004745fb325 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070295 Oct 01 21:16:37.268704 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3379/4767] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:38.036487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:38.037127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:38.048754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:38.049300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:38.052379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:38.053648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:38.055552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:38.056259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:38.383371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:38.397568 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-77ad3562-2597-4f4c-8254-615671d3f461 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1316 microversion: 2.1 time: 0.368991 Oct 01 21:16:38.399464 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1389/4768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:38 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:39.425893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:39.431587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:39.432325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:39.449908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:39.450414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:39.459095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:39.459921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:39.460419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:39.460869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:39.880321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:39.890317 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29459c57-7f0c-4424-b48c-d211d474ff3d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1504 microversion: 2.1 time: 0.465305 Oct 01 21:16:39.919951 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3380/4769] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:39 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:39.925267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:39.926036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:39.939510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:39.940028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:39.940480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:39.941198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:39.943767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:39.944462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:39.992408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:40.015738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:40.021134 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bf177530-b2ba-4f7d-a567-cb0ebf7a4f2d tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695/os-instance-actions/req-263291ad-9f86-4e27-bb8e-f83865d4736e" status: 200 len: 313 microversion: 2.1 time: 0.100339 Oct 01 21:16:40.022909 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1390/4770] 10.222.0.17 () {58 vars in 1419 bytes} [Sat Oct 1 21:16:39 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695/os-instance-actions/req-263291ad-9f86-4e27-bb8e-f83865d4736e => generated 313 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:16:40.055876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7861c9d-cb33-4412-b9e7-70fe31d590ba tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:40.058187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7861c9d-cb33-4412-b9e7-70fe31d590ba tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:40.074095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7861c9d-cb33-4412-b9e7-70fe31d590ba tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:40.074781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7861c9d-cb33-4412-b9e7-70fe31d590ba tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:40.075366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7861c9d-cb33-4412-b9e7-70fe31d590ba tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:40.076130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7861c9d-cb33-4412-b9e7-70fe31d590ba tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:40.077576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7861c9d-cb33-4412-b9e7-70fe31d590ba tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:40.078038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7861c9d-cb33-4412-b9e7-70fe31d590ba tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:40.228476 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7861c9d-cb33-4412-b9e7-70fe31d590ba tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "POST /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695/action" status: 202 len: 0 microversion: 2.1 time: 0.186849 Oct 01 21:16:40.231377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3381/4771] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:16:40 2022] POST /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:16:40.240128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:40.240763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:40.260007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:40.261740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:40.262195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:40.268150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:40.269358 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:40.270377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:41.163857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:41.181702 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9a155ffc-7eb9-49ef-a066-3dee687ebc11 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1506 microversion: 2.1 time: 0.946283 Oct 01 21:16:41.188311 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1391/4772] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:40 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1506 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:41.778741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1124521227", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "7514f41a-afde-4891-9cf4-dbe12b4768e8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1666881393", "security_groups": [{"name": "tempest-secgroup-smoke-579133110"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:42.014456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] validate_networks() for [('7514f41a-afde-4891-9cf4-dbe12b4768e8', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:16:42.209449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:42.210065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:42.226368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:42.226915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:42.227365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:42.228539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:42.229013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:42.229451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:42.637904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:42.647785 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-232bb437-64a6-49b7-b214-44364bb40897 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1511 microversion: 2.1 time: 0.442058 Oct 01 21:16:42.666599 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1392/4773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:42 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:42.949474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:16:42.952012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:16:42.952976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:16:42.953586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:16:42.954253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:16:42.969398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:42.971715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:42.972337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:42.973529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:42.974160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:42.976085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:42.989910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:43.008481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for project 71511e85c1b947e3b03501b27d70d560. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:16:43.016951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for user f77486ef55a0469a99c3795b626bee1a and project 71511e85c1b947e3b03501b27d70d560. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:16:43.048622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:16:43.051819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:16:43.248555 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3c05a72f-a4bd-48e7-b7a1-cc29eda2a8a6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.467874 Oct 01 21:16:43.252637 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3382/4774] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:16:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:16:43.265948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-895bb803-d45d-433b-960d-ff715e72ce2a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:43.271201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-895bb803-d45d-433b-960d-ff715e72ce2a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:43.380736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-895bb803-d45d-433b-960d-ff715e72ce2a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:43.388880 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-895bb803-d45d-433b-960d-ff715e72ce2a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1267 microversion: 2.1 time: 0.128755 Oct 01 21:16:43.397138 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1393/4775] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:43 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:43.675391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:43.676358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:43.690304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:43.696055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:43.696799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:43.697583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:43.698046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:43.698554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:43.950693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:43.964899 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5e7fee66-bd49-4f5f-a7af-05f80401e6da tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1504 microversion: 2.1 time: 0.295435 Oct 01 21:16:43.965844 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3383/4776] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:43 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:43.989093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cbdaa356-e8a2-40c0-bd22-9396273990bd tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '.version_select at 0x7f41725b2160>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:43.990162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cbdaa356-e8a2-40c0-bd22-9396273990bd tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:43.998695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaa356-e8a2-40c0-bd22-9396273990bd tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:43.999353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaa356-e8a2-40c0-bd22-9396273990bd tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:44.001019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaa356-e8a2-40c0-bd22-9396273990bd tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:44.002261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaa356-e8a2-40c0-bd22-9396273990bd tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:44.002905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaa356-e8a2-40c0-bd22-9396273990bd tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:44.003576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdaa356-e8a2-40c0-bd22-9396273990bd tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:44.048263 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cbdaa356-e8a2-40c0-bd22-9396273990bd tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.063686 Oct 01 21:16:44.049981 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1394/4777] 10.222.0.17 () {58 vars in 1296 bytes} [Sat Oct 1 21:16:43 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695/os-instance-actions => generated 611 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:44.065763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:44.066574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:44.076538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:44.077674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:44.079189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:44.081452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:44.082201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:44.083195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:44.133817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:16:44.281704 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e129479a-4585-4c17-8211-12032b7a4b73 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 204 len: 0 microversion: 2.1 time: 0.219263 Oct 01 21:16:44.282890 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3384/4778] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:16:44 2022] DELETE /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:16:44.292792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:44.294130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:44.299056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=52 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:44.316428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:44.316942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:44.317394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:44.318123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:44.318629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:44.319065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:44.415994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:44.417232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:44.433292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:44.434370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:44.435717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:44.441261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:44.442867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:44.444313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:44.595847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:44.612776 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-50fa2742-e2aa-4b6c-adfb-68aefadde591 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1319 microversion: 2.1 time: 0.201213 Oct 01 21:16:44.614168 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3385/4779] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:44 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:44.672827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:44.688622 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b5700d11-a101-49ff-a3f7-cd7de0de1719 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1510 microversion: 2.1 time: 0.401137 Oct 01 21:16:44.691621 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1395/4780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:44 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:16:45.651373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:45.653940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:45.675784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:45.676290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:45.683525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:45.685347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:45.686124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:45.687181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:45.714344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:45.714999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:45.742417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:45.743057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:45.743526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:45.748136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:45.748646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:45.749094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:45.848626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:45.865839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d39582a4-04de-4166-bae9-289fc618ab24 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1325 microversion: 2.1 time: 0.226517 Oct 01 21:16:45.866443 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3386/4781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:45 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1325 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:46.353559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:46.372548 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7f053da8-a43f-4dbb-ad68-e66913d1b74b tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1510 microversion: 2.1 time: 0.659089 Oct 01 21:16:46.375971 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1396/4782] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:45 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1510 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:16:46.896100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:46.896726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:46.914225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:46.914952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:46.915503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:46.920864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:46.921468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:46.922024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:47.130984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e2d7dc9b-7b83-4799-9eac-d68eb2ca460c req-92f32ae9-6ec6-4400-9f6f-467dd3795267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0a18bd-060b-492a-9ee6-c26df9386695", "name": "network-vif-deleted", "tag": "6df0a485-3d9e-4d8a-91fb-e7911daed25d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:47.158317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e2d7dc9b-7b83-4799-9eac-d68eb2ca460c req-92f32ae9-6ec6-4400-9f6f-467dd3795267 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:47.161288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e2d7dc9b-7b83-4799-9eac-d68eb2ca460c req-92f32ae9-6ec6-4400-9f6f-467dd3795267 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:47.164569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e2d7dc9b-7b83-4799-9eac-d68eb2ca460c req-92f32ae9-6ec6-4400-9f6f-467dd3795267 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:47.218992 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e2d7dc9b-7b83-4799-9eac-d68eb2ca460c req-92f32ae9-6ec6-4400-9f6f-467dd3795267 service nova] Creating event network-vif-deleted:6df0a485-3d9e-4d8a-91fb-e7911daed25d for instance 3c0a18bd-060b-492a-9ee6-c26df9386695 on nch2-master-1 Oct 01 21:16:47.240853 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e2d7dc9b-7b83-4799-9eac-d68eb2ca460c req-92f32ae9-6ec6-4400-9f6f-467dd3795267 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114999 Oct 01 21:16:47.253272 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1397/4783] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:16:47.407367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:47.408295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:47.416738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:47.417629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:47.418953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:47.419945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:47.421173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:47.421860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:47.501723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:47.504716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:47.507440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:47.508337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lazy-loading 'fault' on Instance uuid 3c0a18bd-060b-492a-9ee6-c26df9386695 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:16:47.649201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a554c62c88c94526aea50fe59333aa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4f57ea97c64af5958543447819ce8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:47.657152 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fefecfd9-c1a2-4630-8ce7-96d5f51b5be6 tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 200 len: 1306 microversion: 2.1 time: 0.255683 Oct 01 21:16:47.658290 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1398/4784] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:47 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:47.736103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:47.761461 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f32250bd-e9dd-4248-a0e2-150b33ed9cf1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1392 microversion: 2.1 time: 0.872483 Oct 01 21:16:47.764288 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3387/4785] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:46 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1392 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:48.684175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:48.684999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] [instance: 3c0a18bd-060b-492a-9ee6-c26df9386695] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:48.695955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:48.696843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:48.707142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:48.708049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:48.708615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:48.709217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:48.724608 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] HTTP exception thrown: Instance 3c0a18bd-060b-492a-9ee6-c26df9386695 could not be found. Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Request method failure captured: Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 HTTP/1.1 Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK4lzIKX2xuDi4DDctkGXGUIXl9k49eWmht1Djk4EGFHLUYEez-9_8b61qMZvovXLP-agt0CCdypeUTfqdP84JEq53iR0UqExbhhZL69NQoDDnvTHxKCDwOcsmsFoHWlPI-lrXPfVg8A4KD-LGuZN52SewjFonCMm_Q2ei9pSKNdWPM Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ee4f57ea97c64af5958543447819ce8d Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-InstanceActionsTestJSON-637168373 Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ee4f57ea97c64af5958543447819ce8d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ee4f57ea97c64af5958543447819ce8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ee4f57ea97c64af5958543447819ce8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ee4f57ea97c64af5958543447819ce8d"}]}] Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-InstanceActionsTestJSON-637168373 Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ee4f57ea97c64af5958543447819ce8d Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-InstanceActionsTestJSON-637168373 Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-InstanceActionsTestJSON-637168373-project Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: a554c62c88c94526aea50fe59333aa29 Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-InstanceActionsTestJSON-637168373-project Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 3c0a18bd-060b-492a-9ee6-c26df9386695 could not be found. Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '3c0a18bd-060b-492a-9ee6-c26df9386695'} Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c0a18bd-060b-492a-9ee6-c26df9386695 could not be found. Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c0a18bd-060b-492a-9ee6-c26df9386695 could not be found. Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:16:48.727499 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:48.731497 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:16:48.731497 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:16:48.731497 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:16:48.731497 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:16:48.731497 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:16:48.731497 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c0a18bd-060b-492a-9ee6-c26df9386695 could not be found. Oct 01 21:16:48.731497 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:16:48.733583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] Returning 404 to user: Instance 3c0a18bd-060b-492a-9ee6-c26df9386695 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:16:48.734597 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d1b7cb45-c02c-42f6-98a0-bdb248d1dbaf tempest-InstanceActionsTestJSON-637168373 tempest-InstanceActionsTestJSON-637168373-project] 10.222.0.17 "GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695" status: 404 len: 111 microversion: 2.1 time: 0.054625 Oct 01 21:16:48.735590 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1399/4786] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:48 2022] GET /compute/v2.1/servers/3c0a18bd-060b-492a-9ee6-c26df9386695 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:16:48.794437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:48.795111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:48.808780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:48.810474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:48.811446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:48.812217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:48.812708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:48.813154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:48.972668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d53a7450-3745-4c8b-9593-9d1c2d57adb2 req-5aae19bd-df5d-434d-aabd-044e4ad821c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:48.983955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d53a7450-3745-4c8b-9593-9d1c2d57adb2 req-5aae19bd-df5d-434d-aabd-044e4ad821c3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:48.984665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d53a7450-3745-4c8b-9593-9d1c2d57adb2 req-5aae19bd-df5d-434d-aabd-044e4ad821c3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:48.985328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d53a7450-3745-4c8b-9593-9d1c2d57adb2 req-5aae19bd-df5d-434d-aabd-044e4ad821c3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:48.997676 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d53a7450-3745-4c8b-9593-9d1c2d57adb2 req-5aae19bd-df5d-434d-aabd-044e4ad821c3 service nova] Creating event network-changed:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch1-master-1 Oct 01 21:16:49.004829 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d53a7450-3745-4c8b-9593-9d1c2d57adb2 req-5aae19bd-df5d-434d-aabd-044e4ad821c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036416 Oct 01 21:16:49.006602 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1400/4787] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:49.228964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:49.239392 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-30557d8e-0469-4ac1-876d-f3c9dd92b424 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1392 microversion: 2.1 time: 0.450178 Oct 01 21:16:49.240650 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3388/4788] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:48 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1392 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:50.266268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:50.267593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:50.281195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:50.282303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:50.283646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:50.284564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:50.285134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:50.285569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:50.813113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:50.824503 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bb439c3e-3418-443a-b014-63fd44c78a30 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1392 microversion: 2.1 time: 0.564728 Oct 01 21:16:50.830452 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1401/4789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:50 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1392 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:51.860123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:51.861109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:51.882808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:51.900980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:51.901459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:51.907266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:51.908939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:51.910174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:52.291915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:52.304111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5b8c95c0-fd0a-4570-bcf8-456c99294ac3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1392 microversion: 2.1 time: 0.453550 Oct 01 21:16:52.304713 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3389/4790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:51 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1392 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:53.327998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:53.329275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:53.340495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:53.341272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:53.341884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:53.342888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:53.343510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:53.344093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:53.388562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:53.518647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:53.529277 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0248cbf6-a130-4876-97cf-a46292baf44c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1392 microversion: 2.1 time: 0.205384 Oct 01 21:16:53.530484 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1402/4791] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:53 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:54.278134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0f247216-fd6a-4b58-9202-c07eb1a900f5 req-c0886d85-74c8-4455-8d1c-5c0c2ecfd9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "name": "network-vif-plugged", "status": "completed", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:54.296821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:54.297961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:16:54.317530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0f247216-fd6a-4b58-9202-c07eb1a900f5 req-c0886d85-74c8-4455-8d1c-5c0c2ecfd9ad service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:54.318797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0f247216-fd6a-4b58-9202-c07eb1a900f5 req-c0886d85-74c8-4455-8d1c-5c0c2ecfd9ad service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:54.319252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0f247216-fd6a-4b58-9202-c07eb1a900f5 req-c0886d85-74c8-4455-8d1c-5c0c2ecfd9ad service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:54.348511 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0f247216-fd6a-4b58-9202-c07eb1a900f5 req-c0886d85-74c8-4455-8d1c-5c0c2ecfd9ad service nova] Creating event network-vif-plugged:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch1-master-1 Oct 01 21:16:54.361283 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0f247216-fd6a-4b58-9202-c07eb1a900f5 req-c0886d85-74c8-4455-8d1c-5c0c2ecfd9ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086791 Oct 01 21:16:54.365797 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3390/4792] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:16:54.396947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-42ea5424-ac04-4ae3-9c03-a13820ad9178 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:16:54.399293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-42ea5424-ac04-4ae3-9c03-a13820ad9178 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:54.416482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42ea5424-ac04-4ae3-9c03-a13820ad9178 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:54.417024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42ea5424-ac04-4ae3-9c03-a13820ad9178 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:54.417457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42ea5424-ac04-4ae3-9c03-a13820ad9178 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:54.418370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42ea5424-ac04-4ae3-9c03-a13820ad9178 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:54.419021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42ea5424-ac04-4ae3-9c03-a13820ad9178 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:54.420430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42ea5424-ac04-4ae3-9c03-a13820ad9178 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:54.494330 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-42ea5424-ac04-4ae3-9c03-a13820ad9178 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "POST /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a/action" status: 200 len: 24562 microversion: 2.1 time: 0.099844 Oct 01 21:16:54.505778 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1403/4793] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:16:54 2022] POST /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a/action => generated 24562 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:16:54.560825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:54.561867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:54.574709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:54.575453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:54.576185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:54.579141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:54.580650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:54.581330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:54.971006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:54.986215 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f1c6370-700f-404c-8125-883e30f02927 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1392 microversion: 2.1 time: 0.431664 Oct 01 21:16:54.990267 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3391/4794] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:54 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1392 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:56.022258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:56.023364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:56.037225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:56.038388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:56.039410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:56.041029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:56.041719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:56.042485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:56.353431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:56.364459 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f1b86049-d0d9-47cb-bd73-313162ad1262 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1392 microversion: 2.1 time: 0.351479 Oct 01 21:16:56.397750 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1404/4795] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:56 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1392 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:57.404828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:57.408089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:57.425438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:57.427193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:57.429124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:57.431404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:57.432322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:57.434306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:58.019638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:58.037449 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4f35016-b11c-4685-b772-484c28f3729a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1564 microversion: 2.1 time: 0.642040 Oct 01 21:16:58.043276 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3392/4796] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:57 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1564 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:16:58.070772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:16:58.071814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:16:58.083817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:58.084936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:58.085758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:58.086774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:16:58.087678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:16:58.088334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:16:58.424313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:16:58.447059 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-04f69ccb-a7cb-4994-ac9a-cab2813e67de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1564 microversion: 2.1 time: 0.380009 Oct 01 21:16:58.447691 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1405/4797] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:16:58 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1564 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:01.960947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-119478898", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "1ee1c1fa-6c55-452d-b1ac-5318e96bfec3"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:02.021236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] validate_networks() for [('1ee1c1fa-6c55-452d-b1ac-5318e96bfec3', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:17:03.356841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:17:03.356841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:17:03.356841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:17:03.357519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:17:03.357597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:17:03.375101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:03.375909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:03.376659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:03.377892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:03.378641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:03.379896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:03.429524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Getting quotas for project a4c1094d71344db7a70dc610b22bcc08. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:17:03.446665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Getting quotas for user 52f6bf6dd22549699fd1398ec8c3e8e6 and project a4c1094d71344db7a70dc610b22bcc08. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:17:03.494553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:17:03.497176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:17:03.593435 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c27426dd-7b61-4bac-b5cb-922377c20e55 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.769169 Oct 01 21:17:03.594126 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3393/4798] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 21:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 21:17:03.619906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0a1a0f7f-97a4-400e-9db1-e51e06db7456 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:03.627251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0a1a0f7f-97a4-400e-9db1-e51e06db7456 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:03.877768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0a1a0f7f-97a4-400e-9db1-e51e06db7456 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:03.911573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0a1a0f7f-97a4-400e-9db1-e51e06db7456 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:03.914094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0a1a0f7f-97a4-400e-9db1-e51e06db7456 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:03.918098 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0a1a0f7f-97a4-400e-9db1-e51e06db7456 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1258 microversion: 2.21 time: 0.312883 Oct 01 21:17:03.933931 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1406/4799] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:03 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1258 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:04.851630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:04.852257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:04.873972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:04.880092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:04.880530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:04.881303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:04.881788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:04.882227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:04.906823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-4ccf6cbc-b606-4f40-aa7c-6d0e546ab133 req-b55d48b0-2d7f-4c1a-a309-4629e2cbe409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:04.935010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4ccf6cbc-b606-4f40-aa7c-6d0e546ab133 req-b55d48b0-2d7f-4c1a-a309-4629e2cbe409 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:04.940322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4ccf6cbc-b606-4f40-aa7c-6d0e546ab133 req-b55d48b0-2d7f-4c1a-a309-4629e2cbe409 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:04.940531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4ccf6cbc-b606-4f40-aa7c-6d0e546ab133 req-b55d48b0-2d7f-4c1a-a309-4629e2cbe409 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:04.964542 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-4ccf6cbc-b606-4f40-aa7c-6d0e546ab133 req-b55d48b0-2d7f-4c1a-a309-4629e2cbe409 service nova] Creating event network-changed:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch1-master-1 Oct 01 21:17:04.975996 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-4ccf6cbc-b606-4f40-aa7c-6d0e546ab133 req-b55d48b0-2d7f-4c1a-a309-4629e2cbe409 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083623 Oct 01 21:17:04.977870 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1407/4800] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:05.012113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:05.013666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:05.031884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:05.033335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:05.033952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:05.041927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:05.042769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:05.055883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:05.259363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:05.278041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:05.294788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:05.303210 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-47f07c9e-643c-4a16-88ce-b4256133d41b tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1310 microversion: 2.21 time: 0.317387 Oct 01 21:17:05.304778 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1408/4801] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:04 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1310 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:05.386833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:05.400223 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21b42d6a-accb-471c-ac93-a2d366de8e5a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1564 microversion: 2.1 time: 0.553270 Oct 01 21:17:05.424887 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3394/4802] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:04 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1564 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:06.337402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:06.338032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:06.348898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:06.349709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:06.350327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:06.351268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:06.351894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:06.352493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:06.602399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:06.625079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:06.640684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:06.642223 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-73c66cbb-9318-410f-871d-a2fd816f5830 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1316 microversion: 2.21 time: 0.308802 Oct 01 21:17:06.646231 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1409/4803] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:06 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:07.672157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:07.674688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:07.678139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:07.713209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:07.724177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:07.725031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:07.725992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:07.726674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:07.727275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:08.144513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:08.177556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:08.179953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:08.182291 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0feacc6c-3bea-407b-925e-eea95a009b47 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1358 microversion: 2.21 time: 0.514707 Oct 01 21:17:08.183387 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3395/4804] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:07 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1358 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:09.216551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:09.224853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:09.239216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:09.240316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:09.241664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:09.242921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:09.243757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:09.244770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:09.773105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:09.792566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:09.797308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:09.801239 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b1269821-30b2-4353-8c5b-449dd65babfe tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1358 microversion: 2.21 time: 0.591766 Oct 01 21:17:09.803004 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1410/4805] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:09 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1358 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:10.828594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:10.829335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:10.836499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:10.837021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:10.837447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:10.838360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:10.838862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:10.839290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:11.101089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b0088cce-6899-46d5-891f-dae11c4f590e req-970a0ab2-b7e4-4b09-948c-31bda404f6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e81d33-7aea-4717-8ff9-04f0be55932c", "tag": "965359f5-d472-49c9-b524-61960faa69fe"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:11.131250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b0088cce-6899-46d5-891f-dae11c4f590e req-970a0ab2-b7e4-4b09-948c-31bda404f6c0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:11.131826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b0088cce-6899-46d5-891f-dae11c4f590e req-970a0ab2-b7e4-4b09-948c-31bda404f6c0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:11.134206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b0088cce-6899-46d5-891f-dae11c4f590e req-970a0ab2-b7e4-4b09-948c-31bda404f6c0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:11.166197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:11.173134 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b0088cce-6899-46d5-891f-dae11c4f590e req-970a0ab2-b7e4-4b09-948c-31bda404f6c0 service nova] Creating event network-changed:965359f5-d472-49c9-b524-61960faa69fe for instance d6e81d33-7aea-4717-8ff9-04f0be55932c on nch2-master-1 Oct 01 21:17:11.185770 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b0088cce-6899-46d5-891f-dae11c4f590e req-970a0ab2-b7e4-4b09-948c-31bda404f6c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092379 Oct 01 21:17:11.187041 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1411/4806] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:11.212301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:11.243207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:11.246171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:11.247698 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92b48522-bd97-42ce-86be-ac275fd63cb3 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1358 microversion: 2.21 time: 0.423499 Oct 01 21:17:11.248999 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3396/4807] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:10 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:11.341765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e18247af-cd7a-49bf-9aa0-5b353f92f93d tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Action: 'create', calling method: .version_select at 0x7f417256ca60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1617092607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBj2EvteD9sfbHvw+QWQe4L9x9F0akEFZXwJODzfTa2Dlsw4lAAOjLlKOJ5HtqHPbx3+xsewLQhvjk8dIPMLmMDb8bfAPOazg0XbH1aEaknqOWTKMURoMrLsyl0/IglgmQ=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:11.369706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e18247af-cd7a-49bf-9aa0-5b353f92f93d tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:17:11.377171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e18247af-cd7a-49bf-9aa0-5b353f92f93d tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for user 3066b652821f47f6909892c9b04f4236 and project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:17:11.416508 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e18247af-cd7a-49bf-9aa0-5b353f92f93d tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.079520 Oct 01 21:17:11.417154 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1412/4808] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:17:11 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:12.277767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:12.280283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:12.290247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:12.291182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:12.291990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:12.292951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:12.293546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:12.294360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:12.557676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:12.572123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:12.573590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:12.574753 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3a50080-56e2-4ce4-a9e1-9e8c1addc65f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1358 microversion: 2.21 time: 0.301290 Oct 01 21:17:12.592089 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3397/4809] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:12 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:13.544555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1444278226", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "1678675b-420c-43af-8134-76c9be6a30fb"}], "key_name": "tempest-TestNetworkBasicOps-1617092607", "security_groups": [{"name": "tempest-secgroup-smoke-580071928"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:13.611527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:13.612890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:13.619756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:13.620742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:13.622856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:13.623447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:13.623993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:13.625126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:13.626420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:13.626882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:13.632957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:13.796191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:13.805996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:13.807951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:13.809391 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7726593d-3824-4677-bc8c-a5b3017f81f8 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1358 microversion: 2.21 time: 0.209056 Oct 01 21:17:13.810707 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3398/4810] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:13 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:17:14.013359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] validate_networks() for [('1678675b-420c-43af-8134-76c9be6a30fb', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:17:14.532923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:14.837385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:14.838765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:14.846887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:14.847728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:14.848406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:14.849564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:14.850255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:14.850940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:14.925140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:17:14.926060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:17:14.927589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:17:14.928285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:17:14.928872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:17:14.942258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:14.943224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:14.946319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:14.947230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:14.947744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:14.948283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:14.971620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:17:14.977857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for user 3066b652821f47f6909892c9b04f4236 and project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:17:14.995308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:17:14.998056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:17:15.068751 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-84858ac9-c474-4044-a9ad-eb7508cc4106 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.531105 Oct 01 21:17:15.070020 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1413/4811] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:17:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:17:15.086924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:15.098848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:15.100226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:15.101364 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-385650fe-e723-48c7-9ced-e18885285825 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1358 microversion: 2.21 time: 0.268093 Oct 01 21:17:15.102233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7a458fe6-8c46-4e5f-84fb-2b456c0610e2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:15.103597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7a458fe6-8c46-4e5f-84fb-2b456c0610e2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:15.109497 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3399/4812] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:14 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:17:15.222901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7a458fe6-8c46-4e5f-84fb-2b456c0610e2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:15.231475 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7a458fe6-8c46-4e5f-84fb-2b456c0610e2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1249 microversion: 2.1 time: 0.152580 Oct 01 21:17:15.232622 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1414/4813] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:15 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1249 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:16.133392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:16.134688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:16.142406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:16.143281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:16.143923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:16.145520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:16.146173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:16.147504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:16.260266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:16.262734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:16.275875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:16.277102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:16.278223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:16.279503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:16.280128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:16.282025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:16.349486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:16.368883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:16.370645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:16.371990 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1e1ce2e-8ff1-4331-a247-c9cec2bbf117 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1358 microversion: 2.21 time: 0.242616 Oct 01 21:17:16.373191 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3400/4814] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:16 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:16.430558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:16.442635 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2dba5665-891f-4951-8aea-b2e9147ae8a9 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1309 microversion: 2.1 time: 0.189682 Oct 01 21:17:16.447465 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1415/4815] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:16 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1309 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:16.529504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b2586ff9-06c6-47e0-9235-a010eee27275 req-984a7e0f-1876-471a-a9b0-4697a26378ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e81d33-7aea-4717-8ff9-04f0be55932c", "name": "network-vif-plugged", "status": "completed", "tag": "965359f5-d472-49c9-b524-61960faa69fe"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:16.543229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b2586ff9-06c6-47e0-9235-a010eee27275 req-984a7e0f-1876-471a-a9b0-4697a26378ab service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:16.543997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b2586ff9-06c6-47e0-9235-a010eee27275 req-984a7e0f-1876-471a-a9b0-4697a26378ab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:16.545362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b2586ff9-06c6-47e0-9235-a010eee27275 req-984a7e0f-1876-471a-a9b0-4697a26378ab service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:16.560059 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b2586ff9-06c6-47e0-9235-a010eee27275 req-984a7e0f-1876-471a-a9b0-4697a26378ab service nova] Creating event network-vif-plugged:965359f5-d472-49c9-b524-61960faa69fe for instance d6e81d33-7aea-4717-8ff9-04f0be55932c on nch2-master-1 Oct 01 21:17:16.568479 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b2586ff9-06c6-47e0-9235-a010eee27275 req-984a7e0f-1876-471a-a9b0-4697a26378ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051934 Oct 01 21:17:16.571278 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3401/4816] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:17.400372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:17.401313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:17.409629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:17.410281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:17.410891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:17.411803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:17.412481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:17.413171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:17.471449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:17.472512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:17.480347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:17.481009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:17.481560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:17.482582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:17.483277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:17.483917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:17.576076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:17.586865 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b184a58d-f83f-4ce6-88ae-aaa68799ff2b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1307 microversion: 2.1 time: 0.120673 Oct 01 21:17:17.587470 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3402/4817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:17 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1307 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:17.803023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:17.826480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:17.828991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:17.830526 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-040b9bb5-bcdb-4de6-bf7b-1d512af1b7c7 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1358 microversion: 2.21 time: 0.434690 Oct 01 21:17:17.831191 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1416/4818] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:17 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1358 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:18.610399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:18.611272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:18.619095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:18.619896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:18.620402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:18.621396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:18.621924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:18.622688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:18.810665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:18.819560 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c6bc0378-580f-45e2-8286-f1360d67e823 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1374 microversion: 2.1 time: 0.213940 Oct 01 21:17:18.820146 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3403/4819] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:18 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:18.857424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:18.858095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:18.866078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:18.866700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:18.867228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:18.868057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:18.868603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:18.869170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:19.230662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:19.250788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:19.252855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:19.254465 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9797cd26-bb02-493f-b5f1-e5de22508518 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1552 microversion: 2.21 time: 0.401104 Oct 01 21:17:19.255728 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1417/4820] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:18 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1552 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:19.280632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:19.281940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:19.288933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:19.289649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:19.290296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:19.291251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:19.291804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:19.292311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:19.336945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:17:19.460792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9b7a108-f3ae-4c40-8f9e-74d4484feca0 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 204 len: 0 microversion: 2.21 time: 0.184121 Oct 01 21:17:19.462156 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3404/4821] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:17:19 2022] DELETE /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:17:19.471592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-816c0cc0-2dd3-4b56-8a96-595c7f54eda1 req-944c4080-ae7e-4eb3-a692-14f124a77851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a887c41-a630-4ca9-b0a9-a43ab6c503fe", "tag": "c256152f-3e5f-4054-8cf4-fe493178248a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:19.488206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:19.490152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:19.493360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-816c0cc0-2dd3-4b56-8a96-595c7f54eda1 req-944c4080-ae7e-4eb3-a692-14f124a77851 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:19.494038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-816c0cc0-2dd3-4b56-8a96-595c7f54eda1 req-944c4080-ae7e-4eb3-a692-14f124a77851 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:19.495487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-816c0cc0-2dd3-4b56-8a96-595c7f54eda1 req-944c4080-ae7e-4eb3-a692-14f124a77851 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:19.504318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:19.505060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:19.505673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:19.510184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:19.510964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:19.512558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:19.524831 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-816c0cc0-2dd3-4b56-8a96-595c7f54eda1 req-944c4080-ae7e-4eb3-a692-14f124a77851 service nova] Creating event network-changed:c256152f-3e5f-4054-8cf4-fe493178248a for instance 2a887c41-a630-4ca9-b0a9-a43ab6c503fe on nch2-master-1 Oct 01 21:17:19.544305 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-816c0cc0-2dd3-4b56-8a96-595c7f54eda1 req-944c4080-ae7e-4eb3-a692-14f124a77851 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077704 Oct 01 21:17:19.545234 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1418/4822] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:19.843481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:19.844482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:19.852155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:19.852659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:19.853665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:19.854754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:19.855371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:19.856559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:19.888159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:19.920421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:19.922241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:19.927289 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37a69526-86e3-438c-b212-1777d1e971bd tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1558 microversion: 2.21 time: 0.451380 Oct 01 21:17:19.927816 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3405/4823] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:19 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1558 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:20.183018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:20.198653 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e6fa6a4c-ec09-4b6d-a558-d322aba32879 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1374 microversion: 2.1 time: 0.358581 Oct 01 21:17:20.211326 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1419/4824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:19 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1374 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:20.953371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:20.954579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:20.961907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:20.962421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:20.963122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:20.963872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:20.964342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:20.964781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:21.226848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:21.227769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:21.236284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:21.236880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:21.237578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:21.238420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:21.238980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:21.239467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:21.523123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:21.532965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:21.534675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:21.536020 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e0b555c0-9879-410c-8bce-54203e76989a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1558 microversion: 2.21 time: 0.586676 Oct 01 21:17:21.536816 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3406/4825] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:20 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1558 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:21.620419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:21.634596 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e13781eb-5b39-4bb3-9832-06059214b18c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1374 microversion: 2.1 time: 0.415323 Oct 01 21:17:21.636652 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1420/4826] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:21 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1374 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:21.765220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77df82a3-4ab7-4a25-86b7-8cc46f766de3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:21.768455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-77df82a3-4ab7-4a25-86b7-8cc46f766de3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:21.774902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77df82a3-4ab7-4a25-86b7-8cc46f766de3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:21.775402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77df82a3-4ab7-4a25-86b7-8cc46f766de3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:21.775845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77df82a3-4ab7-4a25-86b7-8cc46f766de3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:21.776595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77df82a3-4ab7-4a25-86b7-8cc46f766de3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:21.777089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77df82a3-4ab7-4a25-86b7-8cc46f766de3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:21.777524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77df82a3-4ab7-4a25-86b7-8cc46f766de3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:21.846968 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77df82a3-4ab7-4a25-86b7-8cc46f766de3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action" status: 200 len: 24575 microversion: 2.1 time: 0.085839 Oct 01 21:17:21.848087 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3407/4827] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:17:21 2022] POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action => generated 24575 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:17:22.217574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-8c44ce90-3ce4-4e71-a1d2-2cc00d565f51 req-da4add60-c894-44b0-8edc-3895e7424578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e81d33-7aea-4717-8ff9-04f0be55932c", "name": "network-vif-deleted", "tag": "965359f5-d472-49c9-b524-61960faa69fe"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:22.244265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8c44ce90-3ce4-4e71-a1d2-2cc00d565f51 req-da4add60-c894-44b0-8edc-3895e7424578 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:22.245566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8c44ce90-3ce4-4e71-a1d2-2cc00d565f51 req-da4add60-c894-44b0-8edc-3895e7424578 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:22.246604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8c44ce90-3ce4-4e71-a1d2-2cc00d565f51 req-da4add60-c894-44b0-8edc-3895e7424578 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:22.264245 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-8c44ce90-3ce4-4e71-a1d2-2cc00d565f51 req-da4add60-c894-44b0-8edc-3895e7424578 service nova] Creating event network-vif-deleted:965359f5-d472-49c9-b524-61960faa69fe for instance d6e81d33-7aea-4717-8ff9-04f0be55932c on nch2-master-1 Oct 01 21:17:22.269598 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-8c44ce90-3ce4-4e71-a1d2-2cc00d565f51 req-da4add60-c894-44b0-8edc-3895e7424578 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067132 Oct 01 21:17:22.270568 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1421/4828] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:22.564935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:22.565660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:22.573414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:22.574351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:22.575001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:22.575874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:22.576494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:22.577085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:22.658210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:22.658721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:22.658943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:22.672486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:22.673112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:22.673284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:22.673713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:22.674439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:22.674984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:22.675413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:22.676106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f6bf6dd22549699fd1398ec8c3e8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c1094d71344db7a70dc610b22bcc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:22.677790 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c534e3e-acd9-4809-b2e3-644b6dc46bba tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 200 len: 1343 microversion: 2.21 time: 0.117418 Oct 01 21:17:22.679046 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3408/4829] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:22 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 1343 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:17:22.913842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:22.924580 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-51d7cf7a-4806-474f-8a15-939a53f5fd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1374 microversion: 2.1 time: 0.271004 Oct 01 21:17:22.928482 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1422/4830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:22 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1374 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:23.707860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:23.709261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:23.717103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.717597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.718042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:23.718865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.719581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.720028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:23.734701 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] HTTP exception thrown: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Request method failure captured: Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c HTTP/1.1 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK5NTvX5TACIyDBjUb9c8k__xQ1THT1Bu1cTxe7nfdfaSD84oaky9KBmX79JL5suIYEvXXBxPAdGwrw_q7k1YXpD78x9wURQYWm_t9K0sabNVMcucDuLQ2hW10WHme_jqXL1ExqF44seITk97PzvOk6Es-YlhiD0QvY_ZZ3Myz4h4lU Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.21 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a4c1094d71344db7a70dc610b22bcc08 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1229797646 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a4c1094d71344db7a70dc610b22bcc08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c1094d71344db7a70dc610b22bcc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a4c1094d71344db7a70dc610b22bcc08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c1094d71344db7a70dc610b22bcc08"}]}] Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-InstanceActionsV221TestJSON-1229797646 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a4c1094d71344db7a70dc610b22bcc08 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1229797646 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-InstanceActionsV221TestJSON-1229797646-project Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 52f6bf6dd22549699fd1398ec8c3e8e6 Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-InstanceActionsV221TestJSON-1229797646-project Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd6e81d33-7aea-4717-8ff9-04f0be55932c'} Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.736677 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Returning 404 to user: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:17:23.741723 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-18e67dae-a0f4-4779-8878-26aea78c493f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 404 len: 111 microversion: 2.21 time: 0.034930 Oct 01 21:17:23.746917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3335ce9e-b1b0-42f2-b396-7c5dad75bd5f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '.version_select at 0x7f41737a0e50>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:23.748010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3335ce9e-b1b0-42f2-b396-7c5dad75bd5f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:23.753241 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3409/4831] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:23 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:17:23.755028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3335ce9e-b1b0-42f2-b396-7c5dad75bd5f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.755523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3335ce9e-b1b0-42f2-b396-7c5dad75bd5f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.755967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3335ce9e-b1b0-42f2-b396-7c5dad75bd5f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:23.756683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3335ce9e-b1b0-42f2-b396-7c5dad75bd5f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.757144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3335ce9e-b1b0-42f2-b396-7c5dad75bd5f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.757571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3335ce9e-b1b0-42f2-b396-7c5dad75bd5f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:23.841734 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3335ce9e-b1b0-42f2-b396-7c5dad75bd5f tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.098532 Oct 01 21:17:23.843147 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1423/4832] 10.222.0.17 () {60 vars in 1337 bytes} [Sat Oct 1 21:17:23 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c/os-instance-actions => generated 611 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:17:23.857533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:23.858102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:23.865529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.866038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.866526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:23.867240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.867714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.868154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:23.883620 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] HTTP exception thrown: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Request method failure captured: Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c HTTP/1.1 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK5NTvX5TACIyDBjUb9c8k__xQ1THT1Bu1cTxe7nfdfaSD84oaky9KBmX79JL5suIYEvXXBxPAdGwrw_q7k1YXpD78x9wURQYWm_t9K0sabNVMcucDuLQ2hW10WHme_jqXL1ExqF44seITk97PzvOk6Es-YlhiD0QvY_ZZ3Myz4h4lU Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.21 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a4c1094d71344db7a70dc610b22bcc08 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1229797646 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a4c1094d71344db7a70dc610b22bcc08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c1094d71344db7a70dc610b22bcc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a4c1094d71344db7a70dc610b22bcc08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c1094d71344db7a70dc610b22bcc08"}]}] Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-InstanceActionsV221TestJSON-1229797646 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a4c1094d71344db7a70dc610b22bcc08 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1229797646 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-InstanceActionsV221TestJSON-1229797646-project Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 52f6bf6dd22549699fd1398ec8c3e8e6 Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-InstanceActionsV221TestJSON-1229797646-project Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'd6e81d33-7aea-4717-8ff9-04f0be55932c'} Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:17:23.885608 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.890226 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.891702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Returning 404 to user: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:17:23.892735 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d74633e3-40a0-411a-a356-713abf15f760 tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 404 len: 111 microversion: 2.21 time: 0.039328 Oct 01 21:17:23.896685 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3410/4833] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:17:23 2022] DELETE /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:17:23.901993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:23.902659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] [instance: d6e81d33-7aea-4717-8ff9-04f0be55932c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:23.908880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.909388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.909832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:23.910587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.911048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.911499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:23.932233 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] HTTP exception thrown: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Request method failure captured: Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c HTTP/1.1 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK5NTvX5TACIyDBjUb9c8k__xQ1THT1Bu1cTxe7nfdfaSD84oaky9KBmX79JL5suIYEvXXBxPAdGwrw_q7k1YXpD78x9wURQYWm_t9K0sabNVMcucDuLQ2hW10WHme_jqXL1ExqF44seITk97PzvOk6Es-YlhiD0QvY_ZZ3Myz4h4lU Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Openstack-Nova-Api-Version: 2.21 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: a4c1094d71344db7a70dc610b22bcc08 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1229797646 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a4c1094d71344db7a70dc610b22bcc08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c1094d71344db7a70dc610b22bcc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a4c1094d71344db7a70dc610b22bcc08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c1094d71344db7a70dc610b22bcc08"}]}] Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-InstanceActionsV221TestJSON-1229797646 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: a4c1094d71344db7a70dc610b22bcc08 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1229797646 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-InstanceActionsV221TestJSON-1229797646-project Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 52f6bf6dd22549699fd1398ec8c3e8e6 Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-InstanceActionsV221TestJSON-1229797646-project Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'd6e81d33-7aea-4717-8ff9-04f0be55932c'} Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.939143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:17:23.943958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.943958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:17:23.943958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:17:23.943958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:17:23.943958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:17:23.943958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:17:23.943958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. Oct 01 21:17:23.943958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:17:23.944546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] Returning 404 to user: Instance d6e81d33-7aea-4717-8ff9-04f0be55932c could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:17:23.945648 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a48d0c70-8f82-496d-8c16-b9fc78fd295a tempest-InstanceActionsV221TestJSON-1229797646 tempest-InstanceActionsV221TestJSON-1229797646-project] 10.222.0.17 "GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c" status: 404 len: 111 microversion: 2.21 time: 0.047777 Oct 01 21:17:23.946549 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1424/4834] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:17:23 2022] GET /compute/v2.1/servers/d6e81d33-7aea-4717-8ff9-04f0be55932c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:17:23.949817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:23.951954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:23.963643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.964201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.964658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:23.965384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:23.966518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:23.966966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:24.378948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:24.388585 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ad11b98-6961-45c0-98ed-b26d21f382f0 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1374 microversion: 2.1 time: 0.443755 Oct 01 21:17:24.389223 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3411/4835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:23 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1374 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:25.418011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:25.418859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:25.435824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:25.436869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=14 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:25.439833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:25.440617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:25.441852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:25.443514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:25.444434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:25.445576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:26.201418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:26.212443 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ef4ec75c-f168-488d-937f-370beded383b tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1374 microversion: 2.1 time: 0.799274 Oct 01 21:17:26.229498 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1425/4836] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:25 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1374 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:26.556047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6de7d96c-fceb-410f-96d4-8d9cde1b424e req-fbf3658a-42ce-4599-b310-f30123653e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a887c41-a630-4ca9-b0a9-a43ab6c503fe", "name": "network-vif-plugged", "status": "completed", "tag": "c256152f-3e5f-4054-8cf4-fe493178248a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:26.571812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6de7d96c-fceb-410f-96d4-8d9cde1b424e req-fbf3658a-42ce-4599-b310-f30123653e3e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:26.572457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6de7d96c-fceb-410f-96d4-8d9cde1b424e req-fbf3658a-42ce-4599-b310-f30123653e3e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:26.574225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6de7d96c-fceb-410f-96d4-8d9cde1b424e req-fbf3658a-42ce-4599-b310-f30123653e3e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:26.594691 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6de7d96c-fceb-410f-96d4-8d9cde1b424e req-fbf3658a-42ce-4599-b310-f30123653e3e service nova] Creating event network-vif-plugged:c256152f-3e5f-4054-8cf4-fe493178248a for instance 2a887c41-a630-4ca9-b0a9-a43ab6c503fe on nch2-master-1 Oct 01 21:17:26.602009 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6de7d96c-fceb-410f-96d4-8d9cde1b424e req-fbf3658a-42ce-4599-b310-f30123653e3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050004 Oct 01 21:17:26.603771 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3412/4837] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:27.239298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:27.239936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:27.254758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:27.255694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:27.256300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:27.260209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:27.260901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:27.261508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:27.642690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:27.657353 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-25e2e8dc-0bb8-4c7d-a7a0-1ecf9a27f40c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1374 microversion: 2.1 time: 0.421609 Oct 01 21:17:27.658573 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1426/4838] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:27 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1374 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:28.683728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:28.684775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:28.700610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:28.703983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:28.705908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:28.707115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:28.722730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:28.724304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:29.049107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:29.058041 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0c7d7bd8-8380-479a-bef1-c3aadb1000bd tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1546 microversion: 2.1 time: 0.379986 Oct 01 21:17:29.059444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3413/4839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:28 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1546 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:29.082646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:29.085636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:29.095505 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:29.096145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:29.096691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:29.097639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:29.098253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:29.098833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:29.259448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:29.267861 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d0c31874-522b-4898-a5de-dcba21d24091 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1546 microversion: 2.1 time: 0.190240 Oct 01 21:17:29.268431 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1427/4840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:29 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:32.930151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7cbf4deb-cf95-4d5c-96cf-c360cc3f2114 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:32.930805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7cbf4deb-cf95-4d5c-96cf-c360cc3f2114 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:32.946077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbf4deb-cf95-4d5c-96cf-c360cc3f2114 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:32.946571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbf4deb-cf95-4d5c-96cf-c360cc3f2114 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:32.947024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbf4deb-cf95-4d5c-96cf-c360cc3f2114 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:32.947752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbf4deb-cf95-4d5c-96cf-c360cc3f2114 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:32.948207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbf4deb-cf95-4d5c-96cf-c360cc3f2114 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:32.949024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbf4deb-cf95-4d5c-96cf-c360cc3f2114 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:33.459111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7cbf4deb-cf95-4d5c-96cf-c360cc3f2114 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1834 microversion: 2.1 time: 0.532546 Oct 01 21:17:33.460054 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3414/4841] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:32 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1834 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:33.494370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:33.495645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:33.503431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:33.504369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:33.505046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:33.506043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:33.506746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:33.507409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:33.992553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:34.016342 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c8123d8c-9123-4ab3-be64-58be9d12cfc9 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1683 microversion: 2.1 time: 0.533004 Oct 01 21:17:34.017733 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1428/4842] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:33 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1683 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:34.132622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d37fbe5a-15a2-4b3f-9240-a3e51b2942fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:34.135362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d37fbe5a-15a2-4b3f-9240-a3e51b2942fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:34.147730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d37fbe5a-15a2-4b3f-9240-a3e51b2942fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:34.149248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d37fbe5a-15a2-4b3f-9240-a3e51b2942fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:34.149868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d37fbe5a-15a2-4b3f-9240-a3e51b2942fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:34.151541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d37fbe5a-15a2-4b3f-9240-a3e51b2942fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:34.153308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d37fbe5a-15a2-4b3f-9240-a3e51b2942fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:34.154178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d37fbe5a-15a2-4b3f-9240-a3e51b2942fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:34.239510 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d37fbe5a-15a2-4b3f-9240-a3e51b2942fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action" status: 200 len: 32640 microversion: 2.1 time: 0.110456 Oct 01 21:17:34.244009 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3415/4843] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:17:34 2022] POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action => generated 32640 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 21:17:34.388954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:34.389805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:34.406775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:34.407570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:34.408010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:34.408713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:34.409349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:34.409946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:34.474994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '39e3f059dc9c4fd78a6799b5b209d710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5bb9a57014d588d6a62e872f0ec3c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:34.475602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] flavor_id is None. Assuming migration. {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 01 21:17:34.476056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:17:34.661691 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aee9094d-f145-441c-a9ff-8276fae546ce tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action" status: 202 len: 0 microversion: 2.1 time: 0.276244 Oct 01 21:17:34.663384 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1429/4844] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:17:34 2022] POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:17:34.672187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:34.672907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:34.694373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:34.695371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:34.697535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:34.698926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:34.702075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:34.704541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:34.741272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:34.914481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:34.928246 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fb32f435-3d97-4a48-b444-bfd9a59b3163 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1692 microversion: 2.1 time: 0.260505 Oct 01 21:17:34.930444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3416/4845] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:34 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1692 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:35.956011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:35.957437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:35.970579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:35.971263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:35.971915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:35.972808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:35.973432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:35.974027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:36.328648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:36.360963 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ca9fc2f6-75db-41e5-8ba7-8514b24feb42 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1692 microversion: 2.1 time: 0.409620 Oct 01 21:17:36.362919 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1430/4846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:35 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1692 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:37.388396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:37.389782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:37.404824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:37.405879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:37.406539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:37.408431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:37.411123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:37.411964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:38.342525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:38.356816 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48f6370a-4549-4296-aeb8-65a11ce3f8f6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1692 microversion: 2.1 time: 0.972102 Oct 01 21:17:38.358320 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3417/4847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:37 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1692 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:39.382692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:39.384055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:39.404253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:39.405084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:39.405750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:39.406849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:39.407487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:39.408087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:39.444562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:39.735383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:39.747467 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aa150e50-b6cd-491f-b1c5-983a2f21d19a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1697 microversion: 2.1 time: 0.365979 Oct 01 21:17:39.748176 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1431/4848] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:39 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1697 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:40.778563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:40.780831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:40.785404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:40.795701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:40.797431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:40.797934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:40.799888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:40.801887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:40.802940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:41.536938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:41.548468 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-887d7fd8-62f0-47e5-a4ed-1245a3886033 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1697 microversion: 2.1 time: 0.775710 Oct 01 21:17:41.550959 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3418/4849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:40 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1697 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:41.800891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0f70b763-4fab-4ee8-acc6-44cd72b0c204 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'create', calling method: .version_select at 0x7f4172506280>, body: {"keypair": {"name": "tempest-keypair-1417987251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkKmUCR4xtLL6cgX1TwOedDQYUIAE+MGfjeSAqFofQrSjazvrtMagH6ZXFm0RLRThiTGd+39Cj32g7Q4/Oa4yO2Ta162Gl3v0IgASyyVY3/CHQn8LT2xJt2+GPJajO4zw=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:41.817684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-0f70b763-4fab-4ee8-acc6-44cd72b0c204 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:17:41.823635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-0f70b763-4fab-4ee8-acc6-44cd72b0c204 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for user 6ac020dc323042c48ccce2a8826bc6be and project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:17:41.847876 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0f70b763-4fab-4ee8-acc6-44cd72b0c204 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.186714 Oct 01 21:17:41.848661 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1432/4850] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:17:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:17:42.576524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:42.579081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:42.598622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:42.600305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:42.600800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:42.601747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:42.602389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:42.603470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:42.836859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:42.853266 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29868c9c-3c13-421d-abbc-46f3c254e301 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1697 microversion: 2.1 time: 0.281119 Oct 01 21:17:42.853977 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3419/4851] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:42 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1697 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:43.880587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:43.880587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:43.885925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-87385616", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "494a382d-1e31-4806-a5de-71784de0fc03"}], "security_groups": [{"name": "tempest-securitygroup--971547384"}], "key_name": "tempest-keypair-1417987251", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:43.901253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:43.902233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:43.902711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:43.903524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:43.903995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:43.904424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:44.020517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] validate_networks() for [('494a382d-1e31-4806-a5de-71784de0fc03', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:17:44.248046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:44.257193 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-36695a3b-3f82-4b6a-90ad-d07fa85c9bac tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1697 microversion: 2.1 time: 0.383823 Oct 01 21:17:44.271251 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1433/4852] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:43 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1697 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:44.533773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:17:44.534733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:17:44.535448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:17:44.537612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:17:44.538380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:17:44.552912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:44.553593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:44.554332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:44.555340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:44.556229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:44.556673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:44.579874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:17:44.586030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for user 6ac020dc323042c48ccce2a8826bc6be and project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:17:44.600439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:17:44.605016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:17:44.670109 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68ed73de-47a2-4b23-ad45-d1c4249042f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.788381 Oct 01 21:17:44.677068 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3420/4853] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:17:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:17:44.682623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e824c3ff-824f-4c32-a028-c9beaced2fbd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:44.683460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e824c3ff-824f-4c32-a028-c9beaced2fbd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:44.701006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:44.863627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e824c3ff-824f-4c32-a028-c9beaced2fbd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:44.877110 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e824c3ff-824f-4c32-a028-c9beaced2fbd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1237 microversion: 2.1 time: 0.198444 Oct 01 21:17:44.880884 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1434/4854] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:44 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1237 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:45.284709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:45.285946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:45.302310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:45.303980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:45.304546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:45.310987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:45.311374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:45.312140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:45.819510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:45.827859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec7401cc-7e65-4e6b-8399-fa3abc3373ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1697 microversion: 2.1 time: 0.549429 Oct 01 21:17:45.828451 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3421/4855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:45 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1697 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:45.905874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:45.906758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:45.915206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:45.915976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:45.916426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:45.917156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:45.917621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:45.918053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:46.253955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:46.267923 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-60fc0805-c2e8-4363-8557-6f9e27298d0c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1289 microversion: 2.1 time: 0.368465 Oct 01 21:17:46.270686 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1435/4856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:45 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1289 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:46.867403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:46.869008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:46.889604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:46.890118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:46.890593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:46.891316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:46.891780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:46.892217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:47.199880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:47.216564 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8db5fdb8-835d-4d2b-8ce3-917d0b16576b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1697 microversion: 2.1 time: 0.363277 Oct 01 21:17:47.218540 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3422/4857] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:46 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1697 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:47.295017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:47.297233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:47.313428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:47.314345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:47.315056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:47.316004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:47.316703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:47.317820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:47.558396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:47.577033 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cc5312a1-82e5-4887-bc38-359bb13d9817 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1362 microversion: 2.1 time: 0.286777 Oct 01 21:17:47.578103 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1436/4858] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:47 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:48.128224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-abee8905-4157-467e-b24c-a88bd2f80506 req-a67655c1-01ec-4162-b279-9b770941be12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:48.153710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-abee8905-4157-467e-b24c-a88bd2f80506 req-a67655c1-01ec-4162-b279-9b770941be12 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:48.155827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-abee8905-4157-467e-b24c-a88bd2f80506 req-a67655c1-01ec-4162-b279-9b770941be12 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:48.156220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-abee8905-4157-467e-b24c-a88bd2f80506 req-a67655c1-01ec-4162-b279-9b770941be12 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:48.170652 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-abee8905-4157-467e-b24c-a88bd2f80506 req-a67655c1-01ec-4162-b279-9b770941be12 service nova] Creating event network-changed:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:17:48.176714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-abee8905-4157-467e-b24c-a88bd2f80506 req-a67655c1-01ec-4162-b279-9b770941be12 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052851 Oct 01 21:17:48.177704 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3423/4859] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:17:48.242702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:48.243342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:48.251362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:48.252612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:48.253250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:48.254152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:48.254653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:48.255087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:48.491589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:48.507329 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a32fb16e-15ee-4d95-aee9-c77fb9c6a6fd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1697 microversion: 2.1 time: 0.269732 Oct 01 21:17:48.509571 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1437/4860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:48 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1697 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:48.602831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:48.603950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:48.617283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:48.618635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:48.619482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:48.620753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:48.621478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:48.622775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:48.813511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:48.821976 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6d48d5e8-3896-441b-a190-b0f5aa549292 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1362 microversion: 2.1 time: 0.223993 Oct 01 21:17:48.837716 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3424/4861] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:48 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:49.536774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:49.537411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:49.547787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:49.548671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:49.549297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:49.551213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:49.551859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:49.552587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:49.831958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:49.845732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:49.846385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:49.852802 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-79ff9e32-9261-4213-b58b-65dbefdc83fe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1697 microversion: 2.1 time: 0.320193 Oct 01 21:17:49.853451 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1438/4862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:49 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1697 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:49.858108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:49.859427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:49.860055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:49.860925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:49.861396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:49.861835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:50.079644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:50.094057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-baa452d1-a1e4-4e47-b6cc-bf4998617015 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1362 microversion: 2.1 time: 0.252837 Oct 01 21:17:50.095394 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3425/4863] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:49 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:50.878105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:50.878850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:50.891628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:50.892139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:50.892643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:50.893302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:50.893769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:50.894204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:51.118214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:51.118921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:51.131736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:51.132856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:51.133321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:51.134065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:51.134568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:51.135006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:51.493725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:51.509906 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0c2a80da-3c62-401d-b1ab-980f6ca1900d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1697 microversion: 2.1 time: 0.636183 Oct 01 21:17:51.513542 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1439/4864] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:50 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1697 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:51.532267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:51.552241 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a61d8c24-7868-4a9b-9a01-021409653629 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1362 microversion: 2.1 time: 0.438604 Oct 01 21:17:51.557275 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3426/4865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:51 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:52.537362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:52.537995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:52.549038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:52.549577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:52.550033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:52.550811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:52.551311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:52.551773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:52.584646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:52.586363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:52.615436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:52.618684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:52.625143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:52.631583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:52.634752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:52.635555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:52.920178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:52.931087 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-48ef5974-7f7f-420a-9641-268b57996111 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1696 microversion: 2.1 time: 0.397547 Oct 01 21:17:52.944039 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1440/4866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:52 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1696 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:52.948980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-fa94fe56-ebd1-498f-b969-db4c0615fdc6 req-d70fa15d-b496-4821-8a90-cfa211780447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "name": "network-vif-unplugged", "status": "completed", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:52.970668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fa94fe56-ebd1-498f-b969-db4c0615fdc6 req-d70fa15d-b496-4821-8a90-cfa211780447 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:52.971480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fa94fe56-ebd1-498f-b969-db4c0615fdc6 req-d70fa15d-b496-4821-8a90-cfa211780447 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:52.972113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fa94fe56-ebd1-498f-b969-db4c0615fdc6 req-d70fa15d-b496-4821-8a90-cfa211780447 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:53.008557 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-fa94fe56-ebd1-498f-b969-db4c0615fdc6 req-d70fa15d-b496-4821-8a90-cfa211780447 service nova] Creating event network-vif-unplugged:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch2-master-1 Oct 01 21:17:53.016680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-fa94fe56-ebd1-498f-b969-db4c0615fdc6 req-d70fa15d-b496-4821-8a90-cfa211780447 service nova] Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:17:53.035255 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-fa94fe56-ebd1-498f-b969-db4c0615fdc6 req-d70fa15d-b496-4821-8a90-cfa211780447 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089267 Oct 01 21:17:53.041747 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1441/4867] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:53.191988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:53.223789 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-efbf3655-2b61-48d5-bb6f-5139eb907b76 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1362 microversion: 2.1 time: 0.643735 Oct 01 21:17:53.226262 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3427/4868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:52 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:53.973063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:54.004098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:54.031538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:54.032336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:54.032944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:54.034215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:54.035352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:54.036093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:54.249430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:54.250799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:54.259337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:54.260145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:54.260807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:54.262056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:54.263104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:54.263859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:54.476554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:54.505147 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef9529cf-ee79-4f59-9cc5-f27187db3a66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1362 microversion: 2.1 time: 0.256664 Oct 01 21:17:54.508344 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3428/4869] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:54 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:54.675317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:54.676194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:54.678203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:54.680123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d8925c61-d6a5-4ea9-8214-69f8d101bde0 req-d1f7a465-71e7-465b-9fee-d815e371c383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "name": "network-vif-plugged", "status": "completed", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:54.699350 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-09639523-bfee-4834-a4cc-2e077e5f35c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1696 microversion: 2.1 time: 0.731728 Oct 01 21:17:54.719767 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1442/4870] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:53 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1696 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:54.721131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8925c61-d6a5-4ea9-8214-69f8d101bde0 req-d1f7a465-71e7-465b-9fee-d815e371c383 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:54.721910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8925c61-d6a5-4ea9-8214-69f8d101bde0 req-d1f7a465-71e7-465b-9fee-d815e371c383 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:54.722554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8925c61-d6a5-4ea9-8214-69f8d101bde0 req-d1f7a465-71e7-465b-9fee-d815e371c383 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:54.771897 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d8925c61-d6a5-4ea9-8214-69f8d101bde0 req-d1f7a465-71e7-465b-9fee-d815e371c383 service nova] Creating event network-vif-plugged:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:17:54.789437 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d8925c61-d6a5-4ea9-8214-69f8d101bde0 req-d1f7a465-71e7-465b-9fee-d815e371c383 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109903 Oct 01 21:17:54.790423 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3429/4871] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:55.144350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-181cd6bb-82e9-40b1-a547-b4970dd07187 req-5c918d1f-cd5a-4312-b1bf-886df5b86a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:55.157877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:55.173352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-181cd6bb-82e9-40b1-a547-b4970dd07187 req-5c918d1f-cd5a-4312-b1bf-886df5b86a10 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:55.174021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-181cd6bb-82e9-40b1-a547-b4970dd07187 req-5c918d1f-cd5a-4312-b1bf-886df5b86a10 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:55.174688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-181cd6bb-82e9-40b1-a547-b4970dd07187 req-5c918d1f-cd5a-4312-b1bf-886df5b86a10 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:55.219030 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-181cd6bb-82e9-40b1-a547-b4970dd07187 req-5c918d1f-cd5a-4312-b1bf-886df5b86a10 service nova] Creating event network-changed:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch2-master-1 Oct 01 21:17:55.227907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-181cd6bb-82e9-40b1-a547-b4970dd07187 req-5c918d1f-cd5a-4312-b1bf-886df5b86a10 service nova] Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:17:55.243267 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-181cd6bb-82e9-40b1-a547-b4970dd07187 req-5c918d1f-cd5a-4312-b1bf-886df5b86a10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102439 Oct 01 21:17:55.244527 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1443/4872] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:55.529135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:55.530677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:55.538239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:55.539462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:55.540097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:55.541184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:55.541821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:55.542412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:55.724939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:55.725810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:55.737471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:55.738338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:55.740617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:55.741597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:55.742931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:55.745456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:56.299810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:56.311926 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d084110d-aa53-42a9-8da5-a7e8382b18e4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1694 microversion: 2.1 time: 0.590684 Oct 01 21:17:56.317840 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1444/4873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:55 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1694 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:57.013134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:57.060779 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87051864-5ee4-4bcc-8b32-b7fed5b6dcd0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1362 microversion: 2.1 time: 1.536311 Oct 01 21:17:57.070248 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3430/4874] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:55 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1362 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:57.342620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:57.343862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:57.357479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:57.358542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:57.377371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:57.378932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:57.381113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:57.381915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:57.947543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:57.963498 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-941d0439-a2e0-4cc7-a7b2-8c3f461b1dc6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1691 microversion: 2.1 time: 0.625948 Oct 01 21:17:57.964102 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1445/4875] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:57 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1691 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:57.987753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-93ac01ce-f4bc-45d1-b184-40afa2927c66 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:17:57.988300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-93ac01ce-f4bc-45d1-b184-40afa2927c66 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:57.995488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93ac01ce-f4bc-45d1-b184-40afa2927c66 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:57.996179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93ac01ce-f4bc-45d1-b184-40afa2927c66 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:57.996808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93ac01ce-f4bc-45d1-b184-40afa2927c66 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:57.997701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93ac01ce-f4bc-45d1-b184-40afa2927c66 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:57.998311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93ac01ce-f4bc-45d1-b184-40afa2927c66 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:57.998987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-93ac01ce-f4bc-45d1-b184-40afa2927c66 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:58.096254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:58.097129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:58.109832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:58.110212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:58.110687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:58.111451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:58.111850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:58.112277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:58.185492 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-93ac01ce-f4bc-45d1-b184-40afa2927c66 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action" status: 202 len: 0 microversion: 2.1 time: 0.201639 Oct 01 21:17:58.188158 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3431/4876] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:17:57 2022] POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:17:58.197852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:58.199750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:58.208791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:58.210569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:58.211356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:58.212600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:58.218379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:58.219195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:58.761261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:58.772342 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b394e6c5-9dc1-4b95-8afb-69904ec07347 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1550 microversion: 2.1 time: 0.680544 Oct 01 21:17:58.779361 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1446/4877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:58 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1550 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:17:58.792793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:58.796042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:58.803083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:58.803825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:58.804458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:58.805348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:58.805975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:58.806592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:58.859083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:17:58.924110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:58.941533 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6cfaf81d-22fb-4174-8e3e-c2dad18fb6bb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 0.750630 Oct 01 21:17:58.947165 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3432/4878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:58 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:58.962117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fbaf87e8-f727-4856-aff5-c09ead7ab37b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:58.964550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fbaf87e8-f727-4856-aff5-c09ead7ab37b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:58.994791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbaf87e8-f727-4856-aff5-c09ead7ab37b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:58.995757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbaf87e8-f727-4856-aff5-c09ead7ab37b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:58.997304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbaf87e8-f727-4856-aff5-c09ead7ab37b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:59.001049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbaf87e8-f727-4856-aff5-c09ead7ab37b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:59.002463 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-334d939f-34b5-49a2-b864-2fd6ca2fb6e5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 204 len: 0 microversion: 2.1 time: 0.220638 Oct 01 21:17:59.003111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbaf87e8-f727-4856-aff5-c09ead7ab37b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:59.004148 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1447/4879] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:17:58 2022] DELETE /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:17:59.005357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbaf87e8-f727-4856-aff5-c09ead7ab37b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:59.015634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:59.017567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:59.018067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:17:59.032692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:59.035944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:59.036608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:59.038471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:59.041016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:59.041719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:59.230188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:17:59.241709 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2c5840ef-ca95-42b2-a058-50479ca165cb tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1552 microversion: 2.1 time: 0.233094 Oct 01 21:17:59.242905 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1448/4880] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:59 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:17:59.289424 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fbaf87e8-f727-4856-aff5-c09ead7ab37b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.340035 Oct 01 21:17:59.290166 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3433/4881] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:17:58 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/os-interface => generated 285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:17:59.973890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:17:59.975357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:17:59.983249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:59.984048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:59.984695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:59.985616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:17:59.986331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:17:59.986960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:17:59.997014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:00.265948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:00.266607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:00.275011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:00.275990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:00.276851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:00.277777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:00.278840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:00.281033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:00.303685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:00.323191 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-de1b4f20-4c12-4702-9451-d07831e6099f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 0.353117 Oct 01 21:18:00.328749 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1449/4882] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:17:59 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:00.980371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:00.996521 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c9429b59-a540-435d-99f4-2bda31a53d15 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1552 microversion: 2.1 time: 0.735037 Oct 01 21:18:00.998061 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3434/4883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:00 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1552 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:18:01.351423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:01.352700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:01.360563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:01.361264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:01.361905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:01.362669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:01.363136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:01.363753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:01.576172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-36edea0d-9517-45d0-8310-6225207da9f8 req-5d8c9686-fa57-424f-9df4-bcef093b9492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:01.588455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-36edea0d-9517-45d0-8310-6225207da9f8 req-5d8c9686-fa57-424f-9df4-bcef093b9492 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:01.590293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-36edea0d-9517-45d0-8310-6225207da9f8 req-5d8c9686-fa57-424f-9df4-bcef093b9492 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:01.590987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-36edea0d-9517-45d0-8310-6225207da9f8 req-5d8c9686-fa57-424f-9df4-bcef093b9492 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:01.603439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-36edea0d-9517-45d0-8310-6225207da9f8 req-5d8c9686-fa57-424f-9df4-bcef093b9492 service nova] Creating event network-changed:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:18:01.610870 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-36edea0d-9517-45d0-8310-6225207da9f8 req-5d8c9686-fa57-424f-9df4-bcef093b9492 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037729 Oct 01 21:18:01.612088 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3435/4884] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:18:01.738625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:01.751347 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e74244d5-0ff0-45c9-a95d-c9801196d845 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 0.403921 Oct 01 21:18:01.752143 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1450/4885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:01 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:02.034934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:02.035649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:02.054484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:02.055010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:02.055457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:02.056175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:02.056638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:02.057066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:02.107926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:02.108688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:02.109288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:02.109933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lazy-loading 'fault' on Instance uuid 2a887c41-a630-4ca9-b0a9-a43ab6c503fe {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:18:02.268812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:02.283675 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-325885c5-6381-432b-b2f7-854c07e9ca30 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 200 len: 1339 microversion: 2.1 time: 0.252789 Oct 01 21:18:02.285143 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3436/4886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:02 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 1339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:02.768685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-9196d522-5fb4-4dc4-b973-e07f76e62366 req-f65103ee-111f-4433-b465-e19d0295627a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "name": "network-vif-plugged", "status": "completed", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:02.778529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:02.780601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:02.783513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9196d522-5fb4-4dc4-b973-e07f76e62366 req-f65103ee-111f-4433-b465-e19d0295627a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:02.784182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9196d522-5fb4-4dc4-b973-e07f76e62366 req-f65103ee-111f-4433-b465-e19d0295627a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:02.784888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9196d522-5fb4-4dc4-b973-e07f76e62366 req-f65103ee-111f-4433-b465-e19d0295627a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:02.793088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:02.793984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:02.794704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:02.796857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:02.797544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:02.798223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:02.803291 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-9196d522-5fb4-4dc4-b973-e07f76e62366 req-f65103ee-111f-4433-b465-e19d0295627a service nova] Creating event network-vif-plugged:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch2-master-1 Oct 01 21:18:02.811528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-9196d522-5fb4-4dc4-b973-e07f76e62366 req-f65103ee-111f-4433-b465-e19d0295627a service nova] Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:18:02.824928 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-9196d522-5fb4-4dc4-b973-e07f76e62366 req-f65103ee-111f-4433-b465-e19d0295627a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060393 Oct 01 21:18:02.826127 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1451/4887] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:03.292752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:03.300764 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0de97eca-3b7e-4879-9e9b-51afdc3eeec3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 0.528968 Oct 01 21:18:03.302984 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3437/4888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:02 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:03.309530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:03.311325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 2a887c41-a630-4ca9-b0a9-a43ab6c503fe] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:03.318506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:03.319596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:03.320179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:03.321068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:03.321605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:03.322109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:03.337054 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] HTTP exception thrown: Instance 2a887c41-a630-4ca9-b0a9-a43ab6c503fe could not be found. Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Request method failure captured: Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe HTTP/1.1 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK4LOVXDPptAy9Z8ahY5BAN6oQkeQySO-lfZ24ZJf4uw9Y2SeT-1KvPDvdGtiDRjHTXxTCdqTY2s7gUOnK_7QqGaIovyncnqgocZF8AnwL1nEGiQ5QWarTJjKBy8PldUoiveFbXhtbOzHqLMt8TZRIcZ2wx8oInU05BoPzHEOrtWZ5w Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: d4d77c36520447b3bd3bf8984e9326e2 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestNetworkBasicOps-168457097 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4d77c36520447b3bd3bf8984e9326e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4d77c36520447b3bd3bf8984e9326e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4d77c36520447b3bd3bf8984e9326e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4d77c36520447b3bd3bf8984e9326e2"}]}] Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestNetworkBasicOps-168457097 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: d4d77c36520447b3bd3bf8984e9326e2 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestNetworkBasicOps-168457097 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestNetworkBasicOps-168457097-project Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 3066b652821f47f6909892c9b04f4236 Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestNetworkBasicOps-168457097-project Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 2a887c41-a630-4ca9-b0a9-a43ab6c503fe could not be found. Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '2a887c41-a630-4ca9-b0a9-a43ab6c503fe'} Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a887c41-a630-4ca9-b0a9-a43ab6c503fe could not be found. Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a887c41-a630-4ca9-b0a9-a43ab6c503fe could not be found. Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:18:03.338762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a887c41-a630-4ca9-b0a9-a43ab6c503fe could not be found. Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Returning 404 to user: Instance 2a887c41-a630-4ca9-b0a9-a43ab6c503fe could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d5302eb6-5df1-4bc2-acf3-edf0632b8305 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe" status: 404 len: 111 microversion: 2.1 time: 0.035854 Oct 01 21:18:03.343419 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1452/4889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:03 2022] GET /compute/v2.1/servers/2a887c41-a630-4ca9-b0a9-a43ab6c503fe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:18:03.511899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3e0a7df3-bbd6-4687-aa02-94c29efdbd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '.version_select at 0x7f4173fd6ee0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:03.538282 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3e0a7df3-bbd6-4687-aa02-94c29efdbd23 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1617092607" status: 202 len: 0 microversion: 2.1 time: 0.030751 Oct 01 21:18:03.538966 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3438/4890] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Oct 1 21:18:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1617092607 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:18:03.638273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-5a3c02f5-6a8c-4b21-8113-a60ff3af9db4 req-c2fb95c6-f576-4ad4-9d4c-e76ca36bfe4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a887c41-a630-4ca9-b0a9-a43ab6c503fe", "name": "network-vif-deleted", "tag": "c256152f-3e5f-4054-8cf4-fe493178248a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:03.649053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5a3c02f5-6a8c-4b21-8113-a60ff3af9db4 req-c2fb95c6-f576-4ad4-9d4c-e76ca36bfe4c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:03.649613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5a3c02f5-6a8c-4b21-8113-a60ff3af9db4 req-c2fb95c6-f576-4ad4-9d4c-e76ca36bfe4c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:03.650263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5a3c02f5-6a8c-4b21-8113-a60ff3af9db4 req-c2fb95c6-f576-4ad4-9d4c-e76ca36bfe4c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:03.662944 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-5a3c02f5-6a8c-4b21-8113-a60ff3af9db4 req-c2fb95c6-f576-4ad4-9d4c-e76ca36bfe4c service nova] Creating event network-vif-deleted:c256152f-3e5f-4054-8cf4-fe493178248a for instance 2a887c41-a630-4ca9-b0a9-a43ab6c503fe on nch2-master-1 Oct 01 21:18:03.668893 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-5a3c02f5-6a8c-4b21-8113-a60ff3af9db4 req-c2fb95c6-f576-4ad4-9d4c-e76ca36bfe4c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Oct 01 21:18:03.670907 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1453/4891] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:04.325961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:04.327281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:04.343688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:04.344508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:04.346266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:04.361498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:04.365321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:04.366526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:04.725128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:04.735743 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a770317-b80f-4b6f-b8b3-a69d31d19d6b tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 0.414271 Oct 01 21:18:04.738074 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3439/4892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:04 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:05.762516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:05.763405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:05.778176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:05.779331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:05.780127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:05.781064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:05.781713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:05.787831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:06.162976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:06.171948 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-82de4e95-3479-40c4-b097-c25f39924b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 0.413974 Oct 01 21:18:06.189883 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1454/4893] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:05 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:18:07.200152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:07.202089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:07.231093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:07.245803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e917177d-a88f-4f3e-8cc8-327cd35b8bb4 req-aba08918-b915-4dc7-b17c-98bc93c73ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "name": "network-vif-unplugged", "status": "completed", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:07.251682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:07.254457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:07.255567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:07.257242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:07.257937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:07.267886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e917177d-a88f-4f3e-8cc8-327cd35b8bb4 req-aba08918-b915-4dc7-b17c-98bc93c73ba6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:07.269872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e917177d-a88f-4f3e-8cc8-327cd35b8bb4 req-aba08918-b915-4dc7-b17c-98bc93c73ba6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:07.275256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e917177d-a88f-4f3e-8cc8-327cd35b8bb4 req-aba08918-b915-4dc7-b17c-98bc93c73ba6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:07.302140 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e917177d-a88f-4f3e-8cc8-327cd35b8bb4 req-aba08918-b915-4dc7-b17c-98bc93c73ba6 service nova] Creating event network-vif-unplugged:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch1-master-1 Oct 01 21:18:07.324704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-e917177d-a88f-4f3e-8cc8-327cd35b8bb4 req-aba08918-b915-4dc7-b17c-98bc93c73ba6 service nova] Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:18:07.352828 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e917177d-a88f-4f3e-8cc8-327cd35b8bb4 req-aba08918-b915-4dc7-b17c-98bc93c73ba6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112688 Oct 01 21:18:07.353961 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1455/4894] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:18:07.518707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:07.520423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:07.561793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:07.565462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:07.568252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:07.571798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:07.572653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:07.576099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:07.650744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:18:07.780841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:07.799853 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1f346f9e-9a55-4e42-b8bc-ce2d450d92de tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 0.604638 Oct 01 21:18:07.803887 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3440/4895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:07 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:07.856641 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-38d11c66-08b1-4082-977d-0a23b00b1842 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 204 len: 0 microversion: 2.1 time: 0.343338 Oct 01 21:18:07.857449 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1456/4896] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:18:07 2022] DELETE /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 21:18:07.867948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:07.868871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:07.880073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:07.880910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:07.881469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:07.884352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:07.884985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:07.885569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:08.343542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:08.366115 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e70afcc9-f853-4004-9ec1-6462c3adb878 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1670 microversion: 2.1 time: 0.502360 Oct 01 21:18:08.366768 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3441/4897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:07 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1670 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:08.834151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:08.836422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:08.850669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:08.851179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:08.851628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:08.852364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:08.852820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:08.853255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:09.392143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:09.393724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:09.409256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:09.410146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:09.411101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:09.412445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:09.416966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:09.418349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:10.033668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:10.046057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-17ef3c26-d3e9-457d-a649-589040cd70f5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1670 microversion: 2.1 time: 0.658698 Oct 01 21:18:10.047007 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3442/4898] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:09 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1670 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:10.083691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-dc46fe73-d46e-4041-9694-c267d2112746 req-1e3d3da0-6d6b-49f6-96c4-3823fcb9749d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7958cd56-0c66-403d-9b91-c9ef4262620a", "tag": "a384fd08-6237-4013-8248-4dcd07071291"}, {"name": "network-changed", "server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:10.135253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dc46fe73-d46e-4041-9694-c267d2112746 req-1e3d3da0-6d6b-49f6-96c4-3823fcb9749d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:10.148077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dc46fe73-d46e-4041-9694-c267d2112746 req-1e3d3da0-6d6b-49f6-96c4-3823fcb9749d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:10.149367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dc46fe73-d46e-4041-9694-c267d2112746 req-1e3d3da0-6d6b-49f6-96c4-3823fcb9749d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:10.186358 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:10.199812 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-dc46fe73-d46e-4041-9694-c267d2112746 req-1e3d3da0-6d6b-49f6-96c4-3823fcb9749d service nova] Creating event network-changed:a384fd08-6237-4013-8248-4dcd07071291 for instance 7958cd56-0c66-403d-9b91-c9ef4262620a on nch1-master-1 Oct 01 21:18:10.201183 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-33a60180-572e-4237-92ad-4f6291bbe70d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 1.371321 Oct 01 21:18:10.201895 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-dc46fe73-d46e-4041-9694-c267d2112746 req-1e3d3da0-6d6b-49f6-96c4-3823fcb9749d service nova] Creating event network-changed:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch1-master-1 Oct 01 21:18:10.226223 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1457/4899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:08 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:10.236749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-dc46fe73-d46e-4041-9694-c267d2112746 req-1e3d3da0-6d6b-49f6-96c4-3823fcb9749d service nova] Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:18:10.252405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-dc46fe73-d46e-4041-9694-c267d2112746 req-1e3d3da0-6d6b-49f6-96c4-3823fcb9749d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.184085 Oct 01 21:18:10.254133 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3443/4900] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:11.072719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:11.073140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:11.106590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:11.108853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:11.110189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:11.116779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:11.117963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:11.118794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:11.236128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:11.237605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:11.255710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:11.260494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:11.269181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:11.270086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:11.270906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:11.271549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:11.279081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:11.446917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:11.463068 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-506768ca-1957-44de-be9b-bb844173f516 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1333 microversion: 2.1 time: 0.394779 Oct 01 21:18:11.476182 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1458/4901] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:11 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1333 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:11.656080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:11.681797 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3de765d9-9e74-4d34-8fad-470f9dd35b3d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 0.452941 Oct 01 21:18:11.684454 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3444/4902] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:11 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:18:12.285059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-73d9b8e4-682b-4230-8aec-a296d220e8e1 req-8b99fe18-167d-4d11-9d4d-98c2b5363496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7958cd56-0c66-403d-9b91-c9ef4262620a", "name": "network-vif-deleted", "tag": "a384fd08-6237-4013-8248-4dcd07071291"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:12.300950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-73d9b8e4-682b-4230-8aec-a296d220e8e1 req-8b99fe18-167d-4d11-9d4d-98c2b5363496 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:12.302106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-73d9b8e4-682b-4230-8aec-a296d220e8e1 req-8b99fe18-167d-4d11-9d4d-98c2b5363496 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:12.302871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-73d9b8e4-682b-4230-8aec-a296d220e8e1 req-8b99fe18-167d-4d11-9d4d-98c2b5363496 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:12.327230 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-73d9b8e4-682b-4230-8aec-a296d220e8e1 req-8b99fe18-167d-4d11-9d4d-98c2b5363496 service nova] Creating event network-vif-deleted:a384fd08-6237-4013-8248-4dcd07071291 for instance 7958cd56-0c66-403d-9b91-c9ef4262620a on nch1-master-1 Oct 01 21:18:12.338451 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-73d9b8e4-682b-4230-8aec-a296d220e8e1 req-8b99fe18-167d-4d11-9d4d-98c2b5363496 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059689 Oct 01 21:18:12.342239 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1459/4903] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:12.488500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:12.489474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:12.496952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:12.497615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:12.498632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:12.499365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:12.499837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:12.500280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:12.534373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:12.535149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:12.536493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:12.537012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lazy-loading 'fault' on Instance uuid 7958cd56-0c66-403d-9b91-c9ef4262620a {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:18:12.579867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:12.589281 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c9f8a676-5ef4-4d73-a654-f77f6c1d94f2 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 200 len: 1338 microversion: 2.1 time: 0.105041 Oct 01 21:18:12.589906 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3445/4904] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:12 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:12.710127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:12.711751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:12.726149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:12.727182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:12.727853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:12.730073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:12.731518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:12.734611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:13.322277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:13.332127 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5f5fce1f-f0c2-4f94-afda-d3cc9ad12515 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1690 microversion: 2.1 time: 0.626477 Oct 01 21:18:13.333268 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1460/4905] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:12 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1690 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:13.612275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:13.612889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 7958cd56-0c66-403d-9b91-c9ef4262620a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:13.620519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:13.621220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:13.621830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:13.622872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:13.623504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:13.624097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:13.639794 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] HTTP exception thrown: Instance 7958cd56-0c66-403d-9b91-c9ef4262620a could not be found. Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Request method failure captured: Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a HTTP/1.1 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK4LOVXDPptAy9Z8ahY5BAN6oQkeQySO-lfZ24ZJf4uw9Y2SeT-1KvPDvdGtiDRjHTXxTCdqTY2s7gUOnK_7QqGaIovyncnqgocZF8AnwL1nEGiQ5QWarTJjKBy8PldUoiveFbXhtbOzHqLMt8TZRIcZ2wx8oInU05BoPzHEOrtWZ5w Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d4d77c36520447b3bd3bf8984e9326e2 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestNetworkBasicOps-168457097 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4d77c36520447b3bd3bf8984e9326e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4d77c36520447b3bd3bf8984e9326e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4d77c36520447b3bd3bf8984e9326e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4d77c36520447b3bd3bf8984e9326e2"}]}] Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestNetworkBasicOps-168457097 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d4d77c36520447b3bd3bf8984e9326e2 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestNetworkBasicOps-168457097 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestNetworkBasicOps-168457097-project Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3066b652821f47f6909892c9b04f4236 Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestNetworkBasicOps-168457097-project Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 7958cd56-0c66-403d-9b91-c9ef4262620a could not be found. Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7958cd56-0c66-403d-9b91-c9ef4262620a'} Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7958cd56-0c66-403d-9b91-c9ef4262620a could not be found. Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7958cd56-0c66-403d-9b91-c9ef4262620a could not be found. Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:18:13.641502 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7958cd56-0c66-403d-9b91-c9ef4262620a could not be found. Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Returning 404 to user: Instance 7958cd56-0c66-403d-9b91-c9ef4262620a could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dd709d52-e49d-440a-b280-ee29ff2519b6 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a" status: 404 len: 111 microversion: 2.1 time: 0.037850 Oct 01 21:18:13.647071 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3446/4906] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:13 2022] GET /compute/v2.1/servers/7958cd56-0c66-403d-9b91-c9ef4262620a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:18:13.915167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1d56de3e-be66-4ee8-b7a5-64551f2b9c5f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '.version_select at 0x7f41725b2670>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:13.957812 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1d56de3e-be66-4ee8-b7a5-64551f2b9c5f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-807730869" status: 202 len: 0 microversion: 2.1 time: 0.047184 Oct 01 21:18:13.963132 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1461/4907] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Oct 1 21:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-807730869 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:18:14.363512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:14.364151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:14.388043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:14.390279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:14.392178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:14.397553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:14.398056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:14.398732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:14.866413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:14.893013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-045513d8-8259-4b40-b5d9-34784d3e5ad3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1683 microversion: 2.1 time: 0.538693 Oct 01 21:18:14.895620 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3447/4908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:14 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1683 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:16.665852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-6618972c-0f55-4df4-9ab9-b77de2ead0ff req-984b05ed-d56a-4fe2-a31c-91718e1fc4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "name": "network-vif-plugged", "status": "completed", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:16.685338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:16.691616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6618972c-0f55-4df4-9ab9-b77de2ead0ff req-984b05ed-d56a-4fe2-a31c-91718e1fc4cf service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:16.692118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6618972c-0f55-4df4-9ab9-b77de2ead0ff req-984b05ed-d56a-4fe2-a31c-91718e1fc4cf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:16.692566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6618972c-0f55-4df4-9ab9-b77de2ead0ff req-984b05ed-d56a-4fe2-a31c-91718e1fc4cf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:16.728157 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-6618972c-0f55-4df4-9ab9-b77de2ead0ff req-984b05ed-d56a-4fe2-a31c-91718e1fc4cf service nova] Creating event network-vif-plugged:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch1-master-1 Oct 01 21:18:16.739002 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-6618972c-0f55-4df4-9ab9-b77de2ead0ff req-984b05ed-d56a-4fe2-a31c-91718e1fc4cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075896 Oct 01 21:18:16.740983 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1462/4909] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:18:32.074209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b94c6c9-e001-414b-ab7c-6843d251e7b5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Action: 'create', calling method: .version_select at 0x7f4173b06820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-45189072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJQeFFb9lts2F4F/nLoOvZ8n3pXxNc6VZKYEzyYim2XPMjdam4ZM/40Dbu0MTP0rR4Y5/L8/eln1DuuAc/xc9MxT/1SSSqxPPpRrzCAkQJnU+zVZp7JqyzQT5M1F/P9Zw=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:32.090578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=9 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:32.091813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=74 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:32.110378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4b94c6c9-e001-414b-ab7c-6843d251e7b5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:18:32.116856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4b94c6c9-e001-414b-ab7c-6843d251e7b5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for user 3066b652821f47f6909892c9b04f4236 and project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:18:32.149717 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b94c6c9-e001-414b-ab7c-6843d251e7b5 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.080110 Oct 01 21:18:32.153772 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3448/4910] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:18:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:34.136588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:34.138478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:34.143763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2001001816", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "284a3ef1-6bf1-494a-88dd-09ffd69a2d06"}], "key_name": "tempest-TestNetworkBasicOps-45189072", "security_groups": [{"name": "tempest-secgroup-smoke-1887592551"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:34.278134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] validate_networks() for [('284a3ef1-6bf1-494a-88dd-09ffd69a2d06', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:18:34.607641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:34.608365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:34.624490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:34.626557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:34.630790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:34.631596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:34.632084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:34.632538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:34.963935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:18:34.964380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:18:34.964869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:18:34.965291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:18:34.968005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:18:34.983378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:34.994651 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d898b0d4-445e-4e7d-854d-9da567c4a55a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.392454 Oct 01 21:18:35.006512 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3449/4911] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:34 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:18:35.006838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:35.006838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:35.006838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:35.006838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:35.006838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:35.006838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:35.018398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:35.018846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:35.027268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:35.027799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:35.028838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:35.029303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:18:35.029588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:35.030051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:35.030510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:35.036978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Getting quotas for user 3066b652821f47f6909892c9b04f4236 and project d4d77c36520447b3bd3bf8984e9326e2. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:18:35.051868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:18:35.054548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:18:35.108897 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2cf1b31a-9d79-4ea5-84ce-d5763c8bd14f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.974555 Oct 01 21:18:35.110749 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1463/4912] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:18:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:18:35.121670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-281b9a05-6d10-4f3d-a8cd-21e34edb2d36 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:35.122399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-281b9a05-6d10-4f3d-a8cd-21e34edb2d36 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:35.192115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-281b9a05-6d10-4f3d-a8cd-21e34edb2d36 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:35.199813 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-281b9a05-6d10-4f3d-a8cd-21e34edb2d36 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1247 microversion: 2.1 time: 0.082736 Oct 01 21:18:35.202351 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1464/4913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:35 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1247 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:35.287028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:35.296978 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4ea3e779-4d2c-499c-b385-7346f4c206ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.282614 Oct 01 21:18:35.297576 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3450/4914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:35 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:18:35.330836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:35.331696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:35.343340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:35.344431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:35.344861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:35.345884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:35.346264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:35.346863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:35.627005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:35.637090 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-844f1b96-c9a9-4ce8-8915-bd1286b49b68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.314857 Oct 01 21:18:35.638481 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1465/4915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:35 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:35.672101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24f0d026-5a2a-476c-b638-c56faa59a810 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1110920938"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:35.681663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24f0d026-5a2a-476c-b638-c56faa59a810 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:35.705287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f0d026-5a2a-476c-b638-c56faa59a810 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:35.708872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f0d026-5a2a-476c-b638-c56faa59a810 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:35.709340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f0d026-5a2a-476c-b638-c56faa59a810 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:35.710581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f0d026-5a2a-476c-b638-c56faa59a810 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:35.711256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f0d026-5a2a-476c-b638-c56faa59a810 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:35.711940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f0d026-5a2a-476c-b638-c56faa59a810 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:35.997731 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24f0d026-5a2a-476c-b638-c56faa59a810 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.334781 Oct 01 21:18:35.998914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3451/4916] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:18:35 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 01 21:18:36.228059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:36.229028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:36.239161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:36.241565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:36.246634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:36.247829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:36.248493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:36.249103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:36.352232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:36.375938 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8605739c-4cbc-48d1-9e2b-016ec53908f1 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1299 microversion: 2.1 time: 0.151766 Oct 01 21:18:36.376649 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1466/4917] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:36 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:37.404601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:37.408916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:37.424388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:37.425145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:37.425774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:37.426744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:37.427272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:37.427724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:37.520722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:37.535234 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7b82511f-9725-4a9c-adc5-19ebdd4ded95 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1305 microversion: 2.1 time: 0.138639 Oct 01 21:18:37.535857 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3452/4918] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:37 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1305 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:38.562385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:38.563241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:38.574460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:38.575990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:38.577765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:38.578991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:38.579673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:38.580280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:38.951891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:38.960300 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ebf6a398-60d2-4fa4-b2f3-d96a39cb690f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1373 microversion: 2.1 time: 0.403653 Oct 01 21:18:38.975349 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1467/4919] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:38 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1373 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:39.159702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0afe8628-a681-45ce-a0a8-e64c2a3d0f51 req-61734c78-88a7-44d6-b272-5564700c22ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ba59f2-fb26-452a-b1e5-8fd71c93d2d2", "tag": "1ea0bd47-f007-47ea-8312-0c6a96752357"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:39.178937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0afe8628-a681-45ce-a0a8-e64c2a3d0f51 req-61734c78-88a7-44d6-b272-5564700c22ed service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:39.179797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0afe8628-a681-45ce-a0a8-e64c2a3d0f51 req-61734c78-88a7-44d6-b272-5564700c22ed service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:39.180408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0afe8628-a681-45ce-a0a8-e64c2a3d0f51 req-61734c78-88a7-44d6-b272-5564700c22ed service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:39.193086 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0afe8628-a681-45ce-a0a8-e64c2a3d0f51 req-61734c78-88a7-44d6-b272-5564700c22ed service nova] Creating event network-changed:1ea0bd47-f007-47ea-8312-0c6a96752357 for instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 on nch2-master-1 Oct 01 21:18:39.206335 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0afe8628-a681-45ce-a0a8-e64c2a3d0f51 req-61734c78-88a7-44d6-b272-5564700c22ed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055150 Oct 01 21:18:39.207306 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3453/4920] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:39.983515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:39.984769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:39.991718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:39.998560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:39.999069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:39.999754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:40.000232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:40.004667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:40.368230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:40.383376 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-12b261ed-7392-479b-ada8-5bf17a665a2a tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1373 microversion: 2.1 time: 0.404214 Oct 01 21:18:40.387569 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1468/4921] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:39 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1373 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:40.610368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e5a60c3b-0d3d-4252-aef7-efb62cb2ae8c req-f37b43c6-e8e9-48f8-b8d3-7e7ad8fb33a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "name": "network-vif-plugged", "status": "completed", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:40.630636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e5a60c3b-0d3d-4252-aef7-efb62cb2ae8c req-f37b43c6-e8e9-48f8-b8d3-7e7ad8fb33a4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:40.634546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e5a60c3b-0d3d-4252-aef7-efb62cb2ae8c req-f37b43c6-e8e9-48f8-b8d3-7e7ad8fb33a4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:40.635943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e5a60c3b-0d3d-4252-aef7-efb62cb2ae8c req-f37b43c6-e8e9-48f8-b8d3-7e7ad8fb33a4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:40.663084 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e5a60c3b-0d3d-4252-aef7-efb62cb2ae8c req-f37b43c6-e8e9-48f8-b8d3-7e7ad8fb33a4 service nova] Creating event network-vif-plugged:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:18:40.674674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e5a60c3b-0d3d-4252-aef7-efb62cb2ae8c req-f37b43c6-e8e9-48f8-b8d3-7e7ad8fb33a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071360 Oct 01 21:18:40.675621 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3454/4922] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:41.228735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f8c38015-f526-43c5-8a86-9ff67323330e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:41.239308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f8c38015-f526-43c5-8a86-9ff67323330e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:41.280793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8c38015-f526-43c5-8a86-9ff67323330e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:41.282205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8c38015-f526-43c5-8a86-9ff67323330e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:41.284558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8c38015-f526-43c5-8a86-9ff67323330e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:41.286378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8c38015-f526-43c5-8a86-9ff67323330e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:41.288803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8c38015-f526-43c5-8a86-9ff67323330e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:41.290349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8c38015-f526-43c5-8a86-9ff67323330e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:41.413499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:41.414698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:41.432234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:41.432975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:41.433437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:41.435222 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f8c38015-f526-43c5-8a86-9ff67323330e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action" status: 200 len: 63167 microversion: 2.1 time: 0.207436 Oct 01 21:18:41.437739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:41.451427 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1469/4923] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:18:41 2022] POST /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d/action => generated 63167 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:18:41.452387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:41.453025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:41.646276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:41.655554 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6aeb4383-ecc0-4599-9682-31cd4800e8e3 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1373 microversion: 2.1 time: 0.248835 Oct 01 21:18:41.672009 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3455/4924] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:41 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1373 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:42.685550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:42.686267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:42.704294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:42.705009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:42.705607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:42.706513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:42.711115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:42.711764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:42.947853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:42.962457 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6fc00244-d347-4b81-86ed-c7b370eaf50e tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1373 microversion: 2.1 time: 0.281422 Oct 01 21:18:42.964768 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1470/4925] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:42 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1373 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:43.991192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:43.991913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:44.001718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:44.013685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:44.014359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:44.014926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:44.017660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:44.018446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:44.019160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:44.367656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:44.395392 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-675c3eeb-6d0e-410e-9709-1ea2268c8641 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1373 microversion: 2.1 time: 0.402765 Oct 01 21:18:44.398428 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3456/4926] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:43 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1373 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:45.146069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-78cb826c-1994-4c60-833e-587c8942ed08 req-990c10f7-2e9d-4920-a18e-96417a9f84f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ba59f2-fb26-452a-b1e5-8fd71c93d2d2", "name": "network-vif-plugged", "status": "completed", "tag": "1ea0bd47-f007-47ea-8312-0c6a96752357"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:45.172982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:45.184980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-78cb826c-1994-4c60-833e-587c8942ed08 req-990c10f7-2e9d-4920-a18e-96417a9f84f5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:45.185801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-78cb826c-1994-4c60-833e-587c8942ed08 req-990c10f7-2e9d-4920-a18e-96417a9f84f5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:45.186432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-78cb826c-1994-4c60-833e-587c8942ed08 req-990c10f7-2e9d-4920-a18e-96417a9f84f5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:45.222250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:18:45.227592 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-78cb826c-1994-4c60-833e-587c8942ed08 req-990c10f7-2e9d-4920-a18e-96417a9f84f5 service nova] Creating event network-vif-plugged:1ea0bd47-f007-47ea-8312-0c6a96752357 for instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 on nch2-master-1 Oct 01 21:18:45.246098 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-78cb826c-1994-4c60-833e-587c8942ed08 req-990c10f7-2e9d-4920-a18e-96417a9f84f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105834 Oct 01 21:18:45.261892 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1471/4927] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:45.423796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:45.424470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:45.439057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:45.441111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:45.442182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:45.445519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:45.453274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:45.454038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:45.867723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:45.879547 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b13e09d7-f14f-4875-9e5f-0a61b0fd0d8f tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1373 microversion: 2.1 time: 0.461784 Oct 01 21:18:45.894473 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3457/4928] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:45 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1373 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:46.908034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:46.908687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:46.930133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:46.940761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:46.942534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:46.943554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:46.946537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:46.947214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:47.282006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:47.312545 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6fb18c72-2a96-48df-bbdb-f9becbdb2cb4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1545 microversion: 2.1 time: 0.410572 Oct 01 21:18:47.322543 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1472/4929] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:46 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1545 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:47.356337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:47.359122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:47.381858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:47.382281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:47.383005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:47.384114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:47.385862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:47.386528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:47.627098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:47.638015 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5d6f8060-093e-4709-9474-913e65106c66 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1545 microversion: 2.1 time: 0.301069 Oct 01 21:18:47.639504 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3458/4930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:47 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1545 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:47.799036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9d655a37-b89d-4fca-8f9a-75e9dd690771 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:47.799668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9d655a37-b89d-4fca-8f9a-75e9dd690771 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:47.806925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d655a37-b89d-4fca-8f9a-75e9dd690771 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:47.807756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d655a37-b89d-4fca-8f9a-75e9dd690771 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:47.808469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d655a37-b89d-4fca-8f9a-75e9dd690771 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:47.810083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d655a37-b89d-4fca-8f9a-75e9dd690771 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:47.810773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d655a37-b89d-4fca-8f9a-75e9dd690771 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:47.811408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d655a37-b89d-4fca-8f9a-75e9dd690771 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:48.103654 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9d655a37-b89d-4fca-8f9a-75e9dd690771 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1834 microversion: 2.1 time: 0.308478 Oct 01 21:18:48.104356 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1473/4931] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:47 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1834 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:50.784341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:50.785098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:50.798842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:50.801627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:50.802680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:50.805229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:50.805740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:50.806415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:50.818574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-9515a9f3-9024-4ed6-8187-29b7e5add0f5 req-76981787-79b6-4582-87f8-4a91552eef8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:50.861701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9515a9f3-9024-4ed6-8187-29b7e5add0f5 req-76981787-79b6-4582-87f8-4a91552eef8a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:50.862400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9515a9f3-9024-4ed6-8187-29b7e5add0f5 req-76981787-79b6-4582-87f8-4a91552eef8a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:50.863026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9515a9f3-9024-4ed6-8187-29b7e5add0f5 req-76981787-79b6-4582-87f8-4a91552eef8a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:50.909830 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-9515a9f3-9024-4ed6-8187-29b7e5add0f5 req-76981787-79b6-4582-87f8-4a91552eef8a service nova] Creating event network-changed:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch1-master-1 Oct 01 21:18:50.911782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:18:50.935897 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-9515a9f3-9024-4ed6-8187-29b7e5add0f5 req-76981787-79b6-4582-87f8-4a91552eef8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114606 Oct 01 21:18:50.939505 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1474/4932] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:51.136354 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-90f8a1b9-e301-49e8-8ad1-9a5b2100096f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 204 len: 0 microversion: 2.1 time: 0.356199 Oct 01 21:18:51.143816 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3459/4933] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:18:50 2022] DELETE /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:18:51.154213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:51.155114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:51.173418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:51.179461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:51.181664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:51.183660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:51.185454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:51.188780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:51.530355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:51.542096 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-03658e04-7aff-4b01-a284-7ede7065d212 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1689 microversion: 2.1 time: 0.393712 Oct 01 21:18:51.544073 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1475/4934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:51 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1689 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:52.574175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:52.575891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:52.590632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:52.592284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:52.592972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:52.593917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:52.602095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:52.603662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:52.994842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-57650a58-b3e5-4023-aead-3a0455d6fc51 req-0a350b0f-8285-4f79-8562-5f38e765fcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ba59f2-fb26-452a-b1e5-8fd71c93d2d2", "tag": "1ea0bd47-f007-47ea-8312-0c6a96752357"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:53.032960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-57650a58-b3e5-4023-aead-3a0455d6fc51 req-0a350b0f-8285-4f79-8562-5f38e765fcda service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:53.037523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-57650a58-b3e5-4023-aead-3a0455d6fc51 req-0a350b0f-8285-4f79-8562-5f38e765fcda service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:53.038237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-57650a58-b3e5-4023-aead-3a0455d6fc51 req-0a350b0f-8285-4f79-8562-5f38e765fcda service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:53.079541 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-57650a58-b3e5-4023-aead-3a0455d6fc51 req-0a350b0f-8285-4f79-8562-5f38e765fcda service nova] Creating event network-changed:1ea0bd47-f007-47ea-8312-0c6a96752357 for instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 on nch2-master-1 Oct 01 21:18:53.090370 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-57650a58-b3e5-4023-aead-3a0455d6fc51 req-0a350b0f-8285-4f79-8562-5f38e765fcda service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099543 Oct 01 21:18:53.092410 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1476/4935] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:18:53.294829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:53.303758 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fa5b31d-8817-4829-aadd-c607cccc6150 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1689 microversion: 2.1 time: 0.737533 Oct 01 21:18:53.313315 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3460/4936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:52 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1689 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:54.347558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:54.348270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:54.393349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:54.393927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:54.396802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:54.399323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:54.400415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:54.402534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:54.884750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-08fc16b4-b0de-4163-be90-04cf0192d71f req-7cc42d97-a17c-4f78-a7e0-c9651ce6e91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0779eca2-b27f-4f3c-8eb8-1982e82c3e4d", "name": "network-vif-deleted", "tag": "692a6f09-861c-465e-b5d2-ce4521c3f42a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:18:54.923489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-08fc16b4-b0de-4163-be90-04cf0192d71f req-7cc42d97-a17c-4f78-a7e0-c9651ce6e91b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:54.925204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-08fc16b4-b0de-4163-be90-04cf0192d71f req-7cc42d97-a17c-4f78-a7e0-c9651ce6e91b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:54.926688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-08fc16b4-b0de-4163-be90-04cf0192d71f req-7cc42d97-a17c-4f78-a7e0-c9651ce6e91b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:54.951117 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-08fc16b4-b0de-4163-be90-04cf0192d71f req-7cc42d97-a17c-4f78-a7e0-c9651ce6e91b service nova] Creating event network-vif-deleted:692a6f09-861c-465e-b5d2-ce4521c3f42a for instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d on nch1-master-1 Oct 01 21:18:54.961343 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-08fc16b4-b0de-4163-be90-04cf0192d71f req-7cc42d97-a17c-4f78-a7e0-c9651ce6e91b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082668 Oct 01 21:18:54.962458 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3461/4937] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:18:55.057435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:18:55.072062 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ff684a65-f6f9-40c8-b807-59d3cd90b7f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 200 len: 1570 microversion: 2.1 time: 0.739431 Oct 01 21:18:55.074247 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1477/4938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:54 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 1570 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:18:56.109580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:18:56.110717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:18:56.130571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:56.131560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:56.139293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:56.140396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:18:56.141055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:18:56.141671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:18:56.173299 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] HTTP exception thrown: Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d could not be found. Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Request method failure captured: Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d HTTP/1.1 Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK2hiQttiLqFpU-8rCQHHvV-cPgSq6Vp7kVdJek3nn6F4H5vFTWS4FtOgvdjDYM3WBqdjC3p_4jg80-mVN1iU7Nu4N7YA8dsPbVHGGQ6Xlb8LUviJ4SX_YgNzxd91nA6MQskQH_9HYu8UoC5fzsj_amZuTPDVfcZvtzydTfTYeoAqCM Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 71511e85c1b947e3b03501b27d70d560 Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_71511e85c1b947e3b03501b27d70d560", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/71511e85c1b947e3b03501b27d70d560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/71511e85c1b947e3b03501b27d70d560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/71511e85c1b947e3b03501b27d70d560"}]}] Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 71511e85c1b947e3b03501b27d70d560 Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestNetworkAdvancedServerOps-1998630134-project Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: f77486ef55a0469a99c3795b626bee1a Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1998630134-project Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d could not be found. Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0779eca2-b27f-4f3c-8eb8-1982e82c3e4d'} Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d could not be found. Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d could not be found. Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:56.175334 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:18:56.179950 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:56.179950 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:18:56.179950 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:18:56.179950 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:18:56.179950 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:18:56.179950 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:18:56.179950 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d could not be found. Oct 01 21:18:56.179950 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:18:56.184442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Returning 404 to user: Instance 0779eca2-b27f-4f3c-8eb8-1982e82c3e4d could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:18:56.185619 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f7989af-ec8c-40fa-ae7f-2e9226cdf4bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d" status: 404 len: 111 microversion: 2.1 time: 0.081716 Oct 01 21:18:56.186445 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3462/4939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:18:56 2022] GET /compute/v2.1/servers/0779eca2-b27f-4f3c-8eb8-1982e82c3e4d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:19:00.149604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:00.150222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:00.165509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:00.166031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:00.166470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:00.173093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:00.186105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:00.186990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:00.543052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:00.559222 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9c52be50-45b9-47f2-9607-38942f16a348 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.412289 Oct 01 21:19:00.559795 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1478/4940] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:00 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:00.583252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dfcb200d-340a-4d98-8664-e28df81af7f0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1201146619"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:00.586042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dfcb200d-340a-4d98-8664-e28df81af7f0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:00.602790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfcb200d-340a-4d98-8664-e28df81af7f0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:00.603789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfcb200d-340a-4d98-8664-e28df81af7f0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:00.604584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfcb200d-340a-4d98-8664-e28df81af7f0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:00.606122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfcb200d-340a-4d98-8664-e28df81af7f0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:00.611904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfcb200d-340a-4d98-8664-e28df81af7f0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:00.612740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dfcb200d-340a-4d98-8664-e28df81af7f0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:01.555856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:01.577208 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dfcb200d-340a-4d98-8664-e28df81af7f0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.998249 Oct 01 21:19:01.586222 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3463/4941] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:19:00 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 01 21:19:03.445898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1fc3db20-040e-406d-85b3-0037f3bef741 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '.version_select at 0x7f4173cf1280>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:03.471478 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1fc3db20-040e-406d-85b3-0037f3bef741 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1666881393" status: 202 len: 0 microversion: 2.1 time: 0.029986 Oct 01 21:19:03.472086 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1479/4942] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Oct 1 21:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1666881393 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:19:03.508318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-81531da7-746f-4c99-8465-a2077fef33a1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'create', calling method: .version_select at 0x7f417284eaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1458096555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9amtMOySG1Bmca/qTVAX52wTyoz90V3uec1fO22EhtToVyITSPaj9pTD5Tx1bi655+V1IRzV6TPtkp7vitVFYawArbh/iiEha1iMhQVH0D1ATvfUgYBVuVtRDyvp9Z1Q=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:03.518980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:03.530485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-81531da7-746f-4c99-8465-a2077fef33a1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for project 71511e85c1b947e3b03501b27d70d560. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:19:03.539143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-81531da7-746f-4c99-8465-a2077fef33a1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for user f77486ef55a0469a99c3795b626bee1a and project 71511e85c1b947e3b03501b27d70d560. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:19:03.575945 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-81531da7-746f-4c99-8465-a2077fef33a1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.072950 Oct 01 21:19:03.580342 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3464/4943] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:19:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:04.797503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c13a7b84-610a-4b2a-90dd-0407254e5a34 req-9e9b08cf-f4fe-4c63-bafa-e71feaf4c5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "name": "network-vif-unplugged", "status": "completed", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:04.813562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:04.816251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c13a7b84-610a-4b2a-90dd-0407254e5a34 req-9e9b08cf-f4fe-4c63-bafa-e71feaf4c5e6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:04.816937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c13a7b84-610a-4b2a-90dd-0407254e5a34 req-9e9b08cf-f4fe-4c63-bafa-e71feaf4c5e6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:04.817939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c13a7b84-610a-4b2a-90dd-0407254e5a34 req-9e9b08cf-f4fe-4c63-bafa-e71feaf4c5e6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:04.826135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=73 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:04.842696 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c13a7b84-610a-4b2a-90dd-0407254e5a34 req-9e9b08cf-f4fe-4c63-bafa-e71feaf4c5e6 service nova] Creating event network-vif-unplugged:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:19:04.850821 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c13a7b84-610a-4b2a-90dd-0407254e5a34 req-9e9b08cf-f4fe-4c63-bafa-e71feaf4c5e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058420 Oct 01 21:19:04.852704 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1480/4944] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:06.882661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1e6a3ab3-93f0-40d4-9b40-dbb3745743b5 req-9c54601d-e653-489c-be4a-9006a65875be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "name": "network-vif-plugged", "status": "completed", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:06.896719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1e6a3ab3-93f0-40d4-9b40-dbb3745743b5 req-9c54601d-e653-489c-be4a-9006a65875be service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:06.897515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1e6a3ab3-93f0-40d4-9b40-dbb3745743b5 req-9c54601d-e653-489c-be4a-9006a65875be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:06.898179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1e6a3ab3-93f0-40d4-9b40-dbb3745743b5 req-9c54601d-e653-489c-be4a-9006a65875be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:06.913493 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1e6a3ab3-93f0-40d4-9b40-dbb3745743b5 req-9c54601d-e653-489c-be4a-9006a65875be service nova] Creating event network-vif-plugged:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:19:06.922306 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1e6a3ab3-93f0-40d4-9b40-dbb3745743b5 req-9c54601d-e653-489c-be4a-9006a65875be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044665 Oct 01 21:19:06.923393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3465/4945] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:07.615093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-688998455", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "70b23045-4951-4cf0-9d48-d301c7ecdf7d"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:07.713563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] validate_networks() for [('70b23045-4951-4cf0-9d48-d301c7ecdf7d', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:19:08.206829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:19:08.207432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:19:08.208110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:19:08.208834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:19:08.209535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:19:08.221696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:08.222469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:08.223222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:08.223963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:08.224420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:08.224839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:08.242872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Getting quotas for project 5f12200ca5c649cd993499b7cb7e382f. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:19:08.249078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Getting quotas for user ecdf7bba776f4b9c94f2653679505303 and project 5f12200ca5c649cd993499b7cb7e382f. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:19:08.264446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:19:08.267194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:19:08.317736 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3f22f15e-42c5-4935-8c3e-0dca25bd1ab8 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707811 Oct 01 21:19:08.324919 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1481/4946] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:19:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:19:08.333043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c6c991d-14ee-4dc8-b592-d39e1cc52d55 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:08.334416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c6c991d-14ee-4dc8-b592-d39e1cc52d55 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:08.480194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9c6c991d-14ee-4dc8-b592-d39e1cc52d55 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:08.489922 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c6c991d-14ee-4dc8-b592-d39e1cc52d55 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1213 microversion: 2.1 time: 0.163324 Oct 01 21:19:08.490750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3466/4947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:08 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:09.514256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:09.515556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:09.535515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:09.536260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:09.536896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:09.537781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:09.538434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:09.539042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:09.632283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:09.640733 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-82d6525f-c10b-41aa-887d-a55ac0170190 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1217 microversion: 2.1 time: 0.131403 Oct 01 21:19:09.658278 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1482/4948] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:09 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:10.671729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:10.674041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:10.696196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:10.697793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:10.698263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:10.700187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:10.701954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:10.703807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:10.704661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3f5a1161-e5c1-45b4-bb03-c6f66c6e8006 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:10.725637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3f5a1161-e5c1-45b4-bb03-c6f66c6e8006 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:10.754854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f5a1161-e5c1-45b4-bb03-c6f66c6e8006 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:10.755699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f5a1161-e5c1-45b4-bb03-c6f66c6e8006 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:10.756512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f5a1161-e5c1-45b4-bb03-c6f66c6e8006 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:10.757641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f5a1161-e5c1-45b4-bb03-c6f66c6e8006 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:10.758726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f5a1161-e5c1-45b4-bb03-c6f66c6e8006 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:10.759897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f5a1161-e5c1-45b4-bb03-c6f66c6e8006 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:10.846208 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3f5a1161-e5c1-45b4-bb03-c6f66c6e8006 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "POST /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2/action" status: 200 len: 24572 microversion: 2.1 time: 0.153118 Oct 01 21:19:10.854290 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1483/4949] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:19:10 2022] POST /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2/action => generated 24572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 21:19:10.881310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:10.902480 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec805e31-535f-48ff-8e55-6d62a04ef25b tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1283 microversion: 2.1 time: 0.237025 Oct 01 21:19:10.906272 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3467/4950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:10 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1283 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:11.936031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:11.937411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:11.957146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:11.958038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:11.958758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:11.965640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:11.966641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:11.967335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:12.342311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:12.353393 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c45bcc24-78c4-46c8-a0a8-7bdef26a1419 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1313 microversion: 2.1 time: 0.422368 Oct 01 21:19:12.355405 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1484/4951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:11 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:13.386534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:13.387184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:13.398569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:13.400156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:13.400826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:13.401773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:13.402670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:13.403272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:13.861841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:13.886231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-999e326c-9cb4-435d-8164-5bb0414fe9f7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1313 microversion: 2.1 time: 0.508701 Oct 01 21:19:13.903201 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3468/4952] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:13 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:14.474702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-66295fd3-dcba-4847-b477-3eb4d07170bb req-cb17b1a2-5572-42fc-af51-f00893d72240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490563c9-eb63-4ef4-beb8-f9f7e560fdf1", "tag": "b353e2c1-579e-4085-a0d0-50f9e3c80f6f"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:14.494866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-66295fd3-dcba-4847-b477-3eb4d07170bb req-cb17b1a2-5572-42fc-af51-f00893d72240 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:14.496259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-66295fd3-dcba-4847-b477-3eb4d07170bb req-cb17b1a2-5572-42fc-af51-f00893d72240 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:14.497381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-66295fd3-dcba-4847-b477-3eb4d07170bb req-cb17b1a2-5572-42fc-af51-f00893d72240 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:14.527152 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-66295fd3-dcba-4847-b477-3eb4d07170bb req-cb17b1a2-5572-42fc-af51-f00893d72240 service nova] Creating event network-changed:b353e2c1-579e-4085-a0d0-50f9e3c80f6f for instance 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 on nch1-master-1 Oct 01 21:19:14.538950 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-66295fd3-dcba-4847-b477-3eb4d07170bb req-cb17b1a2-5572-42fc-af51-f00893d72240 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068620 Oct 01 21:19:14.541734 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1485/4953] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:19:14.909251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:14.910126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:14.923382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:14.925865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:14.926421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:14.928573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:14.931424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:14.932144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:15.662293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1362398297", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "8659611c-59bf-46d8-9760-bf32b8a286c1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1458096555", "security_groups": [{"name": "tempest-secgroup-smoke-1349739065"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:15.897372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] validate_networks() for [('8659611c-59bf-46d8-9760-bf32b8a286c1', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:19:16.090593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:16.100349 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7bac34da-9b6a-43d3-b863-21b2189d8ec5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1313 microversion: 2.1 time: 1.195109 Oct 01 21:19:16.101394 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3469/4954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:14 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1313 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:16.756001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:19:16.757106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:19:16.765553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:19:16.767168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:19:16.769553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:19:16.794096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:16.803835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:16.805599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:16.808950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:16.809691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:16.810513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:16.836785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for project 71511e85c1b947e3b03501b27d70d560. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:19:16.844280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for user f77486ef55a0469a99c3795b626bee1a and project 71511e85c1b947e3b03501b27d70d560. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:19:16.869574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:19:16.879771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:19:17.127743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:17.128396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:17.150910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:17.151459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:17.151913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:17.152652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:17.153148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:17.153553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:17.164767 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a7df3e86-98d4-4cf7-b4a9-119135e9661a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.507185 Oct 01 21:19:17.165929 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1486/4955] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:19:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:19:17.179670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-750fce8e-774a-451d-8789-5df35e09b396 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:17.180717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-750fce8e-774a-451d-8789-5df35e09b396 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:17.419290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-750fce8e-774a-451d-8789-5df35e09b396 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:17.440297 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-750fce8e-774a-451d-8789-5df35e09b396 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1267 microversion: 2.1 time: 0.264880 Oct 01 21:19:17.444213 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1487/4956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:17 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:17.744423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:17.756837 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bae48752-600a-4c9c-87f7-ade303b62527 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1313 microversion: 2.1 time: 0.629275 Oct 01 21:19:17.760410 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3470/4957] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:17 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1313 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:18.514028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:18.516048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:18.528664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:18.533291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:18.534062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:18.537631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:18.539297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:18.540107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:18.710529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:18.726951 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d3fb5437-bcf6-486d-8516-3be1e1432c47 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1319 microversion: 2.1 time: 0.217711 Oct 01 21:19:18.728350 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1488/4958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:18 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:18.783956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:18.785282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:18.794512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:18.799328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:18.799828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:18.801841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:18.804382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:18.805519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:18.810907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:19.303520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:19.316868 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-89fc5dd5-a44c-40a4-adfe-184b2d86c284 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1313 microversion: 2.1 time: 0.537118 Oct 01 21:19:19.321726 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3471/4959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:18 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:19.754209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:19.754897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:19.767904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:19.769949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:19.771215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:19.774027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:19.774740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:19.775398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:19.945900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:19.958338 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-16ed6b22-f5df-4b80-9f36-78fcbf0ac650 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1325 microversion: 2.1 time: 0.204965 Oct 01 21:19:19.959642 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1489/4960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:19 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1325 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:20.347754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:20.349199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:20.363737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:20.366094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:20.366945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:20.370079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:20.373698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:20.374340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:20.923588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:20.942562 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f46133c-7e8b-41fe-9c33-f3577a74f065 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1313 microversion: 2.1 time: 0.597456 Oct 01 21:19:20.966013 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3472/4961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:20 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:20.983773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:20.984559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:20.992720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:20.993689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:20.994398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:20.995955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:20.996647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:20.997304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:21.347299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:21.361083 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-18bd668d-b578-4736-9694-2c42431b5896 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1393 microversion: 2.1 time: 0.380316 Oct 01 21:19:21.362425 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1490/4962] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:20 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1393 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:21.976138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:21.976765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:21.999350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:21.999675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:22.000126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:22.000852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:22.001312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:22.007269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:22.032757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c2eb6b62-9044-4ed7-9a3e-1f5acbb39ad6 req-364827f0-449f-43c9-8791-7bbbce1bc3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f815d9a-7897-444e-bdff-9c414aa8eec8", "tag": "cc6a0ac1-f20f-4c7e-a82a-168a222de70d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:22.054913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c2eb6b62-9044-4ed7-9a3e-1f5acbb39ad6 req-364827f0-449f-43c9-8791-7bbbce1bc3f2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:22.059507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c2eb6b62-9044-4ed7-9a3e-1f5acbb39ad6 req-364827f0-449f-43c9-8791-7bbbce1bc3f2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:22.064510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c2eb6b62-9044-4ed7-9a3e-1f5acbb39ad6 req-364827f0-449f-43c9-8791-7bbbce1bc3f2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:22.105442 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c2eb6b62-9044-4ed7-9a3e-1f5acbb39ad6 req-364827f0-449f-43c9-8791-7bbbce1bc3f2 service nova] Creating event network-changed:cc6a0ac1-f20f-4c7e-a82a-168a222de70d for instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 on nch2-master-1 Oct 01 21:19:22.111963 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c2eb6b62-9044-4ed7-9a3e-1f5acbb39ad6 req-364827f0-449f-43c9-8791-7bbbce1bc3f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084279 Oct 01 21:19:22.114946 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1491/4963] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:22.204081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-20e4f9d8-2cb3-45b3-ae0b-ce0c52119dc4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:22.206662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-20e4f9d8-2cb3-45b3-ae0b-ce0c52119dc4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:22.222777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20e4f9d8-2cb3-45b3-ae0b-ce0c52119dc4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:22.223280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20e4f9d8-2cb3-45b3-ae0b-ce0c52119dc4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:22.223896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20e4f9d8-2cb3-45b3-ae0b-ce0c52119dc4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:22.226811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20e4f9d8-2cb3-45b3-ae0b-ce0c52119dc4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:22.227626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20e4f9d8-2cb3-45b3-ae0b-ce0c52119dc4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:22.228231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20e4f9d8-2cb3-45b3-ae0b-ce0c52119dc4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:22.333542 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-20e4f9d8-2cb3-45b3-ae0b-ce0c52119dc4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "POST /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2/action" status: 200 len: 32638 microversion: 2.1 time: 0.158794 Oct 01 21:19:22.342773 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1492/4964] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:19:22 2022] POST /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2/action => generated 32638 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:19:22.397041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:22.400171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:22.426787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:22.430941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:22.433162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:22.436929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:22.440532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:22.441243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:22.689622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:22.698391 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-318ae3f1-07be-4f95-842b-7f772ebd06d0 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1313 microversion: 2.1 time: 0.728008 Oct 01 21:19:22.705246 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3473/4965] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:21 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:22.775214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:22.787970 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-49942a77-908a-47d6-8ec4-4a1e034f7647 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1393 microversion: 2.1 time: 0.402315 Oct 01 21:19:22.788563 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1493/4966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:22 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1393 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:22.852654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-96206f53-9c31-4b53-a696-ef1b5ed46c49 req-52736753-da3d-49d6-a66d-f8b07b3a6533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490563c9-eb63-4ef4-beb8-f9f7e560fdf1", "name": "network-vif-plugged", "status": "completed", "tag": "b353e2c1-579e-4085-a0d0-50f9e3c80f6f"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:22.872803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-96206f53-9c31-4b53-a696-ef1b5ed46c49 req-52736753-da3d-49d6-a66d-f8b07b3a6533 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:22.873305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-96206f53-9c31-4b53-a696-ef1b5ed46c49 req-52736753-da3d-49d6-a66d-f8b07b3a6533 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:22.873747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-96206f53-9c31-4b53-a696-ef1b5ed46c49 req-52736753-da3d-49d6-a66d-f8b07b3a6533 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:22.895716 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-96206f53-9c31-4b53-a696-ef1b5ed46c49 req-52736753-da3d-49d6-a66d-f8b07b3a6533 service nova] Creating event network-vif-plugged:b353e2c1-579e-4085-a0d0-50f9e3c80f6f for instance 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 on nch1-master-1 Oct 01 21:19:22.904711 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-96206f53-9c31-4b53-a696-ef1b5ed46c49 req-52736753-da3d-49d6-a66d-f8b07b3a6533 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060672 Oct 01 21:19:22.905665 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3474/4967] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:19:23.733104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:23.733723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:23.749169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:23.749669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:23.750117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:23.750877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:23.752407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:23.754300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:23.820832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:23.820832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:23.830547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:23.835491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:23.835920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:23.836909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:23.837981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:23.837981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:24.149347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:24.163681 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8ae8580b-28d7-410c-915c-bb6e9fdf0424 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1313 microversion: 2.1 time: 0.434738 Oct 01 21:19:24.179365 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1494/4968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:23 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:24.245564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:24.257471 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c6da13d-b88e-4c7e-adaa-7997d4cb50b1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1393 microversion: 2.1 time: 0.442114 Oct 01 21:19:24.259483 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3475/4969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:23 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1393 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:24.644438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:24.645051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:24.650889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8e138103-38aa-4783-902e-9aa8f46006f4 req-18fb05f5-4f97-4add-8a92-0e6708562f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ba59f2-fb26-452a-b1e5-8fd71c93d2d2", "tag": "1ea0bd47-f007-47ea-8312-0c6a96752357"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:24.655665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:24.656561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:24.657276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:24.658210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:24.659015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:24.659645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:24.671676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8e138103-38aa-4783-902e-9aa8f46006f4 req-18fb05f5-4f97-4add-8a92-0e6708562f14 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:24.672744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8e138103-38aa-4783-902e-9aa8f46006f4 req-18fb05f5-4f97-4add-8a92-0e6708562f14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:24.672874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8e138103-38aa-4783-902e-9aa8f46006f4 req-18fb05f5-4f97-4add-8a92-0e6708562f14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:24.704439 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8e138103-38aa-4783-902e-9aa8f46006f4 req-18fb05f5-4f97-4add-8a92-0e6708562f14 service nova] Creating event network-changed:1ea0bd47-f007-47ea-8312-0c6a96752357 for instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 on nch2-master-1 Oct 01 21:19:24.716762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:19:24.718565 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8e138103-38aa-4783-902e-9aa8f46006f4 req-18fb05f5-4f97-4add-8a92-0e6708562f14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066898 Oct 01 21:19:24.719884 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3476/4970] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:24.889323 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-77279555-8903-4150-8387-dbda6bb0919c tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "DELETE /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 204 len: 0 microversion: 2.1 time: 0.252316 Oct 01 21:19:24.891309 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1495/4971] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:19:24 2022] DELETE /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:19:24.902407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:24.904238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:24.914244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:24.915026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:24.915693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:24.918267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:24.918985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:24.919639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:25.197129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:25.197775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:25.214476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:25.215023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:25.215479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:25.216226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:25.216685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:25.217101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:25.450912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:25.462054 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e92c3678-12fc-473a-a1f4-6466724c3183 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1497 microversion: 2.1 time: 0.271523 Oct 01 21:19:25.465352 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1496/4972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:25 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1497 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:25.477055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:25.478995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:25.498773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:25.499287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:25.499737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:25.503706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:25.504219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:25.504666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:25.656981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:25.671100 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-352df7d4-9357-44c3-aad0-f2a9b686d0a7 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1670 microversion: 2.1 time: 0.773937 Oct 01 21:19:25.673907 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3477/4973] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:24 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1670 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:25.754665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:25.763681 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cdc36e29-c4e8-4ad7-b2a0-623b41388bfb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1393 microversion: 2.1 time: 0.297006 Oct 01 21:19:25.770626 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1497/4974] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:25 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1393 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:25.845014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:25.846594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:25.855666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:25.856466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:25.857081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:25.857955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:25.858752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:25.859582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:26.235202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:26.236858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:26.248260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:26.251420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:26.251890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:26.252648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:26.253133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:26.253558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:26.317447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:19:26.340650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:26.359250 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a521f43-f199-4b08-bba7-53d54c33ec11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.515247 Oct 01 21:19:26.371636 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3478/4975] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:25 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:26.438900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:26.522749 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4a45c117-dfed-4b10-b74d-9be8203511a5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "DELETE /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 204 len: 0 microversion: 2.1 time: 0.301959 Oct 01 21:19:26.528980 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1498/4976] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:19:26 2022] DELETE /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:19:26.532389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:26.533145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:26.563420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:26.566479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:26.568615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:26.570261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:26.572616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:26.574941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:26.706181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:26.707184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:26.719439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:26.723356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:26.723938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:26.724760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:26.725315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:26.725804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:26.763362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:26.774760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88db7aa6-eb06-439e-9139-6f0819b148a9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1503 microversion: 2.1 time: 0.246349 Oct 01 21:19:26.775465 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3479/4977] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:26 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:26.790052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:26.790707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:26.797253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:26.797793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:26.798248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:26.799010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:26.799480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:26.799921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:26.825817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:26.937398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:26.946310 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-92d471f3-a271-4784-9158-54eb9b930c53 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1393 microversion: 2.1 time: 0.162098 Oct 01 21:19:26.946926 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3480/4978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:26 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:27.011613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066b652821f47f6909892c9b04f4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d77c36520447b3bd3bf8984e9326e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:27.020536 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0c00c615-bbf0-461a-8a05-8a467acb31f4 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 200 len: 1670 microversion: 2.1 time: 0.324066 Oct 01 21:19:27.021485 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1499/4979] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:26 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 1670 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:27.254234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-10b05cdb-a457-4360-befa-a511b74b38a6 req-1358796d-b4e0-477e-8279-6b72169342d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ba59f2-fb26-452a-b1e5-8fd71c93d2d2", "name": "network-vif-deleted", "tag": "1ea0bd47-f007-47ea-8312-0c6a96752357"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:27.264353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-10b05cdb-a457-4360-befa-a511b74b38a6 req-1358796d-b4e0-477e-8279-6b72169342d3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:27.265128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-10b05cdb-a457-4360-befa-a511b74b38a6 req-1358796d-b4e0-477e-8279-6b72169342d3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:27.265752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-10b05cdb-a457-4360-befa-a511b74b38a6 req-1358796d-b4e0-477e-8279-6b72169342d3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:27.269425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c09cbe65-a631-4e68-afb9-d2456184b482 req-bbc5d6b0-fe20-4b4e-9209-d313505a69b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f815d9a-7897-444e-bdff-9c414aa8eec8", "name": "network-vif-plugged", "status": "completed", "tag": "cc6a0ac1-f20f-4c7e-a82a-168a222de70d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:27.291251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c09cbe65-a631-4e68-afb9-d2456184b482 req-bbc5d6b0-fe20-4b4e-9209-d313505a69b6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:27.293919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c09cbe65-a631-4e68-afb9-d2456184b482 req-bbc5d6b0-fe20-4b4e-9209-d313505a69b6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:27.294459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c09cbe65-a631-4e68-afb9-d2456184b482 req-bbc5d6b0-fe20-4b4e-9209-d313505a69b6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:27.296191 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-10b05cdb-a457-4360-befa-a511b74b38a6 req-1358796d-b4e0-477e-8279-6b72169342d3 service nova] Creating event network-vif-deleted:1ea0bd47-f007-47ea-8312-0c6a96752357 for instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 on nch2-master-1 Oct 01 21:19:27.301910 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-10b05cdb-a457-4360-befa-a511b74b38a6 req-1358796d-b4e0-477e-8279-6b72169342d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051441 Oct 01 21:19:27.303150 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3481/4980] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:27.312524 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c09cbe65-a631-4e68-afb9-d2456184b482 req-bbc5d6b0-fe20-4b4e-9209-d313505a69b6 service nova] Creating event network-vif-plugged:cc6a0ac1-f20f-4c7e-a82a-168a222de70d for instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 on nch2-master-1 Oct 01 21:19:27.334229 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c09cbe65-a631-4e68-afb9-d2456184b482 req-bbc5d6b0-fe20-4b4e-9209-d313505a69b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070225 Oct 01 21:19:27.335297 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1500/4981] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:19:27.390983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:27.391775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:27.415892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:27.418845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:27.419897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:27.421200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:27.421970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:27.422721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:27.652645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:27.662222 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-43c5a0f2-27ab-4850-b927-bf3067948ef4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.277779 Oct 01 21:19:27.669014 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3482/4982] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:27 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:27.683858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=14 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:27.688836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-903430b2-f00b-4715-9986-54d9b26450f3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-166125680"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:27.691517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-903430b2-f00b-4715-9986-54d9b26450f3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:27.705288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-903430b2-f00b-4715-9986-54d9b26450f3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:27.706017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-903430b2-f00b-4715-9986-54d9b26450f3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:27.706679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-903430b2-f00b-4715-9986-54d9b26450f3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:27.707729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-903430b2-f00b-4715-9986-54d9b26450f3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:27.708906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-903430b2-f00b-4715-9986-54d9b26450f3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:27.709501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-903430b2-f00b-4715-9986-54d9b26450f3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:27.798679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:27.799295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:27.810043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:27.810808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:27.811432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:27.812457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:27.813111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:27.815149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:28.130539 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-903430b2-f00b-4715-9986-54d9b26450f3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.446636 Oct 01 21:19:28.132353 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1501/4983] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:19:27 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 01 21:19:28.147737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:28.150113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:28.161813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:28.163000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:28.163616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:28.164553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:28.165172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:28.165897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:28.221424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:28.233342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2214007-c846-4197-b335-bc69b854c0b1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1503 microversion: 2.1 time: 0.438709 Oct 01 21:19:28.234742 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3483/4984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:27 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:28.240863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:28.241688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] [instance: 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:28.249835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:28.250715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:28.251306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:28.253608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:28.254454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:28.255083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:28.273249 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] HTTP exception thrown: Instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 could not be found. Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Request method failure captured: Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 HTTP/1.1 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK4LOVXDPptAy9Z8ahY5BAN6oQkeQySO-lfZ24ZJf4uw9Y2SeT-1KvPDvdGtiDRjHTXxTCdqTY2s7gUOnK_7QqGaIovyncnqgocZF8AnwL1nEGiQ5QWarTJjKBy8PldUoiveFbXhtbOzHqLMt8TZRIcZ2wx8oInU05BoPzHEOrtWZ5w Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: d4d77c36520447b3bd3bf8984e9326e2 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestNetworkBasicOps-168457097 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4d77c36520447b3bd3bf8984e9326e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4d77c36520447b3bd3bf8984e9326e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4d77c36520447b3bd3bf8984e9326e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4d77c36520447b3bd3bf8984e9326e2"}]}] Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestNetworkBasicOps-168457097 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: d4d77c36520447b3bd3bf8984e9326e2 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestNetworkBasicOps-168457097 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestNetworkBasicOps-168457097-project Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3066b652821f47f6909892c9b04f4236 Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestNetworkBasicOps-168457097-project Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 could not be found. Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '05ba59f2-fb26-452a-b1e5-8fd71c93d2d2'} Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 could not be found. Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 could not be found. Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:19:28.275523 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:19:28.281149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:19:28.281149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:19:28.281149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:19:28.281149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:19:28.281149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:19:28.281149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 could not be found. Oct 01 21:19:28.281149 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:19:28.283402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Returning 404 to user: Instance 05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:19:28.284749 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02401a64-1075-40e2-b8ed-d734cc0d3c71 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2" status: 404 len: 111 microversion: 2.1 time: 0.048232 Oct 01 21:19:28.290553 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3484/4985] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:28 2022] GET /compute/v2.1/servers/05ba59f2-fb26-452a-b1e5-8fd71c93d2d2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:19:28.300958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:28.302705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:28.319883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:28.320521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:28.320992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:28.324693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:28.325382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:28.327430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:28.576195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:28.598076 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-55ce9492-b9d9-4dea-9f28-f3d2266fba0f tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1393 microversion: 2.1 time: 0.461327 Oct 01 21:19:28.600757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:28.603326 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1502/4986] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:28 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1393 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:28.620743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:28.627965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f82e6e96-4d62-4763-b771-5fa62e1abb06 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.338266 Oct 01 21:19:28.628790 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3485/4987] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:28 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:28.928906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6608fa02-f618-4ae8-9726-023ebfddc240 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] Calling method '.version_select at 0x7f4173ac2a60>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:28.999868 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6608fa02-f618-4ae8-9726-023ebfddc240 tempest-TestNetworkBasicOps-168457097 tempest-TestNetworkBasicOps-168457097-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-45189072" status: 202 len: 0 microversion: 2.1 time: 0.114075 Oct 01 21:19:29.007856 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3486/4988] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 21:19:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-45189072 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:19:29.053165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-2d0b8b38-ba84-4268-96cd-2eb4b360714f req-b6c63b18-7ef2-43c4-86f6-8ce3996d1cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490563c9-eb63-4ef4-beb8-f9f7e560fdf1", "name": "network-vif-deleted", "tag": "b353e2c1-579e-4085-a0d0-50f9e3c80f6f"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:29.070826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2d0b8b38-ba84-4268-96cd-2eb4b360714f req-b6c63b18-7ef2-43c4-86f6-8ce3996d1cd6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:29.071605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2d0b8b38-ba84-4268-96cd-2eb4b360714f req-b6c63b18-7ef2-43c4-86f6-8ce3996d1cd6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:29.072328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2d0b8b38-ba84-4268-96cd-2eb4b360714f req-b6c63b18-7ef2-43c4-86f6-8ce3996d1cd6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:29.098356 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-2d0b8b38-ba84-4268-96cd-2eb4b360714f req-b6c63b18-7ef2-43c4-86f6-8ce3996d1cd6 service nova] Creating event network-vif-deleted:b353e2c1-579e-4085-a0d0-50f9e3c80f6f for instance 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 on nch1-master-1 Oct 01 21:19:29.105985 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-2d0b8b38-ba84-4268-96cd-2eb4b360714f req-b6c63b18-7ef2-43c4-86f6-8ce3996d1cd6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313229 Oct 01 21:19:29.107287 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1503/4989] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:29.262775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:29.264523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:29.276550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:29.277118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:29.277814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:29.278817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:29.279506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:29.280200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:29.327606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:29.328208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:29.328725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:29.329698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lazy-loading 'fault' on Instance uuid 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:19:29.415168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:29.427184 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4e2e073b-24fa-4ef9-90af-0fe08bbfd2e5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 200 len: 1303 microversion: 2.1 time: 0.170968 Oct 01 21:19:29.428095 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3487/4990] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:29 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:29.627966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:29.628796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:29.637779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:29.638554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:29.640426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:29.641607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:29.642267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:29.642899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:29.653776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:29.655032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:29.662765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:29.663817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:29.664529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:29.673483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:29.674470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:29.675288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:29.951615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:29.969994 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f9b2124-9f48-41cc-8a2a-50cac8b6c4cc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1686 microversion: 2.1 time: 0.320093 Oct 01 21:19:29.975446 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3488/4991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:29 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1686 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:30.330359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:30.343795 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4cb18a34-d8be-49a5-b8ef-a7d803b12b71 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1564 microversion: 2.1 time: 0.721308 Oct 01 21:19:30.344969 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1504/4992] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:29 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1564 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:30.371455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:30.372250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:30.378652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:30.379156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:30.379910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:30.380815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:30.381449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:30.382060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:30.454043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:30.455994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 490563c9-eb63-4ef4-beb8-f9f7e560fdf1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:30.468505 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:30.470260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:30.472388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:30.473974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:30.475053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:30.475692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:30.518786 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] HTTP exception thrown: Instance 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 could not be found. Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Request method failure captured: Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 HTTP/1.1 Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK7JtPvL-DZiAQcPqrlvzLIH4NP_G1huIZqmdhiaISw4NKoaKRcoKiJb1vdSTTaAHH5ZdIA1uIXGJqFrRG6na2s96uVdtFccRKbnMS69eBA0uOcvxoMetTPXRyyQDXa1k0CaRYb_1iYAj0sbUGW3Rulv8NybGHAucgLRZ8oGPq8LAAM Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 5f12200ca5c649cd993499b7cb7e382f Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-VolumesActionsTest-1307507385 Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5f12200ca5c649cd993499b7cb7e382f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5f12200ca5c649cd993499b7cb7e382f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5f12200ca5c649cd993499b7cb7e382f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5f12200ca5c649cd993499b7cb7e382f"}]}] Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-VolumesActionsTest-1307507385 Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 5f12200ca5c649cd993499b7cb7e382f Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-VolumesActionsTest-1307507385 Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-VolumesActionsTest-1307507385-project Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: ecdf7bba776f4b9c94f2653679505303 Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-VolumesActionsTest-1307507385-project Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 could not be found. Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '490563c9-eb63-4ef4-beb8-f9f7e560fdf1'} Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 could not be found. Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 could not be found. Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:19:30.521939 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:30.528623 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:19:30.528623 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:19:30.528623 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:19:30.528623 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:19:30.528623 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:19:30.528623 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 could not be found. Oct 01 21:19:30.528623 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:30.532925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Returning 404 to user: Instance 490563c9-eb63-4ef4-beb8-f9f7e560fdf1 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:19:30.535751 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9a092ace-522c-4e49-8034-f3c70d491df9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1" status: 404 len: 111 microversion: 2.1 time: 0.088845 Oct 01 21:19:30.537515 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1505/4993] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:30 2022] GET /compute/v2.1/servers/490563c9-eb63-4ef4-beb8-f9f7e560fdf1 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:19:30.647388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-352533869", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "70b23045-4951-4cf0-9d48-d301c7ecdf7d"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:30.674704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:30.686633 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4df482b2-d1eb-4894-8385-d8e7178debd3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1564 microversion: 2.1 time: 0.319416 Oct 01 21:19:30.698520 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3489/4994] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:30 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1564 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:30.763708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] validate_networks() for [('70b23045-4951-4cf0-9d48-d301c7ecdf7d', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:19:30.996516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:30.997153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:31.011224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:31.011744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:31.012203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:31.012939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:31.015534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:31.016325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:31.430033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:31.443769 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca3fd9fd-2bcd-47cc-9a74-c9c71d413319 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1686 microversion: 2.1 time: 0.451396 Oct 01 21:19:31.444436 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3490/4995] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:30 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1686 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:31.453327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ffe2c241-89fc-407b-a9e6-638d50d7b15a req-4c029e54-efdf-4d75-b472-9cb6a4997709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "name": "network-vif-unplugged", "status": "completed", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:31.479943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ffe2c241-89fc-407b-a9e6-638d50d7b15a req-4c029e54-efdf-4d75-b472-9cb6a4997709 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:31.480444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ffe2c241-89fc-407b-a9e6-638d50d7b15a req-4c029e54-efdf-4d75-b472-9cb6a4997709 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:31.480893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ffe2c241-89fc-407b-a9e6-638d50d7b15a req-4c029e54-efdf-4d75-b472-9cb6a4997709 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:31.503813 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ffe2c241-89fc-407b-a9e6-638d50d7b15a req-4c029e54-efdf-4d75-b472-9cb6a4997709 service nova] Creating event network-vif-unplugged:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:19:31.512868 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ffe2c241-89fc-407b-a9e6-638d50d7b15a req-4c029e54-efdf-4d75-b472-9cb6a4997709 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066892 Oct 01 21:19:31.513714 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3491/4996] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:31.821296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:19:31.821833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:19:31.822237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:19:31.822640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:19:31.823836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:19:31.844742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:31.845250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:31.845700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:31.846447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:31.847663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:31.847663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:31.875094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:31.896258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Getting quotas for project 5f12200ca5c649cd993499b7cb7e382f. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:19:31.904920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Getting quotas for user ecdf7bba776f4b9c94f2653679505303 and project 5f12200ca5c649cd993499b7cb7e382f. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:19:31.935054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:19:31.937143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:19:32.043651 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9b5886fa-516d-4b9c-b4f2-8a0c3b567229 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.403180 Oct 01 21:19:32.044304 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1506/4997] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:19:32.058399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-850f6793-6a85-4daf-8c35-6942445c5df3 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:32.059142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-850f6793-6a85-4daf-8c35-6942445c5df3 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:32.170624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-850f6793-6a85-4daf-8c35-6942445c5df3 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:32.177861 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-850f6793-6a85-4daf-8c35-6942445c5df3 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1213 microversion: 2.1 time: 0.125824 Oct 01 21:19:32.178454 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3492/4998] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:32 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:32.471825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:32.472742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:32.483310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:32.484117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:32.484759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:32.489160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:32.489921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:32.491897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:33.017981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:33.037549 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1775dba7-c599-4100-acaa-517bf4e5b2de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.571010 Oct 01 21:19:33.052482 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1507/4999] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:32 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:33.201764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:33.203227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:33.214205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:33.218188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:33.221872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:33.222932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:33.223639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:33.224328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:33.538821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-1bdfdbc2-5b65-43ec-91e8-43328fd5fd58 req-847721e9-3f05-4f51-a7f1-2121ac7a4945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "name": "network-vif-plugged", "status": "completed", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:33.573991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1bdfdbc2-5b65-43ec-91e8-43328fd5fd58 req-847721e9-3f05-4f51-a7f1-2121ac7a4945 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:33.576551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1bdfdbc2-5b65-43ec-91e8-43328fd5fd58 req-847721e9-3f05-4f51-a7f1-2121ac7a4945 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:33.578226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1bdfdbc2-5b65-43ec-91e8-43328fd5fd58 req-847721e9-3f05-4f51-a7f1-2121ac7a4945 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:33.590034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:33.598353 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9375a081-02aa-453b-831f-ffda75b85614 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1209 microversion: 2.1 time: 0.400911 Oct 01 21:19:33.605844 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3493/5000] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:33 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1209 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:33.620914 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-1bdfdbc2-5b65-43ec-91e8-43328fd5fd58 req-847721e9-3f05-4f51-a7f1-2121ac7a4945 service nova] Creating event network-vif-plugged:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:19:33.628682 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-1bdfdbc2-5b65-43ec-91e8-43328fd5fd58 req-847721e9-3f05-4f51-a7f1-2121ac7a4945 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095927 Oct 01 21:19:33.630280 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1508/5001] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:34.074890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:34.075649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:34.077883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:34.096502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:34.097520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:34.100732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:34.102860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:34.105016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:34.105633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:34.633294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:34.634014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:34.643101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:34.643899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:34.644808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:34.646214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:34.647321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:34.647940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:34.834871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:34.848019 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-408c53e7-c294-4b63-b3fe-93bee78d9980 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.778439 Oct 01 21:19:34.851036 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3494/5002] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:34 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:34.872963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:34.887721 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1ca51d06-0bfc-4158-83be-21e68f6dbf06 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1271 microversion: 2.1 time: 0.259276 Oct 01 21:19:34.888628 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1509/5003] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:34 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:35.683744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:35.684553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:35.692524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-1c0f456b-9532-4cf3-a780-474ed6277920 req-66cb710e-b29b-4138-8689-6b7f66d3e71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f815d9a-7897-444e-bdff-9c414aa8eec8", "tag": "cc6a0ac1-f20f-4c7e-a82a-168a222de70d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:35.695739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:35.697875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:35.700973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:35.701981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:35.702654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:35.703286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:35.710115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1c0f456b-9532-4cf3-a780-474ed6277920 req-66cb710e-b29b-4138-8689-6b7f66d3e71d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:35.710644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1c0f456b-9532-4cf3-a780-474ed6277920 req-66cb710e-b29b-4138-8689-6b7f66d3e71d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:35.711092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1c0f456b-9532-4cf3-a780-474ed6277920 req-66cb710e-b29b-4138-8689-6b7f66d3e71d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:35.740094 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-1c0f456b-9532-4cf3-a780-474ed6277920 req-66cb710e-b29b-4138-8689-6b7f66d3e71d service nova] Creating event network-changed:cc6a0ac1-f20f-4c7e-a82a-168a222de70d for instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 on nch2-master-1 Oct 01 21:19:35.748653 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-1c0f456b-9532-4cf3-a780-474ed6277920 req-66cb710e-b29b-4138-8689-6b7f66d3e71d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059714 Oct 01 21:19:35.755150 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1510/5004] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:35.882687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:35.883414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:35.894462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:35.901781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:35.902247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:35.903221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:35.903702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:35.904272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:36.260815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:36.272727 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6859c8c4-8446-498b-9b13-5b20b7b7b325 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1564 microversion: 2.1 time: 0.593714 Oct 01 21:19:36.275237 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3495/5005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:35 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1564 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:36.288927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:36.292633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:36.306694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:36.310106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:36.311853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:36.314192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:36.314875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:36.319232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:36.643243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:36.653813 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-83a2974a-0def-47fe-962f-a5dc6f8328bb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.780011 Oct 01 21:19:36.654750 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1511/5006] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:35 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:36.727321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:36.738455 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-389b4c75-cd48-46cd-bc2c-5a7fa99e7c0e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1313 microversion: 2.1 time: 0.461362 Oct 01 21:19:36.752185 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3496/5007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:36 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:37.685077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:37.686583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:37.705474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:37.706290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:37.707165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:37.708114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:37.710600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:37.711219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:37.765420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:37.768123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:37.793280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:37.793822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:37.795902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:37.800339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:37.800878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:37.801342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:38.093276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:38.116563 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aef7ff74-d3d6-4bef-8c5b-0c8ccce7060a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.438270 Oct 01 21:19:38.118568 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1512/5008] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:37 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:38.250135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-80b8a453-1ce0-4401-b430-6bd538e4bed6 req-c55cd50d-f3f9-4dde-b06f-485ee8984df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8da90f-c891-41ed-8e01-153fef78d0b1", "tag": "39409b69-c57e-4249-84eb-531256929a5b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:38.290316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80b8a453-1ce0-4401-b430-6bd538e4bed6 req-c55cd50d-f3f9-4dde-b06f-485ee8984df7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:38.292173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80b8a453-1ce0-4401-b430-6bd538e4bed6 req-c55cd50d-f3f9-4dde-b06f-485ee8984df7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:38.293902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80b8a453-1ce0-4401-b430-6bd538e4bed6 req-c55cd50d-f3f9-4dde-b06f-485ee8984df7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:38.346011 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-80b8a453-1ce0-4401-b430-6bd538e4bed6 req-c55cd50d-f3f9-4dde-b06f-485ee8984df7 service nova] Creating event network-changed:39409b69-c57e-4249-84eb-531256929a5b for instance 0f8da90f-c891-41ed-8e01-153fef78d0b1 on nch1-master-1 Oct 01 21:19:38.358130 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-80b8a453-1ce0-4401-b430-6bd538e4bed6 req-c55cd50d-f3f9-4dde-b06f-485ee8984df7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113023 Oct 01 21:19:38.359868 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1513/5009] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:19:38.524516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:38.532901 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1e1cfaf-c16b-4c45-92c8-d79d3a750ad7 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1313 microversion: 2.1 time: 0.771343 Oct 01 21:19:38.533504 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3497/5010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:37 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1313 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:39.148972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:39.149926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:39.161882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:39.162733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:39.163608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:39.164777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:39.165525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:39.167324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:39.366630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:39.379804 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-211e2b0d-ae40-4177-8a98-39cf44f74e66 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.239997 Oct 01 21:19:39.394232 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1514/5011] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:39 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:39.557174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:39.557794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:39.568543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:39.577019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:39.577930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:39.578965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:39.579590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:39.580304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:39.883825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:39.897584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-010ec40a-ad7b-49e1-bad8-4f1c83db40fd tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1313 microversion: 2.1 time: 0.344192 Oct 01 21:19:39.898995 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3498/5012] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:39 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:40.405618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:40.407221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:40.421054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:40.421920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:40.423158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:40.424499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:40.425275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:40.426133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:40.691738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:40.711195 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a1cea8c3-6560-4125-830c-407c0e4c3b61 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.309541 Oct 01 21:19:40.715185 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1515/5013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:40 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:40.924121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:40.926024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:40.948801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:40.951391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:40.952834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:40.957775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:40.959219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:40.960656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:41.267841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:41.284013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0558c556-8046-4a2c-a0e6-df536b92f170 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1313 microversion: 2.1 time: 0.363095 Oct 01 21:19:41.286937 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3499/5014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:40 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:41.740381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:41.741631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:41.752020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:41.753055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:41.753730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:41.755545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:41.756349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:41.757035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:41.873200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:41.914692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:42.311216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:42.312143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:42.325743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:42.330093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:42.330958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:42.331707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:42.335151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:42.337584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:42.339544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:43.006201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:43.014926 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-16168e57-b1c8-479a-b407-0df58abeded1 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1313 microversion: 2.1 time: 0.709795 Oct 01 21:19:43.015527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3500/5015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:42 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1313 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:43.157649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:43.174115 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9f56cecc-bd80-4d54-9bda-8e4841d2dccc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 1.439831 Oct 01 21:19:43.193292 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1516/5016] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:41 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:44.044418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:44.045059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:44.063077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:44.063621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:44.064076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:44.064862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:44.065352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:44.065796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:44.205424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:44.205985 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:44.227928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:44.229725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:44.230357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:44.231409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:44.232046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:44.232661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:44.607730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:44.641069 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-06f4462d-28c9-4461-b3ee-a5d5819e501e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1313 microversion: 2.1 time: 0.596845 Oct 01 21:19:44.666342 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3501/5017] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:44 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:44.868606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:44.883410 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9f154a24-efb1-465b-93d7-2522df6ae8b5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.682336 Oct 01 21:19:44.884393 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1517/5018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:44 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:45.315613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0379caf8-ed21-4e9a-ad23-bef737eaeaca req-96372b66-8aa1-40ad-80f5-f4e414d95f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8da90f-c891-41ed-8e01-153fef78d0b1", "name": "network-vif-plugged", "status": "completed", "tag": "39409b69-c57e-4249-84eb-531256929a5b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:45.338900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0379caf8-ed21-4e9a-ad23-bef737eaeaca req-96372b66-8aa1-40ad-80f5-f4e414d95f23 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:45.339582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0379caf8-ed21-4e9a-ad23-bef737eaeaca req-96372b66-8aa1-40ad-80f5-f4e414d95f23 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:45.340156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0379caf8-ed21-4e9a-ad23-bef737eaeaca req-96372b66-8aa1-40ad-80f5-f4e414d95f23 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:45.380919 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0379caf8-ed21-4e9a-ad23-bef737eaeaca req-96372b66-8aa1-40ad-80f5-f4e414d95f23 service nova] Creating event network-vif-plugged:39409b69-c57e-4249-84eb-531256929a5b for instance 0f8da90f-c891-41ed-8e01-153fef78d0b1 on nch1-master-1 Oct 01 21:19:45.403239 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0379caf8-ed21-4e9a-ad23-bef737eaeaca req-96372b66-8aa1-40ad-80f5-f4e414d95f23 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084049 Oct 01 21:19:45.404804 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3502/5019] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:45.678759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:45.679387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:45.695266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:45.707334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:45.708006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:45.710382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:45.710984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:45.714885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:45.785248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:45.912237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:45.913176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:45.952050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:45.957058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:45.959464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:45.968505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:45.969271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:45.984873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:46.167749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:46.176910 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-95eb193e-a5bc-47b8-b17c-38579ec753d5 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1313 microversion: 2.1 time: 0.502555 Oct 01 21:19:46.195124 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1518/5020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:45 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:46.304655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:46.316754 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8262a2c6-eb7d-4fdb-bd13-478e67d03973 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.411161 Oct 01 21:19:46.334758 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3503/5021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:45 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:19:47.207233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:47.212374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:47.235405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:47.236296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:47.238517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:47.239672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:47.242216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:47.242946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:47.342141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:47.342743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:47.358909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:47.359438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:47.359903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:47.360650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:47.361120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:47.367756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:47.511863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:47.529228 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ffe2dae4-fcc0-4b54-9d1e-1ff8d726ddb9 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1497 microversion: 2.1 time: 0.326933 Oct 01 21:19:47.544502 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1519/5022] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:47 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1497 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:47.794731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:47.809479 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48a5cfed-0d81-45ad-8878-5770f7f94582 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.472105 Oct 01 21:19:47.847180 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3504/5023] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:47 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:48.435938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:48.437108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:48.468483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:48.469774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:48.470246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:48.476632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:48.477145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:48.477602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:48.567058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:19:48.784278 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-668f861f-dcc9-46dd-9211-6a390fc86dab tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 204 len: 0 microversion: 2.1 time: 0.357647 Oct 01 21:19:48.790189 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1520/5024] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:19:48 2022] DELETE /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:19:48.796383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:48.798894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:48.809103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:48.809903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:48.811254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:48.812180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:48.812832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:48.813435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:48.853315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:48.854253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:48.864884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:48.867477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:48.868603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:19:48.869185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:48.870161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:48.871687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:48.872852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:49.204274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:49.214920 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b40dfeaf-b608-4cf3-809b-a8ab8e2d1bfa tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.372444 Oct 01 21:19:49.234869 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1521/5025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:48 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:49.260586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:49.282537 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-316368e6-a027-4293-a97b-b432fda7cba4 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1503 microversion: 2.1 time: 0.490517 Oct 01 21:19:49.283176 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3505/5026] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:48 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1503 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:50.246920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:50.248868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:50.264619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:50.265136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:50.265588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:50.277189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:50.277996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:50.278482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:50.310313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:50.311751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:50.331990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:50.334849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:50.337465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:50.342476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:50.344043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:50.346915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:50.505609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:50.527064 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d9edba49-bc43-4f11-92cd-699e891d667a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.285369 Oct 01 21:19:50.530073 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1522/5027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:50 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:51.347340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:51.371614 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-186ae8ca-1a0b-4f14-abbc-716a58e8ab27 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1503 microversion: 2.1 time: 1.063251 Oct 01 21:19:51.373540 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3506/5028] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:50 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1503 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:51.554475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:51.555138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:51.573043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:51.573549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:51.574000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:51.574850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:51.575314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:51.575763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:51.939892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:51.952469 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e6918d0e-0fd3-429f-8e2d-f2c5e781d894 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.401686 Oct 01 21:19:51.955971 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1523/5029] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:51 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:51.959427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b3df4ba8-721d-449a-91b5-8e1df1de315f req-b6bb592f-cec5-489c-8eb9-16a43094602b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8da90f-c891-41ed-8e01-153fef78d0b1", "name": "network-vif-deleted", "tag": "39409b69-c57e-4249-84eb-531256929a5b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:52.012820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b3df4ba8-721d-449a-91b5-8e1df1de315f req-b6bb592f-cec5-489c-8eb9-16a43094602b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:52.014116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b3df4ba8-721d-449a-91b5-8e1df1de315f req-b6bb592f-cec5-489c-8eb9-16a43094602b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:52.020657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b3df4ba8-721d-449a-91b5-8e1df1de315f req-b6bb592f-cec5-489c-8eb9-16a43094602b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:52.077958 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b3df4ba8-721d-449a-91b5-8e1df1de315f req-b6bb592f-cec5-489c-8eb9-16a43094602b service nova] Creating event network-vif-deleted:39409b69-c57e-4249-84eb-531256929a5b for instance 0f8da90f-c891-41ed-8e01-153fef78d0b1 on nch1-master-1 Oct 01 21:19:52.101702 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b3df4ba8-721d-449a-91b5-8e1df1de315f req-b6bb592f-cec5-489c-8eb9-16a43094602b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143836 Oct 01 21:19:52.102673 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3507/5030] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:19:52.396030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:52.396656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:52.416175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:52.416696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:52.417150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:52.417882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:52.418554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:52.419175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:52.504663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:52.515474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:52.518069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:52.521751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lazy-loading 'fault' on Instance uuid 0f8da90f-c891-41ed-8e01-153fef78d0b1 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:19:52.658464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdf7bba776f4b9c94f2653679505303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f12200ca5c649cd993499b7cb7e382f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:52.668300 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-914cab2c-8f4b-4b1a-a757-36ca902fd393 tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 200 len: 1303 microversion: 2.1 time: 0.276055 Oct 01 21:19:52.668914 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1524/5031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:52 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 1303 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:52.982142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:52.984037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:52.995274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:52.996132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:52.996788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:52.998827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:53.000129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:53.001039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:53.011016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c5b61e01-8745-4b18-b62f-adb5f96daefc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:53.013227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c5b61e01-8745-4b18-b62f-adb5f96daefc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:53.037593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b61e01-8745-4b18-b62f-adb5f96daefc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:53.038023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b61e01-8745-4b18-b62f-adb5f96daefc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:53.038473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b61e01-8745-4b18-b62f-adb5f96daefc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:53.049735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b61e01-8745-4b18-b62f-adb5f96daefc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:53.049922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b61e01-8745-4b18-b62f-adb5f96daefc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:53.050615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b61e01-8745-4b18-b62f-adb5f96daefc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:53.120517 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c5b61e01-8745-4b18-b62f-adb5f96daefc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8/action" status: 200 len: 24571 microversion: 2.1 time: 0.115121 Oct 01 21:19:53.121659 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1525/5032] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:19:53 2022] POST /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8/action => generated 24571 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 21:19:53.205564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:53.224062 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ca91093-5261-4634-a5c4-3dc9c33ef7eb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1681 microversion: 2.1 time: 0.247547 Oct 01 21:19:53.244334 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3508/5033] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:52 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:53.696739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:53.698937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] [instance: 0f8da90f-c891-41ed-8e01-153fef78d0b1] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:53.718566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:53.719468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:53.721241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:53.722795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:53.723515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:53.724179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:53.750663 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] HTTP exception thrown: Instance 0f8da90f-c891-41ed-8e01-153fef78d0b1 could not be found. Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Request method failure captured: Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 HTTP/1.1 Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK7JtPvL-DZiAQcPqrlvzLIH4NP_G1huIZqmdhiaISw4NKoaKRcoKiJb1vdSTTaAHH5ZdIA1uIXGJqFrRG6na2s96uVdtFccRKbnMS69eBA0uOcvxoMetTPXRyyQDXa1k0CaRYb_1iYAj0sbUGW3Rulv8NybGHAucgLRZ8oGPq8LAAM Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 5f12200ca5c649cd993499b7cb7e382f Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-VolumesActionsTest-1307507385 Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5f12200ca5c649cd993499b7cb7e382f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5f12200ca5c649cd993499b7cb7e382f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5f12200ca5c649cd993499b7cb7e382f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5f12200ca5c649cd993499b7cb7e382f"}]}] Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-VolumesActionsTest-1307507385 Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 5f12200ca5c649cd993499b7cb7e382f Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-VolumesActionsTest-1307507385 Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-VolumesActionsTest-1307507385-project Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: ecdf7bba776f4b9c94f2653679505303 Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-VolumesActionsTest-1307507385-project Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 0f8da90f-c891-41ed-8e01-153fef78d0b1 could not be found. Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '0f8da90f-c891-41ed-8e01-153fef78d0b1'} Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8da90f-c891-41ed-8e01-153fef78d0b1 could not be found. Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8da90f-c891-41ed-8e01-153fef78d0b1 could not be found. Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:19:53.753798 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:53.760678 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:19:53.760678 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:19:53.760678 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:19:53.760678 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:19:53.760678 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:19:53.760678 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8da90f-c891-41ed-8e01-153fef78d0b1 could not be found. Oct 01 21:19:53.760678 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:19:53.763483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] Returning 404 to user: Instance 0f8da90f-c891-41ed-8e01-153fef78d0b1 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:19:53.764487 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0c6d0017-10e9-4f58-ab72-be62db89f48e tempest-VolumesActionsTest-1307507385 tempest-VolumesActionsTest-1307507385-project] 10.222.0.17 "GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1" status: 404 len: 111 microversion: 2.1 time: 0.072055 Oct 01 21:19:53.765199 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1526/5034] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:53 2022] GET /compute/v2.1/servers/0f8da90f-c891-41ed-8e01-153fef78d0b1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:19:54.249724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:54.250512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:54.262799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:54.264546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:54.265499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:54.267895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:54.268489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:54.275374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:54.579178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:54.594551 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38423090-3494-4f8e-9b77-4a3383c383d9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.349056 Oct 01 21:19:54.595404 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3509/5035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:54 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:54.886119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:54.886801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:54.902266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:54.902799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:54.903422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:54.903953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:54.904419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:54.904851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:55.630260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:55.640060 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2fd521d8-da37-4fee-9429-91a2d7193c22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.758245 Oct 01 21:19:55.642197 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1527/5036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:54 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:57.680889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:57.682172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:57.690172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e2701b0f-47a8-4456-b461-4dbd4f1e121e req-58c79103-c55c-4b5c-961c-d6cf5262c229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "name": "network-vif-unplugged", "status": "completed", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:19:57.718183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:57.721143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:57.722006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:57.724249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:57.726332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:57.727485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:57.729174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e2701b0f-47a8-4456-b461-4dbd4f1e121e req-58c79103-c55c-4b5c-961c-d6cf5262c229 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:57.729779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e2701b0f-47a8-4456-b461-4dbd4f1e121e req-58c79103-c55c-4b5c-961c-d6cf5262c229 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:57.735786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e2701b0f-47a8-4456-b461-4dbd4f1e121e req-58c79103-c55c-4b5c-961c-d6cf5262c229 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:57.790167 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e2701b0f-47a8-4456-b461-4dbd4f1e121e req-58c79103-c55c-4b5c-961c-d6cf5262c229 service nova] Creating event network-vif-unplugged:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:19:57.800644 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e2701b0f-47a8-4456-b461-4dbd4f1e121e req-58c79103-c55c-4b5c-961c-d6cf5262c229 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150460 Oct 01 21:19:57.802561 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3510/5037] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:19:58.525480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:58.534447 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6df33261-48e1-4137-83ac-b0944196330a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.857807 Oct 01 21:19:58.543688 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1528/5038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:57 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:58.569149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:58.570157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:58.581425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:58.582198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:58.585503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:58.586580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:58.587268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:58.589273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:59.294788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:19:59.314555 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8d10fd8c-70e7-4c20-9f48-87922f18b055 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.749623 Oct 01 21:19:59.318590 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3511/5039] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:58 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:19:59.345405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:19:59.346092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:19:59.386439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:59.387040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:59.388078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:19:59.389099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:19:59.391623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:19:59.393350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:00.229029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:00.250787 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e828977f-70f0-4472-ad2f-2941332a9717 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.910436 Oct 01 21:20:00.253155 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1529/5040] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:19:59 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:00.278519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c41429e-42ae-431c-b3a7-edaee0ab121a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:00.284935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c41429e-42ae-431c-b3a7-edaee0ab121a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:00.305783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c41429e-42ae-431c-b3a7-edaee0ab121a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:00.306992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c41429e-42ae-431c-b3a7-edaee0ab121a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:00.307307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c41429e-42ae-431c-b3a7-edaee0ab121a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:00.308108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c41429e-42ae-431c-b3a7-edaee0ab121a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:00.308579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c41429e-42ae-431c-b3a7-edaee0ab121a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:00.309018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c41429e-42ae-431c-b3a7-edaee0ab121a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:00.445225 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c41429e-42ae-431c-b3a7-edaee0ab121a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.171095 Oct 01 21:20:00.450238 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3512/5041] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:20:00 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:20:00.455250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:00.456052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:00.480138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:00.480946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:00.481230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:00.484280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:00.488936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:00.489426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:01.101160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:01.116633 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-53aefb22-14b2-4c7e-b73e-2ce34f10e29f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1670 microversion: 2.1 time: 0.660904 Oct 01 21:20:01.117296 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1530/5042] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:00 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1670 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:01.521150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3294a5c0-902f-4560-a8e7-bd18fdd815a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:01.526274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3294a5c0-902f-4560-a8e7-bd18fdd815a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:01.527288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3294a5c0-902f-4560-a8e7-bd18fdd815a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:01.528478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3294a5c0-902f-4560-a8e7-bd18fdd815a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:01.533297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3294a5c0-902f-4560-a8e7-bd18fdd815a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:01.534632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3294a5c0-902f-4560-a8e7-bd18fdd815a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:01.538966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3294a5c0-902f-4560-a8e7-bd18fdd815a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:01.631928 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3294a5c0-902f-4560-a8e7-bd18fdd815a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.447532 Oct 01 21:20:01.634813 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3513/5043] 10.222.0.17 () {58 vars in 1185 bytes} [Sat Oct 1 21:20:01 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:01.960855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-342545230", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "599bdcec-00a4-4ef0-9271-58d0b41f1c11"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:02.009436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:02.115792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] validate_networks() for [('599bdcec-00a4-4ef0-9271-58d0b41f1c11', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:20:02.141600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:02.142341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:02.148940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:02.149438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:02.149935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:02.150691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:02.151156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:02.151594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:02.555018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:02.564818 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b0f6f34-a97e-4f44-b56c-a33281c821f6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1670 microversion: 2.1 time: 0.426983 Oct 01 21:20:02.574543 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3514/5044] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:02 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1670 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:03.406675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:20:03.407771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:20:03.408428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:20:03.408999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:20:03.409582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:20:03.458879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:03.467604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:03.468357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:03.469354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:03.472177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:03.472844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:03.498905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Getting quotas for project 9441e87384c5410bb11278bead2a3761. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:20:03.521380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Getting quotas for user bbe6040ce96544c0a301331101db7267 and project 9441e87384c5410bb11278bead2a3761. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:20:03.540912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:20:03.543731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:20:03.601685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:03.604977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:03.621172 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b43b92e7-8b3f-49e5-a171-9bcc260d437b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.665526 Oct 01 21:20:03.622125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:03.622968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:03.623983 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1531/5045] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:20:03.625452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:03.627550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:03.628319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:03.628879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:03.634901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8cf39897-9a6b-4c83-a29a-8147686dccd0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:03.635537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8cf39897-9a6b-4c83-a29a-8147686dccd0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:03.761616 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8cf39897-9a6b-4c83-a29a-8147686dccd0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1328 microversion: 2.1 time: 0.130305 Oct 01 21:20:03.762742 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1532/5046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:03 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:04.063407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:04.063407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:04.078028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:04.117575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:04.126638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:04.126898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7776a3e0-6fb5-4b8d-83f5-466fb519375e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.529887 Oct 01 21:20:04.127297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:04.141147 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3515/5047] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:03 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:04.145165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:04.145686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:04.146649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:04.158930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2d419a6-8576-4e2b-9abc-6e1c5e479c8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:04.161330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2d419a6-8576-4e2b-9abc-6e1c5e479c8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:04.179498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=46 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:04.195870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d419a6-8576-4e2b-9abc-6e1c5e479c8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:04.196435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d419a6-8576-4e2b-9abc-6e1c5e479c8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:04.202072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d419a6-8576-4e2b-9abc-6e1c5e479c8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:04.205112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d419a6-8576-4e2b-9abc-6e1c5e479c8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:04.209338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d419a6-8576-4e2b-9abc-6e1c5e479c8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:04.209830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2d419a6-8576-4e2b-9abc-6e1c5e479c8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:04.300680 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2d419a6-8576-4e2b-9abc-6e1c5e479c8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 200 len: 322 microversion: 2.1 time: 0.147290 Oct 01 21:20:04.302032 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3516/5048] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:20:04 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:04.324659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:04.325815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:04.360541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:04.361110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:04.361630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:04.362481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:04.363028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:04.364252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:04.708716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:04.754829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-badafb87-e884-43e7-867a-5a22aa5a5780 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.442846 Oct 01 21:20:04.756798 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3517/5049] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:04 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:04.785184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:04.786184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:04.795280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:04.799236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:04.800493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:04.801223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:04.803792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:04.804532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:04.806653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:04.812202 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-785f6be1-cf6d-4b20-88bc-a739cff8e208 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1683 microversion: 2.1 time: 0.756391 Oct 01 21:20:04.817668 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1533/5050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:04 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1683 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:04.822968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bf6493e5-bab3-4a42-a5d4-6ab30b772acd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:04.823598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bf6493e5-bab3-4a42-a5d4-6ab30b772acd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:04.958580 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bf6493e5-bab3-4a42-a5d4-6ab30b772acd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1328 microversion: 2.1 time: 0.139725 Oct 01 21:20:04.959188 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1534/5051] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:04 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:05.106296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ac7c655b-9c21-420c-b614-1ba1a2c9a5e3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:05.109309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ac7c655b-9c21-420c-b614-1ba1a2c9a5e3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:05.132295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac7c655b-9c21-420c-b614-1ba1a2c9a5e3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:05.132799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac7c655b-9c21-420c-b614-1ba1a2c9a5e3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:05.133244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac7c655b-9c21-420c-b614-1ba1a2c9a5e3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:05.133975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac7c655b-9c21-420c-b614-1ba1a2c9a5e3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:05.134447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac7c655b-9c21-420c-b614-1ba1a2c9a5e3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:05.134906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac7c655b-9c21-420c-b614-1ba1a2c9a5e3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:05.204184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:05.215134 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-af1c432d-097c-4c8e-92b5-904a6b0cad51 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.434096 Oct 01 21:20:05.216090 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3518/5052] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:04 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:05.244539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:05.245571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:05.254092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:05.254979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:05.255655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:05.256609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:05.257543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:05.258190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:05.289417 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ac7c655b-9c21-420c-b614-1ba1a2c9a5e3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8/action" status: 200 len: 32646 microversion: 2.1 time: 0.188793 Oct 01 21:20:05.298712 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1535/5053] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:20:05 2022] POST /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8/action => generated 32646 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:20:05.459536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-474663a8-809b-4c6f-8db3-e10313649674 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:05.460276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-474663a8-809b-4c6f-8db3-e10313649674 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:05.478483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-474663a8-809b-4c6f-8db3-e10313649674 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:05.479669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-474663a8-809b-4c6f-8db3-e10313649674 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:05.482388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-474663a8-809b-4c6f-8db3-e10313649674 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:05.483628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-474663a8-809b-4c6f-8db3-e10313649674 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:05.484271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-474663a8-809b-4c6f-8db3-e10313649674 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:05.485233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-474663a8-809b-4c6f-8db3-e10313649674 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:05.563426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:05.575466 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b5f2ea11-b4d3-4a70-96a0-b9e43a8255a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.336901 Oct 01 21:20:05.578539 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3519/5054] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:05 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:05.601358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:05.603543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:05.637948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:05.639303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:05.639774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:05.640493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:05.641478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:05.642138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:05.912348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:05.936030 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cec8ccf1-be29-46a3-b47e-dd0d503db1f8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.341006 Oct 01 21:20:05.951155 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3520/5055] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:05 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:05.982266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-105de766-8b3d-4513-bf66-e5fb2517593c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:05.986056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-105de766-8b3d-4513-bf66-e5fb2517593c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:06.014957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-105de766-8b3d-4513-bf66-e5fb2517593c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:06.015857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-105de766-8b3d-4513-bf66-e5fb2517593c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:06.025812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-105de766-8b3d-4513-bf66-e5fb2517593c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:06.026851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-105de766-8b3d-4513-bf66-e5fb2517593c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:06.027517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-105de766-8b3d-4513-bf66-e5fb2517593c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:06.028392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-105de766-8b3d-4513-bf66-e5fb2517593c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:06.255686 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-474663a8-809b-4c6f-8db3-e10313649674 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1834 microversion: 2.1 time: 0.815638 Oct 01 21:20:06.295626 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1536/5056] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:05 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1834 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:06.308770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:06.331024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:06.356860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:06.357421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:06.357880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:06.358649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:06.366769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:06.367409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:06.383218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:06.459987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lazy-loading 'flavor' on Instance uuid 6f815d9a-7897-444e-bdff-9c414aa8eec8 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:20:06.508346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Going to try to live migrate instance to another host {{(pid=140437) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 01 21:20:06.519457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-105de766-8b3d-4513-bf66-e5fb2517593c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1415 microversion: 2.1 time: 0.538123 Oct 01 21:20:06.522596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3521/5057] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:05 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1415 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:06.539052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-178451695", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "494a382d-1e31-4806-a5de-71784de0fc03"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:06.713217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] validate_networks() for [('494a382d-1e31-4806-a5de-71784de0fc03', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:20:08.115173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:20:08.116427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:20:08.117577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:20:08.118966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:20:08.119913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:20:08.139485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:08.140195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:08.141162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:08.142276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:08.163422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:08.170601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:08.208583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:20:08.228704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for user 6ac020dc323042c48ccce2a8826bc6be and project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:20:08.254921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:20:08.257710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:20:08.455385 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [7905babf-44e8-4c08-be1b-d8329aafde86] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 21:20:09.475921 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [7905babf-44e8-4c08-be1b-d8329aafde86] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 43924. Oct 01 21:20:09.483094 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0df5d1e5-9ee5-4fa0-aa60-fedb24605f02 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.956897 Oct 01 21:20:09.483806 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3522/5058] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:20:09.489281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2582944-069a-4c6e-82cc-53282c15c013 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:09.497702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2582944-069a-4c6e-82cc-53282c15c013 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:09.522979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2582944-069a-4c6e-82cc-53282c15c013 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:09.523625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2582944-069a-4c6e-82cc-53282c15c013 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:09.526900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2582944-069a-4c6e-82cc-53282c15c013 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:09.530226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2582944-069a-4c6e-82cc-53282c15c013 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:09.530769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2582944-069a-4c6e-82cc-53282c15c013 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:09.535554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2582944-069a-4c6e-82cc-53282c15c013 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:09.975470 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2582944-069a-4c6e-82cc-53282c15c013 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1463 microversion: 2.1 time: 0.490322 Oct 01 21:20:09.979476 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3523/5059] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:09 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1463 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:10.003443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-af8e1853-c6ad-4177-a664-02ab3493791e req-ed6e7f95-d875-4993-9470-59e765a9b316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00279ce5-fd83-43e8-adc3-e229ba14f4fc", "tag": "cab374f7-e459-49da-b807-ec2eee6fba7e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:10.021416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-af8e1853-c6ad-4177-a664-02ab3493791e req-ed6e7f95-d875-4993-9470-59e765a9b316 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:10.022169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-af8e1853-c6ad-4177-a664-02ab3493791e req-ed6e7f95-d875-4993-9470-59e765a9b316 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:10.022819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-af8e1853-c6ad-4177-a664-02ab3493791e req-ed6e7f95-d875-4993-9470-59e765a9b316 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:10.042437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:10.046576 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-af8e1853-c6ad-4177-a664-02ab3493791e req-ed6e7f95-d875-4993-9470-59e765a9b316 service nova] Creating event network-changed:cab374f7-e459-49da-b807-ec2eee6fba7e for instance 00279ce5-fd83-43e8-adc3-e229ba14f4fc on nch1-master-1 Oct 01 21:20:10.065517 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-af8e1853-c6ad-4177-a664-02ab3493791e req-ed6e7f95-d875-4993-9470-59e765a9b316 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076795 Oct 01 21:20:10.067321 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3524/5060] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:10.075237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9e0bcbcc-6573-47de-82cb-db424765fc22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:10.077678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9e0bcbcc-6573-47de-82cb-db424765fc22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:10.183124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9e0bcbcc-6573-47de-82cb-db424765fc22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:10.195474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9e0bcbcc-6573-47de-82cb-db424765fc22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1214 microversion: 2.1 time: 0.126536 Oct 01 21:20:10.198866 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3525/5061] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:10 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:10.888516 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1a246f06-e300-4d66-ab16-ae160c178e34 tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8/action" status: 202 len: 0 microversion: 2.1 time: 4.590780 Oct 01 21:20:10.902801 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1537/5062] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:20:06 2022] POST /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8/action => generated 0 bytes in 4606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:20:10.909779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:10.911142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:10.968366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:10.973272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:10.973874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:10.974763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:10.977843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:10.978632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:11.003150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-363587ea-1510-43dd-b395-03d78af1f464 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:11.004245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-363587ea-1510-43dd-b395-03d78af1f464 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:11.024731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-363587ea-1510-43dd-b395-03d78af1f464 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:11.025237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-363587ea-1510-43dd-b395-03d78af1f464 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:11.025676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-363587ea-1510-43dd-b395-03d78af1f464 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:11.026443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-363587ea-1510-43dd-b395-03d78af1f464 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:11.026938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-363587ea-1510-43dd-b395-03d78af1f464 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:11.050829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-363587ea-1510-43dd-b395-03d78af1f464 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:11.463371 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-363587ea-1510-43dd-b395-03d78af1f464 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1463 microversion: 2.1 time: 0.463967 Oct 01 21:20:11.484660 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1538/5063] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:10 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1463 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:11.512182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:11.513117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:11.542991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:11.545292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:11.549205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:11.551360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:11.557069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:11.557810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:11.648617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:11.667400 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9b0bc72-46c7-4323-8113-729e4c7a83ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.765989 Oct 01 21:20:11.672080 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3526/5064] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:10 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:11.708653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:11.732609 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fb0c8d3d-79ac-4126-89f6-487c50255772 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1266 microversion: 2.1 time: 0.246019 Oct 01 21:20:11.762719 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1539/5065] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:11 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:12.490821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-151caf19-109a-40e3-857b-338e790bb200 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:12.491562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-151caf19-109a-40e3-857b-338e790bb200 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:12.507787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151caf19-109a-40e3-857b-338e790bb200 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:12.509118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151caf19-109a-40e3-857b-338e790bb200 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:12.515683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151caf19-109a-40e3-857b-338e790bb200 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:12.525232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151caf19-109a-40e3-857b-338e790bb200 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:12.526081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151caf19-109a-40e3-857b-338e790bb200 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:12.528813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151caf19-109a-40e3-857b-338e790bb200 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:12.700246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:12.700875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:12.712774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:12.713517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:12.716646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:12.718734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:12.719600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:12.722009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:12.997880 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-151caf19-109a-40e3-857b-338e790bb200 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1463 microversion: 2.1 time: 0.512356 Oct 01 21:20:13.001256 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3527/5066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:12 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1463 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:13.014197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:13.015809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:13.038052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:13.045983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:13.049222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:13.051621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:13.054537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:13.059540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:13.289075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:13.312559 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-27f10f95-f8a4-4994-b625-df3fb09d6db7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1272 microversion: 2.1 time: 0.309773 Oct 01 21:20:13.326384 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3528/5067] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:13 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:13.337814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:13.349017 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a8978c75-320d-401f-8099-91a5e54df0e5 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.654170 Oct 01 21:20:13.349886 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1540/5068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:12 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:13.945318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-f51a74ca-6d72-4106-bb46-8316401b0d3e req-527f6fb4-b75f-40b4-a17e-162e87d25e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f815d9a-7897-444e-bdff-9c414aa8eec8", "name": "network-vif-unplugged", "status": "completed", "tag": "cc6a0ac1-f20f-4c7e-a82a-168a222de70d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:13.977991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f51a74ca-6d72-4106-bb46-8316401b0d3e req-527f6fb4-b75f-40b4-a17e-162e87d25e53 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:13.981326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f51a74ca-6d72-4106-bb46-8316401b0d3e req-527f6fb4-b75f-40b4-a17e-162e87d25e53 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:13.981783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f51a74ca-6d72-4106-bb46-8316401b0d3e req-527f6fb4-b75f-40b4-a17e-162e87d25e53 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:14.025717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-216da583-ed0c-4f9f-80b5-7839bbd66490 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:14.027131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-216da583-ed0c-4f9f-80b5-7839bbd66490 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:14.041354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:14.046907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-216da583-ed0c-4f9f-80b5-7839bbd66490 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:14.051982 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-f51a74ca-6d72-4106-bb46-8316401b0d3e req-527f6fb4-b75f-40b4-a17e-162e87d25e53 service nova] Creating event network-vif-unplugged:cc6a0ac1-f20f-4c7e-a82a-168a222de70d for instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 on nch2-master-1 Oct 01 21:20:14.066770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-216da583-ed0c-4f9f-80b5-7839bbd66490 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:14.067357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-216da583-ed0c-4f9f-80b5-7839bbd66490 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:14.068379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-216da583-ed0c-4f9f-80b5-7839bbd66490 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:14.069301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-216da583-ed0c-4f9f-80b5-7839bbd66490 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:14.072935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-216da583-ed0c-4f9f-80b5-7839bbd66490 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:14.080948 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-f51a74ca-6d72-4106-bb46-8316401b0d3e req-527f6fb4-b75f-40b4-a17e-162e87d25e53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131644 Oct 01 21:20:14.085224 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3529/5069] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:14.348696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:14.352100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:14.367170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:14.369716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:14.370948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:14.381494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:14.382022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:14.382481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:14.833563 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-216da583-ed0c-4f9f-80b5-7839bbd66490 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1463 microversion: 2.1 time: 0.808658 Oct 01 21:20:14.851598 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1541/5070] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:14 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1463 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:14.859045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:14.867736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:14.908175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:14.915130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:14.918268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:14.921938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:14.926421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:14.929295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:14.955840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=10 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:15.338799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:15.354522 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-80ee5b36-0a27-4c27-bec7-6a73584f4037 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.501317 Oct 01 21:20:15.357361 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1542/5071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:14 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:15.466741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:15.480910 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc006bd8-0ae7-4008-8951-cbfa9be06b78 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 1.138775 Oct 01 21:20:15.482017 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3530/5072] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:14 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:15.861020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-94e6662c-b20d-4160-870c-c5ebf87d204a tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:15.861940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-94e6662c-b20d-4160-870c-c5ebf87d204a tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:15.902373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94e6662c-b20d-4160-870c-c5ebf87d204a tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:15.903875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94e6662c-b20d-4160-870c-c5ebf87d204a tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:15.904342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94e6662c-b20d-4160-870c-c5ebf87d204a tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:15.908622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94e6662c-b20d-4160-870c-c5ebf87d204a tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:15.910580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94e6662c-b20d-4160-870c-c5ebf87d204a tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:15.911126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94e6662c-b20d-4160-870c-c5ebf87d204a tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:16.080751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-46cbcb53-9b7e-4ebe-ad8f-324034031aa5 req-2ecd3cce-7fe3-400f-a68e-8174fd4f14c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00279ce5-fd83-43e8-adc3-e229ba14f4fc", "name": "network-vif-plugged", "status": "completed", "tag": "cab374f7-e459-49da-b807-ec2eee6fba7e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:16.104662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-46cbcb53-9b7e-4ebe-ad8f-324034031aa5 req-2ecd3cce-7fe3-400f-a68e-8174fd4f14c9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:16.106738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-46cbcb53-9b7e-4ebe-ad8f-324034031aa5 req-2ecd3cce-7fe3-400f-a68e-8174fd4f14c9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:16.107213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-46cbcb53-9b7e-4ebe-ad8f-324034031aa5 req-2ecd3cce-7fe3-400f-a68e-8174fd4f14c9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:16.142365 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-46cbcb53-9b7e-4ebe-ad8f-324034031aa5 req-2ecd3cce-7fe3-400f-a68e-8174fd4f14c9 service nova] Creating event network-vif-plugged:cab374f7-e459-49da-b807-ec2eee6fba7e for instance 00279ce5-fd83-43e8-adc3-e229ba14f4fc on nch1-master-1 Oct 01 21:20:16.157572 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-46cbcb53-9b7e-4ebe-ad8f-324034031aa5 req-2ecd3cce-7fe3-400f-a68e-8174fd4f14c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286550 Oct 01 21:20:16.160444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3531/5073] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:16.174661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cc4a6376-106c-4d1a-b717-98a7bae2ec8b req-dd24d3f2-3a81-4b2f-961b-62108fa76bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f815d9a-7897-444e-bdff-9c414aa8eec8", "tag": "cc6a0ac1-f20f-4c7e-a82a-168a222de70d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:16.187546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cc4a6376-106c-4d1a-b717-98a7bae2ec8b req-dd24d3f2-3a81-4b2f-961b-62108fa76bfb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:16.188544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cc4a6376-106c-4d1a-b717-98a7bae2ec8b req-dd24d3f2-3a81-4b2f-961b-62108fa76bfb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:16.189424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cc4a6376-106c-4d1a-b717-98a7bae2ec8b req-dd24d3f2-3a81-4b2f-961b-62108fa76bfb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:16.206394 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cc4a6376-106c-4d1a-b717-98a7bae2ec8b req-dd24d3f2-3a81-4b2f-961b-62108fa76bfb service nova] Creating event network-changed:cc6a0ac1-f20f-4c7e-a82a-168a222de70d for instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 on nch2-master-1 Oct 01 21:20:16.214441 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cc4a6376-106c-4d1a-b717-98a7bae2ec8b req-dd24d3f2-3a81-4b2f-961b-62108fa76bfb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048576 Oct 01 21:20:16.215793 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3532/5074] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:20:16.381664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:16.384131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:16.442352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:16.447805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:16.449346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:16.453835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:16.457477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:16.458482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:16.825439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:16.841822 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35e94385-c42e-486f-abd3-a89edad040cf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.465014 Oct 01 21:20:16.842597 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3533/5075] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:16 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:16.860274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:16.863639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:16.906882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:16.919448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:16.921731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:16.922949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:16.923610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:16.924382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:17.584602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:17.600832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c89e556-29c5-498c-8ca9-9d8aac0828a2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 0.756911 Oct 01 21:20:17.604773 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3534/5076] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:16 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:17.626081 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-94e6662c-b20d-4160-870c-c5ebf87d204a tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1463 microversion: 2.1 time: 1.761788 Oct 01 21:20:17.627072 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1543/5077] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:15 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1463 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:17.869157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:17.869791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:17.885906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:17.886427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:17.892674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:17.893942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:17.894620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:17.895226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:18.198006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:18.254272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:18.264676 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-231bcfde-09b5-46f6-b14e-09eaa49dead6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.400368 Oct 01 21:20:18.290868 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3535/5078] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:17 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:18.629311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:18.630253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:18.631963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b1a8087b-3eea-4cb0-bb76-d2d328a18321 req-2c7db404-3da1-4d29-9a55-bf2338abfe19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17738737-ba0e-4e7b-8626-e66b0a6d0fab", "tag": "35bdad89-071d-435a-bb40-b0d7a3777771"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:18.639260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:18.639766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:18.640213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:18.640936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:18.641400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:18.641832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:18.646670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b1a8087b-3eea-4cb0-bb76-d2d328a18321 req-2c7db404-3da1-4d29-9a55-bf2338abfe19 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:18.647164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b1a8087b-3eea-4cb0-bb76-d2d328a18321 req-2c7db404-3da1-4d29-9a55-bf2338abfe19 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:18.647662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b1a8087b-3eea-4cb0-bb76-d2d328a18321 req-2c7db404-3da1-4d29-9a55-bf2338abfe19 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:18.667761 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b1a8087b-3eea-4cb0-bb76-d2d328a18321 req-2c7db404-3da1-4d29-9a55-bf2338abfe19 service nova] Creating event network-changed:35bdad89-071d-435a-bb40-b0d7a3777771 for instance 17738737-ba0e-4e7b-8626-e66b0a6d0fab on nch2-master-1 Oct 01 21:20:18.674333 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b1a8087b-3eea-4cb0-bb76-d2d328a18321 req-2c7db404-3da1-4d29-9a55-bf2338abfe19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289181 Oct 01 21:20:18.675450 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1544/5079] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:18.681077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2c2ffd65-7764-4497-a823-0b0873ccf1a7 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:18.681786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2c2ffd65-7764-4497-a823-0b0873ccf1a7 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:18.689115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c2ffd65-7764-4497-a823-0b0873ccf1a7 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:18.689606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c2ffd65-7764-4497-a823-0b0873ccf1a7 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:18.690227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c2ffd65-7764-4497-a823-0b0873ccf1a7 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:18.691158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c2ffd65-7764-4497-a823-0b0873ccf1a7 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:18.691774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c2ffd65-7764-4497-a823-0b0873ccf1a7 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:18.692627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c2ffd65-7764-4497-a823-0b0873ccf1a7 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:19.009194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:19.019048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3e26424a-c55f-40be-80cf-6a2baa5741e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 0.394068 Oct 01 21:20:19.049112 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3536/5080] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:18 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:19.298852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:19.299300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:19.337847 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2c2ffd65-7764-4497-a823-0b0873ccf1a7 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1649 microversion: 2.1 time: 0.661154 Oct 01 21:20:19.338436 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1545/5081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:18 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1649 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:19.339349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:19.343139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:19.346394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:19.347618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:19.353192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:19.353893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:19.360656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fbf43895-3e7d-4179-b4a9-db1124bcfede tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:19.361566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fbf43895-3e7d-4179-b4a9-db1124bcfede tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:19.392731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbf43895-3e7d-4179-b4a9-db1124bcfede tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:19.395132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbf43895-3e7d-4179-b4a9-db1124bcfede tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:19.398028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbf43895-3e7d-4179-b4a9-db1124bcfede tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:19.402775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbf43895-3e7d-4179-b4a9-db1124bcfede tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:19.406104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbf43895-3e7d-4179-b4a9-db1124bcfede tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:19.407475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fbf43895-3e7d-4179-b4a9-db1124bcfede tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:19.699151 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fbf43895-3e7d-4179-b4a9-db1124bcfede tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1649 microversion: 2.1 time: 0.341726 Oct 01 21:20:19.701109 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1546/5082] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:19 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1649 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:19.715514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:19.726792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd83f253-5028-4a19-ad08-36666a172e05 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.433228 Oct 01 21:20:19.732089 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3537/5083] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:19 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:19.736214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4a66bb54-d3ff-4c73-a63e-151feb480c1d tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:19.737211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4a66bb54-d3ff-4c73-a63e-151feb480c1d tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:19.748816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a66bb54-d3ff-4c73-a63e-151feb480c1d tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:19.749768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a66bb54-d3ff-4c73-a63e-151feb480c1d tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:19.750354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a66bb54-d3ff-4c73-a63e-151feb480c1d tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:19.757211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a66bb54-d3ff-4c73-a63e-151feb480c1d tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:19.760999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a66bb54-d3ff-4c73-a63e-151feb480c1d tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:19.762053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a66bb54-d3ff-4c73-a63e-151feb480c1d tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:20.054066 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4a66bb54-d3ff-4c73-a63e-151feb480c1d tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1649 microversion: 2.1 time: 0.324168 Oct 01 21:20:20.060633 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1547/5084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:19 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1649 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:20.072789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:20.074178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:20.090075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:20.095408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:20.096114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:20.097056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:20.097530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:20.097973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:20.136340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-748678180", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "599bdcec-00a4-4ef0-9271-58d0b41f1c11"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:20.187431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:20.275135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] validate_networks() for [('599bdcec-00a4-4ef0-9271-58d0b41f1c11', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:20:20.757986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:20.777243 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca4cd248-0f04-45f5-be9d-52ab916d44c7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 0.700630 Oct 01 21:20:20.780427 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3538/5085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:20 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:20.818722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:20.819592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:20.838935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:20.840133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:20.840803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:20.841743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:20.845129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:20.845795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:21.312110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:20:21.312608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:20:21.313165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:20:21.313597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:20:21.314023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:20:21.335947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:21.344459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:21.345095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:21.358558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:21.359571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:21.360810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:21.438135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Getting quotas for project 9441e87384c5410bb11278bead2a3761. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:20:21.446277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Getting quotas for user bbe6040ce96544c0a301331101db7267 and project 9441e87384c5410bb11278bead2a3761. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:20:21.465237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:20:21.468098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:20:21.510235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:21.533588 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-35c01450-aacc-4888-a3fe-fb78401bd286 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.734224 Oct 01 21:20:21.539128 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3539/5086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:20 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:21.577102 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1e7ae56f-cdbe-481b-b72e-9d52539a28bd tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444705 Oct 01 21:20:21.579136 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1548/5087] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:20:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:20:21.591143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6bda5137-69cd-4d5b-9be2-4b32913dd522 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:21.592197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6bda5137-69cd-4d5b-9be2-4b32913dd522 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:21.762913 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6bda5137-69cd-4d5b-9be2-4b32913dd522 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1328 microversion: 2.1 time: 0.176488 Oct 01 21:20:21.764080 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3540/5088] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:21 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1328 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:21.805858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:21.807016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:21.829606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:21.830321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:21.832174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:21.834247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:21.834773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:21.839340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:22.474689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:22.484900 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-502b74b3-83c9-47d2-8429-1ff902c12910 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 0.683344 Oct 01 21:20:22.491142 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1549/5089] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:21 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:22.565585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:22.567154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:22.580882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:22.582409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:22.583235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:22.584355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:22.585166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:22.585973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:22.786933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e3997160-594f-4604-8c4b-0e2416c4f3aa tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:22.787987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e3997160-594f-4604-8c4b-0e2416c4f3aa tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:22.806370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3997160-594f-4604-8c4b-0e2416c4f3aa tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:22.807433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3997160-594f-4604-8c4b-0e2416c4f3aa tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:22.810320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3997160-594f-4604-8c4b-0e2416c4f3aa tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:22.811435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3997160-594f-4604-8c4b-0e2416c4f3aa tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:22.812150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3997160-594f-4604-8c4b-0e2416c4f3aa tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:22.814457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3997160-594f-4604-8c4b-0e2416c4f3aa tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:22.978579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:22.991951 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1fc31f0d-96db-4d10-b082-639b60fa03f1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.433235 Oct 01 21:20:22.994597 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3541/5090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:22 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:23.197006 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e3997160-594f-4604-8c4b-0e2416c4f3aa tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1345 microversion: 2.1 time: 0.414903 Oct 01 21:20:23.201924 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1550/5091] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:22 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1345 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:23.519641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:23.521542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:23.532360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:23.535438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:23.535922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:23.538903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:23.543219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:23.544513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:23.820242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:23.835167 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94243ae0-5c21-4759-918f-54bb1608fa80 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 0.325059 Oct 01 21:20:23.837359 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3542/5092] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:23 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:24.023186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:24.024355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:24.049256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:24.049784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:24.050229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:24.051810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:24.052462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:24.053098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:24.227204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b18c5913-5b1a-4d86-a6ef-be91bf65784c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:24.227748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b18c5913-5b1a-4d86-a6ef-be91bf65784c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:24.237265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b18c5913-5b1a-4d86-a6ef-be91bf65784c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:24.239118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b18c5913-5b1a-4d86-a6ef-be91bf65784c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:24.239762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b18c5913-5b1a-4d86-a6ef-be91bf65784c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:24.244139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b18c5913-5b1a-4d86-a6ef-be91bf65784c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:24.244888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b18c5913-5b1a-4d86-a6ef-be91bf65784c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:24.247072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b18c5913-5b1a-4d86-a6ef-be91bf65784c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:24.401531 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b18c5913-5b1a-4d86-a6ef-be91bf65784c tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1421 microversion: 2.1 time: 0.178055 Oct 01 21:20:24.406164 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3543/5093] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:24 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1421 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:24.564265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:24.589888 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-20dbcbf9-ac8c-45ee-b75a-988d5d4d59bf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.569592 Oct 01 21:20:24.590788 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1551/5094] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:24 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:24.865291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:24.867781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:24.874585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:24.875086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:24.875581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:24.876260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:24.876731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:24.877167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:25.261757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:25.280822 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-946213bc-991a-44b7-bb2e-21652e21bafe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 0.415829 Oct 01 21:20:25.281319 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3544/5095] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:24 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:25.429343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9085854c-849f-4583-b115-cfcd952a52f5 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:25.430970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9085854c-849f-4583-b115-cfcd952a52f5 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:25.441187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9085854c-849f-4583-b115-cfcd952a52f5 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:25.446848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9085854c-849f-4583-b115-cfcd952a52f5 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:25.447621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9085854c-849f-4583-b115-cfcd952a52f5 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:25.448638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9085854c-849f-4583-b115-cfcd952a52f5 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:25.449505 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9085854c-849f-4583-b115-cfcd952a52f5 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:25.450054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9085854c-849f-4583-b115-cfcd952a52f5 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:25.583105 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9085854c-849f-4583-b115-cfcd952a52f5 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1421 microversion: 2.1 time: 0.157638 Oct 01 21:20:25.585441 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1552/5096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:25 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1421 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:25.614549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:25.615307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:25.626801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:25.627359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:25.629067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:25.632168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:25.633474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:25.636321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:25.708115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:26.307490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:26.308451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:26.323162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:26.324843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:26.325521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:26.327140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:26.329557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:26.331028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:26.371033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:26.460278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:26.474578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5de4655f-37be-4292-867c-cf2b19407bdb tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1693 microversion: 2.1 time: 0.864568 Oct 01 21:20:26.503870 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3545/5097] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:25 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1693 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:26.615953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5b9e995e-5c12-42bd-a6e5-2746ae240b42 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:26.616962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5b9e995e-5c12-42bd-a6e5-2746ae240b42 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:26.627038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b9e995e-5c12-42bd-a6e5-2746ae240b42 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:26.631409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b9e995e-5c12-42bd-a6e5-2746ae240b42 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:26.632986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b9e995e-5c12-42bd-a6e5-2746ae240b42 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:26.634129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b9e995e-5c12-42bd-a6e5-2746ae240b42 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:26.635407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b9e995e-5c12-42bd-a6e5-2746ae240b42 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:26.638322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5b9e995e-5c12-42bd-a6e5-2746ae240b42 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:26.948417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:26.959855 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-684330c2-7d10-48cc-a3d3-10b888a40efd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 0.658645 Oct 01 21:20:26.963239 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1553/5098] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:26 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:27.362318 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5b9e995e-5c12-42bd-a6e5-2746ae240b42 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1463 microversion: 2.1 time: 0.752241 Oct 01 21:20:27.365614 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3546/5099] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:26 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1463 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:27.512450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:27.513076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:27.535021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:27.550631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:27.551676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:27.552700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:27.553382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:27.554039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:27.736120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-79265fe5-25db-4194-ac83-198310050df3 req-eb791db8-c4da-4af1-bfa2-b107e134a5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17738737-ba0e-4e7b-8626-e66b0a6d0fab", "name": "network-vif-plugged", "status": "completed", "tag": "35bdad89-071d-435a-bb40-b0d7a3777771"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:27.754979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-79265fe5-25db-4194-ac83-198310050df3 req-eb791db8-c4da-4af1-bfa2-b107e134a5fa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:27.767418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-79265fe5-25db-4194-ac83-198310050df3 req-eb791db8-c4da-4af1-bfa2-b107e134a5fa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:27.769015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-79265fe5-25db-4194-ac83-198310050df3 req-eb791db8-c4da-4af1-bfa2-b107e134a5fa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:27.817220 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-79265fe5-25db-4194-ac83-198310050df3 req-eb791db8-c4da-4af1-bfa2-b107e134a5fa service nova] Creating event network-vif-plugged:35bdad89-071d-435a-bb40-b0d7a3777771 for instance 17738737-ba0e-4e7b-8626-e66b0a6d0fab on nch2-master-1 Oct 01 21:20:27.832749 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-79265fe5-25db-4194-ac83-198310050df3 req-eb791db8-c4da-4af1-bfa2-b107e134a5fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102553 Oct 01 21:20:27.836293 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3547/5100] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:20:27.987504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:27.989287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:28.009432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:28.010349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:28.011080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:28.014288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:28.017820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:28.019118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:28.476089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:28.487104 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e4f7292a-f221-4eb0-866f-4b2f552e0afa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1683 microversion: 2.1 time: 0.979151 Oct 01 21:20:28.493461 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1554/5101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:27 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1683 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:28.502152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6563b4e2-bd29-44a9-a4ab-0e0c70a0b7a3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:28.506679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:28.534728 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-28d4669c-cf30-45bd-b46e-14eeba85315e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 0.548275 Oct 01 21:20:28.535517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6563b4e2-bd29-44a9-a4ab-0e0c70a0b7a3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:28.545590 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3548/5102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:27 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:28.586010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6563b4e2-bd29-44a9-a4ab-0e0c70a0b7a3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:28.586818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6563b4e2-bd29-44a9-a4ab-0e0c70a0b7a3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:28.587675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6563b4e2-bd29-44a9-a4ab-0e0c70a0b7a3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:28.588117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba687457-e100-4d45-b198-8a84089f075d tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:28.588753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba687457-e100-4d45-b198-8a84089f075d tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:28.589944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6563b4e2-bd29-44a9-a4ab-0e0c70a0b7a3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:28.590696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6563b4e2-bd29-44a9-a4ab-0e0c70a0b7a3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:28.591449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6563b4e2-bd29-44a9-a4ab-0e0c70a0b7a3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:28.612316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba687457-e100-4d45-b198-8a84089f075d tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:28.612833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba687457-e100-4d45-b198-8a84089f075d tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:28.613280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba687457-e100-4d45-b198-8a84089f075d tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:28.614006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba687457-e100-4d45-b198-8a84089f075d tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:28.614468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba687457-e100-4d45-b198-8a84089f075d tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:28.614926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba687457-e100-4d45-b198-8a84089f075d tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:28.932508 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba687457-e100-4d45-b198-8a84089f075d tempest-TestNetworkAdvancedServerOps-535026007 tempest-TestNetworkAdvancedServerOps-535026007-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1834 microversion: 2.1 time: 0.367862 Oct 01 21:20:28.934674 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3549/5103] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:28 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1834 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:28.965724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:28.966324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:28.973487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:28.974296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:28.975533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:28.977543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:28.979518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:28.980193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:29.073975 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6563b4e2-bd29-44a9-a4ab-0e0c70a0b7a3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1463 microversion: 2.1 time: 0.578302 Oct 01 21:20:29.075583 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1555/5104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:28 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1463 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:29.155699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-22bdaba4-f407-4d3f-934b-d3ea22070be6 req-f504c5fe-bc79-4a8e-97e4-7cf8159231bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d23269-5e85-47d4-8db0-a969821fd2e4", "tag": "ab948520-7560-4773-ac9b-78daa6cbce7b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:29.174145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-22bdaba4-f407-4d3f-934b-d3ea22070be6 req-f504c5fe-bc79-4a8e-97e4-7cf8159231bb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:29.175713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-22bdaba4-f407-4d3f-934b-d3ea22070be6 req-f504c5fe-bc79-4a8e-97e4-7cf8159231bb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:29.176971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-22bdaba4-f407-4d3f-934b-d3ea22070be6 req-f504c5fe-bc79-4a8e-97e4-7cf8159231bb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:29.208595 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-22bdaba4-f407-4d3f-934b-d3ea22070be6 req-f504c5fe-bc79-4a8e-97e4-7cf8159231bb service nova] Creating event network-changed:ab948520-7560-4773-ac9b-78daa6cbce7b for instance 40d23269-5e85-47d4-8db0-a969821fd2e4 on nch2-master-1 Oct 01 21:20:29.214869 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-22bdaba4-f407-4d3f-934b-d3ea22070be6 req-f504c5fe-bc79-4a8e-97e4-7cf8159231bb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063625 Oct 01 21:20:29.215430 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1556/5105] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:29.249688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:29.259701 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca7c23b6-6d47-4d4a-ab99-ffbe58ce7c52 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1683 microversion: 2.1 time: 0.301777 Oct 01 21:20:29.275181 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3550/5106] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:28 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1683 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:29.389008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-634a1721-1823-4d98-8143-9fa58c4d9fee tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:29.391977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-634a1721-1823-4d98-8143-9fa58c4d9fee tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:29.411864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-634a1721-1823-4d98-8143-9fa58c4d9fee tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:29.412711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-634a1721-1823-4d98-8143-9fa58c4d9fee tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:29.413338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-634a1721-1823-4d98-8143-9fa58c4d9fee tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:29.414795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-634a1721-1823-4d98-8143-9fa58c4d9fee tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:29.415417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-634a1721-1823-4d98-8143-9fa58c4d9fee tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:29.416061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-634a1721-1823-4d98-8143-9fa58c4d9fee tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:29.509926 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-634a1721-1823-4d98-8143-9fa58c4d9fee tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8/action" status: 200 len: 38628 microversion: 2.1 time: 0.124991 Oct 01 21:20:29.521639 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1557/5107] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:20:29 2022] POST /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8/action => generated 38628 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:20:29.570939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:29.571567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:29.584430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:29.587331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:29.588032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:29.589053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:29.589755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:29.590405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:30.113176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5276c5a2-864c-4da2-92ec-60719acf8ef8 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:30.114008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5276c5a2-864c-4da2-92ec-60719acf8ef8 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:30.132812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5276c5a2-864c-4da2-92ec-60719acf8ef8 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:30.136444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:30.137130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5276c5a2-864c-4da2-92ec-60719acf8ef8 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:30.138018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5276c5a2-864c-4da2-92ec-60719acf8ef8 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:30.139017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5276c5a2-864c-4da2-92ec-60719acf8ef8 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:30.141320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5276c5a2-864c-4da2-92ec-60719acf8ef8 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:30.144348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5276c5a2-864c-4da2-92ec-60719acf8ef8 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:30.163895 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf7aea9d-698e-4bd4-afa1-630a7dc8cd0b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1314 microversion: 2.1 time: 0.596235 Oct 01 21:20:30.184972 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3551/5108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:29 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:30.497028 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5276c5a2-864c-4da2-92ec-60719acf8ef8 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1463 microversion: 2.1 time: 0.390250 Oct 01 21:20:30.498694 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1558/5109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:30 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1463 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:31.192958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:31.193627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:31.204359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:31.210252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:31.211551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:31.215708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:31.217342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:31.221488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:31.520509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f1e88566-527a-4e1f-9bab-dd457fbe2d28 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:31.521311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f1e88566-527a-4e1f-9bab-dd457fbe2d28 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:31.524205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:31.525266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:31.550867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1e88566-527a-4e1f-9bab-dd457fbe2d28 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:31.551404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1e88566-527a-4e1f-9bab-dd457fbe2d28 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:31.556142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1e88566-527a-4e1f-9bab-dd457fbe2d28 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:31.556945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1e88566-527a-4e1f-9bab-dd457fbe2d28 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:31.557429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1e88566-527a-4e1f-9bab-dd457fbe2d28 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:31.557871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1e88566-527a-4e1f-9bab-dd457fbe2d28 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:31.690382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:31.701131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-27d0544d-2376-4fe1-a612-8118f4d3271a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1501 microversion: 2.1 time: 0.512707 Oct 01 21:20:31.721135 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3552/5110] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:31 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1501 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:31.732574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18200aa1-d60b-45b9-aed5-20e2e52112c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:31.749559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18200aa1-d60b-45b9-aed5-20e2e52112c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:31.750085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18200aa1-d60b-45b9-aed5-20e2e52112c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:31.752199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18200aa1-d60b-45b9-aed5-20e2e52112c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:31.763669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:31.814006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-18200aa1-d60b-45b9-aed5-20e2e52112c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Going to try to stop instance {{(pid=140438) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 21:20:31.864141 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f1e88566-527a-4e1f-9bab-dd457fbe2d28 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1463 microversion: 2.1 time: 0.347367 Oct 01 21:20:31.870153 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1559/5111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:31 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1463 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:31.915830 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-18200aa1-d60b-45b9-aed5-20e2e52112c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab/action" status: 202 len: 0 microversion: 2.1 time: 0.190417 Oct 01 21:20:31.917031 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3553/5112] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:20:31 2022] POST /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:20:31.926307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:31.927019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:31.943602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:31.944110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:31.944559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:31.945334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:31.945847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:31.948644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:32.167630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:32.187782 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9b3ecd59-7ece-4abf-ad78-4d8f35cdc946 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.266383 Oct 01 21:20:32.202158 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1560/5113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:31 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:32.413681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:32.414863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:32.432941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-16e1721e-814a-47aa-b49c-9cc96f724c97 req-f08b6c53-6f38-4f90-830a-d6aebb751bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f815d9a-7897-444e-bdff-9c414aa8eec8", "tag": "cc6a0ac1-f20f-4c7e-a82a-168a222de70d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:32.444642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:32.447978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:32.450401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:32.452311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:32.453421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:32.455083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:32.455986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:32.456951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-16e1721e-814a-47aa-b49c-9cc96f724c97 req-f08b6c53-6f38-4f90-830a-d6aebb751bfd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:32.457463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-16e1721e-814a-47aa-b49c-9cc96f724c97 req-f08b6c53-6f38-4f90-830a-d6aebb751bfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:32.457901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-16e1721e-814a-47aa-b49c-9cc96f724c97 req-f08b6c53-6f38-4f90-830a-d6aebb751bfd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:32.490342 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-16e1721e-814a-47aa-b49c-9cc96f724c97 req-f08b6c53-6f38-4f90-830a-d6aebb751bfd service nova] Creating event network-changed:cc6a0ac1-f20f-4c7e-a82a-168a222de70d for instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 on nch1-master-1 Oct 01 21:20:32.499302 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-16e1721e-814a-47aa-b49c-9cc96f724c97 req-f08b6c53-6f38-4f90-830a-d6aebb751bfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070775 Oct 01 21:20:32.500161 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1561/5114] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:20:32.530046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:20:32.707157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:32.716825 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a75675f-d280-47f6-8520-24f2f96113ae tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 204 len: 0 microversion: 2.1 time: 0.307214 Oct 01 21:20:32.718907 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3554/5115] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:20:32 2022] DELETE /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:20:32.729346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:32.730736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:32.741779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:32.745707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:32.746391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:32.748687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:32.749336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:32.754144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:32.889476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-57608cda-b3f7-445e-a7cd-e1cbc4832f7b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:32.890528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-57608cda-b3f7-445e-a7cd-e1cbc4832f7b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:32.900983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57608cda-b3f7-445e-a7cd-e1cbc4832f7b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:32.901783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57608cda-b3f7-445e-a7cd-e1cbc4832f7b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:32.902431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57608cda-b3f7-445e-a7cd-e1cbc4832f7b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:32.916732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57608cda-b3f7-445e-a7cd-e1cbc4832f7b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:32.918302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57608cda-b3f7-445e-a7cd-e1cbc4832f7b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:32.919041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-57608cda-b3f7-445e-a7cd-e1cbc4832f7b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:33.222288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:33.235880 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-60319461-6ce4-4b4e-924f-2d935192cbb0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1689 microversion: 2.1 time: 0.511863 Oct 01 21:20:33.236488 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1562/5116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:32 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1689 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:33.259300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:33.260159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:33.276429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:33.284763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:33.285498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:33.286447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:33.287301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:33.289576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:33.775993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:33.785727 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-26f91e0c-358c-406b-892c-bc4723b12b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.546436 Oct 01 21:20:33.786245 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1563/5117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:33 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:34.264033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:34.264674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:34.271898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:34.278848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:34.279369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:34.280147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:34.280626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:34.281064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:34.638683 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-57608cda-b3f7-445e-a7cd-e1cbc4832f7b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1463 microversion: 2.1 time: 1.753716 Oct 01 21:20:34.650973 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3555/5118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:32 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1463 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:34.810109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:34.811033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:34.821502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:34.822417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:34.822948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:34.823391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:34.824107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:34.824569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:34.824997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:34.833929 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bb047d8d-9dc2-486d-958f-af1359cf027e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1689 microversion: 2.1 time: 0.574352 Oct 01 21:20:34.835940 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1564/5119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:34 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1689 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:35.192029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:35.200738 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d0349868-0d55-4e4c-9dc9-d54e43af00e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.394876 Oct 01 21:20:35.206844 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3556/5120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:34 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:35.673567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8a77d533-04f8-4062-a812-320033cc7089 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:35.674874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8a77d533-04f8-4062-a812-320033cc7089 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:35.693743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a77d533-04f8-4062-a812-320033cc7089 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:35.697703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a77d533-04f8-4062-a812-320033cc7089 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:35.698658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a77d533-04f8-4062-a812-320033cc7089 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:35.700221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a77d533-04f8-4062-a812-320033cc7089 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:35.701801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a77d533-04f8-4062-a812-320033cc7089 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:35.703466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8a77d533-04f8-4062-a812-320033cc7089 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:35.709906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3c9b3151-3459-4a7d-a543-35b8c3dc965a req-d770a50a-be55-46f3-a92c-5a451ca74678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f815d9a-7897-444e-bdff-9c414aa8eec8", "name": "network-vif-deleted", "tag": "cc6a0ac1-f20f-4c7e-a82a-168a222de70d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:35.722172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3c9b3151-3459-4a7d-a543-35b8c3dc965a req-d770a50a-be55-46f3-a92c-5a451ca74678 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:35.723624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3c9b3151-3459-4a7d-a543-35b8c3dc965a req-d770a50a-be55-46f3-a92c-5a451ca74678 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:35.725684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3c9b3151-3459-4a7d-a543-35b8c3dc965a req-d770a50a-be55-46f3-a92c-5a451ca74678 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:35.753078 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3c9b3151-3459-4a7d-a543-35b8c3dc965a req-d770a50a-be55-46f3-a92c-5a451ca74678 service nova] Creating event network-vif-deleted:cc6a0ac1-f20f-4c7e-a82a-168a222de70d for instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 on nch1-master-1 Oct 01 21:20:35.774184 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3c9b3151-3459-4a7d-a543-35b8c3dc965a req-d770a50a-be55-46f3-a92c-5a451ca74678 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067724 Oct 01 21:20:35.774839 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3557/5121] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:20:35.860776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:35.861893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:35.873997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:35.874622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:35.875217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:35.875876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:35.877786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:35.878234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:35.959092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:35.960210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:35.962180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:35.964136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lazy-loading 'fault' on Instance uuid 6f815d9a-7897-444e-bdff-9c414aa8eec8 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:20:36.093154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:36.108001 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c3ee8896-a024-4c00-9362-0b2bdd52e487 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 200 len: 1357 microversion: 2.1 time: 0.248366 Oct 01 21:20:36.108955 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3558/5122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:35 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:36.207279 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8a77d533-04f8-4062-a812-320033cc7089 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1463 microversion: 2.1 time: 0.541327 Oct 01 21:20:36.211581 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1565/5123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:35 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1463 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:36.229878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:36.230610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:36.240855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:36.241377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:36.243152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:36.245454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:36.246307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:36.247442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:36.539431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:36.552046 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cecab583-841e-4eb2-83c9-16a71fa71cf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.326607 Oct 01 21:20:36.552888 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3559/5124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:36 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:37.134925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:37.136490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: 6f815d9a-7897-444e-bdff-9c414aa8eec8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:37.145591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:37.146378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:37.147231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:37.149647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:37.155683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:37.156468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:37.173004 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] HTTP exception thrown: Instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 could not be found. Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Request method failure captured: Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 HTTP/1.1 Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK2hiQttiLqFpU-8rCQHHvV-cPgSq6Vp7kVdJek3nn6F4H5vFTWS4FtOgvdjDYM3WBqdjC3p_4jg80-mVN1iU7Nu4N7YA8dsPbVHGGQ6Xlb8LUviJ4SX_YgNzxd91nA6MQskQH_9HYu8UoC5fzsj_amZuTPDVfcZvtzydTfTYeoAqCM Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 71511e85c1b947e3b03501b27d70d560 Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_71511e85c1b947e3b03501b27d70d560", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/71511e85c1b947e3b03501b27d70d560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/71511e85c1b947e3b03501b27d70d560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/71511e85c1b947e3b03501b27d70d560"}]}] Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 71511e85c1b947e3b03501b27d70d560 Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestNetworkAdvancedServerOps-1998630134-project Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f77486ef55a0469a99c3795b626bee1a Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1998630134-project Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 could not be found. Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '6f815d9a-7897-444e-bdff-9c414aa8eec8'} Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 could not be found. Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 could not be found. Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:37.175006 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:20:37.180762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:37.180762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:20:37.180762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:20:37.180762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:20:37.180762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:20:37.180762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:20:37.180762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 could not be found. Oct 01 21:20:37.180762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:37.182584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Returning 404 to user: Instance 6f815d9a-7897-444e-bdff-9c414aa8eec8 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:20:37.183641 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8527ecf0-fadf-4ed1-a196-b2f857c663db tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8" status: 404 len: 111 microversion: 2.1 time: 0.054785 Oct 01 21:20:37.184686 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1566/5125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:37 2022] GET /compute/v2.1/servers/6f815d9a-7897-444e-bdff-9c414aa8eec8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:20:37.233971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2eb27f37-856b-4f29-b915-01d09a8b27bc tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:37.234913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2eb27f37-856b-4f29-b915-01d09a8b27bc tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:37.254306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2eb27f37-856b-4f29-b915-01d09a8b27bc tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:37.257084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2eb27f37-856b-4f29-b915-01d09a8b27bc tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:37.258513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2eb27f37-856b-4f29-b915-01d09a8b27bc tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:37.263034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2eb27f37-856b-4f29-b915-01d09a8b27bc tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:37.263753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2eb27f37-856b-4f29-b915-01d09a8b27bc tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:37.264383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2eb27f37-856b-4f29-b915-01d09a8b27bc tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:37.305049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:37.577169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:37.578041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:37.594645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:37.595737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:37.597862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:37.598924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:37.599656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:37.625538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:37.826194 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2eb27f37-856b-4f29-b915-01d09a8b27bc tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1463 microversion: 2.1 time: 0.596167 Oct 01 21:20:37.831388 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3560/5126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:37 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1463 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:37.836545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3d1b2a9b-7105-468b-a507-7b1227bca0a5 req-1a6924d7-98cc-4c1f-baa6-a6683cd6865a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d23269-5e85-47d4-8db0-a969821fd2e4", "name": "network-vif-plugged", "status": "completed", "tag": "ab948520-7560-4773-ac9b-78daa6cbce7b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:37.861294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3d1b2a9b-7105-468b-a507-7b1227bca0a5 req-1a6924d7-98cc-4c1f-baa6-a6683cd6865a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:37.861883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3d1b2a9b-7105-468b-a507-7b1227bca0a5 req-1a6924d7-98cc-4c1f-baa6-a6683cd6865a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:37.862330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3d1b2a9b-7105-468b-a507-7b1227bca0a5 req-1a6924d7-98cc-4c1f-baa6-a6683cd6865a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:37.898760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3d1b2a9b-7105-468b-a507-7b1227bca0a5 req-1a6924d7-98cc-4c1f-baa6-a6683cd6865a service nova] Creating event network-vif-plugged:ab948520-7560-4773-ac9b-78daa6cbce7b for instance 40d23269-5e85-47d4-8db0-a969821fd2e4 on nch2-master-1 Oct 01 21:20:37.907713 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3d1b2a9b-7105-468b-a507-7b1227bca0a5 req-1a6924d7-98cc-4c1f-baa6-a6683cd6865a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074980 Oct 01 21:20:37.912520 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3561/5127] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:37.987666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:37.997088 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e199d036-0c6b-4557-b3f2-de7e20a8703a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.423887 Oct 01 21:20:38.001289 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1567/5128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:37 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:38.853367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8aa00547-ff9e-4723-a5ee-357bfadc0ded tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:38.854180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8aa00547-ff9e-4723-a5ee-357bfadc0ded tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:38.865829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa00547-ff9e-4723-a5ee-357bfadc0ded tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:38.866238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa00547-ff9e-4723-a5ee-357bfadc0ded tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:38.866721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa00547-ff9e-4723-a5ee-357bfadc0ded tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:38.868021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa00547-ff9e-4723-a5ee-357bfadc0ded tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:38.868482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa00547-ff9e-4723-a5ee-357bfadc0ded tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:38.879848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8aa00547-ff9e-4723-a5ee-357bfadc0ded tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:39.050545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:39.050545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:39.063283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:39.063744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:39.064202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:39.064933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:39.065390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:39.065814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:39.269371 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8aa00547-ff9e-4723-a5ee-357bfadc0ded tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1463 microversion: 2.1 time: 0.414613 Oct 01 21:20:39.273863 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3562/5129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:38 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1463 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:39.605233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:39.617505 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e024a3b-384b-4599-9097-ceb468b61f22 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.592433 Oct 01 21:20:39.634550 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1568/5130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:39 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:40.297888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a09d2084-48ce-41a1-8bf4-5b49044094ae tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:40.298521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a09d2084-48ce-41a1-8bf4-5b49044094ae tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:40.306432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a09d2084-48ce-41a1-8bf4-5b49044094ae tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:40.307242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a09d2084-48ce-41a1-8bf4-5b49044094ae tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:40.307876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a09d2084-48ce-41a1-8bf4-5b49044094ae tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:40.308798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a09d2084-48ce-41a1-8bf4-5b49044094ae tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:40.309447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a09d2084-48ce-41a1-8bf4-5b49044094ae tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:40.310082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a09d2084-48ce-41a1-8bf4-5b49044094ae tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:40.657338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:40.657959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:40.670123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:40.673742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:40.674427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:40.677450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:40.678028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:40.680251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:40.685065 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a09d2084-48ce-41a1-8bf4-5b49044094ae tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1648 microversion: 2.1 time: 0.392758 Oct 01 21:20:40.685746 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3563/5131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:40 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1648 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:40.709929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebb541ab-47b5-4638-9c5a-b8f88da68000 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:40.712019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebb541ab-47b5-4638-9c5a-b8f88da68000 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:40.725620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb541ab-47b5-4638-9c5a-b8f88da68000 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:40.727075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb541ab-47b5-4638-9c5a-b8f88da68000 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:40.728042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb541ab-47b5-4638-9c5a-b8f88da68000 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:40.728999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb541ab-47b5-4638-9c5a-b8f88da68000 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:40.730658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb541ab-47b5-4638-9c5a-b8f88da68000 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:40.731418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebb541ab-47b5-4638-9c5a-b8f88da68000 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:40.975931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:40.978964 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebb541ab-47b5-4638-9c5a-b8f88da68000 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1648 microversion: 2.1 time: 0.272681 Oct 01 21:20:40.984561 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3564/5132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:40 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1648 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:40.997828 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4f0d407b-fdaf-4fef-948e-de81255c468e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.344309 Oct 01 21:20:40.998468 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1569/5133] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:40 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:41.019962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f15cf22-89b0-4333-a57d-65468ff404b0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:41.020589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f15cf22-89b0-4333-a57d-65468ff404b0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:41.039943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f15cf22-89b0-4333-a57d-65468ff404b0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:41.040824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f15cf22-89b0-4333-a57d-65468ff404b0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:41.041554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f15cf22-89b0-4333-a57d-65468ff404b0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:41.044288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f15cf22-89b0-4333-a57d-65468ff404b0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:41.045223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f15cf22-89b0-4333-a57d-65468ff404b0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:41.047022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f15cf22-89b0-4333-a57d-65468ff404b0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:41.319745 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f15cf22-89b0-4333-a57d-65468ff404b0 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1648 microversion: 2.1 time: 0.302656 Oct 01 21:20:41.321686 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3565/5134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:41 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1648 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:41.347045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:41.347899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:41.372213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:41.376944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:41.378832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:41.378832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:41.381184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:41.387360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:41.450553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:20:41.540337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:41.586356 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c7bfa025-3e9a-416e-bac3-2a9d5cc12f5b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 204 len: 0 microversion: 2.1 time: 0.241971 Oct 01 21:20:41.587454 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1570/5135] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:20:41 2022] DELETE /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:20:41.597238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88d00901-8d6a-47e0-85ef-b434c26ee7d1 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:41.598005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88d00901-8d6a-47e0-85ef-b434c26ee7d1 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:41.611120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88d00901-8d6a-47e0-85ef-b434c26ee7d1 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:41.611732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88d00901-8d6a-47e0-85ef-b434c26ee7d1 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:41.612353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88d00901-8d6a-47e0-85ef-b434c26ee7d1 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:41.613845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88d00901-8d6a-47e0-85ef-b434c26ee7d1 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:41.616782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88d00901-8d6a-47e0-85ef-b434c26ee7d1 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:41.617257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88d00901-8d6a-47e0-85ef-b434c26ee7d1 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:42.031783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:42.033159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:42.042841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:42.043595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:42.048008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:42.049548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:42.050326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:42.050965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:42.325081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:42.338922 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-26086e48-90c3-4442-ab13-e6fbebe62e8f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.314974 Oct 01 21:20:42.341612 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1571/5136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:42 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:42.414177 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88d00901-8d6a-47e0-85ef-b434c26ee7d1 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1654 microversion: 2.1 time: 0.821208 Oct 01 21:20:42.415818 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3566/5137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:41 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1654 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:43.151056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-be3a4243-575f-4580-ad8f-5482d2828cea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '.version_select at 0x7f41724459d0>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:43.179751 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-be3a4243-575f-4580-ad8f-5482d2828cea tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1458096555" status: 202 len: 0 microversion: 2.1 time: 0.032309 Oct 01 21:20:43.180831 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1572/5138] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Oct 1 21:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1458096555 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:20:43.209036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-22cc92c6-f545-4ba4-a0ac-35836d674c9a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'create', calling method: .version_select at 0x7f417c18d430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-892979206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPZklSMEP5t/t0S5x2mqkT0NApOlsJ4Ugfc/uOdINdwHVG5AGjw9/mwy0OzbjyfSeeC+4+5O80GfehXEmoGexg0qY/R6C6sAY9gfOxtnyTm0zWdne0JNyapcsLA3Ek/EQ=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:43.229510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-22cc92c6-f545-4ba4-a0ac-35836d674c9a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for project 71511e85c1b947e3b03501b27d70d560. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:20:43.231892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-22cc92c6-f545-4ba4-a0ac-35836d674c9a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for user f77486ef55a0469a99c3795b626bee1a and project 71511e85c1b947e3b03501b27d70d560. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:20:43.260068 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-22cc92c6-f545-4ba4-a0ac-35836d674c9a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054917 Oct 01 21:20:43.260848 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3567/5139] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:20:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:43.368185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:43.369145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:43.381162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:43.389117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:43.389687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:43.391121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:43.391959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:43.392395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:43.439953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aacc7706-a16b-4ced-9a34-8b80e7bf1984 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:43.440673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aacc7706-a16b-4ced-9a34-8b80e7bf1984 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:43.448219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aacc7706-a16b-4ced-9a34-8b80e7bf1984 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:43.448987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aacc7706-a16b-4ced-9a34-8b80e7bf1984 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:43.449820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aacc7706-a16b-4ced-9a34-8b80e7bf1984 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:43.450906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aacc7706-a16b-4ced-9a34-8b80e7bf1984 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:43.451841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aacc7706-a16b-4ced-9a34-8b80e7bf1984 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:43.452610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aacc7706-a16b-4ced-9a34-8b80e7bf1984 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:43.767870 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aacc7706-a16b-4ced-9a34-8b80e7bf1984 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1654 microversion: 2.1 time: 0.332191 Oct 01 21:20:43.769258 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3568/5140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:43 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1654 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:43.884756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:43.904055 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-06d228ba-0f80-40a8-8c62-acef589b1ddd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.542295 Oct 01 21:20:43.904650 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1573/5141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:43 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:44.323810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c0157b92-fda9-4b72-aa4a-640952fea274 req-8d3f819b-fb4b-4d5a-b32a-e8889876ddd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d23269-5e85-47d4-8db0-a969821fd2e4", "name": "network-vif-deleted", "tag": "ab948520-7560-4773-ac9b-78daa6cbce7b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:44.341998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c0157b92-fda9-4b72-aa4a-640952fea274 req-8d3f819b-fb4b-4d5a-b32a-e8889876ddd0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:44.345254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c0157b92-fda9-4b72-aa4a-640952fea274 req-8d3f819b-fb4b-4d5a-b32a-e8889876ddd0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:44.350818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c0157b92-fda9-4b72-aa4a-640952fea274 req-8d3f819b-fb4b-4d5a-b32a-e8889876ddd0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:44.372614 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c0157b92-fda9-4b72-aa4a-640952fea274 req-8d3f819b-fb4b-4d5a-b32a-e8889876ddd0 service nova] Creating event network-vif-deleted:ab948520-7560-4773-ac9b-78daa6cbce7b for instance 40d23269-5e85-47d4-8db0-a969821fd2e4 on nch2-master-1 Oct 01 21:20:44.378907 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c0157b92-fda9-4b72-aa4a-640952fea274 req-8d3f819b-fb4b-4d5a-b32a-e8889876ddd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061044 Oct 01 21:20:44.380014 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3569/5142] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:44.793712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:44.794350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:44.801707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:44.802209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:44.803893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:44.805680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:44.806320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:44.806961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:44.856308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:44.856816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:44.857265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:44.857745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lazy-loading 'fault' on Instance uuid 40d23269-5e85-47d4-8db0-a969821fd2e4 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:20:44.932053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:44.932783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:44.935118 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cea83c5e-7bcb-4ed7-8db1-8588dc9b84df tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 200 len: 1453 microversion: 2.1 time: 0.147084 Oct 01 21:20:44.944758 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1574/5143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:44 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:44.948749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:44.949260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:44.950154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:44.951090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:44.951739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:44.952330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:45.235750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:45.245883 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad512285-f6e5-45d0-9d4e-40a48418be3c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.320504 Oct 01 21:20:45.262258 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3570/5144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:44 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:45.961252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:45.961877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 40d23269-5e85-47d4-8db0-a969821fd2e4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:45.969055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:45.969618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:45.970064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:45.971185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:45.971979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:45.972411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:45.987804 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] HTTP exception thrown: Instance 40d23269-5e85-47d4-8db0-a969821fd2e4 could not be found. Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Request method failure captured: Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 HTTP/1.1 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK8ACNIb2dAwSv_uw-eZVbB1vgAHNxJEgslKUiDYiCVE0k8LvTinDw3z5lPhoBl--ZrpE5z6I6IvCNEAR7rTSN_Qn2FEsDEnDB9_Z6acr_oLoLXaqnu3pHeK2NBMG1Gv6ZzZqotT5Bnvww1Lnqa413jwbpiK7b94eXcUHUeKKzBw5Oo Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9441e87384c5410bb11278bead2a3761 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestServerMultinode-1078823603 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9441e87384c5410bb11278bead2a3761", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9441e87384c5410bb11278bead2a3761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9441e87384c5410bb11278bead2a3761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9441e87384c5410bb11278bead2a3761"}]}] Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestServerMultinode-1078823603 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9441e87384c5410bb11278bead2a3761 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestServerMultinode-1078823603 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestServerMultinode-1078823603-project-admin Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: bbe6040ce96544c0a301331101db7267 Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestServerMultinode-1078823603-project-admin Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 40d23269-5e85-47d4-8db0-a969821fd2e4 could not be found. Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '40d23269-5e85-47d4-8db0-a969821fd2e4'} Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d23269-5e85-47d4-8db0-a969821fd2e4 could not be found. Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d23269-5e85-47d4-8db0-a969821fd2e4 could not be found. Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:20:45.989230 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d23269-5e85-47d4-8db0-a969821fd2e4 could not be found. Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Returning 404 to user: Instance 40d23269-5e85-47d4-8db0-a969821fd2e4 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-78a5bf08-a7a6-4029-8387-ba10051b14a9 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4" status: 404 len: 111 microversion: 2.1 time: 0.033880 Oct 01 21:20:45.995154 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1575/5145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:45 2022] GET /compute/v2.1/servers/40d23269-5e85-47d4-8db0-a969821fd2e4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:20:46.000259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:46.000758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:46.008473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:46.008981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:46.009433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:46.010293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:46.010796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:46.011242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:46.038921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:20:46.160012 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84e4221d-074e-4b2e-ab54-9b8f1d4120d3 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 204 len: 0 microversion: 2.1 time: 0.163496 Oct 01 21:20:46.160993 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3571/5146] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:20:45 2022] DELETE /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:20:46.170037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aa73ad03-b10b-4194-8095-350561db2567 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:46.171188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aa73ad03-b10b-4194-8095-350561db2567 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:46.178847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa73ad03-b10b-4194-8095-350561db2567 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:46.180253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa73ad03-b10b-4194-8095-350561db2567 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:46.181074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa73ad03-b10b-4194-8095-350561db2567 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:46.181896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa73ad03-b10b-4194-8095-350561db2567 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:46.182637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa73ad03-b10b-4194-8095-350561db2567 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:46.183146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa73ad03-b10b-4194-8095-350561db2567 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:46.281476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:46.282984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:46.291907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:46.293112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:46.295617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:46.296762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:46.298051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:46.298845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:46.387555 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aa73ad03-b10b-4194-8095-350561db2567 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1655 microversion: 2.1 time: 0.221932 Oct 01 21:20:46.388166 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1576/5147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:46 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1655 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:46.670338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:46.684973 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bcff75f6-f82d-44a7-8e34-2fca4d102423 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.416091 Oct 01 21:20:46.700768 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3572/5148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:46 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:20:47.423790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d50c3421-19e8-450b-88d0-40b64dac7a6b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:47.424692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d50c3421-19e8-450b-88d0-40b64dac7a6b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:47.443706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d50c3421-19e8-450b-88d0-40b64dac7a6b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:47.444126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d50c3421-19e8-450b-88d0-40b64dac7a6b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:47.444612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d50c3421-19e8-450b-88d0-40b64dac7a6b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:47.453015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d50c3421-19e8-450b-88d0-40b64dac7a6b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:47.453625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d50c3421-19e8-450b-88d0-40b64dac7a6b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:47.454145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d50c3421-19e8-450b-88d0-40b64dac7a6b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:47.714971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:47.715566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:47.732765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:47.733377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:47.733726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:47.734799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:47.734928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:47.735387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:47.838782 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d50c3421-19e8-450b-88d0-40b64dac7a6b tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1655 microversion: 2.1 time: 0.425889 Oct 01 21:20:47.839376 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1577/5149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:47 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1655 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:48.334101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:48.346916 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e71afb32-3798-4628-88fd-9c0b53376ffc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.636301 Oct 01 21:20:48.362944 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3573/5150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:47 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:48.863001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4778f3c7-bf16-4147-ad9d-a30705b4e678 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:48.864245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4778f3c7-bf16-4147-ad9d-a30705b4e678 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:48.877697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4778f3c7-bf16-4147-ad9d-a30705b4e678 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:48.878530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4778f3c7-bf16-4147-ad9d-a30705b4e678 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:48.878873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4778f3c7-bf16-4147-ad9d-a30705b4e678 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:48.879601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4778f3c7-bf16-4147-ad9d-a30705b4e678 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:48.880077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4778f3c7-bf16-4147-ad9d-a30705b4e678 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:48.882979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4778f3c7-bf16-4147-ad9d-a30705b4e678 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:49.207986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-60d48f64-7d6d-42da-b3d9-05db6313f868 req-0cf1319b-fc4f-4d77-9b99-fb47afb26a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00279ce5-fd83-43e8-adc3-e229ba14f4fc", "name": "network-vif-deleted", "tag": "cab374f7-e459-49da-b807-ec2eee6fba7e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:49.225020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60d48f64-7d6d-42da-b3d9-05db6313f868 req-0cf1319b-fc4f-4d77-9b99-fb47afb26a45 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:49.225524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60d48f64-7d6d-42da-b3d9-05db6313f868 req-0cf1319b-fc4f-4d77-9b99-fb47afb26a45 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:49.226544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60d48f64-7d6d-42da-b3d9-05db6313f868 req-0cf1319b-fc4f-4d77-9b99-fb47afb26a45 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:49.250665 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-60d48f64-7d6d-42da-b3d9-05db6313f868 req-0cf1319b-fc4f-4d77-9b99-fb47afb26a45 service nova] Creating event network-vif-deleted:cab374f7-e459-49da-b807-ec2eee6fba7e for instance 00279ce5-fd83-43e8-adc3-e229ba14f4fc on nch1-master-1 Oct 01 21:20:49.256229 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-60d48f64-7d6d-42da-b3d9-05db6313f868 req-0cf1319b-fc4f-4d77-9b99-fb47afb26a45 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051937 Oct 01 21:20:49.257636 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3574/5151] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:49.372244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:49.373243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:49.383198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:49.386432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:49.386965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:49.387825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:49.388398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:49.388753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:49.771554 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4778f3c7-bf16-4147-ad9d-a30705b4e678 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 200 len: 1655 microversion: 2.1 time: 0.912418 Oct 01 21:20:49.773347 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1578/5152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:48 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 1655 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:49.786422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:49.800727 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca0faea8-d7d7-4a3a-807e-d249d5219368 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.432956 Oct 01 21:20:49.801661 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3575/5153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:49 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:50.796994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:50.798270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] [instance: 00279ce5-fd83-43e8-adc3-e229ba14f4fc] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:50.806052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:50.806807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:50.807444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:50.808318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:50.808957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:50.809547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:50.829260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:50.830624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:50.837214 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] HTTP exception thrown: Instance 00279ce5-fd83-43e8-adc3-e229ba14f4fc could not be found. Oct 01 21:20:50.839903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:50.842991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Request method failure captured: Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc HTTP/1.1 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK8ACNIb2dAwSv_uw-eZVbB1vgAHNxJEgslKUiDYiCVE0k8LvTinDw3z5lPhoBl--ZrpE5z6I6IvCNEAR7rTSN_Qn2FEsDEnDB9_Z6acr_oLoLXaqnu3pHeK2NBMG1Gv6ZzZqotT5Bnvww1Lnqa413jwbpiK7b94eXcUHUeKKzBw5Oo Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9441e87384c5410bb11278bead2a3761 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestServerMultinode-1078823603 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9441e87384c5410bb11278bead2a3761", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9441e87384c5410bb11278bead2a3761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9441e87384c5410bb11278bead2a3761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9441e87384c5410bb11278bead2a3761"}]}] Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestServerMultinode-1078823603 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9441e87384c5410bb11278bead2a3761 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestServerMultinode-1078823603 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestServerMultinode-1078823603-project-admin Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: bbe6040ce96544c0a301331101db7267 Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestServerMultinode-1078823603-project-admin Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 00279ce5-fd83-43e8-adc3-e229ba14f4fc could not be found. Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '00279ce5-fd83-43e8-adc3-e229ba14f4fc'} Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00279ce5-fd83-43e8-adc3-e229ba14f4fc could not be found. Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00279ce5-fd83-43e8-adc3-e229ba14f4fc could not be found. Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:20:50.843299 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:50.849404 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:20:50.849404 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:20:50.849404 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:20:50.849404 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:20:50.849404 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:20:50.849404 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00279ce5-fd83-43e8-adc3-e229ba14f4fc could not be found. Oct 01 21:20:50.849404 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:20:50.852600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:50.853062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:50.853556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:50.853991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:50.855912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] Returning 404 to user: Instance 00279ce5-fd83-43e8-adc3-e229ba14f4fc could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:20:50.856897 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5bdb5ea6-b7b4-49df-8611-8482a1fcd030 tempest-TestServerMultinode-1078823603 tempest-TestServerMultinode-1078823603-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc" status: 404 len: 111 microversion: 2.1 time: 0.063956 Oct 01 21:20:50.858570 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1579/5154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:50 2022] GET /compute/v2.1/servers/00279ce5-fd83-43e8-adc3-e229ba14f4fc => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:20:51.142550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:51.152456 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a3aa0dff-6556-4b49-be83-54645fd35d52 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.325171 Oct 01 21:20:51.154543 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3576/5155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:50 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:52.179989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:52.181036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:52.204483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:52.210667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:52.213406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:52.215930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:52.216644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:52.220286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:52.858378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:52.876489 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3ab7da6f-aa3d-4b1b-a92d-4ed5f893c3de tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.702358 Oct 01 21:20:52.885450 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1580/5156] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:52 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:53.903036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:53.903756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:53.906713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:53.916179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:53.920391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:53.921066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:53.922026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:53.924254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:53.924897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:54.277808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:54.290056 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b378e06e-5e72-4420-8926-907f83ea97c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.391081 Oct 01 21:20:54.301084 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3577/5157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:53 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:55.324839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:55.325483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:55.333418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:55.334111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:55.334743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:55.336182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:55.336878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:55.337498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:56.010086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:56.018403 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8fdfe961-6e23-49c4-9641-f77babe3a77b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.698898 Oct 01 21:20:56.023150 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1581/5158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:55 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:57.050078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:57.051632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:57.060919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:57.061915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:57.062801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:57.063970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:57.064935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:57.065634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:57.113875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:20:57.389236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:57.405325 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-affa2fc3-8fcb-47a7-8c0e-6938579f5b48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1511 microversion: 2.1 time: 0.366791 Oct 01 21:20:57.407304 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3578/5159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:57 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:58.432063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:58.433561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:58.450240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:58.450766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:58.451214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:58.451941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:58.452398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:58.458233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:58.806572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:58.817023 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f7fab111-7031-4c08-aa3e-24fb9d6e058d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1488 microversion: 2.1 time: 0.389881 Oct 01 21:20:58.838148 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1582/5160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:58 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1488 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:58.846463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac315087-0316-4b33-97a7-ef7a3cb878c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:58.849902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac315087-0316-4b33-97a7-ef7a3cb878c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:58.868571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac315087-0316-4b33-97a7-ef7a3cb878c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:58.869078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac315087-0316-4b33-97a7-ef7a3cb878c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:58.869538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac315087-0316-4b33-97a7-ef7a3cb878c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:58.870261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac315087-0316-4b33-97a7-ef7a3cb878c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:58.875607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac315087-0316-4b33-97a7-ef7a3cb878c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:58.876121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac315087-0316-4b33-97a7-ef7a3cb878c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:58.982884 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac315087-0316-4b33-97a7-ef7a3cb878c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 200 len: 167 microversion: 2.1 time: 0.142562 Oct 01 21:20:58.984038 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3579/5161] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:20:58 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 167 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:20:58.996419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:58.996971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:59.005945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:59.006448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:59.011303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:59.013371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:59.013764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:59.014209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:59.475196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:20:59.487397 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-12ca6852-a59b-4ed6-a658-c067c788bb32 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.494831 Oct 01 21:20:59.495793 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1583/5162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:58 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:20:59.518719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1153190353", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "1b2098db-f261-429f-a74f-9e2f535c3d53"}], "key_name": "tempest-TestNetworkAdvancedServerOps-892979206", "security_groups": [{"name": "tempest-secgroup-smoke-932894582"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:20:59.534540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:20:59.571013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:20:59.571013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:59.571013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:59.571013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:20:59.571013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:20:59.571013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:20:59.571013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:00.038470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] validate_networks() for [('1b2098db-f261-429f-a74f-9e2f535c3d53', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:21:00.114095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:00.125742 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-100d3c9b-ea55-4266-b2b6-9f481b0d32a0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.595226 Oct 01 21:21:00.147900 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1584/5163] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:20:59 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:00.159347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:00.160163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:00.174455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:00.177449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:00.180046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:00.182018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:00.182544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:00.187613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:00.627483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:00.649003 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1938e955-512d-4b41-9d20-ceee99f61e4c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.494690 Oct 01 21:21:00.674791 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1585/5164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:00 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:00.712153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:00.712803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:00.720879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:00.721678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:00.722539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:00.724991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:00.725685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:00.726303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:01.051559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:01.064094 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4b80638f-f503-4adf-ab17-fc663d5c258a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.366256 Oct 01 21:21:01.068790 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1586/5165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:00 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:01.279635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1322485228", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "494a382d-1e31-4806-a5de-71784de0fc03"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:01.366845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] validate_networks() for [('494a382d-1e31-4806-a5de-71784de0fc03', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:21:01.777947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:21:01.778581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:21:01.778893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:21:01.779317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:21:01.779745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:21:01.802658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:01.804599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:01.805295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:01.806476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:01.807150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:01.807778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:01.833381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for project 71511e85c1b947e3b03501b27d70d560. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:21:01.839834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Getting quotas for user f77486ef55a0469a99c3795b626bee1a and project 71511e85c1b947e3b03501b27d70d560. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:21:01.855073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:21:01.858153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:21:01.920612 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e4b452ab-74ae-40ed-8fac-4084789fc7aa tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.406767 Oct 01 21:21:01.921631 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3580/5166] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:20:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 2409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:21:01.932746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba8c674d-f6f6-47a0-8a6f-c14952e74228 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:01.933639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba8c674d-f6f6-47a0-8a6f-c14952e74228 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:02.012782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:21:02.013235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:21:02.013695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:21:02.014118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:21:02.014575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:21:02.025112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:02.025897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:02.026572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:02.027485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:02.028122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:02.029039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:02.062253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:21:02.086551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for user 6ac020dc323042c48ccce2a8826bc6be and project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:21:02.090510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba8c674d-f6f6-47a0-8a6f-c14952e74228 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:02.103656 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba8c674d-f6f6-47a0-8a6f-c14952e74228 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1266 microversion: 2.1 time: 0.173918 Oct 01 21:21:02.118516 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3581/5167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:01 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:02.119022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:21:02.119022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:21:02.204435 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-71ea8bb3-9b71-4663-8c76-92a18b1acd15 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928962 Oct 01 21:21:02.211926 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1587/5168] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:21:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:21:02.218868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8a28975a-02e6-48a7-ae48-dabd944cc521 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:02.219518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8a28975a-02e6-48a7-ae48-dabd944cc521 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:02.524739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8a28975a-02e6-48a7-ae48-dabd944cc521 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:02.537797 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8a28975a-02e6-48a7-ae48-dabd944cc521 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1215 microversion: 2.1 time: 0.322995 Oct 01 21:21:02.540848 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3582/5169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:02 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1215 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:03.146826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:03.147570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:03.166466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:03.170965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:03.171771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:03.173772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:03.216159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:03.216746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:03.217190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:03.481979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:03.496389 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-07297d2c-c1c8-44f1-8f93-b94e0b6ac5f8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1262 microversion: 2.1 time: 0.367376 Oct 01 21:21:03.508436 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1588/5170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:03 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1262 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:03.566103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:03.567567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:03.575821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:03.577627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:03.578190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:03.578776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:03.581313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:03.582329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:03.583166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:03.837607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:03.846023 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6227b77c-b123-49a1-b176-38003f99ed56 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1211 microversion: 2.1 time: 0.284873 Oct 01 21:21:03.850793 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3583/5171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:03 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1211 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:04.521358 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:04.523226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:04.540672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:04.551431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:04.551910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:04.552660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:04.553127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:04.553595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:04.882157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:04.883351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:04.888861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:04.902278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:04.902896 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3bed3915-3ed6-4eff-831a-f255e18468ef tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1324 microversion: 2.1 time: 0.381336 Oct 01 21:21:04.903700 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1589/5172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:04 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:04.926863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:04.927343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:04.928112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:04.928639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:04.929076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:05.264986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:05.276094 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc864acd-75cb-4403-9849-8a1ac01fb6e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1285 microversion: 2.1 time: 0.398849 Oct 01 21:21:05.276705 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3584/5173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:04 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1285 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:05.931227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:05.932530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:05.957245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:05.961004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:05.962132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:05.963824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:05.967159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:05.967901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:05.976426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:06.260011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:06.271437 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eeed3719-e222-416d-956b-12d1dcdc99be tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1324 microversion: 2.1 time: 0.344946 Oct 01 21:21:06.275308 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1590/5174] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:05 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:06.306556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:06.313817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:06.330991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:06.341012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:06.341918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:06.344039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:06.344972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:06.347662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:06.522724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:06.537019 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e071f945-0aed-4856-958e-35629e0753e5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1273 microversion: 2.1 time: 0.232550 Oct 01 21:21:06.538351 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3585/5175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:06 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:07.296666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:07.297234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:07.309809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:07.310701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:07.311365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:07.312365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:07.313675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:07.316118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:07.488674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:07.502618 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3671f63a-f0cf-4918-8a76-78d94c201e48 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1324 microversion: 2.1 time: 0.209850 Oct 01 21:21:07.518469 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1591/5176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:07 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:07.563036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:07.563760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:07.577401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:07.580574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:07.583466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:07.596051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:07.598824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:07.599488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:08.497784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:08.531691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:08.535835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:08.571705 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4c3512dc-c6ec-4365-ae2e-2d9590063bee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1315 microversion: 2.1 time: 1.012558 Oct 01 21:21:08.573965 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3586/5177] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:07 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1315 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:08.577972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:08.583170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:08.585431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:08.591939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:08.592949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:08.595414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:08.970676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:08.982814 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9b8dee33-da53-4b1e-b329-f3a03123ec8e tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 0.457112 Oct 01 21:21:08.984637 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1592/5178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:08 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:09.597961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:09.599108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:09.610169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:09.611006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:09.611586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:09.612561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:09.613089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:09.613881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:10.009195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:10.009830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:10.019291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:10.019796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:10.020239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:10.023722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:10.024930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:10.025539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:10.231071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:10.233217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:10.240703 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1abc25da-ca0e-4d87-9194-01bbc35b268c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 0.236127 Oct 01 21:21:10.242813 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1593/5179] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:10 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:10.258635 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a49e4066-305e-40fd-945a-84ff3fb4754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1315 microversion: 2.1 time: 0.664892 Oct 01 21:21:10.259345 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3587/5180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:09 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:11.227521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7b3a54a6-538e-4ee2-91c7-c04200ab1afc req-495b6d87-f7bf-4e74-8467-aeed7a6e4167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e715b06b-c447-4817-abaf-81424071a1ab", "tag": "45063db8-bdf0-4066-b313-ddfd91d7e60d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:11.260100 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7b3a54a6-538e-4ee2-91c7-c04200ab1afc req-495b6d87-f7bf-4e74-8467-aeed7a6e4167 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:11.265777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:11.266280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7b3a54a6-538e-4ee2-91c7-c04200ab1afc req-495b6d87-f7bf-4e74-8467-aeed7a6e4167 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:11.266280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7b3a54a6-538e-4ee2-91c7-c04200ab1afc req-495b6d87-f7bf-4e74-8467-aeed7a6e4167 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:11.267255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:11.281470 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7b3a54a6-538e-4ee2-91c7-c04200ab1afc req-495b6d87-f7bf-4e74-8467-aeed7a6e4167 service nova] Creating event network-changed:45063db8-bdf0-4066-b313-ddfd91d7e60d for instance e715b06b-c447-4817-abaf-81424071a1ab on nch1-master-1 Oct 01 21:21:11.287107 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7b3a54a6-538e-4ee2-91c7-c04200ab1afc req-495b6d87-f7bf-4e74-8467-aeed7a6e4167 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079103 Oct 01 21:21:11.288561 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1594/5181] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:21:11.288710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:11.289100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:11.289614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:11.290563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:11.291420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:11.292018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:11.293887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:11.294881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:11.301665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:11.302366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:11.303710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:11.304637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:11.305272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:11.305878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:11.629207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:11.642166 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a13e64c8-dbf5-4fc9-a2bf-f5fad00c3a11 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1315 microversion: 2.1 time: 0.352310 Oct 01 21:21:11.643070 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1595/5182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:11 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:11.763153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:11.781825 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95440444-5e8d-4596-83bb-4b83420fdfc0 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 0.520149 Oct 01 21:21:11.783717 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3588/5183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:11 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:12.667968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:12.668748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:12.672308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:12.672968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:12.688262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:12.690172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:12.690686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:12.692657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:12.693158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:12.693644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:12.807826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:12.809230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:12.812662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:12.818192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:12.824719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:12.825940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:12.826896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:12.827934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:12.828810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:12.829598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:13.000765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:13.010398 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cb4047aa-fbb3-4205-b333-597d9be8f85c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1315 microversion: 2.1 time: 0.346344 Oct 01 21:21:13.012061 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1596/5184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:12 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:13.168973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:13.182419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab8587b8-df4c-444a-a662-f27eb9239baf tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 0.379204 Oct 01 21:21:13.202947 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3589/5185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:12 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:13.350785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-5193e9a5-74f2-42a8-a88e-6f23c1c6684a req-36cc4956-234f-428a-94c8-6af127ac7761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c688ca69-aa68-4134-8b57-bcb4a4c9d078", "tag": "b4995ed7-156f-4cce-af7d-483072f60973"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:13.398757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5193e9a5-74f2-42a8-a88e-6f23c1c6684a req-36cc4956-234f-428a-94c8-6af127ac7761 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:13.399252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5193e9a5-74f2-42a8-a88e-6f23c1c6684a req-36cc4956-234f-428a-94c8-6af127ac7761 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:13.399696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5193e9a5-74f2-42a8-a88e-6f23c1c6684a req-36cc4956-234f-428a-94c8-6af127ac7761 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:13.459235 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-5193e9a5-74f2-42a8-a88e-6f23c1c6684a req-36cc4956-234f-428a-94c8-6af127ac7761 service nova] Creating event network-changed:b4995ed7-156f-4cce-af7d-483072f60973 for instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 on nch1-master-1 Oct 01 21:21:13.486230 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-5193e9a5-74f2-42a8-a88e-6f23c1c6684a req-36cc4956-234f-428a-94c8-6af127ac7761 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139745 Oct 01 21:21:13.486877 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1597/5186] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:21:14.042323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:14.043107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:14.072625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:14.073155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:14.075559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:14.076757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:14.076890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:14.077266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:14.218947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:14.219664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:14.233043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:14.233751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:14.234200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:14.234951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:14.235420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:14.235852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:15.105805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:15.121712 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1bbbb238-7f1b-49f7-8527-b3969ec73a07 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1315 microversion: 2.1 time: 1.089065 Oct 01 21:21:15.123102 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3590/5187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:14 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1315 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:15.420309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:15.476255 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ee7a54f6-f996-4aee-96ba-985ffaeceabc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 1.256248 Oct 01 21:21:15.496247 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1598/5188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:14 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:16.145631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:16.149244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:16.171758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:16.173869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:16.174674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:16.176500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:16.176500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:16.177190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:16.505621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:16.506820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:16.517955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:16.523599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:16.524434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:16.525414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:16.527444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:16.529797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:16.689905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:16.712401 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-afbf4604-d031-4a7c-ba98-7a99a38224f9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1315 microversion: 2.1 time: 0.570134 Oct 01 21:21:16.734352 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3591/5189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:16 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:17.015568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:17.033228 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9e121230-1830-462d-9264-f515695a6afd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 0.532665 Oct 01 21:21:17.034269 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1599/5190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:16 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:17.743538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:17.745021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:17.760509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:17.762644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:17.763504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:17.770579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:17.771092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:17.771608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:18.035330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:18.060623 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b7462ae4-b079-4235-b364-f95510f3df19 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1315 microversion: 2.1 time: 0.322648 Oct 01 21:21:18.087197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:18.088533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:18.096979 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3592/5191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:17 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:18.141000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:18.141534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:18.142000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:18.143178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:18.143640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:18.144104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:18.426353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:18.436469 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c69c179c-af00-4dad-93dd-92ef05728e69 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 0.357441 Oct 01 21:21:18.437685 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1600/5192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:18 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:19.094682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:19.096312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:19.107463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:19.116826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:19.119079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:19.120704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:19.121463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:19.122150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:19.361404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:19.371179 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fd6d3c2-c545-4a6d-9502-900192d20295 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1315 microversion: 2.1 time: 0.281061 Oct 01 21:21:19.372253 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3593/5193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:19 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:19.462683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:19.463298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:19.466273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1970619469", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c73daf27-b1ba-44f2-8829-07b97df7622f", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4a3c030a-8624-4d4f-bb7a-67548024ff58"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:19.471415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:19.471926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:19.472377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:19.473104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:19.473556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:19.473997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:19.623385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] validate_networks() for [('4a3c030a-8624-4d4f-bb7a-67548024ff58', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:21:19.753052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:19.765347 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d3453227-ac28-479f-9508-5d2879f4d13a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 0.306854 Oct 01 21:21:19.767330 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1601/5194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:19 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:19.826002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e80e49e1-fb33-4a85-817b-d689986145b7 req-32c3e79f-46c1-49e8-9f0f-335d6b5d7022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e715b06b-c447-4817-abaf-81424071a1ab", "name": "network-vif-plugged", "status": "completed", "tag": "45063db8-bdf0-4066-b313-ddfd91d7e60d"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:19.845216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e80e49e1-fb33-4a85-817b-d689986145b7 req-32c3e79f-46c1-49e8-9f0f-335d6b5d7022 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:19.845711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e80e49e1-fb33-4a85-817b-d689986145b7 req-32c3e79f-46c1-49e8-9f0f-335d6b5d7022 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:19.848954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e80e49e1-fb33-4a85-817b-d689986145b7 req-32c3e79f-46c1-49e8-9f0f-335d6b5d7022 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:19.879966 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e80e49e1-fb33-4a85-817b-d689986145b7 req-32c3e79f-46c1-49e8-9f0f-335d6b5d7022 service nova] Creating event network-vif-plugged:45063db8-bdf0-4066-b313-ddfd91d7e60d for instance e715b06b-c447-4817-abaf-81424071a1ab on nch1-master-1 Oct 01 21:21:19.889382 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e80e49e1-fb33-4a85-817b-d689986145b7 req-32c3e79f-46c1-49e8-9f0f-335d6b5d7022 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076461 Oct 01 21:21:19.891620 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1602/5195] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:21:20.360570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:21:20.361075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:21:20.362156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:21:20.362711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:21:20.364109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:21:20.380535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:20.381856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:20.382588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:20.383731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:20.384430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:20.385484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:20.396206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:20.400924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:20.412182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:21:20.416818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:20.417326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:20.418440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:20.419484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:20.421775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for user eb0bf5fce885439eaa16a0871c2992ac and project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:21:20.421988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:20.422425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:20.444639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:21:20.448929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c73daf27-b1ba-44f2-8829-07b97df7622f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:21:20.565919 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4fe59254-eedb-46de-9e65-053abd9d3939 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104062 Oct 01 21:21:20.576104 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3594/5196] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:21:20.582724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b7b8b5fa-857f-4a7b-9c13-276ff7e28f77 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:20.583343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b7b8b5fa-857f-4a7b-9c13-276ff7e28f77 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:20.652375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b7b8b5fa-857f-4a7b-9c13-276ff7e28f77 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:20.662979 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b7b8b5fa-857f-4a7b-9c13-276ff7e28f77 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1057 microversion: 2.1 time: 0.085173 Oct 01 21:21:20.663599 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3595/5197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:20 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1057 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:20.792980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:20.794485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:20.816070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:20.822836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:20.823452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:20.824302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:20.824797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:20.825393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:20.901034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:20.919927 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2b9b585a-95ce-476c-a80f-975e448e02d8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1315 microversion: 2.1 time: 0.527918 Oct 01 21:21:20.923191 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1603/5198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:20 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:21.209491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:21.235259 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bdbeeff8-c908-4960-bade-71c8721c422c tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 0.449813 Oct 01 21:21:21.235898 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3596/5199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:20 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:21.687087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:21.687787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:21.697525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:21.698005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:21.698457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:21.699206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:21.702986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:21.703693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:21.791942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:21.800025 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-45d90f5f-89fd-49cc-b4f4-3686477ec9bc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1109 microversion: 2.1 time: 0.116676 Oct 01 21:21:21.800935 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1604/5200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:21 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1109 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:21.946168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:21.948276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:21.962067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:21.964119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:21.965213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:21.966654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:21.967472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:21.968127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:21.970437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d7419efa-76ce-4111-95b3-c61bdf2b7e6c req-fe2c1a9d-0676-401c-b6b1-66d4011d00f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c688ca69-aa68-4134-8b57-bcb4a4c9d078", "name": "network-vif-plugged", "status": "completed", "tag": "b4995ed7-156f-4cce-af7d-483072f60973"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:21.988867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d7419efa-76ce-4111-95b3-c61bdf2b7e6c req-fe2c1a9d-0676-401c-b6b1-66d4011d00f5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:21.989443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d7419efa-76ce-4111-95b3-c61bdf2b7e6c req-fe2c1a9d-0676-401c-b6b1-66d4011d00f5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:21.989883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d7419efa-76ce-4111-95b3-c61bdf2b7e6c req-fe2c1a9d-0676-401c-b6b1-66d4011d00f5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:22.023220 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d7419efa-76ce-4111-95b3-c61bdf2b7e6c req-fe2c1a9d-0676-401c-b6b1-66d4011d00f5 service nova] Creating event network-vif-plugged:b4995ed7-156f-4cce-af7d-483072f60973 for instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 on nch1-master-1 Oct 01 21:21:22.040419 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d7419efa-76ce-4111-95b3-c61bdf2b7e6c req-fe2c1a9d-0676-401c-b6b1-66d4011d00f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069566 Oct 01 21:21:22.040789 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1605/5201] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:21:22.265424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:22.266342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:22.279761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:22.280456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:22.281081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:22.281996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:22.282674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:22.283404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:22.549584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:22.567007 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88601b28-3b72-443c-b211-6a4989beb965 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1502 microversion: 2.1 time: 0.625359 Oct 01 21:21:22.573562 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3597/5202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:21 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1502 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:22.598689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09d9d53a-c872-43b1-8698-edae622b1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:22.602737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-09d9d53a-c872-43b1-8698-edae622b1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:22.620965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09d9d53a-c872-43b1-8698-edae622b1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:22.621837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09d9d53a-c872-43b1-8698-edae622b1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:22.622448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09d9d53a-c872-43b1-8698-edae622b1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:22.623910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09d9d53a-c872-43b1-8698-edae622b1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:22.624616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09d9d53a-c872-43b1-8698-edae622b1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:22.628595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09d9d53a-c872-43b1-8698-edae622b1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:22.755272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-09d9d53a-c872-43b1-8698-edae622b1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.161852 Oct 01 21:21:22.757151 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3598/5203] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:22 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 01 21:21:22.826113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:22.826928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:22.837165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:22.840990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:22.842915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:22.843956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:22.849762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:22.850449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:22.872461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:22.882833 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-583fa071-ceff-47ca-99a0-431d04adf699 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1391 microversion: 2.1 time: 0.623233 Oct 01 21:21:22.886928 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1606/5204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:22 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1391 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:23.062816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:23.072626 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b1fdfdf4-555e-495f-acba-6f130c436d86 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1127 microversion: 2.1 time: 0.250863 Oct 01 21:21:23.083569 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3599/5205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:22 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1127 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:23.768665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b137e7e7-df6d-4d88-b181-8632b2a76a2f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:23.771970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b137e7e7-df6d-4d88-b181-8632b2a76a2f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:23.806034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b137e7e7-df6d-4d88-b181-8632b2a76a2f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:23.806706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b137e7e7-df6d-4d88-b181-8632b2a76a2f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:23.807170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b137e7e7-df6d-4d88-b181-8632b2a76a2f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:23.808052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b137e7e7-df6d-4d88-b181-8632b2a76a2f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:23.808678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b137e7e7-df6d-4d88-b181-8632b2a76a2f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:23.809098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b137e7e7-df6d-4d88-b181-8632b2a76a2f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:23.910046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:23.911025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:23.931149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:23.931785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:23.938073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:23.946342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:23.947058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:23.947818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:23.952930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=100 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:23.953173 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b137e7e7-df6d-4d88-b181-8632b2a76a2f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.189178 Oct 01 21:21:23.954148 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1607/5206] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:23 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:21:24.108663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:24.109399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:24.131267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:24.142011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:24.142477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:24.143279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:24.143751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:24.144183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:24.475874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:24.491291 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-289fa625-ce40-4baf-a08f-6c35b17aa9dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1564 microversion: 2.1 time: 0.584334 Oct 01 21:21:24.493439 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3600/5207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:23 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1564 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:24.526418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:24.538038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:24.542981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:24.546476 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b54deef3-fc2d-4f6e-8200-671ef18f10fb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1169 microversion: 2.1 time: 0.440929 Oct 01 21:21:24.548398 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1608/5208] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:24 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1169 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:24.562234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:24.563923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:24.564758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:24.565713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:24.571830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:24.572650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:24.968847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6ed897c8-6624-4c89-9a6b-83214745d35e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:24.971832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ed897c8-6624-4c89-9a6b-83214745d35e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:24.992773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed897c8-6624-4c89-9a6b-83214745d35e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:24.993588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed897c8-6624-4c89-9a6b-83214745d35e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:24.996344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed897c8-6624-4c89-9a6b-83214745d35e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:24.998746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed897c8-6624-4c89-9a6b-83214745d35e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:24.999582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed897c8-6624-4c89-9a6b-83214745d35e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:25.000485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ed897c8-6624-4c89-9a6b-83214745d35e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:25.097264 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6ed897c8-6624-4c89-9a6b-83214745d35e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.133865 Oct 01 21:21:25.099941 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1609/5209] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:24 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:21:25.376707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b0fa92c9-4b42-4cde-8cc8-7f5a0fc53821 req-d77f2381-49c7-4fa5-b2e3-9fece29afd3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71897887-e027-432e-9f78-9ba049bb5cdb", "tag": "f6e0ba8c-8bee-47f5-a2d9-52232e7ec9e8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:25.392495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b0fa92c9-4b42-4cde-8cc8-7f5a0fc53821 req-d77f2381-49c7-4fa5-b2e3-9fece29afd3a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:25.393479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b0fa92c9-4b42-4cde-8cc8-7f5a0fc53821 req-d77f2381-49c7-4fa5-b2e3-9fece29afd3a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:25.394278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b0fa92c9-4b42-4cde-8cc8-7f5a0fc53821 req-d77f2381-49c7-4fa5-b2e3-9fece29afd3a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:25.401457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:25.430877 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b0fa92c9-4b42-4cde-8cc8-7f5a0fc53821 req-d77f2381-49c7-4fa5-b2e3-9fece29afd3a service nova] Creating event network-changed:f6e0ba8c-8bee-47f5-a2d9-52232e7ec9e8 for instance 71897887-e027-432e-9f78-9ba049bb5cdb on nch2-master-1 Oct 01 21:21:25.469864 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b0fa92c9-4b42-4cde-8cc8-7f5a0fc53821 req-d77f2381-49c7-4fa5-b2e3-9fece29afd3a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103198 Oct 01 21:21:25.474840 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1610/5210] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:21:25.577117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:25.577931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:25.593192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:25.594996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:25.597393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:25.598516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:25.600614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:25.601970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:25.613724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:25.627536 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab664259-1c24-407f-97d1-81092024f1dd tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1564 microversion: 2.1 time: 1.114222 Oct 01 21:21:25.632287 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3601/5211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:24 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1564 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:26.111646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aff12770-af8b-49ae-9d83-1a19c135a0a3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:26.114748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aff12770-af8b-49ae-9d83-1a19c135a0a3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:26.131106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff12770-af8b-49ae-9d83-1a19c135a0a3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:26.133983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff12770-af8b-49ae-9d83-1a19c135a0a3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:26.134756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff12770-af8b-49ae-9d83-1a19c135a0a3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:26.138106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff12770-af8b-49ae-9d83-1a19c135a0a3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:26.139223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff12770-af8b-49ae-9d83-1a19c135a0a3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:26.139896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aff12770-af8b-49ae-9d83-1a19c135a0a3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:26.143957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:26.154666 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3855295d-7b15-4487-bd5f-83a3072a46ac tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1169 microversion: 2.1 time: 0.582915 Oct 01 21:21:26.158137 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1611/5212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:25 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1169 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:26.263215 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aff12770-af8b-49ae-9d83-1a19c135a0a3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.154809 Oct 01 21:21:26.265244 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3602/5213] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:26 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:21:27.183167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:27.184714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:27.198284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:27.203464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:27.212972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:27.216954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:27.218893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:27.219343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:27.276881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb29512d-0156-4d5e-bc01-a15fe0df4232 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:27.279497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eb29512d-0156-4d5e-bc01-a15fe0df4232 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:27.297503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb29512d-0156-4d5e-bc01-a15fe0df4232 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:27.299577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb29512d-0156-4d5e-bc01-a15fe0df4232 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:27.300070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb29512d-0156-4d5e-bc01-a15fe0df4232 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:27.302126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb29512d-0156-4d5e-bc01-a15fe0df4232 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:27.305213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb29512d-0156-4d5e-bc01-a15fe0df4232 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:27.306017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb29512d-0156-4d5e-bc01-a15fe0df4232 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:27.414594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb29512d-0156-4d5e-bc01-a15fe0df4232 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.141915 Oct 01 21:21:27.415525 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3603/5214] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:27 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 01 21:21:27.461628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:27.471495 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-217ee206-b102-4f4e-88f9-78e64edb4566 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1169 microversion: 2.1 time: 0.293769 Oct 01 21:21:27.472645 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1612/5215] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:27 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1169 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:28.426398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9112994a-82bf-4405-aab5-cfc7fbef35b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:28.430308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9112994a-82bf-4405-aab5-cfc7fbef35b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:28.447288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9112994a-82bf-4405-aab5-cfc7fbef35b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:28.448064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9112994a-82bf-4405-aab5-cfc7fbef35b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:28.448779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9112994a-82bf-4405-aab5-cfc7fbef35b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:28.449761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9112994a-82bf-4405-aab5-cfc7fbef35b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:28.450466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9112994a-82bf-4405-aab5-cfc7fbef35b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:28.451191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9112994a-82bf-4405-aab5-cfc7fbef35b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:28.499031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:28.500275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:28.509293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:28.509792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:28.510239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:28.510977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:28.511440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:28.514882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:28.515051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9112994a-82bf-4405-aab5-cfc7fbef35b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.092484 Oct 01 21:21:28.519510 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3604/5216] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:28 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:21:28.713398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:28.730777 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-469adbed-8796-4ae7-ac32-12422191904d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1203 microversion: 2.1 time: 0.234763 Oct 01 21:21:28.732923 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1613/5217] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:28 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1203 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:29.528023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f87420bd-911e-4654-af58-e80aa45a46f1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:29.530404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f87420bd-911e-4654-af58-e80aa45a46f1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:29.542954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87420bd-911e-4654-af58-e80aa45a46f1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:29.543460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87420bd-911e-4654-af58-e80aa45a46f1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:29.544445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87420bd-911e-4654-af58-e80aa45a46f1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:29.545416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87420bd-911e-4654-af58-e80aa45a46f1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:29.545894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87420bd-911e-4654-af58-e80aa45a46f1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:29.546336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f87420bd-911e-4654-af58-e80aa45a46f1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:29.602444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f87420bd-911e-4654-af58-e80aa45a46f1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.078444 Oct 01 21:21:29.606233 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3605/5218] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:29 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:21:29.756414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:29.758940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:29.767432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:29.767938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:29.768388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:29.769269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:29.769738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:29.770170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:29.909695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:29.918374 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-76b3970a-8636-42b7-a9c9-d7694719ecb7 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1203 microversion: 2.1 time: 0.166560 Oct 01 21:21:29.918994 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1614/5219] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:29 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:30.190695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:30.190695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:30.220197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-8c73740a-c325-455b-9cf0-e7c8a30d18d5 req-4408b25e-e19a-4fb7-b713-b31ae3310828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c688ca69-aa68-4134-8b57-bcb4a4c9d078", "tag": "b4995ed7-156f-4cce-af7d-483072f60973"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:30.233273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:30.235053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:30.236046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:30.237491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:30.237723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8c73740a-c325-455b-9cf0-e7c8a30d18d5 req-4408b25e-e19a-4fb7-b713-b31ae3310828 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:30.238594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:30.240562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8c73740a-c325-455b-9cf0-e7c8a30d18d5 req-4408b25e-e19a-4fb7-b713-b31ae3310828 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:30.240724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:30.241326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8c73740a-c325-455b-9cf0-e7c8a30d18d5 req-4408b25e-e19a-4fb7-b713-b31ae3310828 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:30.253612 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-8c73740a-c325-455b-9cf0-e7c8a30d18d5 req-4408b25e-e19a-4fb7-b713-b31ae3310828 service nova] Creating event network-changed:b4995ed7-156f-4cce-af7d-483072f60973 for instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 on nch1-master-1 Oct 01 21:21:30.260482 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-8c73740a-c325-455b-9cf0-e7c8a30d18d5 req-4408b25e-e19a-4fb7-b713-b31ae3310828 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043912 Oct 01 21:21:30.261806 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1615/5220] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:21:30.402515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:30.620661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-65d5ecff-3dcf-4f9f-be7b-0f6463c20272 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:30.623693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-65d5ecff-3dcf-4f9f-be7b-0f6463c20272 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:30.642372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65d5ecff-3dcf-4f9f-be7b-0f6463c20272 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:30.642991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65d5ecff-3dcf-4f9f-be7b-0f6463c20272 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:30.643437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65d5ecff-3dcf-4f9f-be7b-0f6463c20272 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:30.645583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65d5ecff-3dcf-4f9f-be7b-0f6463c20272 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:30.647153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65d5ecff-3dcf-4f9f-be7b-0f6463c20272 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:30.647610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-65d5ecff-3dcf-4f9f-be7b-0f6463c20272 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:30.659137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:30.719497 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-65d5ecff-3dcf-4f9f-be7b-0f6463c20272 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.109561 Oct 01 21:21:30.720859 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1616/5221] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:30 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 01 21:21:30.846692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:30.860142 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ef15fb7-b519-4f54-84c5-4ebbc5215476 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1564 microversion: 2.1 time: 0.675148 Oct 01 21:21:30.863253 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3606/5222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:30 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1564 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:30.949013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:30.950061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:30.968754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:30.969999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:30.973185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:30.975960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:30.976559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:30.978340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:31.249723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:31.261319 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e415ceaa-524c-451d-badf-2fa6d85f1182 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1203 microversion: 2.1 time: 0.318610 Oct 01 21:21:31.262437 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1617/5223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:30 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1203 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:31.732415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77dd806b-074b-40cc-91d5-7028c345f1c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:31.737103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-77dd806b-074b-40cc-91d5-7028c345f1c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:31.750861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dd806b-074b-40cc-91d5-7028c345f1c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:31.751374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dd806b-074b-40cc-91d5-7028c345f1c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:31.752316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dd806b-074b-40cc-91d5-7028c345f1c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:31.752976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dd806b-074b-40cc-91d5-7028c345f1c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:31.754523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dd806b-074b-40cc-91d5-7028c345f1c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:31.755140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77dd806b-074b-40cc-91d5-7028c345f1c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:31.804523 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77dd806b-074b-40cc-91d5-7028c345f1c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.077263 Oct 01 21:21:31.805848 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3607/5224] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:31 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:21:32.288788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:32.289502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:32.297943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:32.298593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:32.299296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:32.302405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:32.303305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:32.303997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:32.512170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:32.524125 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7d1b462b-f213-444e-a34b-1a52ad92b0cb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1203 microversion: 2.1 time: 0.240810 Oct 01 21:21:32.525266 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1618/5225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:32 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1203 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:32.816201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7f7d31d-9564-43a8-a36c-dd41a97a758b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:32.820354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7f7d31d-9564-43a8-a36c-dd41a97a758b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:32.832496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7f7d31d-9564-43a8-a36c-dd41a97a758b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:32.840160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7f7d31d-9564-43a8-a36c-dd41a97a758b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:32.842176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7f7d31d-9564-43a8-a36c-dd41a97a758b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:32.845808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7f7d31d-9564-43a8-a36c-dd41a97a758b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:32.846328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7f7d31d-9564-43a8-a36c-dd41a97a758b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:32.846782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7f7d31d-9564-43a8-a36c-dd41a97a758b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:32.901774 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7f7d31d-9564-43a8-a36c-dd41a97a758b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.089610 Oct 01 21:21:32.902481 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3608/5226] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:32 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:21:33.547708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:33.548473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:33.551897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=62 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:33.557673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:33.558368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:33.558838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:33.559870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:33.560512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:33.560944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:33.724800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:33.737819 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e43b056-d518-49e1-8be7-7db5d460ffbe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1203 microversion: 2.1 time: 0.194123 Oct 01 21:21:33.738773 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1619/5227] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:33 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1203 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:33.803984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0cc352fa-5818-46b6-a76d-442e34b3ca8e req-02df511b-55bf-46d7-9ec3-32f170c0ef9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71897887-e027-432e-9f78-9ba049bb5cdb", "name": "network-vif-plugged", "status": "completed", "tag": "f6e0ba8c-8bee-47f5-a2d9-52232e7ec9e8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:33.813431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:33.821873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0cc352fa-5818-46b6-a76d-442e34b3ca8e req-02df511b-55bf-46d7-9ec3-32f170c0ef9e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:33.823038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0cc352fa-5818-46b6-a76d-442e34b3ca8e req-02df511b-55bf-46d7-9ec3-32f170c0ef9e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:33.823699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0cc352fa-5818-46b6-a76d-442e34b3ca8e req-02df511b-55bf-46d7-9ec3-32f170c0ef9e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:33.842319 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0cc352fa-5818-46b6-a76d-442e34b3ca8e req-02df511b-55bf-46d7-9ec3-32f170c0ef9e service nova] Creating event network-vif-plugged:f6e0ba8c-8bee-47f5-a2d9-52232e7ec9e8 for instance 71897887-e027-432e-9f78-9ba049bb5cdb on nch2-master-1 Oct 01 21:21:33.848284 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0cc352fa-5818-46b6-a76d-442e34b3ca8e req-02df511b-55bf-46d7-9ec3-32f170c0ef9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050650 Oct 01 21:21:33.849721 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3609/5228] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:21:33.914468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-280724c0-4cc5-43c6-967a-4bdcdf573720 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:33.916700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-280724c0-4cc5-43c6-967a-4bdcdf573720 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:33.924849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-280724c0-4cc5-43c6-967a-4bdcdf573720 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:33.925719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-280724c0-4cc5-43c6-967a-4bdcdf573720 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:33.926361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-280724c0-4cc5-43c6-967a-4bdcdf573720 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:33.927838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-280724c0-4cc5-43c6-967a-4bdcdf573720 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:33.928511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-280724c0-4cc5-43c6-967a-4bdcdf573720 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:33.929253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-280724c0-4cc5-43c6-967a-4bdcdf573720 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:33.976367 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-280724c0-4cc5-43c6-967a-4bdcdf573720 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 14 microversion: 2.1 time: 0.065975 Oct 01 21:21:33.977241 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1620/5229] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:33 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:21:34.763662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:34.764320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:34.773508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:34.774303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:34.774955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:34.775672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:34.776292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:34.776775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:34.923823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:34.933474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fdf1393e-e479-40b4-a98d-6240f81878bb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1203 microversion: 2.1 time: 0.175793 Oct 01 21:21:34.934363 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3610/5230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:34 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:34.990726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ec12de27-4dbd-4050-8226-3aec73a09514 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:34.993729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ec12de27-4dbd-4050-8226-3aec73a09514 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:35.013747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec12de27-4dbd-4050-8226-3aec73a09514 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.014380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec12de27-4dbd-4050-8226-3aec73a09514 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.014974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec12de27-4dbd-4050-8226-3aec73a09514 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.016101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec12de27-4dbd-4050-8226-3aec73a09514 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.016550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec12de27-4dbd-4050-8226-3aec73a09514 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.017039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec12de27-4dbd-4050-8226-3aec73a09514 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.105077 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ec12de27-4dbd-4050-8226-3aec73a09514 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action" status: 200 len: 8206 microversion: 2.1 time: 0.120211 Oct 01 21:21:35.106322 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1621/5231] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:34 2022] POST /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab/action => generated 8206 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:35.118635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:35.119271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:35.127123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.127621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.130950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.132884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.135209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.135656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.308891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:35.319866 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-79b5c5f9-3349-4893-8705-8de23468be77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.207169 Oct 01 21:21:35.321081 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3611/5232] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:35 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:35.351150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:35.351862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:35.360899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.361497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.362137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.363060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.363609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.364394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.537327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:35.546222 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9af26810-3c42-41a4-91d0-809fbb2016c0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.199661 Oct 01 21:21:35.547443 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1622/5233] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:35 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:35.569212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:35.570125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:35.576714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.577211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.577749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.578461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.578955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.579394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.727222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:35.736237 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9a857434-026d-42a6-94cf-b944ee99e823 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.171353 Oct 01 21:21:35.736836 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3612/5234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:35 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:35.759799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:35.760949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:35.769402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.770303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.771714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.772155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.772778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.773187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.935091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:35.943799 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-34ad014f-e0ba-48e3-a926-e518bddfed96 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.189506 Oct 01 21:21:35.944396 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1623/5235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:35 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:35.962028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:35.964156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:35.967158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:35.967969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:35.974755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.974937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.975485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.976072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.976449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.977430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.978081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.978529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.979180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:35.980160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:35.980840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:35.981465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.036602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Locking {{(pid=140437) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 01 21:21:36.149116 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4b9aaf4a-7888-4bc5-be74-1a5e203438c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.186020 Oct 01 21:21:36.153473 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1624/5236] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:35 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:21:36.167165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:36.169744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:36.188257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.188871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.189412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.190485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.191066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.192042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.194681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:36.211785 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-257165eb-367e-4ecb-85fd-706fa82be8ce tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1389 microversion: 2.1 time: 0.254332 Oct 01 21:21:36.231263 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3613/5237] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:35 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1389 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:36.242059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:36.243165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:36.251762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.252643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.253308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.254271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.255098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.256296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.526908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:36.548170 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-96043f6e-a0cd-4841-8a3f-036d01343532 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.385979 Oct 01 21:21:36.548844 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1625/5238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:36 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:36.589754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:36.601775 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe8a32cc-b21f-4ac4-b05a-3f67aa025ca8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1389 microversion: 2.1 time: 0.365681 Oct 01 21:21:36.602738 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3614/5239] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:36 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1389 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:36.616597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d618d53d-c6b2-4df8-9171-ac37504d9d6e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:36.626635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d618d53d-c6b2-4df8-9171-ac37504d9d6e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.627701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d618d53d-c6b2-4df8-9171-ac37504d9d6e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.628203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d618d53d-c6b2-4df8-9171-ac37504d9d6e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.653300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:36.654143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:36.661181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.662329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.663805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.664569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.665041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.665796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.681027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:36.694056 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-d618d53d-c6b2-4df8-9171-ac37504d9d6e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] HTTP exception thrown: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 is locked Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d618d53d-c6b2-4df8-9171-ac37504d9d6e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Request method failure captured: Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action HTTP/1.1 Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 15 Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK51guwpTsEFYzEaQ9cmedMpT5cluuk71QMpGouMZtWUPSkEoLCE3b04KINSUyFdDxIQYMCDoNcA7IiMJeIf8OZueQYS_eN2BJEhvD4WnfFGYSigDLzOxFn1UZ9n3lFXXox3_ymg9IRNYHqUavbXe4Vw8Fuy884FTQKlMDxiT0lNipw Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e09544743724cf18d2ab2aeb4180d81", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}] Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 6ac020dc323042c48ccce2a8826bc6be Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: {"os-stop": {}} Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 is locked Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '5dadce29-73d7-453e-9e65-783d8432f9f3', 'body': {'os-stop': {}}} Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 is locked Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 is locked Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 is locked Oct 01 21:21:36.695969 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:36.703103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d618d53d-c6b2-4df8-9171-ac37504d9d6e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Returning 409 to user: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 is locked {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:21:36.703103 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d618d53d-c6b2-4df8-9171-ac37504d9d6e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 409 len: 107 microversion: 2.1 time: 0.116662 Oct 01 21:21:36.703103 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1626/5240] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:36 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 107 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:21:36.710274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:36.710940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:36.717780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.718394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.719061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.720169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.720641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.721060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.775291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Unlocking {{(pid=140437) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 01 21:21:36.832432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:36.837651 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9375bc1e-6217-4330-97a3-d145e826e1e0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.133419 Oct 01 21:21:36.838814 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1627/5241] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:36 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:21:36.846292 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-418ccc99-70bd-4038-b597-4bdd336b9379 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1389 microversion: 2.1 time: 0.213531 Oct 01 21:21:36.850526 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3615/5242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:36 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1389 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:36.851742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cbfbe181-e27e-40d5-96c7-0fb042d153e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:36.868898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbfbe181-e27e-40d5-96c7-0fb042d153e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.870879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbfbe181-e27e-40d5-96c7-0fb042d153e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.871670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbfbe181-e27e-40d5-96c7-0fb042d153e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.918381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cbfbe181-e27e-40d5-96c7-0fb042d153e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Going to try to stop instance {{(pid=140437) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 21:21:36.973220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:36.974082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:36.987046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.987472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.988009 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cbfbe181-e27e-40d5-96c7-0fb042d153e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.144815 Oct 01 21:21:36.988163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.988854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:36.990099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:36.990882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:36.999974 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1628/5243] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:36 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:21:37.010967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:37.014852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:37.023292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:37.024790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:37.025485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:37.026640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:37.027148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:37.027591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:37.046202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:21:37.175504 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9756edda-2377-4e11-ac40-c5b2e1c32831 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 204 len: 0 microversion: 2.1 time: 0.223159 Oct 01 21:21:37.176276 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3616/5244] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:21:36 2022] DELETE /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:21:37.185911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:37.186774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:37.194971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:37.194971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:37.195352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:37.196291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:37.196960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:37.197455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:37.355999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:37.365925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:37.369061 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d8ec54ae-a5d6-49ec-ada8-8c6f51e83302 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1395 microversion: 2.1 time: 0.187585 Oct 01 21:21:37.369852 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3617/5245] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:37 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1395 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:37.479431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:37.491499 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c7172661-5999-48bb-996d-5bc92833bbef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.486650 Oct 01 21:21:37.492160 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1629/5246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:37 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:38.392394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:38.393158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:38.415390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:38.416776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:38.417224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:38.418200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:38.418886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:38.419811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:38.521621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:38.523572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:38.534848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:38.535765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:38.537192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:38.538175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:38.539162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:38.539806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:38.628009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:38.638342 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05ee47b8-74d0-42d7-a489-06bc80238c8f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1395 microversion: 2.1 time: 0.249516 Oct 01 21:21:38.639776 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3618/5247] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:38 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1395 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:38.806280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:38.821302 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3357913b-e084-4441-afbd-9e7d1736afb2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.307808 Oct 01 21:21:38.835404 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1630/5248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:38 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:39.375290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-73be2d98-8087-4876-a9b1-461c1faa5877 req-e93863e7-5588-41c4-9cc5-5cf76bfa0c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71897887-e027-432e-9f78-9ba049bb5cdb", "name": "network-vif-deleted", "tag": "f6e0ba8c-8bee-47f5-a2d9-52232e7ec9e8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:39.385964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-73be2d98-8087-4876-a9b1-461c1faa5877 req-e93863e7-5588-41c4-9cc5-5cf76bfa0c0a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:39.386691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-73be2d98-8087-4876-a9b1-461c1faa5877 req-e93863e7-5588-41c4-9cc5-5cf76bfa0c0a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:39.387332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-73be2d98-8087-4876-a9b1-461c1faa5877 req-e93863e7-5588-41c4-9cc5-5cf76bfa0c0a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:39.401157 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-73be2d98-8087-4876-a9b1-461c1faa5877 req-e93863e7-5588-41c4-9cc5-5cf76bfa0c0a service nova] Creating event network-vif-deleted:f6e0ba8c-8bee-47f5-a2d9-52232e7ec9e8 for instance 71897887-e027-432e-9f78-9ba049bb5cdb on nch2-master-1 Oct 01 21:21:39.406827 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-73be2d98-8087-4876-a9b1-461c1faa5877 req-e93863e7-5588-41c4-9cc5-5cf76bfa0c0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035255 Oct 01 21:21:39.407447 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3619/5249] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:21:39.663336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:39.663962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:39.680437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:39.681012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:39.681462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:39.682232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:39.682723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:39.683157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:39.765277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:39.776967 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-051ed148-efb4-47a4-b7d1-476347e593e6 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 200 len: 1188 microversion: 2.1 time: 0.117309 Oct 01 21:21:39.777556 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1631/5250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:39 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 1188 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:39.847818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:39.849351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:39.856042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:39.856797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:39.857360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:39.857934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:39.858424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:39.859120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:40.070784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:40.080790 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9dba16c0-54ca-4d18-9d37-d1c36ec792a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.236874 Oct 01 21:21:40.082924 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3620/5251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:39 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:40.802416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:40.803171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:40.810206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:40.810730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:40.811171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:40.811870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:40.812354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:40.812776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:40.826145 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb HTTP/1.1 Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '71897887-e027-432e-9f78-9ba049bb5cdb'} Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:21:40.827846 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e75bcf18-6c83-44f4-a2b1-19e17c9be693 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 404 len: 111 microversion: 2.1 time: 0.032399 Oct 01 21:21:40.833948 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1632/5252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:40 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:21:41.116754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:41.118340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:41.126299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:41.126855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:41.127377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:41.128169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:41.129333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:41.130216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:41.287602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:41.308579 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ed35f545-90f4-49d9-af19-0dcccea7e994 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.198083 Oct 01 21:21:41.309385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3621/5253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:41 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:41.935180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:41.935950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:41.947414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:41.947896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:41.948426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:41.949803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:41.950279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:41.950948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:41.968801 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb HTTP/1.1 Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '71897887-e027-432e-9f78-9ba049bb5cdb'} Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:21:41.970666 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:41.976461 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:21:41.979220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:21:41.981167 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ad605adf-d3da-40a0-9f50-67c32adeff7c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 404 len: 111 microversion: 2.1 time: 0.050791 Oct 01 21:21:41.985272 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1633/5254] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:21:41 2022] DELETE /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:21:41.998055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:41.998055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 71897887-e027-432e-9f78-9ba049bb5cdb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:42.008474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:42.008997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:42.009458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:42.010210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:42.015427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:42.016259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:42.040886 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb HTTP/1.1 Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '71897887-e027-432e-9f78-9ba049bb5cdb'} Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:21:42.042709 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:21:42.048169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:21:42.048169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:21:42.048169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:21:42.048169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:21:42.048169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:21:42.048169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. Oct 01 21:21:42.048169 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:21:42.048169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 71897887-e027-432e-9f78-9ba049bb5cdb could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:21:42.049015 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02559db6-21d6-4271-91a8-3f73b37f89d0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb" status: 404 len: 111 microversion: 2.1 time: 0.061992 Oct 01 21:21:42.049379 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3622/5255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:41 2022] GET /compute/v2.1/servers/71897887-e027-432e-9f78-9ba049bb5cdb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:21:42.334509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:42.335160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:42.341124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:42.341640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:42.342068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:42.342787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:42.343248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:42.343678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:42.475008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:42.482761 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3b476069-d70d-435a-8362-211bc334ab5c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.152240 Oct 01 21:21:42.483327 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1634/5256] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:42 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:43.506795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:43.507423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:43.515032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:43.515530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:43.515982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:43.516695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:43.517160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:43.517896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:43.662089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:43.670261 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-478a6d92-2958-4b07-aab3-dd1cbe11a95b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.167707 Oct 01 21:21:43.670864 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3623/5257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:43 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:44.693935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:44.694590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:44.701607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:44.702147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:44.702635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:44.703336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:44.703851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:44.704281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:44.838862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:44.847079 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-32b9ab77-c807-4e6c-be03-259ea89fd465 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.157787 Oct 01 21:21:44.862376 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1635/5258] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:44 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:45.870400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:45.871350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:45.881498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:45.882142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:45.882921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:45.884009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:45.884647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:45.885294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:46.119915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:46.130458 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d0eb1f23-8f49-40bf-81f2-5c3d840da966 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.263963 Oct 01 21:21:46.131336 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3624/5259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:45 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:47.158986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:47.158986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:47.171643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:47.172151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:47.172603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:47.173325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:47.173788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:47.174220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:47.341515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:47.351860 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-226f3f28-993f-4b65-bc8a-c4cc8128906d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.200505 Oct 01 21:21:47.353135 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1636/5260] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:47 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:48.380436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:48.381251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:48.424588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:48.425459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:48.427681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:48.429112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:48.429785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:48.430440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:48.474358 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-593332343", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "af3590a1-ce01-4f8a-a2f8-cac49fea20f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4a3c030a-8624-4d4f-bb7a-67548024ff58"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:48.577306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] validate_networks() for [('4a3c030a-8624-4d4f-bb7a-67548024ff58', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:21:48.616052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:48.626962 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-38be4936-0c3c-4cbb-a4f4-1fb374b8447a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1655 microversion: 2.1 time: 0.251000 Oct 01 21:21:48.628051 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3625/5261] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:48 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1655 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:48.653074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e3cb1b7-6327-424f-a01f-374431a7d354 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:48.661899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3cb1b7-6327-424f-a01f-374431a7d354 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:48.663031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3cb1b7-6327-424f-a01f-374431a7d354 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:48.663482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3cb1b7-6327-424f-a01f-374431a7d354 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:48.693321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e3cb1b7-6327-424f-a01f-374431a7d354 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Going to try to start instance {{(pid=140438) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 01 21:21:48.763561 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e3cb1b7-6327-424f-a01f-374431a7d354 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.116472 Oct 01 21:21:48.764198 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3626/5262] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:48 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:21:48.781483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:48.781483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:48.818348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:48.819903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:48.822485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:48.823766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:48.824277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:48.824725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:49.158027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:49.206458 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6462226b-e556-4103-9b11-d710a9ec8c86 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1664 microversion: 2.1 time: 0.424390 Oct 01 21:21:49.216631 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3627/5263] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:48 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1664 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:49.291197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:21:49.291595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:21:49.292481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:21:49.292957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:21:49.293384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:21:49.306665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:49.307859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:49.308479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:49.309363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:49.310107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:49.310646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:49.343262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:21:49.351027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for user eb0bf5fce885439eaa16a0871c2992ac and project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:21:49.430579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:21:49.433005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af3590a1-ce01-4f8a-a2f8-cac49fea20f7',volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:21:49.627771 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8140adb4-6e14-4e56-b0b1-c69641b9537c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.158717 Oct 01 21:21:49.629636 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1637/5264] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:21:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:21:49.642470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b72ff059-77af-4807-98c8-c6e778b797f3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:49.642470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b72ff059-77af-4807-98c8-c6e778b797f3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:49.738061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b72ff059-77af-4807-98c8-c6e778b797f3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:49.750859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b72ff059-77af-4807-98c8-c6e778b797f3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1070 microversion: 2.1 time: 0.112967 Oct 01 21:21:49.751734 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3628/5265] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:49 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1070 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:50.236840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:50.240229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:50.260912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:50.260912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:50.260912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:50.267999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:50.268559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:50.271209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:50.545330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:50.555807 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-081b70e4-d021-41c5-a086-518e1fbabf89 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1664 microversion: 2.1 time: 0.325325 Oct 01 21:21:50.557095 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1638/5266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:50 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1664 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:50.777726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:50.778270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:50.791081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:50.792094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:50.792665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:50.793344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:50.794138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:50.794670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:50.893541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:50.905438 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7fd0dd14-fef6-4698-a21c-e51b9befc343 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1112 microversion: 2.1 time: 0.133111 Oct 01 21:21:50.906045 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3629/5267] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:50 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1112 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:51.361895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-228a84ac-6ce0-4abd-9b66-4dce209ca304 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:51.368660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-228a84ac-6ce0-4abd-9b66-4dce209ca304 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:51.377698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-228a84ac-6ce0-4abd-9b66-4dce209ca304 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:51.378696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-228a84ac-6ce0-4abd-9b66-4dce209ca304 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:51.380386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-228a84ac-6ce0-4abd-9b66-4dce209ca304 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:51.381522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-228a84ac-6ce0-4abd-9b66-4dce209ca304 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:51.382373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-228a84ac-6ce0-4abd-9b66-4dce209ca304 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:51.383147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-228a84ac-6ce0-4abd-9b66-4dce209ca304 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:51.458935 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-228a84ac-6ce0-4abd-9b66-4dce209ca304 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078/action" status: 200 len: 24565 microversion: 2.1 time: 0.102574 Oct 01 21:21:51.460044 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1639/5268] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:51 2022] POST /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078/action => generated 24565 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:21:51.581628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:51.583290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:51.599337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:51.600466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:51.601172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:51.603033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:51.603823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:51.610878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:51.914089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:51.932971 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-de079903-8479-4860-8978-c5d62ff4c0e4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.355252 Oct 01 21:21:51.933797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:51.934875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:51.936077 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3630/5269] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:51 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:51.960151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:51.960860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:51.961533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:51.962435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:51.963089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:51.963753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:51.976290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:51.976931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:51.995910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:51.997811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:51.998726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:52.001193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:52.002745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:52.003587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:52.190245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:52.199976 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-db356dd6-4503-42c1-bf62-5d93bab45409 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1186 microversion: 2.1 time: 0.274143 Oct 01 21:21:52.200566 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1640/5270] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:51 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1186 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:52.252455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:52.264960 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-394c092c-82e3-4297-8ecd-6d6a9017cc00 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.296915 Oct 01 21:21:52.265565 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3631/5271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:51 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:52.289517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:52.289990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:52.298000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:52.298784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:52.299426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:52.300332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:52.300966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:52.301602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:52.356254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:52.370126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Unlocking {{(pid=140437) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 01 21:21:52.438545 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2b958b92-bec2-4581-a818-f7a3f5a58646 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.153803 Oct 01 21:21:52.445854 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1641/5272] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:52 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:21:52.452912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:52.453545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:52.464617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:52.467860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:52.468424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:52.469616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:52.470205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:52.470761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:52.676338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:52.686276 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49abe771-cb1a-481e-9142-7b710e626d93 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.239171 Oct 01 21:21:52.687587 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3632/5273] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:52 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:52.710848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:52.711574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:52.719287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:52.719888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:52.720472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:52.721265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:52.721806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:52.722384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:53.001100 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:53.011955 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d077a1eb-0574-4ebf-be83-f620f9182457 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.305704 Oct 01 21:21:53.012845 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1642/5274] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:52 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:53.042840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:53.044312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:53.054750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:53.056067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:53.056701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:53.057676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:53.058325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:53.058797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:53.227423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:53.228170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:53.253255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:53.255402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:53.257950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:53.259591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:53.262177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:53.263284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:53.315394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:53.330984 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1f0fb129-52ea-4c65-8bdf-f943680015c8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.298424 Oct 01 21:21:53.332128 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3633/5275] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:53 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:53.358185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-87ac44a9-65a5-4dae-ab64-f89c938006e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:53.358760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-87ac44a9-65a5-4dae-ab64-f89c938006e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:53.373160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ac44a9-65a5-4dae-ab64-f89c938006e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:53.373818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ac44a9-65a5-4dae-ab64-f89c938006e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:53.374148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ac44a9-65a5-4dae-ab64-f89c938006e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:53.374905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ac44a9-65a5-4dae-ab64-f89c938006e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:53.375721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ac44a9-65a5-4dae-ab64-f89c938006e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:53.376635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-87ac44a9-65a5-4dae-ab64-f89c938006e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:53.453424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:53.465278 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-87ac44a9-65a5-4dae-ab64-f89c938006e2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.110833 Oct 01 21:21:53.466724 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3634/5276] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:53 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:21:53.478201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:53.479307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:53.489149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:53.490228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:53.491095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:53.492301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:53.495076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:53.495859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:53.532129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:53.555724 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-22f9c251-a472-4442-8d2d-d3adf06a1928 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1228 microversion: 2.1 time: 0.334109 Oct 01 21:21:53.563204 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1643/5277] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:53 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1228 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:53.713582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:53.729223 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df1503ff-faf4-45b7-9211-3a59626aa2f2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1673 microversion: 2.1 time: 0.257974 Oct 01 21:21:53.730998 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3635/5278] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:53 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:54.040703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b9d742f8-f987-4e24-8003-537069107b1b req-e430f0e1-03d3-41bd-bf35-0531b0a154b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb45dd0-44e5-4abe-a6d2-ab807e1431e2", "tag": "516cb0ce-90bc-4b1e-af5b-c1e67be8c8eb"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:54.062065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b9d742f8-f987-4e24-8003-537069107b1b req-e430f0e1-03d3-41bd-bf35-0531b0a154b8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:54.063002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b9d742f8-f987-4e24-8003-537069107b1b req-e430f0e1-03d3-41bd-bf35-0531b0a154b8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:54.064219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b9d742f8-f987-4e24-8003-537069107b1b req-e430f0e1-03d3-41bd-bf35-0531b0a154b8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:54.077383 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b9d742f8-f987-4e24-8003-537069107b1b req-e430f0e1-03d3-41bd-bf35-0531b0a154b8 service nova] Creating event network-changed:516cb0ce-90bc-4b1e-af5b-c1e67be8c8eb for instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 on nch2-master-1 Oct 01 21:21:54.084204 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b9d742f8-f987-4e24-8003-537069107b1b req-e430f0e1-03d3-41bd-bf35-0531b0a154b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050299 Oct 01 21:21:54.085022 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1644/5279] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:21:54.149668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ef03cd0-4cb6-4e0d-8ff6-d94dbce2dc31 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Action: 'create', calling method: .version_select at 0x7f4172667670>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1258334286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9mXE0yiSQkd/iWy5KlIR39I44U7F5708oKkaraJsuswnM/M96EZ04sk5n5vkQe92coQgLQOkfYXSc/BFJcc4bmmmp6M97ZS5APXqyODUTL+IUCuyi+NNGRWKCMVqyXDw=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:54.166002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8ef03cd0-4cb6-4e0d-8ff6-d94dbce2dc31 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Getting quotas for project 90cb48440cb446ea9abfc00ed0f53779. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:21:54.172520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8ef03cd0-4cb6-4e0d-8ff6-d94dbce2dc31 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Getting quotas for user 55dadd491ec1441aac4171eff46bd679 and project 90cb48440cb446ea9abfc00ed0f53779. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:21:54.199905 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ef03cd0-4cb6-4e0d-8ff6-d94dbce2dc31 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054806 Oct 01 21:21:54.200528 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3636/5280] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:21:54 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:21:54.587903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:54.588763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:54.596884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:54.597577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:54.598211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:54.599968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:54.600659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:54.601579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:54.752585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:54.753289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:54.761567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:54.762576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:54.763033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:54.763841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:54.764308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:54.764736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:54.863106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:54.873663 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-21b51d0b-f48e-47ca-8548-afb11f06b487 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1216 microversion: 2.1 time: 0.291502 Oct 01 21:21:54.888785 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1645/5281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:54 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1216 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:54.969350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:54.984041 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-91fc8258-6cbe-4b07-bf77-a76d8afc82f5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1653 microversion: 2.1 time: 0.235207 Oct 01 21:21:54.986041 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3637/5282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:54 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1653 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:55.011928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-436e1361-4ab1-4252-89c7-54d09e1d5e71 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:55.012577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-436e1361-4ab1-4252-89c7-54d09e1d5e71 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:55.027299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-436e1361-4ab1-4252-89c7-54d09e1d5e71 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:55.028024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-436e1361-4ab1-4252-89c7-54d09e1d5e71 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:55.028334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-436e1361-4ab1-4252-89c7-54d09e1d5e71 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:55.029073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-436e1361-4ab1-4252-89c7-54d09e1d5e71 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:55.029541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-436e1361-4ab1-4252-89c7-54d09e1d5e71 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:55.029979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-436e1361-4ab1-4252-89c7-54d09e1d5e71 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:55.111479 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-436e1361-4ab1-4252-89c7-54d09e1d5e71 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.103664 Oct 01 21:21:55.116956 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1646/5283] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:21:55 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:21:55.126202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:55.126908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:55.137094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:55.137883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:55.138427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:55.139257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:55.139785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:55.140320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:55.369880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:55.382548 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62861305-10c7-4c32-832d-b8682adc06bc tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1660 microversion: 2.1 time: 0.264493 Oct 01 21:21:55.383637 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3638/5284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:55 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1660 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:55.531181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-893338496", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8f49ce01-740d-4958-95e8-e334234cf31f", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1258334286", "security_groups": [{"name": "tempest-secgroup-smoke-750042212"}], "networks": [{"uuid": "a3d2a130-9025-4565-a207-8dace0ad4690"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:55.693201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] validate_networks() for [('a3d2a130-9025-4565-a207-8dace0ad4690', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:21:55.903675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:55.904754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:55.924319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:55.927067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:55.929728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:55.929728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:55.930281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:55.930641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.150783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:56.168196 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d756bc5c-b6ee-4996-88f2-b567c0a17f3a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1216 microversion: 2.1 time: 0.270330 Oct 01 21:21:56.169272 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3639/5285] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:55 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1216 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:56.354729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:21:56.355159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:21:56.355638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:21:56.356091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:21:56.356513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:21:56.366071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.366578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.367011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.367744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.368199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.368624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.385237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Getting quotas for project 90cb48440cb446ea9abfc00ed0f53779. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:21:56.390364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Getting quotas for user 55dadd491ec1441aac4171eff46bd679 and project 90cb48440cb446ea9abfc00ed0f53779. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:21:56.409194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:56.409854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:56.416744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.417263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.417888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.418618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.419341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.419768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.449390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:21:56.451717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f49ce01-740d-4958-95e8-e334234cf31f',volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:21:56.553380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:56.564982 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e8eeedf7-e123-4873-b4c6-6177a5a17dce tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.159563 Oct 01 21:21:56.565981 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3640/5286] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:56 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:56.588794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:56.589410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:56.595185 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-80e63e61-94d3-4f08-89af-1e74702bac0c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.068400 Oct 01 21:21:56.596047 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1647/5287] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:21:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:21:56.596174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.596442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.596894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.597740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.598802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.599266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.607993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-00ed8c7f-0657-446a-9ea6-9ec707b16006 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:56.608620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-00ed8c7f-0657-446a-9ea6-9ec707b16006 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:56.667083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-00ed8c7f-0657-446a-9ea6-9ec707b16006 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:56.677235 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-00ed8c7f-0657-446a-9ea6-9ec707b16006 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1098 microversion: 2.1 time: 0.073516 Oct 01 21:21:56.677820 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1648/5288] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:56 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1098 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:56.742845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:56.751365 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a8477a6c-724c-4880-8aad-173926796bcf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.166461 Oct 01 21:21:56.752369 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3641/5289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:56 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:21:56.775467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:56.776080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:56.782942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.783430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.783866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.784551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.785034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.786097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.927696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:56.943222 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eea3a2bb-8277-4c73-a1a6-5883c00f7e1e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.171227 Oct 01 21:21:56.944418 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1649/5290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:56 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:56.968189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:56.969026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:56.976312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.977061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.977733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:56.978800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:56.979461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:56.979909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:57.151590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:57.160786 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae30b06d-98ac-4fa2-9134-e918a835661c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.197306 Oct 01 21:21:57.161380 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3642/5291] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:56 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:57.188498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:57.189469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:57.196735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:57.197537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:57.198021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:57.198157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:57.198479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:57.199271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:57.199811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:57.200254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:57.206066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:57.206597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:57.207037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:57.208534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:57.209176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:57.209611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:57.341414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:57.349493 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-03396f12-6cb1-4d60-b576-7921a09dc336 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.168154 Oct 01 21:21:57.350073 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1650/5292] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:57 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:57.356945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:57.366131 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-711a58a7-f450-44fc-95fe-c5ab20935c38 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1216 microversion: 2.1 time: 0.174111 Oct 01 21:21:57.366976 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3643/5293] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:57 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:57.373402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:57.374369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:57.381143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:57.381707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:57.382250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:57.383082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:57.383663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:57.384159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:57.521961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:57.530512 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-48b87efc-27a5-45b6-a8ef-3e4df56104dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.161111 Oct 01 21:21:57.531111 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1651/5294] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:57 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:57.700788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:57.701481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:57.707808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:57.708404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:57.708911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:57.711043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:57.711750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:57.712511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:57.779854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:57.792146 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80c3f24a-ac45-4dfa-a4b2-1d182a091423 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1204 microversion: 2.1 time: 0.095842 Oct 01 21:21:57.793350 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3644/5295] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:57 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:58.390233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:58.392420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:58.399589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:58.400085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:58.400552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:58.401486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:58.401973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:58.402395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:58.727104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:58.736525 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4aa11b6a-3c8c-4f8d-bced-c0623cf18ae5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1216 microversion: 2.1 time: 0.350764 Oct 01 21:21:58.737248 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1652/5296] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:58 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1216 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:58.816976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:58.818224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:58.825492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:58.826352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:58.827068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:58.828732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:58.829673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:58.830332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:58.999634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:21:59.008326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6091798d-cb2c-4d01-9d76-089994539081 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1281 microversion: 2.1 time: 0.195350 Oct 01 21:21:59.009570 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3645/5297] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:58 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1281 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:21:59.760880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:21:59.762361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:21:59.765601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:21:59.771403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:59.773249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:59.773877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:59.774824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:59.775472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:59.775918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:59.790327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-37839e39-011d-45a5-a0bd-98ad5f87ba0a req-0db33edc-aebb-42a3-b2f8-ce260a105940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f19d48-4464-4271-b98d-4176809bb0df", "tag": "d7849c43-7b57-4b6d-9472-7dd7d93d9837"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:59.804773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-37839e39-011d-45a5-a0bd-98ad5f87ba0a req-0db33edc-aebb-42a3-b2f8-ce260a105940 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:59.808734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-37839e39-011d-45a5-a0bd-98ad5f87ba0a req-0db33edc-aebb-42a3-b2f8-ce260a105940 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:59.809874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-37839e39-011d-45a5-a0bd-98ad5f87ba0a req-0db33edc-aebb-42a3-b2f8-ce260a105940 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:59.824934 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-37839e39-011d-45a5-a0bd-98ad5f87ba0a req-0db33edc-aebb-42a3-b2f8-ce260a105940 service nova] Creating event network-changed:d7849c43-7b57-4b6d-9472-7dd7d93d9837 for instance c7f19d48-4464-4271-b98d-4176809bb0df on nch2-master-1 Oct 01 21:21:59.833133 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-37839e39-011d-45a5-a0bd-98ad5f87ba0a req-0db33edc-aebb-42a3-b2f8-ce260a105940 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046444 Oct 01 21:21:59.834434 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3646/5298] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:21:59.932863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d551ac66-8b6f-44bb-9f43-114c5240fa71 req-122de316-2a91-406b-91c3-052d67ee93fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb45dd0-44e5-4abe-a6d2-ab807e1431e2", "name": "network-vif-plugged", "status": "completed", "tag": "516cb0ce-90bc-4b1e-af5b-c1e67be8c8eb"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:21:59.948584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d551ac66-8b6f-44bb-9f43-114c5240fa71 req-122de316-2a91-406b-91c3-052d67ee93fa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:21:59.949369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d551ac66-8b6f-44bb-9f43-114c5240fa71 req-122de316-2a91-406b-91c3-052d67ee93fa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:21:59.949800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d551ac66-8b6f-44bb-9f43-114c5240fa71 req-122de316-2a91-406b-91c3-052d67ee93fa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:21:59.978898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d551ac66-8b6f-44bb-9f43-114c5240fa71 req-122de316-2a91-406b-91c3-052d67ee93fa service nova] Creating event network-vif-plugged:516cb0ce-90bc-4b1e-af5b-c1e67be8c8eb for instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 on nch2-master-1 Oct 01 21:21:59.987122 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d551ac66-8b6f-44bb-9f43-114c5240fa71 req-122de316-2a91-406b-91c3-052d67ee93fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059319 Oct 01 21:21:59.988322 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3647/5299] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:22:00.033243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:00.034458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:00.051320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:00.052584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:00.053731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:00.056131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:00.057407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:00.058217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:00.083248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:00.105209 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-06b1d4ca-c23c-4d99-b8b0-2da3b7310b4f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1216 microversion: 2.1 time: 0.349369 Oct 01 21:22:00.114851 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1653/5300] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:21:59 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1216 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:00.244106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:00.253463 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-413e7a66-af31-45a6-b534-b1488fcee4dd tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1269 microversion: 2.1 time: 0.225233 Oct 01 21:22:00.256293 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3648/5301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:00 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1269 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:01.136444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:01.137911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:01.146458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:01.147410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:01.147988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:01.148851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:01.149620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:01.150294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:01.278060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:01.278756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:01.291520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:01.300755 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-09f19d59-c642-47a0-a4d3-fa521710fd2e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1216 microversion: 2.1 time: 0.169121 Oct 01 21:22:01.306533 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1654/5302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:01 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:01.306724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:01.306724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:01.306724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:01.306724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:01.306724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:01.306724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:01.527590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:01.535886 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e3ed6e1-2526-492c-9b24-cf67a7174f1c tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1269 microversion: 2.1 time: 0.262353 Oct 01 21:22:01.536472 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3649/5303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:01 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1269 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:02.325320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:02.325988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:02.333491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.333982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.334426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.335155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.335616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.336053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.355074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:02.357949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:02.361049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:02.368679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.369257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.369766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.382248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.382874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.383683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.466457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:22:02.466916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:22:02.467403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:22:02.467828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:22:02.468265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:22:02.476357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:02.484408 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-44241174-1f9a-48d8-95a7-2fe942e4a89d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1402 microversion: 2.1 time: 0.163069 Oct 01 21:22:02.485083 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1655/5304] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:02 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1402 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:02.506832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:02.507450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:02.513365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.513861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.515034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.515755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.516220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.516700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.528967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:02.537356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.537942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.538473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.539579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.540129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.540647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.570107 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c9df17a0-74f5-4843-8ed2-1c916f07651d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078/action" status: 202 len: 1138 microversion: 2.1 time: 0.220874 Oct 01 21:22:02.585519 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3650/5305] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:22:02 2022] POST /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078/action => generated 1138 bytes in 236 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 01 21:22:02.589590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:02.590214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:02.596903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.597413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.598428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.599269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.599973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.600372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.680038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:02.692417 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5da758ce-b1f2-4564-bc0b-61f07c9a1428 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1402 microversion: 2.1 time: 0.189231 Oct 01 21:22:02.695540 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1656/5306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:02 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1402 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:02.712619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:02.713425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:02.721484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.722426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.723668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.724511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.725269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.725839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.772350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:02.775998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:02.781754 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad0b208c-d09b-4437-a63e-da7ec7a1434f tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1269 microversion: 2.1 time: 0.196759 Oct 01 21:22:02.782356 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3651/5307] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:02 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1269 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:02.788090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1637444369"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:02.790779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:02.798150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.798894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.799509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.800421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:02.801096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:02.801530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:02.902676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:02.912557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:02.919196 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8fa10f22-dcdc-4c30-95c9-6df46700fe88 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.220066 Oct 01 21:22:02.920237 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1657/5308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:02 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:02.935499 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.compute.api [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Attempting to quiesce instance before volume snapshot. Oct 01 21:22:02.983061 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.compute.api [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 01 21:22:03.070833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Creating snapshot from volume af3590a1-ce01-4f8a-a2f8-cac49fea20f7. {{(pid=140438) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 01 21:22:03.807107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:03.807820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:03.816915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:03.818161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:03.819702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:03.820681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:03.822073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:03.822780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:03.995764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:04.010792 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4d86c89b-50fb-4618-b05c-5bf95679bcb0 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1269 microversion: 2.1 time: 0.208782 Oct 01 21:22:04.025731 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1658/5309] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:03 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1269 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:04.025731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:04.025731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:04.025731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:04.025731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:04.026300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:04.027194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:04.027667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:04.028162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:04.181382 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0c37e8e-dcc3-4057-8c45-a5a6b2fbb0ec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "POST /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2/action" status: 202 len: 0 microversion: 2.1 time: 1.397097 Oct 01 21:22:04.184851 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3652/5310] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:22:02 2022] POST /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2/action => generated 0 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 21:22:04.251292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:04.260658 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ba135674-c90a-47c5-bff5-f3c083e1d6cc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.247911 Oct 01 21:22:04.261254 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1659/5311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:04 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:04.497709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:04.507504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1508626553", "imageRef": "165695c4-07ce-4a33-9c8b-a0efd4acfc45", "flavorRef": "452", "networks": [{"uuid": "4a3c030a-8624-4d4f-bb7a-67548024ff58"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:04.577736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] validate_networks() for [('4a3c030a-8624-4d4f-bb7a-67548024ff58', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:22:04.972126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:22:04.972633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:22:04.973628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:22:04.974056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:22:04.974508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:22:04.984444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:04.984985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:04.985444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:04.986220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:04.986715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:04.987161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:05.005462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:22:05.011010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for user eb0bf5fce885439eaa16a0871c2992ac and project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:22:05.025028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:22:05.028372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='67c87bce-6167-4219-9eee-20a0aeed139b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:22:05.047241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:05.047873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:05.054651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:05.055244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:05.055657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:05.056618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:05.057095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:05.057525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:05.121724 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fbc2b699-3aef-49fa-9e4e-b612ae0fbc40 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624764 Oct 01 21:22:05.126583 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3653/5312] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:22:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:22:05.133823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-baf14da2-16bd-4d33-af49-384ba099eff2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:05.134840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-baf14da2-16bd-4d33-af49-384ba099eff2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:05.199900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-baf14da2-16bd-4d33-af49-384ba099eff2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:05.210591 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-baf14da2-16bd-4d33-af49-384ba099eff2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1230 microversion: 2.1 time: 0.080443 Oct 01 21:22:05.211545 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3654/5313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:05 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1230 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:05.255078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:05.263962 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aaab2dd1-39dd-435f-8a1d-af505902d2c1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1269 microversion: 2.1 time: 0.224972 Oct 01 21:22:05.266605 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1660/5314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:05 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1269 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:05.288476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:05.289284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:05.296162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:05.296671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:05.297114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:05.298009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:05.298936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:05.299281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:05.455363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:05.464557 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-27518af0-12ed-42c5-ae28-6783a459a546 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.180418 Oct 01 21:22:05.465139 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3655/5315] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:05 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:05.919816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-bc034d72-a8cb-4fc1-ac89-b0e4284d1d08 req-013ebe35-0c95-47c3-aaf0-500410ab5793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f19d48-4464-4271-b98d-4176809bb0df", "name": "network-vif-plugged", "status": "completed", "tag": "d7849c43-7b57-4b6d-9472-7dd7d93d9837"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:05.931645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bc034d72-a8cb-4fc1-ac89-b0e4284d1d08 req-013ebe35-0c95-47c3-aaf0-500410ab5793 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:05.932110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bc034d72-a8cb-4fc1-ac89-b0e4284d1d08 req-013ebe35-0c95-47c3-aaf0-500410ab5793 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:05.932790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-bc034d72-a8cb-4fc1-ac89-b0e4284d1d08 req-013ebe35-0c95-47c3-aaf0-500410ab5793 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:05.947223 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-bc034d72-a8cb-4fc1-ac89-b0e4284d1d08 req-013ebe35-0c95-47c3-aaf0-500410ab5793 service nova] Creating event network-vif-plugged:d7849c43-7b57-4b6d-9472-7dd7d93d9837 for instance c7f19d48-4464-4271-b98d-4176809bb0df on nch2-master-1 Oct 01 21:22:05.953609 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-bc034d72-a8cb-4fc1-ac89-b0e4284d1d08 req-013ebe35-0c95-47c3-aaf0-500410ab5793 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037783 Oct 01 21:22:05.954750 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1661/5316] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:22:06.234338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:06.236520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:06.245425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:06.246513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:06.247311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:06.248335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:06.249048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:06.249504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:06.289765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:06.291344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:06.299186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:06.299863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:06.300312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:06.301316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:06.301787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:06.302221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:06.356310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:06.376172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:06.391407 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1cb1eb95-d0de-4b22-abd8-f9e9eb9d9dd8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1282 microversion: 2.1 time: 0.160916 Oct 01 21:22:06.393974 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3656/5317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:06 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:06.489217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:06.489846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:06.498091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:06.498630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:06.501958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:06.506702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:06.507220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:06.507677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:06.511157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:06.522685 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-38026b99-6d2c-43ed-8093-0426ab802f91 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1269 microversion: 2.1 time: 0.239079 Oct 01 21:22:06.536822 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1662/5318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:06 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1269 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:07.139066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:07.150366 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d66c9f74-5c14-4ba2-b63b-4be2814644bc tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.664339 Oct 01 21:22:07.151833 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3657/5319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:06 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:07.429058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:07.430413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:07.438059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=14 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:07.441829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:07.442316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:07.443008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:07.444100 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:07.444736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:07.445171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:07.522569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:07.530720 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-112d9c0a-27a1-48b7-8df5-f6743b5663e8 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1300 microversion: 2.1 time: 0.106296 Oct 01 21:22:07.531615 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1663/5320] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:07 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:07.548652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:07.549993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:07.557920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:07.558438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:07.564717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:07.565849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:07.569221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:07.569929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:07.774319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:07.787594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-691bbdd0-f4d5-42cb-a004-3d624a0b36ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1457 microversion: 2.1 time: 0.241889 Oct 01 21:22:07.789528 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3658/5321] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:07 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1457 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:07.810999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:07.812078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:07.819760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:07.820597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:07.821292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:07.822258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:07.822974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:07.823688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:07.999997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:08.014353 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f80a9605-afbf-47c2-bb0c-52ab856d9f3a tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1457 microversion: 2.1 time: 0.207157 Oct 01 21:22:08.015643 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1664/5322] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:07 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1457 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:08.175946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:08.176582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:08.182743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:08.183527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:08.184234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:08.185301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:08.186130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:08.186850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:08.438159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:08.447220 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-db8f91c9-28cc-4b91-8604-0381317cd3d1 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.275240 Oct 01 21:22:08.448118 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3659/5323] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:08 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:08.558463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:08.559122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:08.565355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:08.565858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:08.566903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:08.567657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:08.568133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:08.568574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:08.667687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-ee009be3-1490-4e96-b69d-548e8e64e5e7 req-a674b1c5-b0ff-486e-a0f4-9b141cb04aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca86ca19-db63-48b9-97c2-50f9193faf8b", "tag": "90fc0752-a688-4d4a-a0be-ce068d95d41e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:08.679886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ee009be3-1490-4e96-b69d-548e8e64e5e7 req-a674b1c5-b0ff-486e-a0f4-9b141cb04aa3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:08.680388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ee009be3-1490-4e96-b69d-548e8e64e5e7 req-a674b1c5-b0ff-486e-a0f4-9b141cb04aa3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:08.680839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-ee009be3-1490-4e96-b69d-548e8e64e5e7 req-a674b1c5-b0ff-486e-a0f4-9b141cb04aa3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:08.696626 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-ee009be3-1490-4e96-b69d-548e8e64e5e7 req-a674b1c5-b0ff-486e-a0f4-9b141cb04aa3 service nova] Creating event network-changed:90fc0752-a688-4d4a-a0be-ce068d95d41e for instance ca86ca19-db63-48b9-97c2-50f9193faf8b on nch1-master-1 Oct 01 21:22:08.702778 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-ee009be3-1490-4e96-b69d-548e8e64e5e7 req-a674b1c5-b0ff-486e-a0f4-9b141cb04aa3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038342 Oct 01 21:22:08.703739 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3660/5324] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:22:09.165121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:09.184648 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0f7421ff-b72a-4558-9f91-d4ce7e40b296 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1342 microversion: 2.1 time: 0.629625 Oct 01 21:22:09.201387 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1665/5325] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:08 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1342 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:09.472860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:09.473803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:09.482773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:09.483717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:09.484242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:09.485481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:09.486457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:09.486996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:09.724786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:09.733631 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-817b80d7-25de-4506-9fc1-e57be233e051 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.264769 Oct 01 21:22:09.734225 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3661/5326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:09 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:10.212369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:10.213109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:10.220135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:10.220623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:10.221065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:10.221769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:10.222225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:10.222840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:10.438968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:10.450661 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-86e6e3cc-5eaf-44d8-a288-50378aecb88d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1342 microversion: 2.1 time: 0.242553 Oct 01 21:22:10.452318 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1666/5327] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:10 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1342 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:10.468142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6c2cdd6e-6fac-4465-a65c-202bf6a7c0e6 req-33ba0341-7cfc-4f29-982e-1e2070ce0c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f19d48-4464-4271-b98d-4176809bb0df", "tag": "d7849c43-7b57-4b6d-9472-7dd7d93d9837"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:10.492587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6c2cdd6e-6fac-4465-a65c-202bf6a7c0e6 req-33ba0341-7cfc-4f29-982e-1e2070ce0c8d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:10.493098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6c2cdd6e-6fac-4465-a65c-202bf6a7c0e6 req-33ba0341-7cfc-4f29-982e-1e2070ce0c8d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:10.493558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6c2cdd6e-6fac-4465-a65c-202bf6a7c0e6 req-33ba0341-7cfc-4f29-982e-1e2070ce0c8d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:10.520220 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6c2cdd6e-6fac-4465-a65c-202bf6a7c0e6 req-33ba0341-7cfc-4f29-982e-1e2070ce0c8d service nova] Creating event network-changed:d7849c43-7b57-4b6d-9472-7dd7d93d9837 for instance c7f19d48-4464-4271-b98d-4176809bb0df on nch2-master-1 Oct 01 21:22:10.529878 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6c2cdd6e-6fac-4465-a65c-202bf6a7c0e6 req-33ba0341-7cfc-4f29-982e-1e2070ce0c8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085651 Oct 01 21:22:10.533388 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3662/5328] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:22:10.761083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:10.761852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:10.770796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:10.771294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:10.771734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:10.774277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:10.774782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:10.775215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:11.232686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:11.249327 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bd43242c-48e9-4752-82f4-93154c737b3a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.493318 Oct 01 21:22:11.252604 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1667/5329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:10 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:11.474133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:11.475548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:11.483752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:11.484270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:11.484734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:11.485468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:11.486143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:11.486645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:11.646877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:11.657987 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-13fd8469-4c67-454a-8584-94e383501972 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1388 microversion: 2.1 time: 0.188249 Oct 01 21:22:11.659106 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3663/5330] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:11 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1388 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:12.276610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:12.277181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:12.285093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:12.285825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:12.286278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:12.287029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:12.287484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:12.287920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:12.542239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:12.558151 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cdefa1e7-a97b-4ded-836e-ed90d3414a51 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.285323 Oct 01 21:22:12.559328 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1668/5331] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:12 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:12.606880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7143604a-4af6-4c46-8565-92e3aef54a84 req-3a6b30c8-1ca1-47db-88b9-9ff653f2480f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f19d48-4464-4271-b98d-4176809bb0df", "tag": "d7849c43-7b57-4b6d-9472-7dd7d93d9837"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:12.628779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7143604a-4af6-4c46-8565-92e3aef54a84 req-3a6b30c8-1ca1-47db-88b9-9ff653f2480f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:12.630757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7143604a-4af6-4c46-8565-92e3aef54a84 req-3a6b30c8-1ca1-47db-88b9-9ff653f2480f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:12.631322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7143604a-4af6-4c46-8565-92e3aef54a84 req-3a6b30c8-1ca1-47db-88b9-9ff653f2480f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:12.645264 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7143604a-4af6-4c46-8565-92e3aef54a84 req-3a6b30c8-1ca1-47db-88b9-9ff653f2480f service nova] Creating event network-changed:d7849c43-7b57-4b6d-9472-7dd7d93d9837 for instance c7f19d48-4464-4271-b98d-4176809bb0df on nch2-master-1 Oct 01 21:22:12.652606 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7143604a-4af6-4c46-8565-92e3aef54a84 req-3a6b30c8-1ca1-47db-88b9-9ff653f2480f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057219 Oct 01 21:22:12.653714 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3664/5332] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:22:12.686711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:12.687343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:12.695297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:12.695790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:12.696690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:12.697605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:12.701018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:12.702317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:13.024040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:13.035412 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-78c981d4-9c30-4936-ac23-3d83b6832934 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1376 microversion: 2.1 time: 0.353281 Oct 01 21:22:13.038630 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1669/5333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:12 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1376 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:13.585415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:13.586435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:13.597801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:13.598889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:13.599524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:13.600545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:13.601336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:13.602135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:13.773959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:13.784080 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a32148d8-d748-42e1-99b6-85fc0f0bbbe8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.204315 Oct 01 21:22:13.784806 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3665/5334] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:13 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:14.059257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:14.059961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:14.067765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:14.068296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:14.068699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:14.069411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:14.069878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:14.070354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:14.204554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:14.212595 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4247a714-5fc7-4718-92a8-228822b1dddb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1376 microversion: 2.1 time: 0.157837 Oct 01 21:22:14.213171 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1670/5335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:14 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:14.670215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-43a5c356-26ec-4a50-ad6d-8a9c9986f69b req-8a0fdb41-7fba-4ccb-a7d3-5c61bbbc2233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f19d48-4464-4271-b98d-4176809bb0df", "tag": "d7849c43-7b57-4b6d-9472-7dd7d93d9837"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:14.680758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-43a5c356-26ec-4a50-ad6d-8a9c9986f69b req-8a0fdb41-7fba-4ccb-a7d3-5c61bbbc2233 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:14.681258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-43a5c356-26ec-4a50-ad6d-8a9c9986f69b req-8a0fdb41-7fba-4ccb-a7d3-5c61bbbc2233 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:14.681707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-43a5c356-26ec-4a50-ad6d-8a9c9986f69b req-8a0fdb41-7fba-4ccb-a7d3-5c61bbbc2233 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:14.692843 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-43a5c356-26ec-4a50-ad6d-8a9c9986f69b req-8a0fdb41-7fba-4ccb-a7d3-5c61bbbc2233 service nova] Creating event network-changed:d7849c43-7b57-4b6d-9472-7dd7d93d9837 for instance c7f19d48-4464-4271-b98d-4176809bb0df on nch2-master-1 Oct 01 21:22:14.697717 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-43a5c356-26ec-4a50-ad6d-8a9c9986f69b req-8a0fdb41-7fba-4ccb-a7d3-5c61bbbc2233 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031424 Oct 01 21:22:14.698331 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3666/5336] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:22:14.809015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:14.809558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:14.816690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:14.817234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:14.817745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:14.818577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:14.819145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:14.819586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:15.046402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:15.055356 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cffa0076-f72c-4b12-869c-ff19173f9764 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.250243 Oct 01 21:22:15.055949 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1671/5337] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:14 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:15.232840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:15.233891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:15.239524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:15.240262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:15.247606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:15.248121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:15.248720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:15.249457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:15.249937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:15.250398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:15.386415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:15.394384 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ad628f2-e7f2-46c9-900f-b58933678dda tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1376 microversion: 2.1 time: 0.162605 Oct 01 21:22:15.395012 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3667/5338] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:15 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:16.080576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:16.082047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:16.090868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:16.091628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:16.092148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:16.093199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:16.093899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:16.095039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:16.265642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:16.275125 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a23179c9-f4ba-413e-b1b3-93b0d82362e7 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.198842 Oct 01 21:22:16.275952 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1672/5339] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:16 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:16.417651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:16.418211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:16.427028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:16.427537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:16.427994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:16.428720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:16.429298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:16.429768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:16.586359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:16.597471 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4218796-5aa5-4fc6-bcb0-d26cdb04bf53 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1376 microversion: 2.1 time: 0.183785 Oct 01 21:22:16.598052 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3668/5340] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:16 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:17.298565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:17.299183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:17.306720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:17.307231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:17.307671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:17.308366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:17.308966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:17.309395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:17.448489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:17.456377 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-74e90fed-4659-4534-8c9e-289c9c9db9c4 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.161669 Oct 01 21:22:17.457493 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1673/5341] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:17 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:17.619747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:17.620428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:17.627610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:17.628146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:17.628604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:17.629324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:17.629802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:17.630257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:17.764309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:17.773051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f162f02-7d93-4db2-8a3a-ea926064a8cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1376 microversion: 2.1 time: 0.157284 Oct 01 21:22:17.773766 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3669/5342] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:17 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:17.977242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d894ebaf-2598-42de-8899-015626c79288 req-27bc3e55-28a6-490a-8f1b-87b344d8db39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca86ca19-db63-48b9-97c2-50f9193faf8b", "name": "network-vif-plugged", "status": "completed", "tag": "90fc0752-a688-4d4a-a0be-ce068d95d41e"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:17.996364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d894ebaf-2598-42de-8899-015626c79288 req-27bc3e55-28a6-490a-8f1b-87b344d8db39 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:17.997341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d894ebaf-2598-42de-8899-015626c79288 req-27bc3e55-28a6-490a-8f1b-87b344d8db39 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:17.997924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d894ebaf-2598-42de-8899-015626c79288 req-27bc3e55-28a6-490a-8f1b-87b344d8db39 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:18.023317 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d894ebaf-2598-42de-8899-015626c79288 req-27bc3e55-28a6-490a-8f1b-87b344d8db39 service nova] Creating event network-vif-plugged:90fc0752-a688-4d4a-a0be-ce068d95d41e for instance ca86ca19-db63-48b9-97c2-50f9193faf8b on nch1-master-1 Oct 01 21:22:18.030439 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d894ebaf-2598-42de-8899-015626c79288 req-27bc3e55-28a6-490a-8f1b-87b344d8db39 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061083 Oct 01 21:22:18.031090 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1674/5343] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:22:18.481201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:18.481833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:18.488073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:18.488573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:18.489030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:18.489756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:18.490230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:18.490706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:18.627194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:18.629937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:18.637670 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ee5866cd-32e1-431f-b96c-86f281418a22 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1691 microversion: 2.1 time: 0.160308 Oct 01 21:22:18.638474 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3670/5344] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:18 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:18.798255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:18.798984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:18.805273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:18.805750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:18.806190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:18.806921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:18.807388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:18.807821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:18.941479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:18.945088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:18.950174 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8fb43ea3-ec60-4686-a686-247bb05ce1be tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1376 microversion: 2.1 time: 0.157326 Oct 01 21:22:18.950782 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1675/5345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:18 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:19.283297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1009233166", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:19.337003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:22:19.649598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:22:19.650279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:22:19.650569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:22:19.651005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:22:19.651485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:22:19.661510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:19.662022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:19.662473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:19.662748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:19.663256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:19.663490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:19.663732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:19.664450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:19.669933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:19.670424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:19.670905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:19.671775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:19.672237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:19.672664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:19.681856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Getting quotas for project 0bb47fed88494698a3be2a0b34761464. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:22:19.687137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Getting quotas for user 2f6a9ae0c03d4328be8a4665cc503005 and project 0bb47fed88494698a3be2a0b34761464. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:22:19.700476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:22:19.702874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:22:19.747257 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-acfe9221-c103-47a7-9e00-802a829ebdc6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.468107 Oct 01 21:22:19.754468 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3671/5346] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:22:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:22:19.759484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3aef2c3d-6fb6-4ea1-9b4e-f7c430812acf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:19.760125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3aef2c3d-6fb6-4ea1-9b4e-f7c430812acf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:19.827461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3aef2c3d-6fb6-4ea1-9b4e-f7c430812acf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:19.828742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:19.835489 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3aef2c3d-6fb6-4ea1-9b4e-f7c430812acf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1214 microversion: 2.1 time: 0.079580 Oct 01 21:22:19.836454 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3672/5347] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:19 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:19.851011 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-42b297e1-9647-49d8-9baf-cd344c06612d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1697 microversion: 2.1 time: 0.192645 Oct 01 21:22:19.851719 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1676/5348] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:19 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:19.974407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:19.975011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:19.981481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:19.981985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:19.982519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:19.983185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:19.983657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:19.984132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:20.147065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:20.155474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1f736e4-9f4e-4c68-aedf-46d8a7890a12 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1376 microversion: 2.1 time: 0.185066 Oct 01 21:22:20.156364 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3673/5349] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:19 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1376 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:20.859238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:20.859947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:20.866987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:20.867483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:20.867923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:20.868622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:20.869086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:20.869519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:20.875484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:20.876122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:20.883521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:20.884031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:20.884491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:20.885466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:20.885944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:20.886391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:20.935579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:20.944374 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1ebdf623-f6f5-4a4f-bd3c-a7b02d98849c tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1218 microversion: 2.1 time: 0.089591 Oct 01 21:22:20.944982 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1677/5350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:20 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:21.035621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:21.044146 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c4bbbf44-fb79-4d65-9cb7-c11e87017b60 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1697 microversion: 2.1 time: 0.172370 Oct 01 21:22:21.071156 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3674/5351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:20 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1697 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:21.188896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:21.189521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:21.196451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:21.196952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:21.197471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:21.198187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:21.198697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:21.199127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:21.338112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:21.346279 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4386f48b-f092-4ccb-ac4f-ad44fbb0add2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1376 microversion: 2.1 time: 0.161972 Oct 01 21:22:21.346909 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1678/5352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:21 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:21.968531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:21.969240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:21.976798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:21.977303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:21.977758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:21.978509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:21.978989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:21.979433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.064856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:22.075867 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4649089c-3e71-4f1d-bbb3-b8f1c504e892 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1266 microversion: 2.1 time: 0.111268 Oct 01 21:22:22.077593 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3675/5353] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:21 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:22.103905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:22.104538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:22.112487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.113213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.113911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.114834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.115417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.115994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.264853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:22.273280 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d32a21dd-2bba-4cfe-bd6f-ba57b18a751d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1697 microversion: 2.1 time: 0.175118 Oct 01 21:22:22.274189 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1679/5354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:22 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:22.369544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:22.370168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:22.376420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.376921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.377376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.378103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.378610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.379052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.515995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:22.524017 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a0fa59f-e2ad-4b0a-85b8-7a5785be6df2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1562 microversion: 2.1 time: 0.158380 Oct 01 21:22:22.524605 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3676/5355] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:22 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:22.551301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:22.551922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:22.558001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.558512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.558963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.559669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.560129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.560555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.725556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:22.735196 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7618919f-f24b-45d5-8807-bfd48a3299ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1562 microversion: 2.1 time: 0.188385 Oct 01 21:22:22.736475 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1680/5356] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:22 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1562 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:22.832899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:22.834039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:22.840409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.840987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.842245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.843419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.843973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.844420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.872797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:22:22.963959 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1138b26c-ee4b-4901-bfa0-6a47ae03fc6a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 204 len: 0 microversion: 2.1 time: 0.135367 Oct 01 21:22:22.964552 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3677/5357] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:22:22 2022] DELETE /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:22:22.974083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:22.974664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:22.981217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.982087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.982576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:22.983289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:22.983753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:22.984180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:23.103674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:23.107062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:23.117478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:23.118599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:23.119432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:23.120704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:23.121678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:23.122681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:23.131141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:23.140933 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e8640ab-5cf1-467d-89fa-87f80e6f206f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1568 microversion: 2.1 time: 0.172009 Oct 01 21:22:23.141495 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1681/5358] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:22 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:23.246002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:23.263349 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c20b0aa7-7cb8-44e6-9144-a5b222725661 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1272 microversion: 2.1 time: 0.164439 Oct 01 21:22:23.264419 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3678/5359] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:23 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:23.308488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:23.309980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:23.317203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:23.317806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:23.318510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:23.319259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:23.319710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:23.320143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:23.499903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:23.509067 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-277854f9-8403-411c-a887-69756a5bc18a tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1682 microversion: 2.1 time: 0.208576 Oct 01 21:22:23.510131 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1682/5360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:23 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:24.047448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1fa9d9b1-fb9a-4cd6-b462-db921c46afd1 req-5e0483e2-0728-47f3-b164-1c8636dfa692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c688ca69-aa68-4134-8b57-bcb4a4c9d078", "name": "network-vif-plugged", "status": "completed", "tag": "b4995ed7-156f-4cce-af7d-483072f60973"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:24.054988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:24.062592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1fa9d9b1-fb9a-4cd6-b462-db921c46afd1 req-5e0483e2-0728-47f3-b164-1c8636dfa692 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:24.063499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1fa9d9b1-fb9a-4cd6-b462-db921c46afd1 req-5e0483e2-0728-47f3-b164-1c8636dfa692 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:24.064015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1fa9d9b1-fb9a-4cd6-b462-db921c46afd1 req-5e0483e2-0728-47f3-b164-1c8636dfa692 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:24.079156 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1fa9d9b1-fb9a-4cd6-b462-db921c46afd1 req-5e0483e2-0728-47f3-b164-1c8636dfa692 service nova] Creating event network-vif-plugged:b4995ed7-156f-4cce-af7d-483072f60973 for instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 on nch1-master-1 Oct 01 21:22:24.086447 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1fa9d9b1-fb9a-4cd6-b462-db921c46afd1 req-5e0483e2-0728-47f3-b164-1c8636dfa692 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044126 Oct 01 21:22:24.087581 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3679/5361] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:22:24.165518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:24.166135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:24.173731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:24.174236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:24.174743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:24.175527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:24.176038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:24.176463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:24.302325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:24.303045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:24.311473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:24.312101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:24.312831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:24.313782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:24.314338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:24.314878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:24.328281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:24.338053 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-23b1df67-cdc9-4f30-9b9a-0b2e13cff047 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1568 microversion: 2.1 time: 0.176584 Oct 01 21:22:24.339378 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1683/5362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:24 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:24.621542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:24.632231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76c6d858-7fbd-45ad-917b-9ec47343fd78 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1314 microversion: 2.1 time: 0.334885 Oct 01 21:22:24.633442 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3680/5363] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:24 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:25.082017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e087a427-3dc8-4d50-9879-a31c0138ad0a req-4f664627-cbb3-417d-9d9e-0beed40791a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1535fb-debe-4cc7-9458-0616ec81b19e", "tag": "9efc36d5-57b0-4577-92e1-ba73a2c82c80"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:25.093311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e087a427-3dc8-4d50-9879-a31c0138ad0a req-4f664627-cbb3-417d-9d9e-0beed40791a1 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:25.093802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e087a427-3dc8-4d50-9879-a31c0138ad0a req-4f664627-cbb3-417d-9d9e-0beed40791a1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:25.094268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e087a427-3dc8-4d50-9879-a31c0138ad0a req-4f664627-cbb3-417d-9d9e-0beed40791a1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:25.105358 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e087a427-3dc8-4d50-9879-a31c0138ad0a req-4f664627-cbb3-417d-9d9e-0beed40791a1 service nova] Creating event network-changed:9efc36d5-57b0-4577-92e1-ba73a2c82c80 for instance 7e1535fb-debe-4cc7-9458-0616ec81b19e on nch1-master-1 Oct 01 21:22:25.111118 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e087a427-3dc8-4d50-9879-a31c0138ad0a req-4f664627-cbb3-417d-9d9e-0beed40791a1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034396 Oct 01 21:22:25.112012 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1684/5364] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:22:25.364043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:25.364824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:25.375806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:25.376591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:25.377774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:25.380109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:25.380760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:25.381360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:25.485828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:25.496482 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7923a022-59b0-498c-bb75-ecf5cf5484ab tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1526 microversion: 2.1 time: 0.136421 Oct 01 21:22:25.497073 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3681/5365] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:25 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1526 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:25.658384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:25.659580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:25.668407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:25.669485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:25.670210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:25.671319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:25.672036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:25.672741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:25.886285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:25.900782 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cb8c2986-271e-4569-a554-d5387c506fff tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1314 microversion: 2.1 time: 0.247119 Oct 01 21:22:25.901654 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1685/5366] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:25 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:26.524456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:26.525131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:26.532481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:26.533023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:26.533482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:26.534213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:26.534730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:26.535222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:26.571029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:26.571657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:26.572121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:26.572625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lazy-loading 'fault' on Instance uuid ca86ca19-db63-48b9-97c2-50f9193faf8b {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:22:26.614778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:26.623027 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd8d0b5d-9920-45bb-8ee9-ff4dc3659e3b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 200 len: 1366 microversion: 2.1 time: 0.103310 Oct 01 21:22:26.623633 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3682/5367] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:26 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:26.927307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:26.928010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:26.936461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:26.937178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:26.937809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:26.938892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:26.939535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:26.940209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:27.091565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:27.100668 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2548da47-48be-4264-b5f8-6f07fe8e33ee tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1314 microversion: 2.1 time: 0.178687 Oct 01 21:22:27.101437 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1686/5368] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:26 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:27.128783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-95bdcefd-b176-49ba-a41f-1429252da9cc req-68cc2c90-84ab-47c9-91e9-32f03423a969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca86ca19-db63-48b9-97c2-50f9193faf8b", "name": "network-vif-deleted", "tag": "90fc0752-a688-4d4a-a0be-ce068d95d41e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:27.138369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-95bdcefd-b176-49ba-a41f-1429252da9cc req-68cc2c90-84ab-47c9-91e9-32f03423a969 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:27.138926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-95bdcefd-b176-49ba-a41f-1429252da9cc req-68cc2c90-84ab-47c9-91e9-32f03423a969 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:27.139370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-95bdcefd-b176-49ba-a41f-1429252da9cc req-68cc2c90-84ab-47c9-91e9-32f03423a969 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:27.150332 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-95bdcefd-b176-49ba-a41f-1429252da9cc req-68cc2c90-84ab-47c9-91e9-32f03423a969 service nova] Creating event network-vif-deleted:90fc0752-a688-4d4a-a0be-ce068d95d41e for instance ca86ca19-db63-48b9-97c2-50f9193faf8b on nch1-master-1 Oct 01 21:22:27.155444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-95bdcefd-b176-49ba-a41f-1429252da9cc req-68cc2c90-84ab-47c9-91e9-32f03423a969 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030472 Oct 01 21:22:27.156160 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3683/5369] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:22:27.648535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:27.649268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:27.657586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:27.658451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:27.660172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:27.661316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:27.661890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:27.662446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:27.680416 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b HTTP/1.1 Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ca86ca19-db63-48b9-97c2-50f9193faf8b'} Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:22:27.683009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:22:27.690974 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:22:27.690974 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:22:27.690974 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:22:27.690974 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:22:27.690974 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:22:27.690974 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:22:27.690974 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:22:27.690974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:22:27.693095 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bdad91a2-9488-42fe-a944-0c3427e532ca tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 404 len: 111 microversion: 2.1 time: 0.047724 Oct 01 21:22:27.693566 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1687/5370] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:27 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:22:28.130721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:28.132247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:28.139290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:28.140102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:28.140619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:28.141424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:28.142243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:28.142769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:28.290263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:28.299523 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-89a69618-fc05-4768-a715-0bfdcf74480e tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1314 microversion: 2.1 time: 0.174879 Oct 01 21:22:28.300610 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3684/5371] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:28 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:29.324611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:29.325419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:29.333461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:29.334065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:29.334576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:29.335543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:29.336076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:29.336576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:29.491348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:29.502301 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-930594b5-8239-42e5-b8fd-6d33af21f981 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1314 microversion: 2.1 time: 0.181560 Oct 01 21:22:29.503503 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1688/5372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:29 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:29.603372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-241d4e00-05d3-44f9-8af0-d3f9896a6873 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:29.605685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-241d4e00-05d3-44f9-8af0-d3f9896a6873 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:29.612610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-241d4e00-05d3-44f9-8af0-d3f9896a6873 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:29.613110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-241d4e00-05d3-44f9-8af0-d3f9896a6873 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:29.613560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-241d4e00-05d3-44f9-8af0-d3f9896a6873 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:29.614300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-241d4e00-05d3-44f9-8af0-d3f9896a6873 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:29.614802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-241d4e00-05d3-44f9-8af0-d3f9896a6873 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:29.615244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-241d4e00-05d3-44f9-8af0-d3f9896a6873 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:29.677222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:29.707381 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-241d4e00-05d3-44f9-8af0-d3f9896a6873 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.107996 Oct 01 21:22:29.708635 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3685/5373] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:22:29 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:22:29.717362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:29.718010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:29.724891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:29.725385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:29.725829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:29.726589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:29.727066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:29.727486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:29.875148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:29.888377 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-437c217e-c897-44f3-ae72-393a89179041 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1670 microversion: 2.1 time: 0.174906 Oct 01 21:22:29.890905 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1689/5374] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:29 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:30.093079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:30.098921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-021df9ba-0104-422c-af68-9c104ee8996b req-e09794bd-0b14-4ca1-8c48-fc725728cac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1535fb-debe-4cc7-9458-0616ec81b19e", "name": "network-vif-plugged", "status": "completed", "tag": "9efc36d5-57b0-4577-92e1-ba73a2c82c80"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:30.112721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-021df9ba-0104-422c-af68-9c104ee8996b req-e09794bd-0b14-4ca1-8c48-fc725728cac4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:30.113557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-021df9ba-0104-422c-af68-9c104ee8996b req-e09794bd-0b14-4ca1-8c48-fc725728cac4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:30.114224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-021df9ba-0104-422c-af68-9c104ee8996b req-e09794bd-0b14-4ca1-8c48-fc725728cac4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:30.127486 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-021df9ba-0104-422c-af68-9c104ee8996b req-e09794bd-0b14-4ca1-8c48-fc725728cac4 service nova] Creating event network-vif-plugged:9efc36d5-57b0-4577-92e1-ba73a2c82c80 for instance 7e1535fb-debe-4cc7-9458-0616ec81b19e on nch1-master-1 Oct 01 21:22:30.133643 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-021df9ba-0104-422c-af68-9c104ee8996b req-e09794bd-0b14-4ca1-8c48-fc725728cac4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042744 Oct 01 21:22:30.134261 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3686/5375] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:22:30.527739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:30.528378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:30.533142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=74 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:30.538705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:30.539241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:30.539669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:30.540559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:30.541180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:30.541638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:30.688428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:30.699044 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9ec48db4-55d9-4c7e-9e19-c7d0c5115d69 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1314 microversion: 2.1 time: 0.175666 Oct 01 21:22:30.709476 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1690/5376] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:30 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:30.920157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:30.921489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:30.928107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:30.928611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:30.929058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:30.929808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:30.930273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:30.931094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:31.099994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:31.108580 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-971b0ddd-171f-4106-bc0a-5070748a3bf2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1675 microversion: 2.1 time: 0.194527 Oct 01 21:22:31.109218 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3687/5377] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:30 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1675 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:31.726014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:31.726863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:31.735937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:31.736526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:31.737170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:31.738043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:31.738577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:31.739017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:31.873122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:31.881519 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8b890086-4458-4e9d-bea2-830e585aabcf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1463 microversion: 2.1 time: 0.160737 Oct 01 21:22:31.882077 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1691/5378] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:31 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:31.907715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac3d02db-d918-43ea-bcc9-31de38813b5d tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c387064-4e94-46fa-8a41-d63dfab6a47f", "device": "/dev/sdb"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:31.910764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac3d02db-d918-43ea-bcc9-31de38813b5d tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:31.917709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d02db-d918-43ea-bcc9-31de38813b5d tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:31.918205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d02db-d918-43ea-bcc9-31de38813b5d tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:31.918944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d02db-d918-43ea-bcc9-31de38813b5d tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:31.919667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d02db-d918-43ea-bcc9-31de38813b5d tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:31.920142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d02db-d918-43ea-bcc9-31de38813b5d tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:31.920579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3d02db-d918-43ea-bcc9-31de38813b5d tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:31.923182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:32.136744 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:32.137642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:32.146672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:32.147409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:32.148122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:32.149138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:32.149931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:32.150521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:32.195602 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac3d02db-d918-43ea-bcc9-31de38813b5d tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "POST /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291669 Oct 01 21:22:32.196240 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3688/5379] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:22:31 2022] POST /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:22:32.317834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:32.327243 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-926ed800-fa0e-4432-b1e0-07e15612f11e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.197634 Oct 01 21:22:32.327926 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1692/5380] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:32 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:39.958432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:39.959168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:39.966336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:39.966889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:39.967346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:39.968073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:39.968738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:39.969249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:40.062006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lazy-loading 'services' on Instance uuid 7e1535fb-debe-4cc7-9458-0616ec81b19e {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:22:40.143494 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bbf814b4-9599-40c4-a033-3e80432efa56 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e/os-volume_attachments/2c387064-4e94-46fa-8a41-d63dfab6a47f" status: 202 len: 0 microversion: 2.1 time: 0.191135 Oct 01 21:22:40.144158 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3689/5381] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:22:39 2022] DELETE /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e/os-volume_attachments/2c387064-4e94-46fa-8a41-d63dfab6a47f => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:22:41.286752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:41.287320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:41.295822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:41.296530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:41.296983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:41.297705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:41.298168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:41.298640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:41.330738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:22:41.334616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:41.431132 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-786283ae-3904-4389-ba24-4e6b35edfbaf tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 204 len: 0 microversion: 2.1 time: 0.147492 Oct 01 21:22:41.432076 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1693/5382] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:22:41 2022] DELETE /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:22:41.443674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:41.444359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:41.451679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:41.452256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:41.452731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:41.453452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:41.454150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:41.454834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:41.609367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:41.617711 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f371639a-8182-4d19-9be0-167210b07ad6 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1469 microversion: 2.1 time: 0.180226 Oct 01 21:22:41.618292 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3690/5383] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:41 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:22:42.641917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:42.642894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:42.650406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:42.650935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:42.651390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:42.652104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:42.652564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:42.652992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:42.798192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:42.808419 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1c39a36e-fb64-4644-ac7d-42a0922f9ef7 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1469 microversion: 2.1 time: 0.170930 Oct 01 21:22:42.809257 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1694/5384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:42 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:43.797905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-6fe4e74a-b88c-437a-8035-4eb066d0ba85 req-b9a28542-a55b-4946-a3b7-693fd1ea030d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1535fb-debe-4cc7-9458-0616ec81b19e", "name": "network-vif-deleted", "tag": "9efc36d5-57b0-4577-92e1-ba73a2c82c80"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:43.817184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6fe4e74a-b88c-437a-8035-4eb066d0ba85 req-b9a28542-a55b-4946-a3b7-693fd1ea030d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:43.818392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6fe4e74a-b88c-437a-8035-4eb066d0ba85 req-b9a28542-a55b-4946-a3b7-693fd1ea030d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:43.819105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-6fe4e74a-b88c-437a-8035-4eb066d0ba85 req-b9a28542-a55b-4946-a3b7-693fd1ea030d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:43.833452 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-6fe4e74a-b88c-437a-8035-4eb066d0ba85 req-b9a28542-a55b-4946-a3b7-693fd1ea030d service nova] Creating event network-vif-deleted:9efc36d5-57b0-4577-92e1-ba73a2c82c80 for instance 7e1535fb-debe-4cc7-9458-0616ec81b19e on nch1-master-1 Oct 01 21:22:43.839144 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-6fe4e74a-b88c-437a-8035-4eb066d0ba85 req-b9a28542-a55b-4946-a3b7-693fd1ea030d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045898 Oct 01 21:22:43.839512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:43.840574 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3691/5385] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:22:43.849643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:43.857941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:43.859105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:43.859105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:43.861067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:43.861708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:43.862309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:43.950774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6a9ae0c03d4328be8a4665cc503005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb47fed88494698a3be2a0b34761464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:43.964001 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d458050e-7d99-4628-97c6-47dcfa8e2347 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 200 len: 1299 microversion: 2.1 time: 0.134645 Oct 01 21:22:43.964894 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1695/5386] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:43 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:44.990615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:44.991571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] [instance: 7e1535fb-debe-4cc7-9458-0616ec81b19e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:44.998782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:44.999297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:44.999817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:45.000612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:45.001126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:45.001614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:45.017271 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] HTTP exception thrown: Instance 7e1535fb-debe-4cc7-9458-0616ec81b19e could not be found. Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Request method failure captured: Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e HTTP/1.1 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK-J-hDa79fdu8-Dv_QDtMpQXnApFcPjmDCn4GweLbOGMeqH83jr7Bt77cTyf3cEMrRLUcaLf3Ab0M7YRlHPdF6rui1bs2Ee5bWj1eg53woXMGpy6iZf8twNZiCn6Ky1B-KzPFFqhZgkld6EzJ2GMqxXJ7k_toElfNxOSgNxazTWlhQ Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 0bb47fed88494698a3be2a0b34761464 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesBackupsTest-1744874988 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0bb47fed88494698a3be2a0b34761464", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0bb47fed88494698a3be2a0b34761464"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0bb47fed88494698a3be2a0b34761464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0bb47fed88494698a3be2a0b34761464"}]}] Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesBackupsTest-1744874988 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 0bb47fed88494698a3be2a0b34761464 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesBackupsTest-1744874988 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesBackupsTest-1744874988-project Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 2f6a9ae0c03d4328be8a4665cc503005 Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesBackupsTest-1744874988-project Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 7e1535fb-debe-4cc7-9458-0616ec81b19e could not be found. Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '7e1535fb-debe-4cc7-9458-0616ec81b19e'} Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e1535fb-debe-4cc7-9458-0616ec81b19e could not be found. Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e1535fb-debe-4cc7-9458-0616ec81b19e could not be found. Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:22:45.018983 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e1535fb-debe-4cc7-9458-0616ec81b19e could not be found. Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] Returning 404 to user: Instance 7e1535fb-debe-4cc7-9458-0616ec81b19e could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82d25709-9dc4-4ad7-9857-87222aa17930 tempest-VolumesBackupsTest-1744874988 tempest-VolumesBackupsTest-1744874988-project] 10.222.0.17 "GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e" status: 404 len: 111 microversion: 2.1 time: 0.035617 Oct 01 21:22:45.025093 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3692/5387] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:44 2022] GET /compute/v2.1/servers/7e1535fb-debe-4cc7-9458-0616ec81b19e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:22:51.739954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5f7c3a20-403d-4bc1-805b-d720f6c1ffa6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:51.743671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5f7c3a20-403d-4bc1-805b-d720f6c1ffa6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:51.753694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f7c3a20-403d-4bc1-805b-d720f6c1ffa6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:51.754634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f7c3a20-403d-4bc1-805b-d720f6c1ffa6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:51.755356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f7c3a20-403d-4bc1-805b-d720f6c1ffa6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:51.756415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f7c3a20-403d-4bc1-805b-d720f6c1ffa6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:51.756987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f7c3a20-403d-4bc1-805b-d720f6c1ffa6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:51.757847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5f7c3a20-403d-4bc1-805b-d720f6c1ffa6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:51.824656 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5f7c3a20-403d-4bc1-805b-d720f6c1ffa6 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "POST /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078/action" status: 200 len: 24571 microversion: 2.1 time: 0.090554 Oct 01 21:22:51.825511 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1696/5388] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:22:51 2022] POST /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078/action => generated 24571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:22:56.152256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:56.153124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:56.154395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-99a7d83c-f186-4dd8-a5a1-f34e409817c5 req-fc95f533-1f22-4e84-b670-f6f3adee47d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f19d48-4464-4271-b98d-4176809bb0df", "tag": "d7849c43-7b57-4b6d-9472-7dd7d93d9837"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:56.165593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=29 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:56.168114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:22:56.184301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-99a7d83c-f186-4dd8-a5a1-f34e409817c5 req-fc95f533-1f22-4e84-b670-f6f3adee47d8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:56.184916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-99a7d83c-f186-4dd8-a5a1-f34e409817c5 req-fc95f533-1f22-4e84-b670-f6f3adee47d8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:56.185547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-99a7d83c-f186-4dd8-a5a1-f34e409817c5 req-fc95f533-1f22-4e84-b670-f6f3adee47d8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:56.188054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:56.188838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:56.189563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:56.190919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:56.192358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:56.192826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:56.218474 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-99a7d83c-f186-4dd8-a5a1-f34e409817c5 req-fc95f533-1f22-4e84-b670-f6f3adee47d8 service nova] Creating event network-changed:d7849c43-7b57-4b6d-9472-7dd7d93d9837 for instance c7f19d48-4464-4271-b98d-4176809bb0df on nch2-master-1 Oct 01 21:22:56.228049 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-99a7d83c-f186-4dd8-a5a1-f34e409817c5 req-fc95f533-1f22-4e84-b670-f6f3adee47d8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084442 Oct 01 21:22:56.229682 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1697/5389] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:22:56.255760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:22:56.674716 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a62e6fe0-ccd9-4ad3-a6a6-b4b12598b256 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 204 len: 0 microversion: 2.1 time: 0.535947 Oct 01 21:22:56.675810 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3693/5390] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:22:56 2022] DELETE /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:22:56.687146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:56.688289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:56.696374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:56.697401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:56.697859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:56.698854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:56.699323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:56.699928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:56.901494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:56.912682 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f30de9f2-36c0-490b-936f-65ea48376e89 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1581 microversion: 2.1 time: 0.231235 Oct 01 21:22:56.913656 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1698/5391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:56 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1581 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:57.942840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:57.943576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:57.951533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:57.952058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:57.952686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:57.953618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:57.954109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:57.954584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:58.109055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:58.119546 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d013078b-97c1-4fda-aa89-e7d324869fc3 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1463 microversion: 2.1 time: 0.180385 Oct 01 21:22:58.120383 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3694/5392] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:57 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:58.836920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:58.837975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:58.845124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:58.845880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:58.846527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:58.847428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:58.848063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:58.848665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:58.879275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:22:58.964137 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f899c417-5ae6-497c-98a9-f321720d6792 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 204 len: 0 microversion: 2.1 time: 0.129557 Oct 01 21:22:58.965280 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1699/5393] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:22:58 2022] DELETE /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:22:58.974275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:58.975273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:58.992558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:58.993549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:58.994288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:58.996131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:58.998365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:58.999667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:59.037276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d62825a0-173a-40fe-b55c-18c02c459190 req-0a4f14b0-3a21-40f1-9da3-aa110ea6b263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f19d48-4464-4271-b98d-4176809bb0df", "name": "network-vif-deleted", "tag": "d7849c43-7b57-4b6d-9472-7dd7d93d9837"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:22:59.052027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d62825a0-173a-40fe-b55c-18c02c459190 req-0a4f14b0-3a21-40f1-9da3-aa110ea6b263 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:59.052528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d62825a0-173a-40fe-b55c-18c02c459190 req-0a4f14b0-3a21-40f1-9da3-aa110ea6b263 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:59.052976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d62825a0-173a-40fe-b55c-18c02c459190 req-0a4f14b0-3a21-40f1-9da3-aa110ea6b263 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:59.065136 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d62825a0-173a-40fe-b55c-18c02c459190 req-0a4f14b0-3a21-40f1-9da3-aa110ea6b263 service nova] Creating event network-vif-deleted:d7849c43-7b57-4b6d-9472-7dd7d93d9837 for instance c7f19d48-4464-4271-b98d-4176809bb0df on nch2-master-1 Oct 01 21:22:59.070409 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d62825a0-173a-40fe-b55c-18c02c459190 req-0a4f14b0-3a21-40f1-9da3-aa110ea6b263 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037875 Oct 01 21:22:59.071462 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1700/5394] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:22:59.142720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:59.146215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:22:59.147048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:22:59.151446 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c799fa67-ef03-4b1c-90b8-05ddd12ee5ea tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1408 microversion: 2.1 time: 0.182142 Oct 01 21:22:59.152024 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3695/5395] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:58 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:22:59.154900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:59.155401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:59.155831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:59.156531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:22:59.156987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:22:59.157413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:22:59.223878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:22:59.232309 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-397c5eb0-237a-4256-b7a2-2e048a9046ec tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1396 microversion: 2.1 time: 0.090830 Oct 01 21:22:59.232929 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1701/5396] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:22:59 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1396 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:00.178772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:00.181119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:00.188151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:00.188842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:00.196675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:00.198149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:00.198698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:00.199319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:00.257697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:00.259764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:00.268943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:00.269724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:00.271192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:00.272802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:00.273543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:00.275698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:00.320807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:00.321640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:00.322356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:00.323061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lazy-loading 'fault' on Instance uuid c7f19d48-4464-4271-b98d-4176809bb0df {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:23:00.374050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:00.386544 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b08abf7-5fbc-4b44-934f-cfbc0aef9ab0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1408 microversion: 2.1 time: 0.214322 Oct 01 21:23:00.387735 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3696/5397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:00 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:00.418531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55dadd491ec1441aac4171eff46bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cb48440cb446ea9abfc00ed0f53779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:00.428138 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9ca0d20f-6ffd-4b3a-bfb9-c81787880ec1 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 200 len: 1234 microversion: 2.1 time: 0.175417 Oct 01 21:23:00.428870 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1702/5398] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:00 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 1234 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:01.297104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a4e1095d-a1fc-4e22-ba9d-6eaaab7c1bcc req-7b6d3ecf-265c-44b6-952c-cc642f834f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb45dd0-44e5-4abe-a6d2-ab807e1431e2", "name": "network-vif-deleted", "tag": "516cb0ce-90bc-4b1e-af5b-c1e67be8c8eb"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:01.310701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a4e1095d-a1fc-4e22-ba9d-6eaaab7c1bcc req-7b6d3ecf-265c-44b6-952c-cc642f834f1b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:01.311200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a4e1095d-a1fc-4e22-ba9d-6eaaab7c1bcc req-7b6d3ecf-265c-44b6-952c-cc642f834f1b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:01.313740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a4e1095d-a1fc-4e22-ba9d-6eaaab7c1bcc req-7b6d3ecf-265c-44b6-952c-cc642f834f1b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:01.333180 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a4e1095d-a1fc-4e22-ba9d-6eaaab7c1bcc req-7b6d3ecf-265c-44b6-952c-cc642f834f1b service nova] Creating event network-vif-deleted:516cb0ce-90bc-4b1e-af5b-c1e67be8c8eb for instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 on nch2-master-1 Oct 01 21:23:01.339902 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a4e1095d-a1fc-4e22-ba9d-6eaaab7c1bcc req-7b6d3ecf-265c-44b6-952c-cc642f834f1b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047495 Oct 01 21:23:01.346331 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3697/5399] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:01.422299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:01.423783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:01.427365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:01.440008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:01.441033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:01.442295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:01.443308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:01.444473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:01.444981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:01.457059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:01.458308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] [instance: c7f19d48-4464-4271-b98d-4176809bb0df] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:01.472413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:01.473960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:01.474933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:01.476694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:01.477677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:01.479178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:01.500317 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] HTTP exception thrown: Instance c7f19d48-4464-4271-b98d-4176809bb0df could not be found. Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Request method failure captured: Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df HTTP/1.1 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK9PWIfWd0px_xautJch7ABGI7b-U8DtXEqRmR2K5Yky9DJb3K-2aWVupfAR7s7K4rVAbG6QhjBUy1S9UxcsSczJCUjk389I0sHz8DKGILXWIxXSDir9BtoKZp2mqmBWSJwtagiCzLoRNupWAGZiRlfnbEDDXo1pC11HVLjYoTlPFgc Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 90cb48440cb446ea9abfc00ed0f53779 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestVolumeBackupRestore-262965167 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_90cb48440cb446ea9abfc00ed0f53779", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90cb48440cb446ea9abfc00ed0f53779"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/90cb48440cb446ea9abfc00ed0f53779"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/90cb48440cb446ea9abfc00ed0f53779"}]}] Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestVolumeBackupRestore-262965167 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 90cb48440cb446ea9abfc00ed0f53779 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestVolumeBackupRestore-262965167 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestVolumeBackupRestore-262965167-project Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 55dadd491ec1441aac4171eff46bd679 Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestVolumeBackupRestore-262965167-project Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance c7f19d48-4464-4271-b98d-4176809bb0df could not be found. Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'c7f19d48-4464-4271-b98d-4176809bb0df'} Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f19d48-4464-4271-b98d-4176809bb0df could not be found. Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f19d48-4464-4271-b98d-4176809bb0df could not be found. Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:01.507592 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:01.514387 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:01.514387 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:01.514387 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:01.514387 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:23:01.514387 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:23:01.514387 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f19d48-4464-4271-b98d-4176809bb0df could not be found. Oct 01 21:23:01.514387 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:01.514387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Returning 404 to user: Instance c7f19d48-4464-4271-b98d-4176809bb0df could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:23:01.514387 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3666d90-3962-49ee-b7a3-252421cdb9c6 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df" status: 404 len: 111 microversion: 2.1 time: 0.059026 Oct 01 21:23:01.517492 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3698/5400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:01 2022] GET /compute/v2.1/servers/c7f19d48-4464-4271-b98d-4176809bb0df => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:23:01.529740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:01.539145 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1789282f-69ba-454c-bcdf-8663476ec6e2 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1366 microversion: 2.1 time: 0.120996 Oct 01 21:23:01.541041 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1703/5401] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:01 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:01.834857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-040a3cb5-013b-4ae6-8c8f-292439d73968 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] Calling method '.version_select at 0x7f4172971c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:01.896570 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-040a3cb5-013b-4ae6-8c8f-292439d73968 tempest-TestVolumeBackupRestore-262965167 tempest-TestVolumeBackupRestore-262965167-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1258334286" status: 202 len: 0 microversion: 2.1 time: 0.069201 Oct 01 21:23:01.897662 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3699/5402] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1258334286 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:23:02.563794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:02.564457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:02.577910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:02.578585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:02.579388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:02.580614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:02.581403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:02.582093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:02.656235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:02.657286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:02.657286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:02.657707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lazy-loading 'fault' on Instance uuid 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:23:02.739871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:02.748866 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e1232e9c-9ccc-44f8-94b9-fdb84fd7a2b5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 200 len: 1160 microversion: 2.1 time: 0.189256 Oct 01 21:23:02.749796 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1704/5403] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:02 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 1160 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:03.776242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:03.777843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:03.788989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:03.793081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:03.793847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:03.794937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:03.795892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:03.796565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:03.818912 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 HTTP/1.1 Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '0bb45dd0-44e5-4abe-a6d2-ab807e1431e2'} Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:03.822294 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:03.827853 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:03.827853 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:03.827853 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:03.827853 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:23:03.827853 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:23:03.827853 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:03.827853 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:23:03.829786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:23:03.830770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6250c14f-dd22-487b-9b99-809a54eb0277 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 404 len: 111 microversion: 2.1 time: 0.061739 Oct 01 21:23:03.831299 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3700/5404] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:03 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:23:04.203816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:04.204384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:04.216508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:04.216964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:04.217441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:04.218556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1769b88f-e5c1-4ed1-a9ae-fde1f95f4240 req-9b065ff3-107a-4962-90f3-fb0bb7e61060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c688ca69-aa68-4134-8b57-bcb4a4c9d078", "tag": "b4995ed7-156f-4cce-af7d-483072f60973"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:04.224245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:04.224765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:04.225332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:04.238950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1769b88f-e5c1-4ed1-a9ae-fde1f95f4240 req-9b065ff3-107a-4962-90f3-fb0bb7e61060 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:04.239756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1769b88f-e5c1-4ed1-a9ae-fde1f95f4240 req-9b065ff3-107a-4962-90f3-fb0bb7e61060 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:04.242254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1769b88f-e5c1-4ed1-a9ae-fde1f95f4240 req-9b065ff3-107a-4962-90f3-fb0bb7e61060 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:04.256635 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1769b88f-e5c1-4ed1-a9ae-fde1f95f4240 req-9b065ff3-107a-4962-90f3-fb0bb7e61060 service nova] Creating event network-changed:b4995ed7-156f-4cce-af7d-483072f60973 for instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 on nch1-master-1 Oct 01 21:23:04.267760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1769b88f-e5c1-4ed1-a9ae-fde1f95f4240 req-9b065ff3-107a-4962-90f3-fb0bb7e61060 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054659 Oct 01 21:23:04.268420 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3701/5405] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:23:04.279692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:23:04.406408 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2a2165fa-215c-4df7-8f95-36236bb2d427 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 204 len: 0 microversion: 2.1 time: 0.206434 Oct 01 21:23:04.407403 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1705/5406] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:23:04 2022] DELETE /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:23:04.427533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:04.428713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:04.441033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:04.441711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:04.442255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:04.444136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:04.444858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:04.446126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:04.640648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:04.649682 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc0d98d5-5e9d-4afd-9d8b-00144018c6d3 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1688 microversion: 2.1 time: 0.233864 Oct 01 21:23:04.650274 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3702/5407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:04 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:05.674889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:05.675602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:05.683098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:05.683590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:05.684033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:05.684732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:05.685193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:05.685625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:05.704315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:05.824044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:05.832423 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bd395ada-6a07-4887-8afc-063230c67abe tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1570 microversion: 2.1 time: 0.161720 Oct 01 21:23:05.833025 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1706/5408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:05 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:06.856836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:06.858047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:06.865938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:06.866466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:06.867038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:06.868041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:06.869046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:06.869499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:06.920047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-191f0f6d-634e-4bf3-83c5-03d49c127337 req-c1a7a35a-418a-48fd-ab6c-8cd0451f8163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c688ca69-aa68-4134-8b57-bcb4a4c9d078", "name": "network-vif-deleted", "tag": "b4995ed7-156f-4cce-af7d-483072f60973"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:06.937008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-191f0f6d-634e-4bf3-83c5-03d49c127337 req-c1a7a35a-418a-48fd-ab6c-8cd0451f8163 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:06.937796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-191f0f6d-634e-4bf3-83c5-03d49c127337 req-c1a7a35a-418a-48fd-ab6c-8cd0451f8163 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:06.938680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-191f0f6d-634e-4bf3-83c5-03d49c127337 req-c1a7a35a-418a-48fd-ab6c-8cd0451f8163 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:06.954780 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-191f0f6d-634e-4bf3-83c5-03d49c127337 req-c1a7a35a-418a-48fd-ab6c-8cd0451f8163 service nova] Creating event network-vif-deleted:b4995ed7-156f-4cce-af7d-483072f60973 for instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 on nch1-master-1 Oct 01 21:23:06.956041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77486ef55a0469a99c3795b626bee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71511e85c1b947e3b03501b27d70d560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:06.962014 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-191f0f6d-634e-4bf3-83c5-03d49c127337 req-c1a7a35a-418a-48fd-ab6c-8cd0451f8163 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049529 Oct 01 21:23:06.963422 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1707/5409] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:23:06.966258 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7fea2fd-6c00-4c27-ac48-ce4725b0d623 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 200 len: 1503 microversion: 2.1 time: 0.113952 Oct 01 21:23:06.966885 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3703/5410] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:06 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 1503 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:07.038530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:07.039559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:07.049480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.050234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.050858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.052547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.053269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.054480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.078263 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b HTTP/1.1 Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ca86ca19-db63-48b9-97c2-50f9193faf8b'} Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:23:07.080336 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.085636 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.088915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:23:07.092609 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-95d6ba0c-c21d-46f3-86e6-cb94c9aa0619 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 404 len: 111 microversion: 2.1 time: 0.058644 Oct 01 21:23:07.096542 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1708/5411] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:23:07 2022] DELETE /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:23:07.107861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:07.108647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: ca86ca19-db63-48b9-97c2-50f9193faf8b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:07.124712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.125204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.125664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.126393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.127138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.129887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.148482 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b HTTP/1.1 Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'ca86ca19-db63-48b9-97c2-50f9193faf8b'} Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:07.150356 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.155871 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:07.155871 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:07.155871 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:07.155871 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:23:07.155871 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:23:07.155871 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. Oct 01 21:23:07.155871 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.157689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance ca86ca19-db63-48b9-97c2-50f9193faf8b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:23:07.158903 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e36e0aa8-9733-4504-97b4-a1b3869b2b5b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b" status: 404 len: 111 microversion: 2.1 time: 0.060546 Oct 01 21:23:07.159926 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1709/5412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:07 2022] GET /compute/v2.1/servers/ca86ca19-db63-48b9-97c2-50f9193faf8b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:23:07.376584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:07.377428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:07.387178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.388136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.388792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.389776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.390518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.391240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.615858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:07.627922 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b4124545-84bf-4f91-a054-4b8379c10163 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.563469 Oct 01 21:23:07.643803 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3704/5413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:07 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:07.657016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:07.657977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:07.665949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.666463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.666932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.667933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.668671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.669110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.901204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:07.911970 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-589514ae-1a8a-4ded-9d26-7c849095cf7d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.260029 Oct 01 21:23:07.912856 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1710/5414] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:07 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:07.935754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:07.937081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:07.944105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.944616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.945078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.945804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.946289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.947293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.956870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:07.958132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:07.965853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.966522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.966983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.967899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:07.968684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:07.968815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:07.986840 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 HTTP/1.1 Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '0bb45dd0-44e5-4abe-a6d2-ab807e1431e2'} Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:23:07.988906 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-668a1d4c-0d08-4dab-a04a-ab9e9fffafec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 404 len: 111 microversion: 2.1 time: 0.037899 Oct 01 21:23:07.994712 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1711/5415] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:23:07 2022] DELETE /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:23:07.999131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:07.999763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] [instance: c688ca69-aa68-4134-8b57-bcb4a4c9d078] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:08.005907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:08.006412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:08.006912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:08.007635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:08.008111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:08.008698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:08.024420 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] HTTP exception thrown: Instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 could not be found. Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Request method failure captured: Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 HTTP/1.1 Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK2hiQttiLqFpU-8rCQHHvV-cPgSq6Vp7kVdJek3nn6F4H5vFTWS4FtOgvdjDYM3WBqdjC3p_4jg80-mVN1iU7Nu4N7YA8dsPbVHGGQ6Xlb8LUviJ4SX_YgNzxd91nA6MQskQH_9HYu8UoC5fzsj_amZuTPDVfcZvtzydTfTYeoAqCM Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 71511e85c1b947e3b03501b27d70d560 Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_71511e85c1b947e3b03501b27d70d560", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/71511e85c1b947e3b03501b27d70d560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/71511e85c1b947e3b03501b27d70d560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/71511e85c1b947e3b03501b27d70d560"}]}] Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 71511e85c1b947e3b03501b27d70d560 Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1998630134 Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestNetworkAdvancedServerOps-1998630134-project Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: f77486ef55a0469a99c3795b626bee1a Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1998630134-project Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 could not be found. Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'c688ca69-aa68-4134-8b57-bcb4a4c9d078'} Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 could not be found. Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 could not be found. Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.026838 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 could not be found. Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Returning 404 to user: Instance c688ca69-aa68-4134-8b57-bcb4a4c9d078 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5363561b-dbbe-4352-9931-5ba2da8ea6b8 tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078" status: 404 len: 111 microversion: 2.1 time: 0.033382 Oct 01 21:23:08.031726 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1712/5416] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:07 2022] GET /compute/v2.1/servers/c688ca69-aa68-4134-8b57-bcb4a4c9d078 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:23:08.038118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:08.038789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:08.047125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:08.047645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:08.048096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:08.048818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:08.049284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:08.049713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:08.069052 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 HTTP/1.1 Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '0bb45dd0-44e5-4abe-a6d2-ab807e1431e2'} Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:23:08.070995 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1df402e8-5f8b-40ec-a578-28530f4166a5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2" status: 404 len: 111 microversion: 2.1 time: 0.041327 Oct 01 21:23:08.078109 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1713/5417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:08 2022] GET /compute/v2.1/servers/0bb45dd0-44e5-4abe-a6d2-ab807e1431e2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:23:08.141746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:08.151600 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb59702c-9084-46e8-a37c-62916eef5cc0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.220228 Oct 01 21:23:08.152393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3705/5418] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:07 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:08.164688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff2fcf0d-221c-48db-b121-ba5db146123f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Action: 'create', calling method: .version_select at 0x7f417254aaf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-78231844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfreTEAKirh7zcedqLx+JCC+D+fZBpcR7LnYQOPOJz7yw7aYaT7Pl9B5tlAJgwuDSjAvnWafs3XH8P5xVzaV1qy3KgutgpkO+BEyYBwWsFmX4cA80fLarVRrRwWWRMNBg=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:08.175287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:08.176320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:08.187224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff2fcf0d-221c-48db-b121-ba5db146123f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for project df0e56b020444dd28af868590b1bccf4. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:23:08.187433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:08.188416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:08.189579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:08.191648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:08.192874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:08.194712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:08.201104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-ff2fcf0d-221c-48db-b121-ba5db146123f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for user eb0bf5fce885439eaa16a0871c2992ac and project df0e56b020444dd28af868590b1bccf4. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:23:08.243965 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ff2fcf0d-221c-48db-b121-ba5db146123f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.083419 Oct 01 21:23:08.244956 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1714/5419] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:23:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:08.374543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:08.385150 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-699c06bd-34b0-4cbf-8ab1-24893cd2747e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.214058 Oct 01 21:23:08.395984 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3706/5420] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:08 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:08.461951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-275683731", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "494a382d-1e31-4806-a5de-71784de0fc03"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:08.548356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] validate_networks() for [('494a382d-1e31-4806-a5de-71784de0fc03', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:23:09.677226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:23:09.677800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:23:09.678139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:23:09.678611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:23:09.679032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:23:09.689256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:09.689751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:09.690200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:09.690985 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:09.691452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:09.691884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:09.710012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:23:09.715522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for user 6ac020dc323042c48ccce2a8826bc6be and project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:23:09.728533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:23:09.730902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:23:09.779522 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6ff4bd68-3d4f-4586-9616-aa0f24111c10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323581 Oct 01 21:23:09.786412 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1715/5421] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:23:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:23:09.791784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-823bfb6a-d5cf-4edc-92cb-fcb1430a752f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:09.792430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-823bfb6a-d5cf-4edc-92cb-fcb1430a752f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:09.866362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-823bfb6a-d5cf-4edc-92cb-fcb1430a752f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:09.876649 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-823bfb6a-d5cf-4edc-92cb-fcb1430a752f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1214 microversion: 2.1 time: 0.088599 Oct 01 21:23:09.877829 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3707/5422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:09 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:10.914361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:10.915482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:10.929116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:10.931429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:10.931919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:10.936294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:10.937179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:10.937896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:11.144782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:11.156380 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1e9ba2a7-b435-4c5a-8d87-dd056c92c854 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1266 microversion: 2.1 time: 0.256836 Oct 01 21:23:11.156984 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1716/5423] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:10 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:12.182877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:12.183682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:12.219608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:12.222609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:12.225213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:12.226250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:12.228646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:12.229365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:12.355326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:12.364355 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7021201-41d5-4632-917e-a0dccb5d1ade tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1272 microversion: 2.1 time: 0.187778 Oct 01 21:23:12.379674 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3708/5424] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:12 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:13.392168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:13.393459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:13.419220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:13.420153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:13.421983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:13.423406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:13.425148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:13.428121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:14.423494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:14.428206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1597849032", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-78231844", "security_groups": [{"name": "tempest-secgroup-smoke-1901537890"}], "block_device_mapping_v2": [{"uuid": "91a33031-458c-4c6f-8fe0-fccc855ffd7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4a3c030a-8624-4d4f-bb7a-67548024ff58"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:14.444722 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-61bea12a-1053-4d41-8a12-4ac12be08b88 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1314 microversion: 2.1 time: 1.054019 Oct 01 21:23:14.446508 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1717/5425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:13 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1314 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:14.632500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] validate_networks() for [('4a3c030a-8624-4d4f-bb7a-67548024ff58', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:23:15.291852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f4602c01-f85a-4486-9de9-ffc0b25d410f req-71b6fcdf-959a-44c5-8ef6-2fd0297e4795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d358e0-3b74-4ab2-90e5-2a43eb80a0f4", "tag": "869e8ce8-9f3c-4fbf-9707-f99b9ee70089"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:15.316928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f4602c01-f85a-4486-9de9-ffc0b25d410f req-71b6fcdf-959a-44c5-8ef6-2fd0297e4795 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:15.317673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f4602c01-f85a-4486-9de9-ffc0b25d410f req-71b6fcdf-959a-44c5-8ef6-2fd0297e4795 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:15.318454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f4602c01-f85a-4486-9de9-ffc0b25d410f req-71b6fcdf-959a-44c5-8ef6-2fd0297e4795 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:15.332327 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f4602c01-f85a-4486-9de9-ffc0b25d410f req-71b6fcdf-959a-44c5-8ef6-2fd0297e4795 service nova] Creating event network-changed:869e8ce8-9f3c-4fbf-9707-f99b9ee70089 for instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 on nch2-master-1 Oct 01 21:23:15.338896 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f4602c01-f85a-4486-9de9-ffc0b25d410f req-71b6fcdf-959a-44c5-8ef6-2fd0297e4795 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051658 Oct 01 21:23:15.340077 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1718/5426] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:15.476509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:15.478063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:15.481885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:23:15.482468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:23:15.483105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:23:15.483660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:23:15.484369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:23:15.490278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:15.490813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:15.491265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:15.491994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:15.494277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:15.494989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:15.509808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:15.510721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:15.511566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:15.512586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:15.513324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:15.514042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:15.540455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:23:15.547577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for user eb0bf5fce885439eaa16a0871c2992ac and project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:23:15.673070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:23:15.680195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91a33031-458c-4c6f-8fe0-fccc855ffd7f',volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:23:15.828142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:15.836512 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cd2bda4d-18d0-4eec-9bf9-2743b2222be8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1314 microversion: 2.1 time: 0.366744 Oct 01 21:23:15.854998 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1719/5427] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:15 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:15.864659 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5210f1ba-7b79-4d14-884e-2601297e9c90 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.453593 Oct 01 21:23:15.866423 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3709/5428] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:23:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 01 21:23:15.880170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5cbbbafa-3288-4090-8e04-295a689a59df tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:15.880899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5cbbbafa-3288-4090-8e04-295a689a59df tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:16.004928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5cbbbafa-3288-4090-8e04-295a689a59df tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:16.018012 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5cbbbafa-3288-4090-8e04-295a689a59df tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1093 microversion: 2.1 time: 0.141595 Oct 01 21:23:16.018012 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1720/5429] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:15 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1093 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:16.380010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c52852e-b65b-429d-80c0-570c6681143d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] Calling method '.version_select at 0x7f41725c31f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:16.422880 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c52852e-b65b-429d-80c0-570c6681143d tempest-TestNetworkAdvancedServerOps-1998630134 tempest-TestNetworkAdvancedServerOps-1998630134-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-892979206" status: 202 len: 0 microversion: 2.1 time: 0.046925 Oct 01 21:23:16.424225 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3710/5430] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Oct 1 21:23:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-892979206 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:23:16.863067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:16.864788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:16.877009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:16.877746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:16.878592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:16.879623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:16.880800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:16.881424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:17.048471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:17.048862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:17.066962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:17.068946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:17.071520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:17.074474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:17.075192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:17.077549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:17.210596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:17.226304 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ce0cf90d-e391-4363-a0b6-abc7114d5096 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1191 microversion: 2.1 time: 0.190369 Oct 01 21:23:17.227159 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3711/5431] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:17 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1191 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:17.470859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:17.484082 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3bd56da4-4bf9-4fd3-8c57-ba7c1be699c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1314 microversion: 2.1 time: 0.626508 Oct 01 21:23:17.492155 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1721/5432] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:16 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:18.252385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:18.253022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:18.284692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:18.285305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:18.285785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:18.286595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:18.287074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:18.287521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:18.510153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:18.511468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:18.521837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:18.549991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:18.552726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:18.553491 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0eac97b-7229-4841-b441-709bda6de2aa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1209 microversion: 2.1 time: 0.300073 Oct 01 21:23:18.554298 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3712/5433] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:18 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1209 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:18.555378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:18.556346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:18.557756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:18.558365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:18.736370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:18.744845 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-77cf5a64-f261-4150-b532-31ef30861d2b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1314 microversion: 2.1 time: 0.239460 Oct 01 21:23:18.747303 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1722/5434] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:18 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:19.577188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:19.577882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:19.588846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:19.596125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:19.597110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:19.598124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:19.599025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:19.599759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:19.778223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:19.779055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:19.794285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:19.802074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:19.825642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:19.826119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:19.830732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:19.830732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:19.831022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:20.124157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:20.140867 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1737e503-05ad-4871-a370-c1625e21754d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1314 microversion: 2.1 time: 0.371225 Oct 01 21:23:20.142519 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1723/5435] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:19 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:20.194922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:20.223839 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-51c3fe09-6fcb-4de5-8a55-8863aaf1ece4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1265 microversion: 2.1 time: 0.650714 Oct 01 21:23:20.224759 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3713/5436] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:19 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1265 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:20.586410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-749368c2-66a3-4cf3-887e-052b7c652733 req-47942513-a623-46a3-b348-d4e004730f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d358e0-3b74-4ab2-90e5-2a43eb80a0f4", "name": "network-vif-plugged", "status": "completed", "tag": "869e8ce8-9f3c-4fbf-9707-f99b9ee70089"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:20.601059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-749368c2-66a3-4cf3-887e-052b7c652733 req-47942513-a623-46a3-b348-d4e004730f9e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:20.601854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-749368c2-66a3-4cf3-887e-052b7c652733 req-47942513-a623-46a3-b348-d4e004730f9e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:20.603470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-749368c2-66a3-4cf3-887e-052b7c652733 req-47942513-a623-46a3-b348-d4e004730f9e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:20.627954 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-749368c2-66a3-4cf3-887e-052b7c652733 req-47942513-a623-46a3-b348-d4e004730f9e service nova] Creating event network-vif-plugged:869e8ce8-9f3c-4fbf-9707-f99b9ee70089 for instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 on nch2-master-1 Oct 01 21:23:20.635084 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-749368c2-66a3-4cf3-887e-052b7c652733 req-47942513-a623-46a3-b348-d4e004730f9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053276 Oct 01 21:23:20.636341 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1724/5437] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:23:21.166506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:21.168278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:21.179599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:21.180120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:21.181241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:21.181993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:21.182638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:21.183292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:21.225821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:21.251634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:21.252997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:21.278522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:21.279035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:21.282354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:21.283164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:21.283641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:21.284075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:21.466986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:21.476746 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-58a97a59-bda1-457b-b1fc-b9e1b5e2c50c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1265 microversion: 2.1 time: 0.231737 Oct 01 21:23:21.478964 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1725/5438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:21 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:21.485114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a5633d44-ac35-4f0e-ab39-7512ab67e11c req-768e789f-f160-4703-a6de-e7d09545b233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705efbe6-8a41-4a4b-8308-aacfce5ae9c0", "tag": "6933cdba-d259-4cb3-98f5-726e87767a86"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:21.497178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a5633d44-ac35-4f0e-ab39-7512ab67e11c req-768e789f-f160-4703-a6de-e7d09545b233 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:21.498520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a5633d44-ac35-4f0e-ab39-7512ab67e11c req-768e789f-f160-4703-a6de-e7d09545b233 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:21.499473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a5633d44-ac35-4f0e-ab39-7512ab67e11c req-768e789f-f160-4703-a6de-e7d09545b233 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:21.509681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:21.519926 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e44205e7-f37c-4c73-8550-539d70fd61b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1314 microversion: 2.1 time: 0.357904 Oct 01 21:23:21.521182 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3714/5439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:21 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:21.549376 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a5633d44-ac35-4f0e-ab39-7512ab67e11c req-768e789f-f160-4703-a6de-e7d09545b233 service nova] Creating event network-changed:6933cdba-d259-4cb3-98f5-726e87767a86 for instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 on nch1-master-1 Oct 01 21:23:21.558354 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a5633d44-ac35-4f0e-ab39-7512ab67e11c req-768e789f-f160-4703-a6de-e7d09545b233 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077921 Oct 01 21:23:21.560997 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1726/5440] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:22.501730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:22.502386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:22.511063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:22.511592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:22.512194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:22.512973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:22.513470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:22.513932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:22.545369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:22.546073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:22.564162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:22.564672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:22.565123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:22.565854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:22.566323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:22.566788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:22.744129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:22.755273 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f9464839-f357-4f7c-ad22-3f06eba2d07a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1501 microversion: 2.1 time: 0.214641 Oct 01 21:23:22.756097 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1727/5441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:22 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:22.787954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:22.790050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:22.798639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:22.802322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:22.803049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:22.803581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:22.804317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:22.806060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:22.806446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:22.814262 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2589547-b5f6-48aa-b027-e3a2756505b3 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1265 microversion: 2.1 time: 0.314372 Oct 01 21:23:22.815553 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3715/5442] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:22 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:22.965435 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.network.security_group_api [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Removing security group b1ccc75f-dd3f-4994-8e19-4180fafdc010 from port 869e8ce8-9f3c-4fbf-9707-f99b9ee70089 Oct 01 21:23:23.270958 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-38544660-a0ee-42ee-bab2-f8f425b4fda4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4/action" status: 202 len: 0 microversion: 2.1 time: 0.486882 Oct 01 21:23:23.272138 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1728/5443] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:23:22 2022] POST /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:23:23.282215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-456945ba-eca1-42cc-9dcf-1c3648939585 req-12d3aafb-94de-477a-972d-ad7907a6ddf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d358e0-3b74-4ab2-90e5-2a43eb80a0f4", "tag": "869e8ce8-9f3c-4fbf-9707-f99b9ee70089"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:23.283827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:23.284609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:23.293399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-456945ba-eca1-42cc-9dcf-1c3648939585 req-12d3aafb-94de-477a-972d-ad7907a6ddf2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.294570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-456945ba-eca1-42cc-9dcf-1c3648939585 req-12d3aafb-94de-477a-972d-ad7907a6ddf2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.295041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-456945ba-eca1-42cc-9dcf-1c3648939585 req-12d3aafb-94de-477a-972d-ad7907a6ddf2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.298042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.300735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.301355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.307161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.307775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.308474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.310984 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-456945ba-eca1-42cc-9dcf-1c3648939585 req-12d3aafb-94de-477a-972d-ad7907a6ddf2 service nova] Creating event network-changed:869e8ce8-9f3c-4fbf-9707-f99b9ee70089 for instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 on nch2-master-1 Oct 01 21:23:23.317157 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-456945ba-eca1-42cc-9dcf-1c3648939585 req-12d3aafb-94de-477a-972d-ad7907a6ddf2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039243 Oct 01 21:23:23.318002 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3716/5444] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:23.434956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:23.443602 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-af4a2b39-6c5c-4212-95f3-9cccd2af628c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1459 microversion: 2.1 time: 0.163935 Oct 01 21:23:23.444338 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1729/5445] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:23 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:23.468364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:23.469003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:23.476493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.477049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.477722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.478522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.479257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.479705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.626070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:23.642159 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-949015d6-a877-4afc-bb95-72e334142818 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.178421 Oct 01 21:23:23.642979 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3717/5446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:23 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:23.668662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:23.669288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:23.676219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.676720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.677169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.677886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.678354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.678821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.839253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:23.840201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:23.846522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.847317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.847856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.848695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.849269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.849798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.914386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:23.925607 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a2ae53f3-446c-4815-ba47-3a2c76d19fd6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.261619 Oct 01 21:23:23.935327 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1730/5447] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:23 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:23.948754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:23.949619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:23.957053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.957805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.958427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.959462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:23.959923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:23.960526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:23.999026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:24.008097 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-123e43ab-39db-4310-8d9f-ee19645cac4a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1265 microversion: 2.1 time: 0.172947 Oct 01 21:23:24.010067 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3718/5448] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:23 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:24.112214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:24.123566 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-875927e0-767e-4437-8b03-4aecc7837c5b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.178792 Oct 01 21:23:24.124939 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1731/5449] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:23 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:24.158920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:24.158920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:24.158920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:24.158920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:24.158920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:24.158920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:24.158920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:24.158920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:24.316121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:24.325666 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-54f321f6-e19c-4741-89e1-6874d37d344a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.181493 Oct 01 21:23:24.326274 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3719/5450] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:24 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:24.449392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1624322468", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "494a382d-1e31-4806-a5de-71784de0fc03"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:24.505824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] validate_networks() for [('494a382d-1e31-4806-a5de-71784de0fc03', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:23:24.883375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:23:24.883997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:23:24.884562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:23:24.885091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:23:24.885593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:23:24.894760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:24.895341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:24.895860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:24.896696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:24.897237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:24.897759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:24.905823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:24.918362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:23:24.923937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Getting quotas for user 6ac020dc323042c48ccce2a8826bc6be and project 9e09544743724cf18d2ab2aeb4180d81. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:23:24.926399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:24.939624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:23:24.942078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:23:24.989225 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a3f0a1a3-7132-45e8-bcdc-b19ce806d4c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544439 Oct 01 21:23:24.989925 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1732/5451] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:23:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:23:25.001301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88495d92-36c3-4db3-98d6-00c67fab3a5f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:25.002051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88495d92-36c3-4db3-98d6-00c67fab3a5f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:25.033458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:25.034624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:25.043528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:25.044346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:25.045002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:25.046153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:25.046863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:25.047518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:25.079428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88495d92-36c3-4db3-98d6-00c67fab3a5f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:25.087861 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88495d92-36c3-4db3-98d6-00c67fab3a5f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1215 microversion: 2.1 time: 0.090531 Oct 01 21:23:25.088458 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3720/5452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:24 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:25.195280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:25.205712 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4ce73cb3-9891-4900-814d-999d9e87fc1c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1265 microversion: 2.1 time: 0.176969 Oct 01 21:23:25.206434 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1733/5453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:25 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:26.110108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:26.116516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:26.117154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:26.127769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:26.128264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:26.128745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:26.129679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:26.130361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:26.131012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:26.221716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:26.229177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:26.229743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:26.244331 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c1a1ceec-6e6c-4596-8f3d-1d87257a67e3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1275 microversion: 2.1 time: 0.134922 Oct 01 21:23:26.244935 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3721/5454] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:26 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:26.248109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:26.248910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:26.249534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:26.250417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:26.251211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:26.252446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:26.386915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9fa94091-83ee-4c94-ad12-f256db51960c req-04ccf824-de34-45b4-b0ac-32a25d6d1861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705efbe6-8a41-4a4b-8308-aacfce5ae9c0", "name": "network-vif-plugged", "status": "completed", "tag": "6933cdba-d259-4cb3-98f5-726e87767a86"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:26.391934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:26.401518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9fa94091-83ee-4c94-ad12-f256db51960c req-04ccf824-de34-45b4-b0ac-32a25d6d1861 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:26.402998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9fa94091-83ee-4c94-ad12-f256db51960c req-04ccf824-de34-45b4-b0ac-32a25d6d1861 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:26.404621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9fa94091-83ee-4c94-ad12-f256db51960c req-04ccf824-de34-45b4-b0ac-32a25d6d1861 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:26.425225 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9fa94091-83ee-4c94-ad12-f256db51960c req-04ccf824-de34-45b4-b0ac-32a25d6d1861 service nova] Creating event network-vif-plugged:6933cdba-d259-4cb3-98f5-726e87767a86 for instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 on nch1-master-1 Oct 01 21:23:26.434664 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9fa94091-83ee-4c94-ad12-f256db51960c req-04ccf824-de34-45b4-b0ac-32a25d6d1861 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051737 Oct 01 21:23:26.435713 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3722/5455] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:26.472388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:26.483933 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-def10029-f105-4115-9011-8d5f1f26edb4 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1265 microversion: 2.1 time: 0.258592 Oct 01 21:23:26.485150 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1734/5456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:26 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:27.270326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:27.271764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:27.279670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:27.280505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:27.280962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:27.281894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:27.282387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:27.282969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:27.442351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:27.453603 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0937cfb8-fad5-4b25-8949-18a248c2512c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1315 microversion: 2.1 time: 0.188350 Oct 01 21:23:27.454417 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3723/5457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:27 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:27.509467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:27.511035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:27.519829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:27.520604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:27.521351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:27.522273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:27.522939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:27.523702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:27.732228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:27.744931 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d35c3c3c-46a5-44d9-92f2-0993930585a0 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1265 microversion: 2.1 time: 0.240434 Oct 01 21:23:27.745681 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1735/5458] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:27 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:28.087157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-78af9e95-0acb-40a9-b622-d3a3a1611382 req-e608e864-81df-42b4-a431-b01e1166e7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32dee155-0c3f-40d5-91c4-88164b58b932", "tag": "a30def5b-5ce5-4959-a8e4-bb1af1030d29"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:28.098050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-78af9e95-0acb-40a9-b622-d3a3a1611382 req-e608e864-81df-42b4-a431-b01e1166e7f7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:28.098742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-78af9e95-0acb-40a9-b622-d3a3a1611382 req-e608e864-81df-42b4-a431-b01e1166e7f7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:28.099279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-78af9e95-0acb-40a9-b622-d3a3a1611382 req-e608e864-81df-42b4-a431-b01e1166e7f7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:28.112847 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-78af9e95-0acb-40a9-b622-d3a3a1611382 req-e608e864-81df-42b4-a431-b01e1166e7f7 service nova] Creating event network-changed:a30def5b-5ce5-4959-a8e4-bb1af1030d29 for instance 32dee155-0c3f-40d5-91c4-88164b58b932 on nch2-master-1 Oct 01 21:23:28.118418 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-78af9e95-0acb-40a9-b622-d3a3a1611382 req-e608e864-81df-42b4-a431-b01e1166e7f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035161 Oct 01 21:23:28.119385 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3724/5459] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:23:28.483404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:28.484032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:28.490911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:28.491413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:28.491902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:28.493400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:28.494107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:28.494742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:28.657051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:28.666643 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3241e7cd-89d3-4685-afa7-9c4ff1da7fc4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1315 microversion: 2.1 time: 0.187075 Oct 01 21:23:28.667231 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1736/5460] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:28 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:28.769963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:28.770762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:28.778752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:28.779481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:28.780148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:28.780876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:28.781591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:28.782053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:28.919687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:28.927758 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15ad1b2a-8190-4e7e-b030-43b96f61ee31 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1452 microversion: 2.1 time: 0.163005 Oct 01 21:23:28.928332 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3725/5461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:28 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:28.950399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:28.951048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:28.956982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:28.957470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:28.957915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:28.958645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:28.959102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:28.959532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:29.098350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:29.106965 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-57e70ed4-402c-45c3-bf2a-726f9d26b55b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1452 microversion: 2.1 time: 0.160370 Oct 01 21:23:29.107560 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1737/5462] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:28 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:29.690391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:29.691457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:29.699834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:29.700465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:29.700921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:29.702105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:29.702863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:29.703470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:29.875072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:29.890997 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21c6e172-1766-4514-8108-bcdd97ff55a6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1315 microversion: 2.1 time: 0.205107 Oct 01 21:23:29.892231 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3726/5463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:29 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:30.917166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:30.918893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:30.926217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:30.926741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:30.927179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:30.928216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:30.928938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:30.929359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:31.194197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:31.202922 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1366784b-6913-43d4-a0f9-1dc86f32f303 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1315 microversion: 2.1 time: 0.290839 Oct 01 21:23:31.203460 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1738/5464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:30 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:31.490814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-dec0fadf-fac8-48c4-a6d1-1b9ab4fec400 req-aacc75dc-254d-4f55-8341-7790194314d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705efbe6-8a41-4a4b-8308-aacfce5ae9c0", "tag": "6933cdba-d259-4cb3-98f5-726e87767a86"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:31.501297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dec0fadf-fac8-48c4-a6d1-1b9ab4fec400 req-aacc75dc-254d-4f55-8341-7790194314d0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:31.501958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dec0fadf-fac8-48c4-a6d1-1b9ab4fec400 req-aacc75dc-254d-4f55-8341-7790194314d0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:31.502423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dec0fadf-fac8-48c4-a6d1-1b9ab4fec400 req-aacc75dc-254d-4f55-8341-7790194314d0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:31.514480 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-dec0fadf-fac8-48c4-a6d1-1b9ab4fec400 req-aacc75dc-254d-4f55-8341-7790194314d0 service nova] Creating event network-changed:6933cdba-d259-4cb3-98f5-726e87767a86 for instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 on nch1-master-1 Oct 01 21:23:31.519393 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-dec0fadf-fac8-48c4-a6d1-1b9ab4fec400 req-aacc75dc-254d-4f55-8341-7790194314d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032397 Oct 01 21:23:31.519987 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3727/5465] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:32.227589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:32.229005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:32.236262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:32.236872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:32.237413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:32.238306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:32.240050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:32.240549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:32.314958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-33e4c62d-7fe4-42eb-acbf-49c530fc58ea req-9b56d52a-2fba-46a8-9b43-68c166c56102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32dee155-0c3f-40d5-91c4-88164b58b932", "name": "network-vif-plugged", "status": "completed", "tag": "a30def5b-5ce5-4959-a8e4-bb1af1030d29"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:32.332712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-33e4c62d-7fe4-42eb-acbf-49c530fc58ea req-9b56d52a-2fba-46a8-9b43-68c166c56102 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:32.337806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-33e4c62d-7fe4-42eb-acbf-49c530fc58ea req-9b56d52a-2fba-46a8-9b43-68c166c56102 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:32.338960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-33e4c62d-7fe4-42eb-acbf-49c530fc58ea req-9b56d52a-2fba-46a8-9b43-68c166c56102 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:32.360070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-33e4c62d-7fe4-42eb-acbf-49c530fc58ea req-9b56d52a-2fba-46a8-9b43-68c166c56102 service nova] Creating event network-vif-plugged:a30def5b-5ce5-4959-a8e4-bb1af1030d29 for instance 32dee155-0c3f-40d5-91c4-88164b58b932 on nch2-master-1 Oct 01 21:23:32.365712 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-33e4c62d-7fe4-42eb-acbf-49c530fc58ea req-9b56d52a-2fba-46a8-9b43-68c166c56102 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055086 Oct 01 21:23:32.366646 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3728/5466] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:23:32.453207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:32.464670 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-64345cc9-80c2-475c-b89d-53251b742d08 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1315 microversion: 2.1 time: 0.242794 Oct 01 21:23:32.465557 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1739/5467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:32 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:33.489586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:33.490305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:33.497599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:33.498171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:33.498859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:33.499590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:33.500076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:33.500530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:33.657898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:33.668395 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cfdf9f06-cb34-4b2e-9b46-9084ccd86f10 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1315 microversion: 2.1 time: 0.183967 Oct 01 21:23:33.668980 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3729/5468] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:33 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:34.695707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:34.696256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:34.703314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:34.703804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:34.704248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:34.704945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:34.705407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:34.705847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:34.835115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:34.843580 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2b88e15e-5751-4164-a104-fcd560d420c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1502 microversion: 2.1 time: 0.151899 Oct 01 21:23:34.844442 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1740/5469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:34 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:34.866321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-90c810ad-6d74-4462-b94f-2f6183b2651b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:34.866921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-90c810ad-6d74-4462-b94f-2f6183b2651b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:34.873804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c810ad-6d74-4462-b94f-2f6183b2651b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:34.874305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c810ad-6d74-4462-b94f-2f6183b2651b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:34.874867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c810ad-6d74-4462-b94f-2f6183b2651b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:34.875589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c810ad-6d74-4462-b94f-2f6183b2651b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:34.876071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c810ad-6d74-4462-b94f-2f6183b2651b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:34.876519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c810ad-6d74-4462-b94f-2f6183b2651b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:34.949639 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-90c810ad-6d74-4462-b94f-2f6183b2651b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932/action" status: 202 len: 0 microversion: 2.1 time: 0.086983 Oct 01 21:23:34.950606 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3730/5470] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:23:34 2022] POST /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:23:34.960492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:34.961803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:34.973354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:34.973354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=18 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:34.973354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:34.973354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:34.973354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:34.973354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:34.973354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:34.974693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:35.134572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:35.144993 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c34b9dbf-b10a-4059-b704-42e414b46940 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1507 microversion: 2.1 time: 0.189728 Oct 01 21:23:35.146068 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1741/5471] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:34 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:36.167692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:36.173831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:36.174601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:36.182476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:36.183045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:36.183505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:36.184423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:36.185166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:36.185793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:36.323569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:36.335013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3acfab01-14d6-4647-a64e-6781397cdcc9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1487 microversion: 2.1 time: 0.168136 Oct 01 21:23:36.335688 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3731/5472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:36 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1487 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:36.358697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:36.359322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:36.366863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:36.367353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:36.368332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:36.369084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:36.369545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:36.369983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:36.393516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lazy-loading 'flavor' on Instance uuid 32dee155-0c3f-40d5-91c4-88164b58b932 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:23:36.580069 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a18134a2-e17f-4499-a202-412059d14b87 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932/action" status: 202 len: 0 microversion: 2.1 time: 0.225220 Oct 01 21:23:36.580689 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1742/5473] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:23:36 2022] POST /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:23:36.589411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:36.590030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:36.596352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:36.597032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:36.597550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:36.598636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:36.599282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:36.599769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:36.733304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:36.741058 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15f73eaa-009c-450d-bb4c-f9b2de3033df tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1493 microversion: 2.1 time: 0.155759 Oct 01 21:23:36.741817 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3732/5474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:36 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1493 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:37.766876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:37.767586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:37.774732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:37.775219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:37.775659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:37.776352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:37.776804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:37.777227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:37.907094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:37.915342 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dd0cbfd5-72d1-4ea2-9651-eaee5690ccd4 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1514 microversion: 2.1 time: 0.153166 Oct 01 21:23:37.915913 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1743/5475] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:37 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:38.940037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:38.940646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:38.948693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:38.949237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:38.949702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:38.950428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:38.950942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:38.951395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:39.082323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:39.091794 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a5888bb9-d99c-4c66-a699-8d3165274fb9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1514 microversion: 2.1 time: 0.156007 Oct 01 21:23:39.092377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3733/5476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:38 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:40.119267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:40.120179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:40.129791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:40.130617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:40.131070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:40.132029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:40.132593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:40.133120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:40.378752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:40.396274 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dae64cac-e2fd-48c3-aa41-b152bdc4c66f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1509 microversion: 2.1 time: 0.280271 Oct 01 21:23:40.398326 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1744/5477] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:40 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:40.404255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-90187485-9eb5-4e17-b3de-ec2c6e62f2de req-60220840-ea2a-414b-8447-c2170c135e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32dee155-0c3f-40d5-91c4-88164b58b932", "name": "network-vif-plugged", "status": "completed", "tag": "a30def5b-5ce5-4959-a8e4-bb1af1030d29"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:40.417981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-90187485-9eb5-4e17-b3de-ec2c6e62f2de req-60220840-ea2a-414b-8447-c2170c135e30 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:40.418930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-90187485-9eb5-4e17-b3de-ec2c6e62f2de req-60220840-ea2a-414b-8447-c2170c135e30 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:40.419638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-90187485-9eb5-4e17-b3de-ec2c6e62f2de req-60220840-ea2a-414b-8447-c2170c135e30 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:40.424722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:40.438325 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-90187485-9eb5-4e17-b3de-ec2c6e62f2de req-60220840-ea2a-414b-8447-c2170c135e30 service nova] Creating event network-vif-plugged:a30def5b-5ce5-4959-a8e4-bb1af1030d29 for instance 32dee155-0c3f-40d5-91c4-88164b58b932 on nch2-master-1 Oct 01 21:23:40.446564 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-90187485-9eb5-4e17-b3de-ec2c6e62f2de req-60220840-ea2a-414b-8447-c2170c135e30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046638 Oct 01 21:23:40.447756 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3734/5478] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:23:41.423760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:41.424614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:41.439328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:41.439959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:41.440480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:41.441319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:41.442343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:41.445171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:41.675774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:41.688552 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-345bc763-a9a9-4a77-8315-1f950f2ca3b9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1509 microversion: 2.1 time: 0.270176 Oct 01 21:23:41.689187 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1745/5479] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:41 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:42.695779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1421122933", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:42.714040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:42.714964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:42.725521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:42.726035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:42.726508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:42.727285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:42.727754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:42.728326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:42.755436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:23:42.899861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:42.908468 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aa533b64-45c8-4cf8-88bb-6d3b955ac614 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1509 microversion: 2.1 time: 0.199416 Oct 01 21:23:42.909066 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1746/5480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:42 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:43.342074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:23:43.342943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:23:43.343593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:23:43.344176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:23:43.344695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:23:43.357380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:43.357917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:43.358380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:43.359164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:43.360281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:43.360736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:43.383517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Getting quotas for project 3702ba8854c041f4ad1a3de3347dd5b3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:23:43.392467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Getting quotas for user fb9b3c506e6244b28569e68fb36ad5fc and project 3702ba8854c041f4ad1a3de3347dd5b3. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:23:43.412818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:23:43.415907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:23:43.470290 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b31e3669-54a8-41a7-9ad1-f559a963f225 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780245 Oct 01 21:23:43.471509 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3735/5481] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:23:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:23:43.485093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cd5ba031-8f1f-470f-b184-f1264ae62583 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:43.486004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cd5ba031-8f1f-470f-b184-f1264ae62583 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:43.561845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cd5ba031-8f1f-470f-b184-f1264ae62583 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:43.573016 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cd5ba031-8f1f-470f-b184-f1264ae62583 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1215 microversion: 2.1 time: 0.094558 Oct 01 21:23:43.573843 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1747/5482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:43 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:43.933714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:43.934370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:43.942209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:43.943454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:43.943612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:43.944444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:43.945120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:43.945748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:44.129558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:44.142057 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aae591ff-cbab-4466-abb2-078963bd13ea tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1509 microversion: 2.1 time: 0.212615 Oct 01 21:23:44.143272 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3736/5483] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:43 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:44.597395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:44.597942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:44.609767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:44.610268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:44.610747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:44.611495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:44.611961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:44.612395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:44.631834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:44.683937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:44.697966 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-54783ca4-3e36-4910-86d6-fc709e1c4ce4 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1267 microversion: 2.1 time: 0.104504 Oct 01 21:23:44.698895 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1748/5484] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:44 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:45.168445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:45.169096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:45.179603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:45.180391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:45.181003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:45.182063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:45.182726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:45.183324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:45.437120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:45.448491 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-33833ac2-4554-494e-b572-cb364bd62a18 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1509 microversion: 2.1 time: 0.284657 Oct 01 21:23:45.449417 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3737/5485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:45 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:45.721992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:45.723380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:45.731708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:45.732226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:45.732672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:45.733430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:45.733899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:45.734340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:45.807396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:45.815383 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a772ba85-6dc2-4bed-8dfa-70869e58dec9 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1273 microversion: 2.1 time: 0.097996 Oct 01 21:23:45.816109 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1749/5486] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:45 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:46.478002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:46.479434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:46.494713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:46.495464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:46.496100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:46.498029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:46.498735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:46.499934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:46.686187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:46.695578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f2389785-1d19-40f4-bb63-b4cc313b1593 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1509 microversion: 2.1 time: 0.222749 Oct 01 21:23:46.696928 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3738/5487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:46 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:46.774852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-2e3c59a4-85d6-40be-81a4-fd52edd78bf2 req-b59b6b53-aea2-44a4-b86d-c04eefffcd08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee75e16d-9908-4408-a9c7-484b4d22ac48", "tag": "f2c0e1c8-d976-4f95-97a2-8b642f3441f8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:46.805761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2e3c59a4-85d6-40be-81a4-fd52edd78bf2 req-b59b6b53-aea2-44a4-b86d-c04eefffcd08 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:46.806900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2e3c59a4-85d6-40be-81a4-fd52edd78bf2 req-b59b6b53-aea2-44a4-b86d-c04eefffcd08 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:46.808056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2e3c59a4-85d6-40be-81a4-fd52edd78bf2 req-b59b6b53-aea2-44a4-b86d-c04eefffcd08 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:46.822934 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-2e3c59a4-85d6-40be-81a4-fd52edd78bf2 req-b59b6b53-aea2-44a4-b86d-c04eefffcd08 service nova] Creating event network-changed:f2c0e1c8-d976-4f95-97a2-8b642f3441f8 for instance ee75e16d-9908-4408-a9c7-484b4d22ac48 on nch1-master-1 Oct 01 21:23:46.830854 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-2e3c59a4-85d6-40be-81a4-fd52edd78bf2 req-b59b6b53-aea2-44a4-b86d-c04eefffcd08 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060490 Oct 01 21:23:46.832022 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1750/5488] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:46.843058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:46.843910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:46.859250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:46.859877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:46.860740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:46.861354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:46.862178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:46.862759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:47.141289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:47.152401 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d85a3f2-36be-47b0-aa33-4b44c85eba0b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1315 microversion: 2.1 time: 0.313788 Oct 01 21:23:47.153343 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3739/5489] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:46 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:47.721375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:47.722094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:47.729725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:47.730231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:47.731338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:47.732238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:47.732699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:47.733310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:47.888341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:47.900845 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d08da141-21e5-4499-a5f3-1311094af76c tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1509 microversion: 2.1 time: 0.184144 Oct 01 21:23:47.901873 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1751/5490] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:47 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:48.176861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:48.177696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:48.186157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:48.186708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:48.187166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:48.187932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:48.188560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:48.189004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:48.453732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:48.465202 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-14a8ddc8-ba65-425d-b019-9921fc148f77 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1315 microversion: 2.1 time: 0.292527 Oct 01 21:23:48.465817 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3740/5491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:48 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:48.924557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:48.925318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:48.933473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:48.934049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:48.934622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:48.935449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:48.936183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:48.936704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:49.088757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:49.099163 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-24e9f54a-4b3d-4180-82ca-e354664b5aef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1509 microversion: 2.1 time: 0.178463 Oct 01 21:23:49.099860 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1752/5492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:48 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:49.488750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:49.489437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:49.497526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:49.498045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:49.498522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:49.499259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:49.499740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:49.500191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:49.641972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:49.650747 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19e6263e-5432-4027-a830-9b4c19b98e09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1315 microversion: 2.1 time: 0.166335 Oct 01 21:23:49.651325 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3741/5493] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:49 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:50.124526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:50.125167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:50.134276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:50.135039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:50.135419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:50.136166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:50.136797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:50.137244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:50.415683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:50.428467 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-99bea6ce-d09d-4b2d-b48e-bc4cb1faeeee tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1506 microversion: 2.1 time: 0.308599 Oct 01 21:23:50.429226 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1753/5494] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:50 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:50.674057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:50.674718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:50.682337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:50.682873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:50.683341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:50.684061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:50.684542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:50.685060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:50.820495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:50.828605 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-533c8a99-2307-487d-8147-595e03a3c63b tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1315 microversion: 2.1 time: 0.158520 Oct 01 21:23:50.829193 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3742/5495] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:50 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:51.453027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:51.453683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:51.460635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:51.461148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:51.462161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:51.463036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:51.463538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:51.464037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:51.601609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:51.609484 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3aacd12f-b60d-4040-a9df-190d51e15fac tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1506 microversion: 2.1 time: 0.160470 Oct 01 21:23:51.610052 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1754/5496] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:51 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:51.851442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:51.852000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:51.859274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:51.859784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:51.860249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:51.860962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:51.861438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:51.861884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:51.993895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:52.002162 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7586752c-34c5-44e9-aafa-ba8718601c09 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1315 microversion: 2.1 time: 0.154806 Oct 01 21:23:52.003913 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3743/5497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:51 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:52.340356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b16d11d4-e37f-4371-aad3-0bc4330293be req-cddf2c67-f51f-4f94-a94f-59cacdc6d434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32dee155-0c3f-40d5-91c4-88164b58b932", "name": "network-vif-unplugged", "status": "completed", "tag": "a30def5b-5ce5-4959-a8e4-bb1af1030d29"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:52.351411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b16d11d4-e37f-4371-aad3-0bc4330293be req-cddf2c67-f51f-4f94-a94f-59cacdc6d434 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:52.352642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b16d11d4-e37f-4371-aad3-0bc4330293be req-cddf2c67-f51f-4f94-a94f-59cacdc6d434 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:52.353368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b16d11d4-e37f-4371-aad3-0bc4330293be req-cddf2c67-f51f-4f94-a94f-59cacdc6d434 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:52.365608 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b16d11d4-e37f-4371-aad3-0bc4330293be req-cddf2c67-f51f-4f94-a94f-59cacdc6d434 service nova] Creating event network-vif-unplugged:a30def5b-5ce5-4959-a8e4-bb1af1030d29 for instance 32dee155-0c3f-40d5-91c4-88164b58b932 on nch2-master-1 Oct 01 21:23:52.371431 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b16d11d4-e37f-4371-aad3-0bc4330293be req-cddf2c67-f51f-4f94-a94f-59cacdc6d434 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035761 Oct 01 21:23:52.372135 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1755/5498] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:52.632589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:52.633256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:52.639333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:52.639850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:52.640308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:52.641021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:52.641496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:52.641943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:52.772586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:52.783760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae3b5cbb-9858-4618-810c-24670f950cd7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 200 len: 1449 microversion: 2.1 time: 0.154943 Oct 01 21:23:52.784405 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3744/5499] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:52 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:52.812253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:52.813073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:52.819635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:52.820169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:52.820679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:52.821445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:52.821907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:52.822333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:52.957117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:52.965677 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b3097a7f-2536-473e-9e03-9e2b79cf1610 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.158910 Oct 01 21:23:52.966258 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1756/5500] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:52 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:52.992976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:52.993749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:53.001286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.001797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.002261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.003031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.003512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.003963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.028491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:53.029658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:53.037574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.038160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.038743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.039949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.040619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.041207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.160425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:53.169341 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5cbe5f18-c183-4684-9367-b580bf1c706b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.180753 Oct 01 21:23:53.169878 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3745/5501] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:52 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:53.191804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:53.192585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:53.199567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.200136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.200621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.201333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.201825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.202180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:53.202330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.210679 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2b0714bd-dd02-4b03-9c89-007cd3d6cf87 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1315 microversion: 2.1 time: 0.187149 Oct 01 21:23:53.212185 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1757/5502] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:53 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:53.340721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:53.348676 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-74d951b8-2f34-4103-8b6e-bc191d2c3e68 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.160806 Oct 01 21:23:53.349255 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3746/5503] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:53 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:53.371140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:53.371762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:53.377812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.378303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.378777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.379471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.379931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.380371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.523317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:53.531572 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1201f1e2-0022-41df-beb7-e89422e1717b tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.164983 Oct 01 21:23:53.532160 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1758/5504] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:53 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:53.554350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6fbdbe76-41d0-4883-9c05-565e1c5ad80f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:53.557169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:53.557890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:53.564446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fbdbe76-41d0-4883-9c05-565e1c5ad80f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.564964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fbdbe76-41d0-4883-9c05-565e1c5ad80f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.565432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fbdbe76-41d0-4883-9c05-565e1c5ad80f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.592084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6fbdbe76-41d0-4883-9c05-565e1c5ad80f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Going to try to stop instance {{(pid=140438) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 21:23:53.636230 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6fbdbe76-41d0-4883-9c05-565e1c5ad80f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.086082 Oct 01 21:23:53.636936 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3747/5505] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:23:53 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:23:53.647419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:53.648494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:53.651225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:53.657314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.657897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.658630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.659499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:53.660020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:53.660443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:53.794879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:53.803239 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c385c794-3c6a-452f-9bfc-7dc489f9dd53 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.161783 Oct 01 21:23:53.803829 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1759/5506] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:53 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:54.236237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:54.236996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:54.243927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:54.244548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:54.245075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:54.245906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:54.246426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:54.246991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:54.387257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:54.391206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-00aebab2-67ea-4958-bc50-db72dee2faf2 req-d4775bc0-4486-40e2-9ac9-4607ff7084ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee75e16d-9908-4408-a9c7-484b4d22ac48", "name": "network-vif-plugged", "status": "completed", "tag": "f2c0e1c8-d976-4f95-97a2-8b642f3441f8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:54.396212 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7cbb6a87-cce2-4a35-995a-2a4cfa6ec51d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1315 microversion: 2.1 time: 0.165864 Oct 01 21:23:54.397086 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3748/5507] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:54 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:54.405257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-00aebab2-67ea-4958-bc50-db72dee2faf2 req-d4775bc0-4486-40e2-9ac9-4607ff7084ca service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:54.405845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-00aebab2-67ea-4958-bc50-db72dee2faf2 req-d4775bc0-4486-40e2-9ac9-4607ff7084ca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:54.406371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-00aebab2-67ea-4958-bc50-db72dee2faf2 req-d4775bc0-4486-40e2-9ac9-4607ff7084ca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:54.420981 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-00aebab2-67ea-4958-bc50-db72dee2faf2 req-d4775bc0-4486-40e2-9ac9-4607ff7084ca service nova] Creating event network-vif-plugged:f2c0e1c8-d976-4f95-97a2-8b642f3441f8 for instance ee75e16d-9908-4408-a9c7-484b4d22ac48 on nch1-master-1 Oct 01 21:23:54.426258 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-00aebab2-67ea-4958-bc50-db72dee2faf2 req-d4775bc0-4486-40e2-9ac9-4607ff7084ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040191 Oct 01 21:23:54.426797 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1760/5508] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:23:54.827373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:54.828012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:54.834719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:54.835186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:54.835711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:54.837134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:54.837686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:54.838144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:54.974689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:54.984138 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2594406-da65-49d5-9b40-9a6a56873781 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.160801 Oct 01 21:23:54.984844 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3749/5509] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:54 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:23:55.421829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:55.422832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:55.424963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:55.431482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:55.431980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:55.432453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:55.433427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:55.433935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:55.434460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:55.577580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:55.586213 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe24f798-45e4-4daf-9bff-d14b12075a3f tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1315 microversion: 2.1 time: 0.169999 Oct 01 21:23:55.586829 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1761/5510] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:55 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:56.009355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:56.010094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:56.018913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:56.019421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:56.019878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:56.020622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:56.021103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:56.021572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:56.170630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:56.179896 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf0d9f1a-4dc8-4877-80d6-fd7410009417 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.175174 Oct 01 21:23:56.180914 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3750/5511] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:56 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:56.609180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:56.609808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:56.616856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:56.617351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:56.617801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:56.618525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:56.619019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:56.619452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:56.751868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:56.760709 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e65f8af8-46fe-447a-a9c9-b1797c5e53fb tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1465 microversion: 2.1 time: 0.155485 Oct 01 21:23:56.761435 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1762/5512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:56 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:56.809432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:56.809992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:56.816201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:56.816703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:56.817160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:56.817893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:56.818391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:56.818921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:56.823735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:56.847629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:23:56.923714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-616b14ea-fc3e-421a-bec1-fc23f907a61a tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 204 len: 0 microversion: 2.1 time: 0.118073 Oct 01 21:23:56.924681 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3751/5513] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:23:56 2022] DELETE /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:23:56.933741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:56.934367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:56.940418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:56.940912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:56.941356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:56.942059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:56.942559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:56.942994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:57.075870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:57.083832 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f2218221-8fdf-4c32-b2f6-076d8fab6875 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1471 microversion: 2.1 time: 0.154538 Oct 01 21:23:57.084419 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1763/5514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:56 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:57.205443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:57.206175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:57.213633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:57.214145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:57.214668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:57.215531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:57.216035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:57.216491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:57.352049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:57.360213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9270c272-8794-4b2c-ab2b-e039d28cfb0d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.159101 Oct 01 21:23:57.360782 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3752/5515] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:57 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:58.107340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:58.107972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:58.114931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:58.115430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:58.115878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:58.116585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:58.117051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:58.117485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:58.249494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:58.257365 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5da23708-8ba1-42b9-9244-1c68fa100e43 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1471 microversion: 2.1 time: 0.154075 Oct 01 21:23:58.257950 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1764/5516] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:58 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:58.383737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:58.385176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:58.388114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:23:58.393596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:58.394106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:58.394753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:58.395473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:58.395944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:58.396394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:58.626387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:58.635262 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6d554f17-ed1b-4434-88ff-284c63cb5ad7 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.254896 Oct 01 21:23:58.650421 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3753/5517] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:58 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:58.912602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-6726528d-0984-40a4-909e-fb9b34b24778 req-5da34055-11d1-444d-ab48-7f69fc682712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee75e16d-9908-4408-a9c7-484b4d22ac48", "name": "network-vif-deleted", "tag": "f2c0e1c8-d976-4f95-97a2-8b642f3441f8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:23:58.924461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6726528d-0984-40a4-909e-fb9b34b24778 req-5da34055-11d1-444d-ab48-7f69fc682712 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:58.925119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6726528d-0984-40a4-909e-fb9b34b24778 req-5da34055-11d1-444d-ab48-7f69fc682712 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:58.926094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-6726528d-0984-40a4-909e-fb9b34b24778 req-5da34055-11d1-444d-ab48-7f69fc682712 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:58.939800 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-6726528d-0984-40a4-909e-fb9b34b24778 req-5da34055-11d1-444d-ab48-7f69fc682712 service nova] Creating event network-vif-deleted:f2c0e1c8-d976-4f95-97a2-8b642f3441f8 for instance ee75e16d-9908-4408-a9c7-484b4d22ac48 on nch1-master-1 Oct 01 21:23:58.945399 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-6726528d-0984-40a4-909e-fb9b34b24778 req-5da34055-11d1-444d-ab48-7f69fc682712 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038072 Oct 01 21:23:58.946106 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1765/5518] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:23:59.280939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:59.281634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:59.288538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:59.289123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:59.289667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:59.290457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:59.291799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:59.292299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:59.326253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:59.326774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:59.327233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:59.327811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lazy-loading 'fault' on Instance uuid ee75e16d-9908-4408-a9c7-484b4d22ac48 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:23:59.376568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9b3c506e6244b28569e68fb36ad5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3702ba8854c041f4ad1a3de3347dd5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:59.385775 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab8db075-f095-4d03-9dff-5931a3821482 tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 200 len: 1305 microversion: 2.1 time: 0.109320 Oct 01 21:23:59.386879 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3754/5519] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:59 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:23:59.662790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:23:59.663438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:23:59.670232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:59.670767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:59.671220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:59.671958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:23:59.672482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:23:59.672873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:23:59.821149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:23:59.830990 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3dc571c9-f431-4ca5-8939-568e21ff775f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.173466 Oct 01 21:23:59.831577 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1766/5520] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:23:59 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:24:00.410927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:00.411601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] [instance: ee75e16d-9908-4408-a9c7-484b4d22ac48] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:00.419138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:00.419652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:00.420121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:00.420855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:00.421340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:00.421844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:00.436209 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] HTTP exception thrown: Instance ee75e16d-9908-4408-a9c7-484b4d22ac48 could not be found. Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Request method failure captured: Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 HTTP/1.1 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK_cRr9qhFxECG2d_o7-23_krNuTA17jxWPdxpsIIMMalDHEwtwEA6KnvVl7NjcR3M-d9UMHaJxqR6MNqWqOx51ROciNzxfWZrJ5HkTMz3TMXW_twdd6jXtzuYPy8X2wsZLpUBe8dCmN4B39TqRPBLiOHBsJj4Hn3ixf9ryXHzLuvC4 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 3702ba8854c041f4ad1a3de3347dd5b3 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesNegativeTest-514173341 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3702ba8854c041f4ad1a3de3347dd5b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3702ba8854c041f4ad1a3de3347dd5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3702ba8854c041f4ad1a3de3347dd5b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3702ba8854c041f4ad1a3de3347dd5b3"}]}] Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesNegativeTest-514173341 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 3702ba8854c041f4ad1a3de3347dd5b3 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesNegativeTest-514173341 Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesNegativeTest-514173341-project Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: fb9b3c506e6244b28569e68fb36ad5fc Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesNegativeTest-514173341-project Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance ee75e16d-9908-4408-a9c7-484b4d22ac48 could not be found. Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'ee75e16d-9908-4408-a9c7-484b4d22ac48'} Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee75e16d-9908-4408-a9c7-484b4d22ac48 could not be found. Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee75e16d-9908-4408-a9c7-484b4d22ac48 could not be found. Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:00.437908 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee75e16d-9908-4408-a9c7-484b4d22ac48 could not be found. Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] Returning 404 to user: Instance ee75e16d-9908-4408-a9c7-484b4d22ac48 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1b00bdb2-2c04-4ca0-b0f4-8bfae4ae643d tempest-VolumesNegativeTest-514173341 tempest-VolumesNegativeTest-514173341-project] 10.222.0.17 "GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48" status: 404 len: 111 microversion: 2.1 time: 0.032653 Oct 01 21:24:00.441884 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3755/5521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:00 2022] GET /compute/v2.1/servers/ee75e16d-9908-4408-a9c7-484b4d22ac48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:24:00.858465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:00.859670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:00.867155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:00.867647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:00.868089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:00.869352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:00.870480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:00.870942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:01.030419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:01.036893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=100 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:01.043666 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-64e4f2eb-ee32-401c-a80d-b47a08bd52c3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.189874 Oct 01 21:24:01.044530 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1767/5522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:00 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:02.069582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:02.070919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:02.079701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:02.080285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:02.080950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:02.081686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:02.082249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:02.082765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:02.450948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:02.459802 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ea9d2bf8-8a56-40fa-b309-e8663a8736db tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.394403 Oct 01 21:24:02.460381 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3756/5523] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:02 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:03.485604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:03.486335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:03.499568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:03.500233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:03.500706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:03.501667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:03.503000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:03.503546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:03.671695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:03.681654 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1c4c4ca8-c367-41ac-8212-c3fc13b8e90f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1678 microversion: 2.1 time: 0.200069 Oct 01 21:24:03.682357 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1768/5524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:03 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:04.707579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:04.708248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:04.716287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:04.717060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:04.717371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:04.718261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:04.718640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:04.719070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:04.858676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:04.867147 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa907bef-d7ba-4d62-a077-238b3cf709e8 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1655 microversion: 2.1 time: 0.163774 Oct 01 21:24:04.867886 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3757/5525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:04 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:04.892490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ccb4dd8c-58c3-46c4-9f45-e968c6bcbc77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:04.899876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ccb4dd8c-58c3-46c4-9f45-e968c6bcbc77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:04.901163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ccb4dd8c-58c3-46c4-9f45-e968c6bcbc77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:04.901837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ccb4dd8c-58c3-46c4-9f45-e968c6bcbc77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:04.928372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ccb4dd8c-58c3-46c4-9f45-e968c6bcbc77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Going to try to start instance {{(pid=140437) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 01 21:24:04.979942 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ccb4dd8c-58c3-46c4-9f45-e968c6bcbc77 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.092490 Oct 01 21:24:04.980712 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1769/5526] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:24:04 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:24:04.991467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:04.993215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:05.000839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:05.001692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:05.002705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:05.003545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:05.004056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:05.005348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:05.274150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:05.284955 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4262518a-e78b-4a66-b76e-cb7d64b40f8a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1664 microversion: 2.1 time: 0.299285 Oct 01 21:24:05.286070 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3758/5527] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:04 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1664 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:06.320432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:06.321192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:06.330867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:06.331369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:06.331812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:06.332529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:06.332988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:06.334192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:06.503038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:06.511993 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9cde5c64-0884-4db4-84a8-0c3db76fc5fe tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.198054 Oct 01 21:24:06.512514 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1770/5528] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:06 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:06.535534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:06.536240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:06.545079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:06.546143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:06.546738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:06.547473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:06.548099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:06.548729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:06.775744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:06.792285 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-04c628f8-38d3-4e0d-b7f8-550accf9a3c6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.260154 Oct 01 21:24:06.793145 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3759/5529] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:06 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:06.817620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:06.818328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:06.827086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:06.828232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:06.828730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:06.829689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:06.830259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:06.830913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:07.008946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:07.018641 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6bb5c284-f2f4-4a9e-a387-e59e1008b4a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.204974 Oct 01 21:24:07.019483 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1771/5530] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:06 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:07.046146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:07.050072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:07.057684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:07.058294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:07.059087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:07.059987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:07.060544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:07.061313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:07.206915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:07.216113 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21aa6002-5e11-4fcc-8f60-6483f941b6b6 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.175766 Oct 01 21:24:07.216716 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3760/5531] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:07 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:07.239060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:07.239682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:07.247008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:07.247948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:07.248460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:07.249162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:07.249830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:07.250261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:07.413868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:07.422108 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-08a76e49-e3c3-46ce-aa0a-48d51c6aa357 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.187018 Oct 01 21:24:07.422721 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1772/5532] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:07 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:07.446121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:07.447404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:07.453508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:07.454020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:07.454477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:07.455224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:07.455708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:07.456244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:07.480063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lazy-loading 'flavor' on Instance uuid 5dadce29-73d7-453e-9e65-783d8432f9f3 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:24:07.546887 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4db9194a-fe0e-4d8b-b0a1-7d123527e0ef tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.104559 Oct 01 21:24:07.547846 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3761/5533] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:24:07 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:24:07.557217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:07.557837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:07.564106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:07.564786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:07.565188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:07.565915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:07.567441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:07.567882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:07.706469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:07.714268 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2d167703-ac5d-46e6-aaf7-79bcba4010d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1676 microversion: 2.1 time: 0.161806 Oct 01 21:24:07.714888 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1773/5534] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:07 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:08.738112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:08.738997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:08.746162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:08.746711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:08.747175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:08.747903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:08.748385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:08.748868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:08.886161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:08.894207 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-404a2a3c-d7b9-4ea8-8435-c5ce53639d12 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1659 microversion: 2.1 time: 0.160457 Oct 01 21:24:08.894822 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3762/5535] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:08 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1659 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:08.917385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-972a500a-9fbf-4048-b724-bd677d5d6591 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:08.918211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-972a500a-9fbf-4048-b724-bd677d5d6591 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:08.925191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-972a500a-9fbf-4048-b724-bd677d5d6591 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:08.925730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-972a500a-9fbf-4048-b724-bd677d5d6591 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:08.926181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-972a500a-9fbf-4048-b724-bd677d5d6591 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:08.926922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-972a500a-9fbf-4048-b724-bd677d5d6591 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:08.927391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-972a500a-9fbf-4048-b724-bd677d5d6591 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:08.927829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-972a500a-9fbf-4048-b724-bd677d5d6591 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:08.995406 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-972a500a-9fbf-4048-b724-bd677d5d6591 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.081741 Oct 01 21:24:08.996160 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1774/5536] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:24:08 2022] POST /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:24:09.004958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:09.005741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:09.014652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:09.015354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:09.016036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:09.017433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:09.017922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:09.018433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:09.241947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:09.250632 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-83447e34-6fe7-40e5-b039-2802d3c2eeb3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1665 microversion: 2.1 time: 0.249593 Oct 01 21:24:09.251407 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3763/5537] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:08 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1665 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:10.276801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:10.277647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:10.285739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:10.286324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:10.286874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:10.287685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:10.288231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:10.288765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:10.436254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:10.444940 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5fe466ed-d6a2-4ada-8cef-2a3b03566ac2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.173043 Oct 01 21:24:10.445549 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1775/5538] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:10 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:10.467756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:10.468480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:10.475946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:10.476531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:10.477061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:10.477905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:10.478446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:10.478981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:10.614108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:10.618199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:10.624772 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-23f027b4-9731-4d10-b2bf-a847917d0dcb tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1668 microversion: 2.1 time: 0.160893 Oct 01 21:24:10.625639 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3764/5539] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:10 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:10.655250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:10.658209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:10.664515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:10.665152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:10.665621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:10.666355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:10.666847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:10.667284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:10.693685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:24:10.700834 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.compute.api [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Working on deleting snapshot 370127d8-d5f3-40be-a6f4-97de873aa231 from shelved instance... Oct 01 21:24:11.328803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Doing local delete in cell 2663fce6-13d1-4945-900e-d818f7f389c0(cell1) {{(pid=140437) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 01 21:24:11.329848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:11.330350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:11.330825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:11.331265 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.compute.api [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 01 21:24:11.335329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] deallocate_for_instance() {{(pid=140437) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 01 21:24:11.925221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Updating instance_info_cache with network_info: [] {{(pid=140437) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 01 21:24:11.927577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-f1bb27f0-c10e-4106-a020-87658ab8f39c req-646ad88d-eb83-4789-bc02-d1d4ada0b3ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32dee155-0c3f-40d5-91c4-88164b58b932", "name": "network-vif-deleted", "tag": "a30def5b-5ce5-4959-a8e4-bb1af1030d29"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:11.955392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f1bb27f0-c10e-4106-a020-87658ab8f39c req-646ad88d-eb83-4789-bc02-d1d4ada0b3ae service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:11.957794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f1bb27f0-c10e-4106-a020-87658ab8f39c req-646ad88d-eb83-4789-bc02-d1d4ada0b3ae service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:11.957794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-f1bb27f0-c10e-4106-a020-87658ab8f39c req-646ad88d-eb83-4789-bc02-d1d4ada0b3ae service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:11.980563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.server_external_events [req-f1bb27f0-c10e-4106-a020-87658ab8f39c req-646ad88d-eb83-4789-bc02-d1d4ada0b3ae service nova] Unable to find a host for instance 32dee155-0c3f-40d5-91c4-88164b58b932. Dropping event network-vif-deleted {{(pid=140438) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 01 21:24:11.981911 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-f1bb27f0-c10e-4106-a020-87658ab8f39c req-646ad88d-eb83-4789-bc02-d1d4ada0b3ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.060111 Oct 01 21:24:11.984298 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3765/5540] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 01 21:24:12.387639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:12.410156 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c0f32853-d32f-4582-ae7f-2ccff4c87928 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "DELETE /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 204 len: 0 microversion: 2.1 time: 1.759231 Oct 01 21:24:12.410810 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1776/5541] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:24:10 2022] DELETE /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 0 bytes in 1761 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:24:12.420688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:12.421566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 32dee155-0c3f-40d5-91c4-88164b58b932] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:12.430404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:12.431475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:12.432293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:12.433289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:12.434424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:12.435268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:12.454039 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] HTTP exception thrown: Instance 32dee155-0c3f-40d5-91c4-88164b58b932 could not be found. Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Request method failure captured: Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 HTTP/1.1 Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK51guwpTsEFYzEaQ9cmedMpT5cluuk71QMpGouMZtWUPSkEoLCE3b04KINSUyFdDxIQYMCDoNcA7IiMJeIf8OZueQYS_eN2BJEhvD4WnfFGYSigDLzOxFn1UZ9n3lFXXox3_ymg9IRNYHqUavbXe4Vw8Fuy884FTQKlMDxiT0lNipw Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e09544743724cf18d2ab2aeb4180d81", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}] Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ac020dc323042c48ccce2a8826bc6be Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 32dee155-0c3f-40d5-91c4-88164b58b932 could not be found. Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '32dee155-0c3f-40d5-91c4-88164b58b932'} Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32dee155-0c3f-40d5-91c4-88164b58b932 could not be found. Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32dee155-0c3f-40d5-91c4-88164b58b932 could not be found. Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:12.455874 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32dee155-0c3f-40d5-91c4-88164b58b932 could not be found. Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Returning 404 to user: Instance 32dee155-0c3f-40d5-91c4-88164b58b932 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d2c59e1e-cfc6-43f2-a86c-888abb9508d0 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932" status: 404 len: 111 microversion: 2.1 time: 0.041568 Oct 01 21:24:12.469193 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3766/5542] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:12 2022] GET /compute/v2.1/servers/32dee155-0c3f-40d5-91c4-88164b58b932 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:24:12.472900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:12.473556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:12.480371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:12.480875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:12.481325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:12.482044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:12.482534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:12.482972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:12.511670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:24:12.604332 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b7b14ed-fa97-4b4f-8316-37ca075fb0b2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "DELETE /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 204 len: 0 microversion: 2.1 time: 0.140248 Oct 01 21:24:12.608473 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1777/5543] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:24:12 2022] DELETE /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:24:12.613742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:12.614391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:12.622468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:12.623099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:12.623540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:12.624483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:12.624966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:12.625418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:12.728182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:12.737996 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b6233283-dce4-4fa4-ad35-159f640de553 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1465 microversion: 2.1 time: 0.128340 Oct 01 21:24:12.738629 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3767/5544] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:12 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1465 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:24:13.766445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:13.767276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:13.776088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:13.776608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:13.777111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:13.778728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:13.779257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:13.779730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:13.889651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:13.901115 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-46ddb0e5-054d-43c4-bc1d-e3c70f9d6d48 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1465 microversion: 2.1 time: 0.142154 Oct 01 21:24:13.901876 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1778/5545] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:13 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1465 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:14.435492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5bea5cd6-7218-4dfa-95b9-c815f2876891 req-517dc353-500b-4fcc-a61e-7857d42b5711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d358e0-3b74-4ab2-90e5-2a43eb80a0f4", "name": "network-vif-deleted", "tag": "869e8ce8-9f3c-4fbf-9707-f99b9ee70089"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:14.447328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5bea5cd6-7218-4dfa-95b9-c815f2876891 req-517dc353-500b-4fcc-a61e-7857d42b5711 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:14.447829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5bea5cd6-7218-4dfa-95b9-c815f2876891 req-517dc353-500b-4fcc-a61e-7857d42b5711 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:14.448470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5bea5cd6-7218-4dfa-95b9-c815f2876891 req-517dc353-500b-4fcc-a61e-7857d42b5711 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:14.475375 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5bea5cd6-7218-4dfa-95b9-c815f2876891 req-517dc353-500b-4fcc-a61e-7857d42b5711 service nova] Creating event network-vif-deleted:869e8ce8-9f3c-4fbf-9707-f99b9ee70089 for instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 on nch2-master-1 Oct 01 21:24:14.483359 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5bea5cd6-7218-4dfa-95b9-c815f2876891 req-517dc353-500b-4fcc-a61e-7857d42b5711 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051258 Oct 01 21:24:14.486761 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3768/5546] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:14.926214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:14.926988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:14.935154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:14.935950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:14.936391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:14.937289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:14.937910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:14.938359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:14.974047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:14.975483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:14.976101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:14.976747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lazy-loading 'fault' on Instance uuid 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:24:15.028174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:15.038071 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-67a477f1-527f-4dd6-bbae-1c13466997bf tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 200 len: 1304 microversion: 2.1 time: 0.115755 Oct 01 21:24:15.038914 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1779/5547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:14 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:16.066791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:16.067566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:16.074657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:16.075528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:16.075992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:16.077127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:16.077938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:16.078553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:16.097234 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] HTTP exception thrown: Instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 could not be found. Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Request method failure captured: Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 HTTP/1.1 Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK51guwpTsEFYzEaQ9cmedMpT5cluuk71QMpGouMZtWUPSkEoLCE3b04KINSUyFdDxIQYMCDoNcA7IiMJeIf8OZueQYS_eN2BJEhvD4WnfFGYSigDLzOxFn1UZ9n3lFXXox3_ymg9IRNYHqUavbXe4Vw8Fuy884FTQKlMDxiT0lNipw Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e09544743724cf18d2ab2aeb4180d81", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}] Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ac020dc323042c48ccce2a8826bc6be Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 could not be found. Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '34d358e0-3b74-4ab2-90e5-2a43eb80a0f4'} Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 could not be found. Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 could not be found. Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:16.098971 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 could not be found. Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Returning 404 to user: Instance 34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1ce8e384-f406-4fb3-85f5-04704f72a0dd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4" status: 404 len: 111 microversion: 2.1 time: 0.039096 Oct 01 21:24:16.103091 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3769/5548] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:16 2022] GET /compute/v2.1/servers/34d358e0-3b74-4ab2-90e5-2a43eb80a0f4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:24:16.111326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:16.112109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:16.121128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:16.121702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:16.122284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:16.123328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:16.124660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:16.125263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:16.164122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:24:16.276150 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8ebe5e35-d4f9-45b9-88eb-d84dc35e07a5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 204 len: 0 microversion: 2.1 time: 0.167893 Oct 01 21:24:16.277137 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1780/5549] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:24:16 2022] DELETE /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:24:16.285711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:16.286359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:16.295300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:16.295839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:16.296295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:16.297052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:16.297530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:16.298051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:16.490738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:16.500546 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-890898a4-2d8c-4f37-a589-ec105b01f432 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1508 microversion: 2.1 time: 0.218689 Oct 01 21:24:16.511802 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3770/5550] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:16 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:17.529218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:17.529939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:17.538101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:17.538101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:17.538721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:17.539195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:17.539656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:17.540791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:17.709871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:17.720788 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a601174b-ea51-47e0-9c23-fa5710d6f13e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1508 microversion: 2.1 time: 0.196259 Oct 01 21:24:17.721926 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1781/5551] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:17 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:18.248632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-db603435-ae6a-4510-bcb4-33b694581778 req-3b810a6b-a7e4-4abe-92ce-8628cdc3bee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e715b06b-c447-4817-abaf-81424071a1ab", "name": "network-vif-deleted", "tag": "45063db8-bdf0-4066-b313-ddfd91d7e60d"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:18.276330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-db603435-ae6a-4510-bcb4-33b694581778 req-3b810a6b-a7e4-4abe-92ce-8628cdc3bee7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:18.277827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-db603435-ae6a-4510-bcb4-33b694581778 req-3b810a6b-a7e4-4abe-92ce-8628cdc3bee7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:18.278317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-db603435-ae6a-4510-bcb4-33b694581778 req-3b810a6b-a7e4-4abe-92ce-8628cdc3bee7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:18.300297 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-db603435-ae6a-4510-bcb4-33b694581778 req-3b810a6b-a7e4-4abe-92ce-8628cdc3bee7 service nova] Creating event network-vif-deleted:45063db8-bdf0-4066-b313-ddfd91d7e60d for instance e715b06b-c447-4817-abaf-81424071a1ab on nch1-master-1 Oct 01 21:24:18.316184 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-db603435-ae6a-4510-bcb4-33b694581778 req-3b810a6b-a7e4-4abe-92ce-8628cdc3bee7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063958 Oct 01 21:24:18.318004 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3771/5552] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:18.746391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:18.747640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:18.755996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:18.756685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:18.757165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:18.758464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:18.759012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:18.759902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:18.802635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:18.803087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:18.803587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:18.804138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lazy-loading 'fault' on Instance uuid e715b06b-c447-4817-abaf-81424071a1ab {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:24:18.893124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:18.906143 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c6b94673-17c5-499d-ac5d-98f36f85cadd tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 200 len: 1305 microversion: 2.1 time: 0.164390 Oct 01 21:24:18.914955 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1782/5553] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:18 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 1305 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:19.933345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:19.934074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: e715b06b-c447-4817-abaf-81424071a1ab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:19.940366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:19.940883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:19.941351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:19.942079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:19.942589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:19.943050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:19.956529 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] HTTP exception thrown: Instance e715b06b-c447-4817-abaf-81424071a1ab could not be found. Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Request method failure captured: Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab HTTP/1.1 Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK51guwpTsEFYzEaQ9cmedMpT5cluuk71QMpGouMZtWUPSkEoLCE3b04KINSUyFdDxIQYMCDoNcA7IiMJeIf8OZueQYS_eN2BJEhvD4WnfFGYSigDLzOxFn1UZ9n3lFXXox3_ymg9IRNYHqUavbXe4Vw8Fuy884FTQKlMDxiT0lNipw Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e09544743724cf18d2ab2aeb4180d81", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}] Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ac020dc323042c48ccce2a8826bc6be Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e715b06b-c447-4817-abaf-81424071a1ab could not be found. Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e715b06b-c447-4817-abaf-81424071a1ab'} Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e715b06b-c447-4817-abaf-81424071a1ab could not be found. Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e715b06b-c447-4817-abaf-81424071a1ab could not be found. Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:19.958182 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e715b06b-c447-4817-abaf-81424071a1ab could not be found. Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Returning 404 to user: Instance e715b06b-c447-4817-abaf-81424071a1ab could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fc2a0a9b-75d9-4ef8-baee-93be94c1b1ad tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab" status: 404 len: 111 microversion: 2.1 time: 0.032150 Oct 01 21:24:19.962242 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3772/5554] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:19 2022] GET /compute/v2.1/servers/e715b06b-c447-4817-abaf-81424071a1ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:24:19.968262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:19.968773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:19.975929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:19.976352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:19.976799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:19.978073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:19.978571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:19.979007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:20.005006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:24:20.083113 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-61f96dd2-d0b3-404f-a3fd-b8fefe693455 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "DELETE /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 204 len: 0 microversion: 2.1 time: 0.118495 Oct 01 21:24:20.083893 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1783/5555] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:24:19 2022] DELETE /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:24:20.092420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:20.093054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:20.099369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:20.099874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:20.100335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:20.101043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:20.101515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:20.101957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:20.232575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:20.240687 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c44cad9d-40f5-467f-86c6-13c5fd8021d3 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1494 microversion: 2.1 time: 0.152255 Oct 01 21:24:20.241252 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3773/5556] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:20 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1494 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:20.364922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-199260398", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "d10ec7ed-790f-4d26-a4a9-2cf78f4a33f8"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:20.422834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] validate_networks() for [('d10ec7ed-790f-4d26-a4a9-2cf78f4a33f8', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:24:20.769705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:24:20.770136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:24:20.770666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:24:20.771083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:24:20.771501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:24:20.780956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:20.781439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:20.781879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:20.782696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:20.783106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:20.783532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:20.801942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Getting quotas for project dd6e51791d934c73bf7d92e7ed1a8909. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:24:20.807243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Getting quotas for user 98361240b014405cb20cf9c145061be6 and project dd6e51791d934c73bf7d92e7ed1a8909. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:24:20.819492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:24:20.822467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:24:20.867844 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe6727ec-b6ae-427b-be8c-d3593b95fb26 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507068 Oct 01 21:24:20.868514 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1784/5557] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:24:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:24:20.879682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eec9ff56-18f3-4d6b-8974-c820edba3fab tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:20.880321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eec9ff56-18f3-4d6b-8974-c820edba3fab tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:20.938956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eec9ff56-18f3-4d6b-8974-c820edba3fab tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:20.946093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eec9ff56-18f3-4d6b-8974-c820edba3fab tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1218 microversion: 2.1 time: 0.070378 Oct 01 21:24:20.947370 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3774/5558] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:20 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:24:21.267733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:21.268503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:21.277880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:21.278703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:21.279403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:21.280359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:21.281039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:21.281770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:21.534375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:21.544374 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9d773229-1386-4f27-8def-c0ed053f8ca5 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 200 len: 1494 microversion: 2.1 time: 0.284117 Oct 01 21:24:21.545051 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1785/5559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:21 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 1494 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:21.826208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d7536db8-169c-4a4e-8010-474ca6bca9e0 req-7a326774-9af0-44f4-aece-4c2cfa8cc79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17738737-ba0e-4e7b-8626-e66b0a6d0fab", "name": "network-vif-deleted", "tag": "35bdad89-071d-435a-bb40-b0d7a3777771"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:21.838012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d7536db8-169c-4a4e-8010-474ca6bca9e0 req-7a326774-9af0-44f4-aece-4c2cfa8cc79c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:21.838543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d7536db8-169c-4a4e-8010-474ca6bca9e0 req-7a326774-9af0-44f4-aece-4c2cfa8cc79c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:21.839004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d7536db8-169c-4a4e-8010-474ca6bca9e0 req-7a326774-9af0-44f4-aece-4c2cfa8cc79c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:21.850646 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d7536db8-169c-4a4e-8010-474ca6bca9e0 req-7a326774-9af0-44f4-aece-4c2cfa8cc79c service nova] Creating event network-vif-deleted:35bdad89-071d-435a-bb40-b0d7a3777771 for instance 17738737-ba0e-4e7b-8626-e66b0a6d0fab on nch2-master-1 Oct 01 21:24:21.856568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d7536db8-169c-4a4e-8010-474ca6bca9e0 req-7a326774-9af0-44f4-aece-4c2cfa8cc79c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034239 Oct 01 21:24:21.857181 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3775/5560] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:21.970814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:21.971939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:21.980409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:21.981479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:21.982110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:21.983053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:21.983691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:21.984311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:22.091711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:22.104473 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4c1180b8-6ea7-4816-acad-af204de5a9d6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1288 microversion: 2.1 time: 0.139412 Oct 01 21:24:22.105685 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1786/5561] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:21 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1288 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:22.569491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:22.570318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 17738737-ba0e-4e7b-8626-e66b0a6d0fab] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:22.577381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:22.577972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:22.578536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:22.579579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:22.579927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:22.580450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:22.594590 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] HTTP exception thrown: Instance 17738737-ba0e-4e7b-8626-e66b0a6d0fab could not be found. Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Request method failure captured: Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab HTTP/1.1 Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK51guwpTsEFYzEaQ9cmedMpT5cluuk71QMpGouMZtWUPSkEoLCE3b04KINSUyFdDxIQYMCDoNcA7IiMJeIf8OZueQYS_eN2BJEhvD4WnfFGYSigDLzOxFn1UZ9n3lFXXox3_ymg9IRNYHqUavbXe4Vw8Fuy884FTQKlMDxiT0lNipw Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e09544743724cf18d2ab2aeb4180d81", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}] Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ac020dc323042c48ccce2a8826bc6be Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 17738737-ba0e-4e7b-8626-e66b0a6d0fab could not be found. Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '17738737-ba0e-4e7b-8626-e66b0a6d0fab'} Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17738737-ba0e-4e7b-8626-e66b0a6d0fab could not be found. Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17738737-ba0e-4e7b-8626-e66b0a6d0fab could not be found. Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:22.596295 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:22.600082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:22.600082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:22.600082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:22.600082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:24:22.600082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:24:22.600082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17738737-ba0e-4e7b-8626-e66b0a6d0fab could not be found. Oct 01 21:24:22.600082 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:22.600082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Returning 404 to user: Instance 17738737-ba0e-4e7b-8626-e66b0a6d0fab could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:24:22.600082 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eeebcbdd-4000-4e1b-9502-acdc8ab475c9 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab" status: 404 len: 111 microversion: 2.1 time: 0.033653 Oct 01 21:24:22.601605 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3776/5562] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:22 2022] GET /compute/v2.1/servers/17738737-ba0e-4e7b-8626-e66b0a6d0fab => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:24:22.606802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:22.607311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:22.615208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:22.615664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:22.616143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:22.616851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:22.617337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:22.617746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:22.645336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:24:22.648341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:DELETE=2,nova_cell1:SELECT=90,nova_cell1:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:22.723202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:22.729046 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2783145b-a161-43af-b73e-2c19f8e8a63a tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 204 len: 0 microversion: 2.1 time: 0.125910 Oct 01 21:24:22.729844 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1787/5563] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:24:22 2022] DELETE /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 21:24:22.738533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:22.739393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:22.747256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:22.748008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:22.748475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:22.749216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:22.749701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:22.750157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:22.891143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:22.899920 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b1c43ecc-f839-4b26-a256-c3ae776fa37f tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1674 microversion: 2.1 time: 0.164993 Oct 01 21:24:22.900511 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3777/5564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:22 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:23.128993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:23.129802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:23.137773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:23.138322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:23.138733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:23.139435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:23.139893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:23.140328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:23.341424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:23.349900 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2ded794f-00fc-4182-98e5-53526c403ef9 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1318 microversion: 2.1 time: 0.225835 Oct 01 21:24:23.350600 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1788/5565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:23 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:23.871186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e7902afe-daad-41b7-b5f2-090edd9023f1 req-652e62ca-bb35-4ed0-ac06-a93f2f548fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663df986-3e91-45fd-82d9-aad3d0f6ee3f", "tag": "88496653-8dfa-49b5-b5c5-e0ec0c050ae8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:23.881788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e7902afe-daad-41b7-b5f2-090edd9023f1 req-652e62ca-bb35-4ed0-ac06-a93f2f548fd9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:23.882290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e7902afe-daad-41b7-b5f2-090edd9023f1 req-652e62ca-bb35-4ed0-ac06-a93f2f548fd9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:23.882782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e7902afe-daad-41b7-b5f2-090edd9023f1 req-652e62ca-bb35-4ed0-ac06-a93f2f548fd9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:23.894325 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e7902afe-daad-41b7-b5f2-090edd9023f1 req-652e62ca-bb35-4ed0-ac06-a93f2f548fd9 service nova] Creating event network-changed:88496653-8dfa-49b5-b5c5-e0ec0c050ae8 for instance 663df986-3e91-45fd-82d9-aad3d0f6ee3f on nch2-master-1 Oct 01 21:24:23.899659 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e7902afe-daad-41b7-b5f2-090edd9023f1 req-652e62ca-bb35-4ed0-ac06-a93f2f548fd9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031593 Oct 01 21:24:23.900246 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3778/5566] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:23.923117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:23.923736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:23.931084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:23.931576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:23.932022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:23.932727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:23.933188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:23.933617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:24.065105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:24.073512 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-04acd40d-f727-4b68-8623-b26cbda16dd2 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1674 microversion: 2.1 time: 0.154356 Oct 01 21:24:24.074093 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1789/5567] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:23 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:24.373935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:24.374772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:24.381061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:24.381573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:24.382042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:24.382787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:24.383270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:24.384223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:24.516094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:24.524760 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ccae5f00-f704-4a02-870b-e1aac552f1e2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1318 microversion: 2.1 time: 0.154544 Oct 01 21:24:24.525339 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3779/5568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:24 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:25.096681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:25.097444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:25.105084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:25.105591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:25.106048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:25.106790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:25.107265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:25.107710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:25.240371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:25.249127 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bc179c82-92cb-4208-bd37-ae430a9499c1 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1674 microversion: 2.1 time: 0.156392 Oct 01 21:24:25.249794 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1790/5569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:25 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:25.547281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:25.547913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:25.554747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:25.555326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:25.555789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:25.556503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:25.556972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:25.557415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:25.791355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:25.799470 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-22444650-9a34-40e9-a654-b1cff3c65c34 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1318 microversion: 2.1 time: 0.256155 Oct 01 21:24:25.800057 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3780/5570] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:25 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:25.963257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a8c7e65f-88fd-4869-bdf8-21dd57f50acc req-2231126b-bda0-4c10-a66d-01ae097694f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dadce29-73d7-453e-9e65-783d8432f9f3", "name": "network-vif-deleted", "tag": "c3a6460d-e913-433f-b170-e532527a6007"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:25.973668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a8c7e65f-88fd-4869-bdf8-21dd57f50acc req-2231126b-bda0-4c10-a66d-01ae097694f5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:25.974170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a8c7e65f-88fd-4869-bdf8-21dd57f50acc req-2231126b-bda0-4c10-a66d-01ae097694f5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:25.974890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a8c7e65f-88fd-4869-bdf8-21dd57f50acc req-2231126b-bda0-4c10-a66d-01ae097694f5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:25.987356 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a8c7e65f-88fd-4869-bdf8-21dd57f50acc req-2231126b-bda0-4c10-a66d-01ae097694f5 service nova] Creating event network-vif-deleted:c3a6460d-e913-433f-b170-e532527a6007 for instance 5dadce29-73d7-453e-9e65-783d8432f9f3 on nch1-master-1 Oct 01 21:24:25.992284 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a8c7e65f-88fd-4869-bdf8-21dd57f50acc req-2231126b-bda0-4c10-a66d-01ae097694f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033849 Oct 01 21:24:25.992896 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1791/5571] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:26.273191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:26.274410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:26.280475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:26.280977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:26.281429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:26.282138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:26.282636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:26.283081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:26.315920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:26.316424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:26.316878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:26.317344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lazy-loading 'fault' on Instance uuid 5dadce29-73d7-453e-9e65-783d8432f9f3 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:24:26.364334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac020dc323042c48ccce2a8826bc6be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e09544743724cf18d2ab2aeb4180d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:26.372994 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-42ec85ea-33dc-4622-8f7d-0ccac2c6506e tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 200 len: 1327 microversion: 2.1 time: 0.103665 Oct 01 21:24:26.373586 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3781/5572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:26 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:26.823387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:26.824201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:26.830850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:26.831359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:26.831829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:26.832611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:26.833075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:26.833663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:26.978174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:26.986115 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-19c531e1-ea20-457d-8685-135fa5b91cd2 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1318 microversion: 2.1 time: 0.168482 Oct 01 21:24:26.986819 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1792/5573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:26 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:27.398049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:27.398633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] [instance: 5dadce29-73d7-453e-9e65-783d8432f9f3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:27.406313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:27.406865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:27.407326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:27.408051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:27.408543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:27.408969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:27.423662 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] HTTP exception thrown: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 could not be found. Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Request method failure captured: Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 HTTP/1.1 Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK51guwpTsEFYzEaQ9cmedMpT5cluuk71QMpGouMZtWUPSkEoLCE3b04KINSUyFdDxIQYMCDoNcA7IiMJeIf8OZueQYS_eN2BJEhvD4WnfFGYSigDLzOxFn1UZ9n3lFXXox3_ymg9IRNYHqUavbXe4Vw8Fuy884FTQKlMDxiT0lNipw Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e09544743724cf18d2ab2aeb4180d81", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e09544743724cf18d2ab2aeb4180d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e09544743724cf18d2ab2aeb4180d81"}]}] Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 9e09544743724cf18d2ab2aeb4180d81 Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-1979298670 Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 6ac020dc323042c48ccce2a8826bc6be Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-1979298670-project Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 could not be found. Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '5dadce29-73d7-453e-9e65-783d8432f9f3'} Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 could not be found. Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 could not be found. Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:27.425351 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 could not be found. Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Returning 404 to user: Instance 5dadce29-73d7-453e-9e65-783d8432f9f3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0e623cb1-6310-4ec2-b159-611094691f85 tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3" status: 404 len: 111 microversion: 2.1 time: 0.032815 Oct 01 21:24:27.429008 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3782/5574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:27 2022] GET /compute/v2.1/servers/5dadce29-73d7-453e-9e65-783d8432f9f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:24:27.435646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0f19db37-8334-4a94-b7c7-902ae9212e3d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] Calling method '.version_select at 0x7f4173b7bc10>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:27.454141 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0f19db37-8334-4a94-b7c7-902ae9212e3d tempest-ServerActionsTestJSON-1979298670 tempest-ServerActionsTestJSON-1979298670-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417987251" status: 202 len: 0 microversion: 2.1 time: 0.022438 Oct 01 21:24:27.454789 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1793/5575] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 21:24:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417987251 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:24:28.009332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:28.010266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:28.016322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:28.016821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:28.017271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:28.017982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:28.018452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:28.018914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:28.156099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:28.164152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34048e77-0d57-4d1f-aa84-1012ee310ca7 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1318 microversion: 2.1 time: 0.158838 Oct 01 21:24:28.164936 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3783/5576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:28 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:28.687690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d8123359-7987-49ec-a990-c118d11a791b req-95176b67-c396-4f8f-a86a-66e87c6ff0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663df986-3e91-45fd-82d9-aad3d0f6ee3f", "name": "network-vif-plugged", "status": "completed", "tag": "88496653-8dfa-49b5-b5c5-e0ec0c050ae8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:28.700462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d8123359-7987-49ec-a990-c118d11a791b req-95176b67-c396-4f8f-a86a-66e87c6ff0af service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:28.701044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d8123359-7987-49ec-a990-c118d11a791b req-95176b67-c396-4f8f-a86a-66e87c6ff0af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:28.701564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d8123359-7987-49ec-a990-c118d11a791b req-95176b67-c396-4f8f-a86a-66e87c6ff0af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:28.712612 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d8123359-7987-49ec-a990-c118d11a791b req-95176b67-c396-4f8f-a86a-66e87c6ff0af service nova] Creating event network-vif-plugged:88496653-8dfa-49b5-b5c5-e0ec0c050ae8 for instance 663df986-3e91-45fd-82d9-aad3d0f6ee3f on nch2-master-1 Oct 01 21:24:28.717779 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d8123359-7987-49ec-a990-c118d11a791b req-95176b67-c396-4f8f-a86a-66e87c6ff0af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033919 Oct 01 21:24:28.718396 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1794/5577] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:29.187279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:29.188039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:29.190883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=68 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:29.197178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:29.197686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:29.198142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:29.198889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:29.199365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:29.199808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:29.334901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:29.345318 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2c585db5-8a93-4593-8997-b8debfb58f96 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1318 microversion: 2.1 time: 0.161923 Oct 01 21:24:29.345938 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3784/5578] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:29 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:30.371324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:30.372699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:30.380082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:30.380831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:30.381456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:30.382172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:30.384364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:30.384854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:30.664042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:30.677305 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1b151563-2c4e-4963-a00e-75780ff8a8f3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1507 microversion: 2.1 time: 0.312022 Oct 01 21:24:30.677911 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1795/5579] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:30 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:33.376745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39dedaec-caad-41a9-a29c-cb61e187ce0c tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dea6e35-1c10-40b3-8361-2f40a38aaad1", "device": "/dev/sdb"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:33.379917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-39dedaec-caad-41a9-a29c-cb61e187ce0c tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:33.382696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:33.388982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39dedaec-caad-41a9-a29c-cb61e187ce0c tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:33.389503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39dedaec-caad-41a9-a29c-cb61e187ce0c tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:33.389972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39dedaec-caad-41a9-a29c-cb61e187ce0c tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:33.390747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39dedaec-caad-41a9-a29c-cb61e187ce0c tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:33.391229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39dedaec-caad-41a9-a29c-cb61e187ce0c tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:33.391678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39dedaec-caad-41a9-a29c-cb61e187ce0c tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:33.687520 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-39dedaec-caad-41a9-a29c-cb61e187ce0c tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "POST /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316260 Oct 01 21:24:33.688227 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3785/5580] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:24:33 2022] POST /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:37.234302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:37.236288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:37.374548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-185599622", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "e642022f-e473-47f8-bacf-a47e44e8c605"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:37.450484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] validate_networks() for [('e642022f-e473-47f8-bacf-a47e44e8c605', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:24:37.921225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:24:37.921660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:24:37.922148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:24:37.922626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:24:37.923054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:24:37.932277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:37.932805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:37.933248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:37.933991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:37.934458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:37.934917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:37.953767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Getting quotas for project b6bf21b68848471081c62ade9d6ec793. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:24:37.963266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Getting quotas for user 32fcb91152c84fd8b7260e4febb07ade and project b6bf21b68848471081c62ade9d6ec793. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:24:37.977863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:24:37.980272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:24:38.030118 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-746ac9a5-4d0b-44fb-8aee-3322d6003ac8 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800823 Oct 01 21:24:38.031129 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1796/5581] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:24:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:24:38.044319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-32d90939-571a-427d-82ff-7683186ef91e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:38.045047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-32d90939-571a-427d-82ff-7683186ef91e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:38.106000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-32d90939-571a-427d-82ff-7683186ef91e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:38.113759 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-32d90939-571a-427d-82ff-7683186ef91e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1224 microversion: 2.1 time: 0.075497 Oct 01 21:24:38.114349 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3786/5582] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:38 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:39.139088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:39.140381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:39.148053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:39.148625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:39.149324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:39.150122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:39.150694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:39.151198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:39.226393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:39.235192 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-84ccc751-35dc-44be-aeea-4a80747165f0 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1276 microversion: 2.1 time: 0.100982 Oct 01 21:24:39.250893 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1797/5583] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:39 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:40.262750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:40.264986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:40.277932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:40.279086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:40.280480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:40.282035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:40.284097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:40.284875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:40.538109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:40.553861 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2ec539f8-e297-4c02-976e-e87e80eff5e4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1324 microversion: 2.1 time: 0.297275 Oct 01 21:24:40.571495 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3787/5584] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:40 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:41.305541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-0e440c40-e12d-412b-a53d-59cc74f125b0 req-6e7dfb81-0890-4c29-b8eb-bd28b386386d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d12764-f0ff-4e82-a390-b19e3a2b2a8e", "tag": "f6cf399b-6ae6-4872-939e-a52905070814"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:41.320210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0e440c40-e12d-412b-a53d-59cc74f125b0 req-6e7dfb81-0890-4c29-b8eb-bd28b386386d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:41.320705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0e440c40-e12d-412b-a53d-59cc74f125b0 req-6e7dfb81-0890-4c29-b8eb-bd28b386386d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:41.321336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0e440c40-e12d-412b-a53d-59cc74f125b0 req-6e7dfb81-0890-4c29-b8eb-bd28b386386d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:41.333366 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-0e440c40-e12d-412b-a53d-59cc74f125b0 req-6e7dfb81-0890-4c29-b8eb-bd28b386386d service nova] Creating event network-changed:f6cf399b-6ae6-4872-939e-a52905070814 for instance 00d12764-f0ff-4e82-a390-b19e3a2b2a8e on nch1-master-1 Oct 01 21:24:41.339185 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-0e440c40-e12d-412b-a53d-59cc74f125b0 req-6e7dfb81-0890-4c29-b8eb-bd28b386386d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125424 Oct 01 21:24:41.339800 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1798/5585] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:41.578222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:41.579323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:41.589169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:41.589952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:41.590802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:41.591735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:41.592561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:41.593152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:41.615323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:41.766132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:41.775048 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff1f7f16-ed78-47a0-b905-7ccf0884551a tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1324 microversion: 2.1 time: 0.201650 Oct 01 21:24:41.775647 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3788/5586] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:41 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:24:42.799487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:42.800207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:42.806608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:42.807182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:42.807720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:42.808537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:42.809075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:42.809513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:42.944963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:42.954412 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7294ae3c-f040-46ad-bf64-1140b319505e tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1324 microversion: 2.1 time: 0.160232 Oct 01 21:24:42.961272 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1799/5587] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:42 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1324 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:43.979042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:43.979728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:43.986751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:43.987246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:43.987711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:43.988436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:43.988918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:43.989371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:44.122278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:44.131603 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f786237-b380-4be6-8630-89bef900b88b tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1324 microversion: 2.1 time: 0.156618 Oct 01 21:24:44.132211 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3789/5588] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:43 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1324 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:45.155484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:45.156036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:45.162803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:45.163299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:45.163747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:45.164456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:45.165186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:45.165923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:45.302406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:45.310276 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0ef68cac-08a6-4df6-937f-cff538b818a9 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1324 microversion: 2.1 time: 0.158863 Oct 01 21:24:45.310880 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1800/5589] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:45 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1324 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:46.333410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:46.333981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:46.341678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:46.342183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:46.342682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:46.343432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:46.343908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:46.344356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:46.475870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:46.483893 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b3303979-2955-483c-bd74-f8045cca45d4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1324 microversion: 2.1 time: 0.154533 Oct 01 21:24:46.484476 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3790/5590] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:46 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1324 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:46.709177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-0f5b646d-8b3e-410b-a3bb-96b4624bf11d req-30347959-83a8-4935-a702-13f5e564672a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d12764-f0ff-4e82-a390-b19e3a2b2a8e", "name": "network-vif-plugged", "status": "completed", "tag": "f6cf399b-6ae6-4872-939e-a52905070814"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:46.720228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0f5b646d-8b3e-410b-a3bb-96b4624bf11d req-30347959-83a8-4935-a702-13f5e564672a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:46.720718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0f5b646d-8b3e-410b-a3bb-96b4624bf11d req-30347959-83a8-4935-a702-13f5e564672a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:46.721193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0f5b646d-8b3e-410b-a3bb-96b4624bf11d req-30347959-83a8-4935-a702-13f5e564672a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:46.735453 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-0f5b646d-8b3e-410b-a3bb-96b4624bf11d req-30347959-83a8-4935-a702-13f5e564672a service nova] Creating event network-vif-plugged:f6cf399b-6ae6-4872-939e-a52905070814 for instance 00d12764-f0ff-4e82-a390-b19e3a2b2a8e on nch1-master-1 Oct 01 21:24:46.740459 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-0f5b646d-8b3e-410b-a3bb-96b4624bf11d req-30347959-83a8-4935-a702-13f5e564672a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035035 Oct 01 21:24:46.741073 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1801/5591] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:47.506917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:47.507620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:47.514576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:47.515084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:47.515545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:47.516263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:47.516740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:47.517187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:47.647615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:47.656081 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f47ef499-91d4-48b2-ad15-ead9f53245b4 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1324 microversion: 2.1 time: 0.153098 Oct 01 21:24:47.656611 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3791/5592] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:47 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1324 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:48.677332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:48.678113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:48.683019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:48.683731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:48.690932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:48.691426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:48.691868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:48.692570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:48.693035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:48.693471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:48.822149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:48.830005 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b185e4b9-8b53-4d88-82cc-6b3ce48d1462 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1521 microversion: 2.1 time: 0.154526 Oct 01 21:24:48.830628 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1802/5593] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:48 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:48.853627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:48.854164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:48.856174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:48.862348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:48.862914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:48.863382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:48.864117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:48.864598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:48.865053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:48.889095 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] HTTP exception thrown: Instance is not a member of specified network Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Request method failure captured: Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e/ips/invalid HTTP/1.1 Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLAVw7l94J0bWVbV3zvPAChikvH3V4rjgv_YyGRNBPrjHJLJXdXL2t62igFgHNlBTbIgR7yUv9uE7UL27SzRB1StTbbdo8sQsbAZj6FYARp0iKFdoUkXZNvarUrqMbpzl3wKgcg7KkiWz5chvKVpyLMUIwh6zqhBGdDMoLTqR8e2iJY Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b6bf21b68848471081c62ade9d6ec793 Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-193682808 Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6bf21b68848471081c62ade9d6ec793", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6bf21b68848471081c62ade9d6ec793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6bf21b68848471081c62ade9d6ec793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6bf21b68848471081c62ade9d6ec793"}]}] Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-193682808 Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b6bf21b68848471081c62ade9d6ec793 Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-193682808 Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerAddressesNegativeTestJSON-193682808-project Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 32fcb91152c84fd8b7260e4febb07ade Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-193682808-project Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance is not a member of specified network Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'server_id': '00d12764-f0ff-4e82-a390-b19e3a2b2a8e', 'id': 'invalid'} Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 01 21:24:48.903648 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:48.907292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Returning 404 to user: Instance is not a member of specified network {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:24:48.907292 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-246fff84-cd82-44f9-9f3b-7067388615b3 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.056248 Oct 01 21:24:48.907292 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3792/5594] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Oct 1 21:24:48 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e/ips/invalid => generated 91 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:24:48.915335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-926fde4c-2fad-4801-9507-9719532e08ba tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:48.915819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-926fde4c-2fad-4801-9507-9719532e08ba tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Failed to fetch instance by id 999 {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 01 21:24:48.916332 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-926fde4c-2fad-4801-9507-9719532e08ba tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] HTTP exception thrown: Instance 999 could not be found. Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-926fde4c-2fad-4801-9507-9719532e08ba tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Request method failure captured: Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLAVw7l94J0bWVbV3zvPAChikvH3V4rjgv_YyGRNBPrjHJLJXdXL2t62igFgHNlBTbIgR7yUv9uE7UL27SzRB1StTbbdo8sQsbAZj6FYARp0iKFdoUkXZNvarUrqMbpzl3wKgcg7KkiWz5chvKVpyLMUIwh6zqhBGdDMoLTqR8e2iJY Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: b6bf21b68848471081c62ade9d6ec793 Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-193682808 Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6bf21b68848471081c62ade9d6ec793", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6bf21b68848471081c62ade9d6ec793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6bf21b68848471081c62ade9d6ec793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6bf21b68848471081c62ade9d6ec793"}]}] Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-193682808 Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: b6bf21b68848471081c62ade9d6ec793 Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-193682808 Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerAddressesNegativeTestJSON-193682808-project Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 32fcb91152c84fd8b7260e4febb07ade Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-193682808-project Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 999 could not be found. Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'server_id': '999'} Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 01 21:24:48.918341 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:24:48.922036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-926fde4c-2fad-4801-9507-9719532e08ba tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Returning 404 to user: Instance 999 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:24:48.922036 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-926fde4c-2fad-4801-9507-9719532e08ba tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009062 Oct 01 21:24:48.922036 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1803/5595] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Oct 1 21:24:48 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 21:24:48.928987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:48.929578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:48.935634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:48.936134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:48.936609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:48.937307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:48.937777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:48.938217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:48.964361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:24:49.040989 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0a71891a-e5cb-43ed-ac6b-e81ea31fcd73 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "DELETE /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 204 len: 0 microversion: 2.1 time: 0.115711 Oct 01 21:24:49.041508 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3793/5596] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:24:48 2022] DELETE /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:24:49.050161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:49.050825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:49.056996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:49.057532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:49.057989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:49.058817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:49.059308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:49.059747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:49.195683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:49.203762 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-93fdd4d4-4f07-4a42-a9a4-11663c554fe1 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1527 microversion: 2.1 time: 0.157777 Oct 01 21:24:49.204325 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1804/5597] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:49 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1527 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:50.228339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:50.228714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:50.235467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:50.235970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:50.236426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:50.237133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:50.237608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:50.238073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:50.367298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fcb91152c84fd8b7260e4febb07ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf21b68848471081c62ade9d6ec793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:50.375146 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-af27bd53-2610-48b9-8e9c-9f3290800c54 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 200 len: 1527 microversion: 2.1 time: 0.151552 Oct 01 21:24:50.375723 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3794/5598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:50 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 1527 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:24:50.852407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e298d024-6243-4c6a-89fa-845fdf053fe0 req-f6d065e8-773f-41a4-8b49-f48119171f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d12764-f0ff-4e82-a390-b19e3a2b2a8e", "name": "network-vif-deleted", "tag": "f6cf399b-6ae6-4872-939e-a52905070814"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:50.864266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e298d024-6243-4c6a-89fa-845fdf053fe0 req-f6d065e8-773f-41a4-8b49-f48119171f03 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:50.864981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e298d024-6243-4c6a-89fa-845fdf053fe0 req-f6d065e8-773f-41a4-8b49-f48119171f03 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:50.865583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e298d024-6243-4c6a-89fa-845fdf053fe0 req-f6d065e8-773f-41a4-8b49-f48119171f03 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:50.879883 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e298d024-6243-4c6a-89fa-845fdf053fe0 req-f6d065e8-773f-41a4-8b49-f48119171f03 service nova] Creating event network-vif-deleted:f6cf399b-6ae6-4872-939e-a52905070814 for instance 00d12764-f0ff-4e82-a390-b19e3a2b2a8e on nch1-master-1 Oct 01 21:24:50.885897 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e298d024-6243-4c6a-89fa-845fdf053fe0 req-f6d065e8-773f-41a4-8b49-f48119171f03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037966 Oct 01 21:24:50.886795 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1805/5599] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:24:51.400917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:51.401554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] [instance: 00d12764-f0ff-4e82-a390-b19e3a2b2a8e] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:51.408597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:51.409110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:51.409579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:51.410309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:51.410815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:51.411317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:51.425243 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] HTTP exception thrown: Instance 00d12764-f0ff-4e82-a390-b19e3a2b2a8e could not be found. Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Request method failure captured: Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e HTTP/1.1 Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLAVw7l94J0bWVbV3zvPAChikvH3V4rjgv_YyGRNBPrjHJLJXdXL2t62igFgHNlBTbIgR7yUv9uE7UL27SzRB1StTbbdo8sQsbAZj6FYARp0iKFdoUkXZNvarUrqMbpzl3wKgcg7KkiWz5chvKVpyLMUIwh6zqhBGdDMoLTqR8e2iJY Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b6bf21b68848471081c62ade9d6ec793 Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-193682808 Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6bf21b68848471081c62ade9d6ec793", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6bf21b68848471081c62ade9d6ec793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6bf21b68848471081c62ade9d6ec793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6bf21b68848471081c62ade9d6ec793"}]}] Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-193682808 Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b6bf21b68848471081c62ade9d6ec793 Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-193682808 Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerAddressesNegativeTestJSON-193682808-project Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 32fcb91152c84fd8b7260e4febb07ade Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-193682808-project Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 00d12764-f0ff-4e82-a390-b19e3a2b2a8e could not be found. Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '00d12764-f0ff-4e82-a390-b19e3a2b2a8e'} Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d12764-f0ff-4e82-a390-b19e3a2b2a8e could not be found. Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d12764-f0ff-4e82-a390-b19e3a2b2a8e could not be found. Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:51.427040 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d12764-f0ff-4e82-a390-b19e3a2b2a8e could not be found. Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] Returning 404 to user: Instance 00d12764-f0ff-4e82-a390-b19e3a2b2a8e could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-493268c1-208f-465c-9d40-b5e922042c62 tempest-ServerAddressesNegativeTestJSON-193682808 tempest-ServerAddressesNegativeTestJSON-193682808-project] 10.222.0.17 "GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e" status: 404 len: 111 microversion: 2.1 time: 0.032165 Oct 01 21:24:51.434581 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3795/5600] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:24:51 2022] GET /compute/v2.1/servers/00d12764-f0ff-4e82-a390-b19e3a2b2a8e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:24:55.701952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2147060914", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": "none"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:55.709265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:55.763265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:24:55.763697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:24:55.764178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:24:55.764595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:24:55.765014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:24:55.774354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:55.774869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:55.775310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:55.776043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:55.776499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:55.776929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:55.784011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:55.798411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Getting quotas for project 70dcbab212774655a7094ebc0cb9d800. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:24:55.803591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Getting quotas for user 3f7614694df347bea9be492787dbd455 and project 70dcbab212774655a7094ebc0cb9d800. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:24:55.815898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:24:55.818223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: b1696b07-5295-4f5d-9494-5d8d57b10d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:24:55.864094 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8fb2eec4-6ad8-4518-b3e4-0f69f1860c4a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.277079 Oct 01 21:24:55.864829 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1806/5601] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 21:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 21:24:55.876023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0efd530a-d5cd-4feb-9814-0d10011989be tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:55.876657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0efd530a-d5cd-4feb-9814-0d10011989be tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: b1696b07-5295-4f5d-9494-5d8d57b10d16] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:55.936060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0efd530a-d5cd-4feb-9814-0d10011989be tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:55.944509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0efd530a-d5cd-4feb-9814-0d10011989be tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:55.946614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0efd530a-d5cd-4feb-9814-0d10011989be tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:55.947755 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0efd530a-d5cd-4feb-9814-0d10011989be tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16" status: 200 len: 1278 microversion: 2.47 time: 0.075772 Oct 01 21:24:55.948330 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3796/5602] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:24:55 2022] GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16 => generated 1278 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:24:56.012432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1703932671", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": "none"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:56.067016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:24:56.067466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:24:56.068047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:24:56.068537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:24:56.068968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:24:56.078816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:56.079375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:56.079854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:56.080780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:56.081421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:56.081963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:56.100525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Getting quotas for project 70dcbab212774655a7094ebc0cb9d800. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:24:56.106566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Getting quotas for user 3f7614694df347bea9be492787dbd455 and project 70dcbab212774655a7094ebc0cb9d800. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:24:56.119543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:24:56.121747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:24:56.168709 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2896a3bc-2d5d-4d18-9972-a3a15a565d1b tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.160151 Oct 01 21:24:56.169383 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1807/5603] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Oct 1 21:24:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 162 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 21:24:56.182383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a35ee33-03ea-4c2a-9cf2-0253f0a79f4f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:24:56.185146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a35ee33-03ea-4c2a-9cf2-0253f0a79f4f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:56.232578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a35ee33-03ea-4c2a-9cf2-0253f0a79f4f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "PUT /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 992 microversion: 2.47 time: 0.055756 Oct 01 21:24:56.238541 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3797/5604] 10.222.0.17 () {62 vars in 1297 bytes} [Sat Oct 1 21:24:56 2022] PUT /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 992 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:24:56.254800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-654ee91a-c9c7-47d5-9ece-cf99c65cd1fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:56.255790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-654ee91a-c9c7-47d5-9ece-cf99c65cd1fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:56.322578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-654ee91a-c9c7-47d5-9ece-cf99c65cd1fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:56.331446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-654ee91a-c9c7-47d5-9ece-cf99c65cd1fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:56.332907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-654ee91a-c9c7-47d5-9ece-cf99c65cd1fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:56.334149 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-654ee91a-c9c7-47d5-9ece-cf99c65cd1fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1278 microversion: 2.47 time: 0.083939 Oct 01 21:24:56.335131 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1808/5605] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:24:56 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:24:57.361428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:57.362057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:57.369735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:57.370239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:57.370732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:57.371468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:57.371944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:57.372558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:57.439193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:57.448226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:57.449744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:57.450921 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef13c85a-1915-4b1c-9f6f-ef74ce0ce79f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1330 microversion: 2.47 time: 0.093555 Oct 01 21:24:57.451484 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3798/5606] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:24:57 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:24:58.477173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:58.477895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:58.485231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:58.485740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:58.486186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:58.486917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:58.487379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:58.487812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:58.555439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:58.563576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:58.565032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:58.566174 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2934f37c-05aa-4b25-8cfd-355155447823 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1336 microversion: 2.47 time: 0.092985 Oct 01 21:24:58.566777 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1809/5607] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:24:58 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:24:59.592789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:24:59.593417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:24:59.596377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:24:59.602090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:59.602623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:59.603081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:59.603795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:24:59.604267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:24:59.604712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:24:59.672376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:59.681637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:59.683117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:24:59.684293 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f6a1def3-85f7-410d-9e1c-7f95d580b901 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1336 microversion: 2.47 time: 0.095500 Oct 01 21:24:59.685065 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3799/5608] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:24:59 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:00.711637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:00.712293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:00.719220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:00.719720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:00.720172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:00.720875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:00.721340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:00.721773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:00.789562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:00.798033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:00.799520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:00.800671 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2802c041-13a0-4dfa-aeed-493331b3a052 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1336 microversion: 2.47 time: 0.093163 Oct 01 21:25:00.801244 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1810/5609] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:00 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:01.826065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:01.826638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:01.833520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:01.834022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:01.834485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:01.835213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:01.836298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:01.836745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:01.899323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:01.907488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:01.908965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:01.910149 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cdf52eb8-4ee9-4c8a-9171-02accfc8e39a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1357 microversion: 2.47 time: 0.088413 Oct 01 21:25:01.910755 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3800/5610] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:01 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1357 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:01.935119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:25:01.937830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:01.944596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:01.945660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:01.946100 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:01.946852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:01.947307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:01.947733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:02.024050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:25:02.024482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:25:02.024967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:25:02.025384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:25:02.025808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:25:02.085144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:02.092000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:02.092493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:02.092932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:02.093636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:02.094097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:02.094541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:02.122214 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dccb9b60-764f-4807-b13a-8ba14a5a84ac tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "POST /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68/action" status: 202 len: 1079 microversion: 2.47 time: 0.190997 Oct 01 21:25:02.122883 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1811/5611] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Oct 1 21:25:01 2022] POST /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68/action => generated 1079 bytes in 192 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 01 21:25:02.143496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:02.144125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:02.151087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:02.151595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:02.152055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:02.152767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:02.153239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:02.153684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:02.218067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:02.226374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:02.227869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:02.229055 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5840e8ea-cf54-4987-86c6-6a51db6f160a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.089581 Oct 01 21:25:02.229622 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3801/5612] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:02 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:03.255813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:03.256466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:03.263709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:03.264215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:03.264704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:03.265425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:03.265896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:03.266347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:03.357259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:03.366018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:03.367838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:03.369356 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-19c71e29-84bc-4cf4-a0d4-9dd8cb3c92fe tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.117719 Oct 01 21:25:03.378847 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1812/5613] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:03 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:04.396442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:04.397020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:04.404252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:04.404758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:04.405216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:04.405928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:04.406404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:04.406885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:04.471001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:04.479240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:04.480714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:04.481898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2ec768d6-a9b3-47ea-be7e-05037428d113 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.089674 Oct 01 21:25:04.482459 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3802/5614] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:04 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:05.507710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:05.508335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:05.515319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:05.515841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:05.516270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:05.516982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:05.517449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:05.517884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:05.583393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:05.592318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:05.593779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:05.594996 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e177ff3a-10ce-47a3-ac6e-867d38cef7a3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.091356 Oct 01 21:25:05.595567 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1813/5615] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:05 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:25:06.620802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:06.621463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:06.624342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:06.630219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:06.630756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:06.631213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:06.631933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:06.632907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:06.633353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:06.705356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:06.713641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:06.715147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:06.716333 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7395dd95-439c-4246-9cb1-882a8f1f6f42 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.099574 Oct 01 21:25:06.716891 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3803/5616] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:06 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:07.741021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:07.742148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:07.744081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:07.744940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=14 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:07.751882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:07.752378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:07.752831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:07.753536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:07.754000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:07.754464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:07.818449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:07.826779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:07.828233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:07.829409 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d44e39e8-fc5e-4126-8e7c-95ce1355326e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.092309 Oct 01 21:25:07.829983 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1814/5617] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:07 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:08.854095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:08.854781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:08.861645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:08.862149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:08.862627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:08.863337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:08.863810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:08.864252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:08.928263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:08.937447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:08.938996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:08.940226 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26a7eb00-bb56-4446-9be2-9ce116059399 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.090198 Oct 01 21:25:08.940794 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3804/5618] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:08 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:09.966896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:09.967520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:09.974401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:09.974936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:09.975387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:09.976729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:09.977193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:09.977630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:10.049125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:10.057412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:10.058893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:10.060065 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1694d68c-9ff1-434d-a28b-3b5e493cf892 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.097185 Oct 01 21:25:10.060638 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1815/5619] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:09 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:11.086680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:11.087499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:11.094724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:11.095239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:11.095701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:11.096457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:11.096938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:11.097392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:11.164200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:11.172698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:11.174176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:11.175405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0c15e7a-dfa3-4188-a58c-483730e24709 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.094167 Oct 01 21:25:11.175976 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3805/5620] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:11 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:12.203496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:12.204130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:12.211191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:12.211706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:12.212138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:12.212845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:12.213316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:12.213752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:12.278271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:12.286562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:12.288061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:12.289883 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5a061001-25c1-4c0f-8e15-682197863813 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.090401 Oct 01 21:25:12.290453 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1816/5621] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:12 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:13.315620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:13.316170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:13.323772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:13.324276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:13.324739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:13.325451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:13.325926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:13.326402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:13.331006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:13.393384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:13.402218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:13.403723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:13.404903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eadb93d9-a562-4e85-8c25-890ff414f4d3 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.093426 Oct 01 21:25:13.405470 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3806/5622] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:13 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:14.430201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:14.430848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:14.437575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:14.438068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:14.438522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:14.439233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:14.439694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:14.440126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:14.504403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:14.512688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:14.514126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:14.515319 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8f5a2334-0a1a-47c6-bddf-fa89aafc4675 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.089148 Oct 01 21:25:14.515891 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1817/5623] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:14 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:15.541407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:15.542299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:15.549441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:15.549944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:15.550404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:15.551142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:15.551619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:15.552068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:15.623708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:15.632881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:15.634587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:15.635858 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc8d4f8c-df55-4d1e-b47d-9514d5a1069c tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.098665 Oct 01 21:25:15.636422 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3807/5624] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:15 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:16.662266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:16.662851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:16.670101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:16.670637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:16.671090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:16.671797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:16.672265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:16.672701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:16.736464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:16.745237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:16.746747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:16.747938 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e7678d85-f385-4450-beb0-2b6a01e6dae8 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.089888 Oct 01 21:25:16.748513 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1818/5625] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:16 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 21:25:17.773760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:17.774402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:17.781517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:17.782029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:17.782504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:17.783240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:17.783725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:17.784178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:17.847531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:17.856155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:17.857647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:17.858878 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0bb82f24-c8b5-4593-b680-6d3b8329595f tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.089782 Oct 01 21:25:17.859447 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3808/5626] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:17 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:18.884462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:18.885092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:18.892117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:18.892611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:18.893058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:18.893763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:18.894229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:18.894705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:18.962346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:18.970613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:18.972079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:18.973264 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ee596922-700a-4cf3-8ff5-1e472f574790 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.092818 Oct 01 21:25:18.973831 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1819/5627] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:18 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:19.999564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:20.000351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:20.007467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:20.007988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:20.008492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:20.009267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:20.009740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:20.010183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:20.077759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:20.086386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:20.087876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:20.089108 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d5197b2a-a1a1-4839-972d-37d1e2336a16 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.093617 Oct 01 21:25:20.089728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3809/5628] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:19 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:21.118747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:21.119374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:21.126209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:21.126755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:21.127233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:21.127914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:21.128377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:21.128822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:21.192999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:21.202045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:21.203555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:21.204735 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0f275664-9222-4000-9ad5-ac42420c18fc tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.090550 Oct 01 21:25:21.205300 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1820/5629] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:21 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:22.229414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:22.230144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:22.237516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:22.238023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:22.238561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:22.239279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:22.239791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:22.240229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:22.308418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:22.316673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:22.318169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:22.319406 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-915931cb-9f09-4667-a555-703a78c714dd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.094122 Oct 01 21:25:22.320713 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3810/5630] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:22 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:23.346044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:23.346624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:23.353908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:23.354397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:23.354865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:23.355567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:23.356025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:23.356453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:23.422644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:23.430876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:23.432323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:23.433489 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2d20380f-f9e8-4521-a0a6-e8e7082f9a37 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.091551 Oct 01 21:25:23.434046 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1821/5631] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:23 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:24.458788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:24.459434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:24.466412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:24.467019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:24.467482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:24.468203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:24.468684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:24.469134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:24.539999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:24.549466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:24.551349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:24.552743 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1543439f-9129-4f44-ab56-92d36403f5bf tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.097984 Oct 01 21:25:24.553328 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3811/5632] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:24 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:25.580527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:25.581065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:25.587988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:25.588478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:25.588978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:25.589674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:25.590138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:25.590589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:25.654029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:25.662523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:25.663962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:25.665136 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8c5377a7-9dac-4013-b9c2-4ba4fcdc3de7 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.088765 Oct 01 21:25:25.665709 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1822/5633] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:25 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:26.691446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:26.691996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:26.699340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:26.699869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:26.700320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:26.701029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:26.701502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:26.701940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:26.769434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:26.778369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:26.779876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:26.781074 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6ca6afdb-9e28-49a7-a5ca-5e2920abb132 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.093745 Oct 01 21:25:26.781652 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3812/5634] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:26 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:27.806749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:27.807403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:27.810508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:27.815685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:27.816174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:27.816614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:27.817315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:27.817773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:27.818200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:27.821678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:27.886682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:27.894891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:27.896341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:27.897516 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ecf9b509-7258-430d-bc0d-65dc7bf17fdb tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.094764 Oct 01 21:25:27.898088 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1823/5635] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:27 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:28.924018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:28.924701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:28.931785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:28.932289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:28.933355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:28.934064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:28.934560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:28.935006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:28.998301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:29.006605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:29.008080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:29.009291 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-22349bc0-af29-4f9e-93b0-4377c1fa9312 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1366 microversion: 2.47 time: 0.089221 Oct 01 21:25:29.009853 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3813/5636] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:28 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:30.034859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:30.035494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:30.043240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:30.043740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:30.044181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:30.044897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:30.045357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:30.045787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:30.109821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:30.117963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:30.119434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:30.121130 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1cf4ccf5-0f16-40de-96a3-766f51ee101a tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1372 microversion: 2.47 time: 0.090572 Oct 01 21:25:30.121701 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1824/5637] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:30 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:31.148594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:31.149265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:31.152045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=30 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:31.158438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:31.158998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:31.159479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:31.160196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:31.160698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:31.161141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:31.224629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:31.232770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:31.234225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:31.235433 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-340d6175-cdda-4127-9077-31b1456a4fe6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1372 microversion: 2.47 time: 0.090837 Oct 01 21:25:31.236002 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3814/5638] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:31 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:32.260806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:32.261446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:32.268363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:32.268855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:32.269311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:32.270010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:32.270475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:32.270932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:32.334604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.343672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.345155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.346320 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-229e079b-dbe7-430e-bebc-7ae59c95ed50 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1357 microversion: 2.47 time: 0.089561 Oct 01 21:25:32.346920 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1825/5639] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:32 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1357 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:32.373643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:32.378384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.379292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Searching by: {'deleted': False, 'project_id': '70dcbab212774655a7094ebc0cb9d800'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 21:25:32.386302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:32.386830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:32.387284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:32.388028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:32.388499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:32.388939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:32.505760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 21:25:32.584078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.591078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:32.591579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:32.592034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:32.602555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.604024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.642235 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-34cd0a57-6d03-4c19-8d58-c10458eb205e tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.272750 Oct 01 21:25:32.642876 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3815/5640] 10.222.0.17 () {60 vars in 1187 bytes} [Sat Oct 1 21:25:32 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:32.675712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:32.676221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:32.682388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:32.682918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:32.683364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:32.684077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:32.684542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:32.684975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:32.710206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:25:32.785940 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c9c05e65-6cc1-4e10-b5a2-da2da2af50bd tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 204 len: 0 microversion: 2.47 time: 0.113919 Oct 01 21:25:32.786854 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1826/5641] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:25:32 2022] DELETE /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:25:32.796504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:32.797136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:32.803308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:32.803849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:32.804377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:32.805759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:32.806263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:32.806885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:32.890883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.899095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.900559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:32.901730 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bff15588-2f58-4256-a1dd-26313030458d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1363 microversion: 2.47 time: 0.110584 Oct 01 21:25:32.902297 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3816/5642] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:32 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1363 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:33.927733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:33.928365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:33.935280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:33.935767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:33.936209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:33.936902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:33.937370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:33.937794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:34.005116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:34.013800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:34.015287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:34.016459 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0dd8eb4c-e34d-469a-a507-1afb2eba2d47 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 200 len: 1363 microversion: 2.47 time: 0.093133 Oct 01 21:25:34.017031 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1827/5643] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:33 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:35.041316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:35.042211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: f6bff947-5a85-463f-b09d-dea07f742c68] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:35.050072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:35.050620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:35.051080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:35.051803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:35.052284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:35.052733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:35.067174 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] HTTP exception thrown: Instance f6bff947-5a85-463f-b09d-dea07f742c68 could not be found. Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Request method failure captured: Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 HTTP/1.1 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLAnwhmcEexnJ-nrStJawZXkH9AI5pR4ZFks0TFBjKNUR8WwWn4uiMu-cuA9k8FSHvrjfZmmURi_-aiYPHkr-rbJdLS1TjOSS2FsySGGf0ztL3vZor_FhTvo7ia6qi5GDuexuSefJaIXKC3ZAT_sy9yxgH7iCAfzxJFZktm8M-V79-M Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.47 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 70dcbab212774655a7094ebc0cb9d800 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerShowV247Test-1036958471 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_70dcbab212774655a7094ebc0cb9d800", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70dcbab212774655a7094ebc0cb9d800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/70dcbab212774655a7094ebc0cb9d800"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70dcbab212774655a7094ebc0cb9d800"}]}] Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerShowV247Test-1036958471 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 70dcbab212774655a7094ebc0cb9d800 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerShowV247Test-1036958471 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerShowV247Test-1036958471-project Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3f7614694df347bea9be492787dbd455 Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerShowV247Test-1036958471-project Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance f6bff947-5a85-463f-b09d-dea07f742c68 could not be found. Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'f6bff947-5a85-463f-b09d-dea07f742c68'} Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bff947-5a85-463f-b09d-dea07f742c68 could not be found. Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bff947-5a85-463f-b09d-dea07f742c68 could not be found. Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:25:35.068746 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bff947-5a85-463f-b09d-dea07f742c68 could not be found. Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Returning 404 to user: Instance f6bff947-5a85-463f-b09d-dea07f742c68 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-79ad697f-226d-48ee-a976-03daf4daa05d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68" status: 404 len: 111 microversion: 2.47 time: 0.032941 Oct 01 21:25:35.073475 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3817/5644] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:35 2022] GET /compute/v2.1/servers/f6bff947-5a85-463f-b09d-dea07f742c68 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:25:35.078930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:35.079469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: b1696b07-5295-4f5d-9494-5d8d57b10d16] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:35.086322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:35.086857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:35.087304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:35.088004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:35.088467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:35.088898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:35.114897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: b1696b07-5295-4f5d-9494-5d8d57b10d16] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:25:35.194281 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f52d3614-647d-483b-b941-a5f31a09d565 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16" status: 204 len: 0 microversion: 2.47 time: 0.118819 Oct 01 21:25:35.195109 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1828/5645] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Oct 1 21:25:35 2022] DELETE /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 21:25:35.203648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:35.204291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: b1696b07-5295-4f5d-9494-5d8d57b10d16] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:35.210415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:35.210964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:35.211429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:35.212155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:35.212637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:35.213082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:35.293630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:35.301928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:35.303444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:35.304803 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca54abcc-0149-4104-a7f8-35b4c27e55ee tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16" status: 200 len: 1363 microversion: 2.47 time: 0.104927 Oct 01 21:25:35.305198 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3818/5646] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:35 2022] GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16 => generated 1363 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:36.331265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:36.331908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: b1696b07-5295-4f5d-9494-5d8d57b10d16] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:36.338743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:36.339230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:36.340249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:36.340943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:36.341398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:36.341829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:36.410626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:36.419250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:36.420702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:36.421876 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-93d0d8ec-72e1-4687-a972-1d25fd1b8cb6 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16" status: 200 len: 1363 microversion: 2.47 time: 0.095085 Oct 01 21:25:36.422438 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1829/5647] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:36 2022] GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:36.762964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:36.763577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:36.770800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:36.771449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:36.771927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:36.772670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:36.773155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:36.773611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:36.800082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:25:36.878126 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e22f5b2-4299-49ae-aa28-ce9364628876 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 204 len: 0 microversion: 2.1 time: 0.119685 Oct 01 21:25:36.878774 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3819/5648] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:25:36 2022] DELETE /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:25:36.889158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:36.890203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:36.896145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:36.896630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:36.897070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:36.897772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:36.898233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:36.898689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:37.033262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:37.041232 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b91859c5-07a8-4027-bd86-fbc4181e6e08 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1576 microversion: 2.1 time: 0.158025 Oct 01 21:25:37.042079 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1830/5649] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:36 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:37.447646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:37.448377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: b1696b07-5295-4f5d-9494-5d8d57b10d16] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:37.454994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:37.455501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:37.455969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:37.456685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:37.457166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:37.457614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:37.493430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:37.493936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:37.494401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:37.494902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lazy-loading 'fault' on Instance uuid b1696b07-5295-4f5d-9494-5d8d57b10d16 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:25:37.536101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:37.538383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:37.546437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:37.547948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7614694df347bea9be492787dbd455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70dcbab212774655a7094ebc0cb9d800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:37.549160 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab503ff9-91d4-4f0d-87dc-e71de0c0851d tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16" status: 200 len: 1368 microversion: 2.47 time: 0.105922 Oct 01 21:25:37.549729 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3820/5650] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:37 2022] GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 21:25:38.065481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:38.066146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:38.073150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:38.073651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:38.074098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:38.074837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:38.075310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:38.075749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:38.208036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:38.218284 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-33772976-6d41-4bb7-a587-ee953f6101fa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1576 microversion: 2.1 time: 0.156704 Oct 01 21:25:38.219123 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1831/5651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:38 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:38.575841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:38.576510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] [instance: b1696b07-5295-4f5d-9494-5d8d57b10d16] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:38.584527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:38.585070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:38.585524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:38.586251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:38.586749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:38.587193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:38.602435 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] HTTP exception thrown: Instance b1696b07-5295-4f5d-9494-5d8d57b10d16 could not be found. Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Request method failure captured: Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16 HTTP/1.1 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLAnwhmcEexnJ-nrStJawZXkH9AI5pR4ZFks0TFBjKNUR8WwWn4uiMu-cuA9k8FSHvrjfZmmURi_-aiYPHkr-rbJdLS1TjOSS2FsySGGf0ztL3vZor_FhTvo7ia6qi5GDuexuSefJaIXKC3ZAT_sy9yxgH7iCAfzxJFZktm8M-V79-M Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Openstack-Nova-Api-Version: 2.47 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 70dcbab212774655a7094ebc0cb9d800 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerShowV247Test-1036958471 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_70dcbab212774655a7094ebc0cb9d800", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70dcbab212774655a7094ebc0cb9d800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/70dcbab212774655a7094ebc0cb9d800"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70dcbab212774655a7094ebc0cb9d800"}]}] Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerShowV247Test-1036958471 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 70dcbab212774655a7094ebc0cb9d800 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerShowV247Test-1036958471 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerShowV247Test-1036958471-project Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 3f7614694df347bea9be492787dbd455 Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerShowV247Test-1036958471-project Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance b1696b07-5295-4f5d-9494-5d8d57b10d16 could not be found. Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'b1696b07-5295-4f5d-9494-5d8d57b10d16'} Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1696b07-5295-4f5d-9494-5d8d57b10d16 could not be found. Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1696b07-5295-4f5d-9494-5d8d57b10d16 could not be found. Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:25:38.604476 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1696b07-5295-4f5d-9494-5d8d57b10d16 could not be found. Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] Returning 404 to user: Instance b1696b07-5295-4f5d-9494-5d8d57b10d16 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-efb74c35-f9b8-4bc6-999d-63255772c428 tempest-ServerShowV247Test-1036958471 tempest-ServerShowV247Test-1036958471-project] 10.222.0.17 "GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16" status: 404 len: 111 microversion: 2.47 time: 0.034758 Oct 01 21:25:38.608340 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3821/5652] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Oct 1 21:25:38 2022] GET /compute/v2.1/servers/b1696b07-5295-4f5d-9494-5d8d57b10d16 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:25:39.241348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:39.242231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:39.251990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:39.252907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:39.253363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:39.254206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:39.254853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:39.255556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:39.354875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:39.366429 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b7bc1532-49c8-4b85-b5f5-bde4858eb22b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 200 len: 1508 microversion: 2.1 time: 0.128684 Oct 01 21:25:39.367499 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1832/5653] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:39 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 1508 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:39.614965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a26731c9-575c-4999-b7d5-ccd33bf538ca req-ab77a211-9b4f-4b41-8ddc-907530796139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705efbe6-8a41-4a4b-8308-aacfce5ae9c0", "name": "network-vif-deleted", "tag": "6933cdba-d259-4cb3-98f5-726e87767a86"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:25:39.634701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a26731c9-575c-4999-b7d5-ccd33bf538ca req-ab77a211-9b4f-4b41-8ddc-907530796139 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:39.635210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a26731c9-575c-4999-b7d5-ccd33bf538ca req-ab77a211-9b4f-4b41-8ddc-907530796139 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:39.637191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a26731c9-575c-4999-b7d5-ccd33bf538ca req-ab77a211-9b4f-4b41-8ddc-907530796139 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:39.649734 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a26731c9-575c-4999-b7d5-ccd33bf538ca req-ab77a211-9b4f-4b41-8ddc-907530796139 service nova] Creating event network-vif-deleted:6933cdba-d259-4cb3-98f5-726e87767a86 for instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 on nch1-master-1 Oct 01 21:25:39.656189 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a26731c9-575c-4999-b7d5-ccd33bf538ca req-ab77a211-9b4f-4b41-8ddc-907530796139 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049751 Oct 01 21:25:39.657554 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3822/5654] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:25:40.392340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:40.393143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:40.400508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:40.401172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:40.401635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:40.402452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:40.402936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:40.403391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:40.421257 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 HTTP/1.1 Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '705efbe6-8a41-4a4b-8308-aacfce5ae9c0'} Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:25:40.422967 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:25:40.427118 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:25:40.427118 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:25:40.427118 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:25:40.427118 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:25:40.427118 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:25:40.427118 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:25:40.427118 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:25:40.428323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:25:40.429200 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9efc4c86-fbeb-47d5-93ec-1a1555d13850 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 404 len: 111 microversion: 2.1 time: 0.041604 Oct 01 21:25:40.429785 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1833/5655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:40 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:25:40.549227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1753960793", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-78231844", "security_groups": [{"name": "tempest-secgroup-smoke-1901537890"}], "block_device_mapping_v2": [{"uuid": "91a33031-458c-4c6f-8fe0-fccc855ffd7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4a3c030a-8624-4d4f-bb7a-67548024ff58"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:25:40.679758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] validate_networks() for [('4a3c030a-8624-4d4f-bb7a-67548024ff58', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:25:41.114108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:25:41.114584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:25:41.115161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:25:41.115685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:25:41.116123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:25:41.125549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:41.126058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:41.126540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:41.127283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:41.127753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:41.128196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:41.148749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:25:41.154247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for user eb0bf5fce885439eaa16a0871c2992ac and project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:25:41.216531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:25:41.218837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91a33031-458c-4c6f-8fe0-fccc855ffd7f',volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:25:41.353616 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fec99b6c-eeac-472e-981d-77b40f522485 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.808782 Oct 01 21:25:41.354257 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3823/5656] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:25:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:25:41.366847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e871d24e-3278-4a5b-8e50-835f7cd5da7e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:41.367533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e871d24e-3278-4a5b-8e50-835f7cd5da7e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:41.432485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e871d24e-3278-4a5b-8e50-835f7cd5da7e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:41.442744 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e871d24e-3278-4a5b-8e50-835f7cd5da7e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1093 microversion: 2.1 time: 0.080409 Oct 01 21:25:41.443646 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1834/5657] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:41 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:42.469985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:42.471168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:42.478587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:42.479095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:42.479549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:42.483365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:42.483365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:42.483365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:42.549713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:42.558479 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-08c83363-2701-4aff-a5a2-128db39b50e5 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1191 microversion: 2.1 time: 0.091904 Oct 01 21:25:42.559312 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3824/5658] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:42 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:25:43.583153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:43.583779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:43.598955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:43.599472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:43.599921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:43.600647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:43.601114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:43.601548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:43.823000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:43.837161 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e00ae31-ed28-4a63-af59-ad2364a7970f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1277 microversion: 2.1 time: 0.257769 Oct 01 21:25:43.837934 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1835/5659] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:43 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:44.478447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0916ea90-b48c-48de-acd8-9e746a085ff0 req-371f34f2-0589-4d0a-b7aa-e1d94278fafa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677", "tag": "9a487a9f-53a0-460a-8557-d29ccbdfd254"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:25:44.492225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0916ea90-b48c-48de-acd8-9e746a085ff0 req-371f34f2-0589-4d0a-b7aa-e1d94278fafa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:44.493035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0916ea90-b48c-48de-acd8-9e746a085ff0 req-371f34f2-0589-4d0a-b7aa-e1d94278fafa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:44.493636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0916ea90-b48c-48de-acd8-9e746a085ff0 req-371f34f2-0589-4d0a-b7aa-e1d94278fafa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:44.512053 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0916ea90-b48c-48de-acd8-9e746a085ff0 req-371f34f2-0589-4d0a-b7aa-e1d94278fafa service nova] Creating event network-changed:9a487a9f-53a0-460a-8557-d29ccbdfd254 for instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 on nch1-master-1 Oct 01 21:25:44.517249 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0916ea90-b48c-48de-acd8-9e746a085ff0 req-371f34f2-0589-4d0a-b7aa-e1d94278fafa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043198 Oct 01 21:25:44.518125 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3825/5660] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:25:44.865319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:44.866122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:44.874075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:44.874629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:44.875254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:44.875979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:44.876610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:44.877048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:45.036776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:45.047438 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0ae099b2-0573-4369-a179-5b9ac1652d33 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1265 microversion: 2.1 time: 0.185832 Oct 01 21:25:45.048110 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1836/5661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:44 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:46.071589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:46.072301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:46.080089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:46.080598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:46.081056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:46.081767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:46.082273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:46.082768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:46.224637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:46.232576 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cba99520-47a7-4abb-8921-2c38c369cc30 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1265 microversion: 2.1 time: 0.165104 Oct 01 21:25:46.233164 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3826/5662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:46 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:47.254922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:47.256277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:47.265196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:47.265911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:47.266605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:47.267383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:47.268028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:47.268660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:47.425034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:47.436316 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8886bfad-84fe-4386-815c-e30f41f0c47c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1265 microversion: 2.1 time: 0.184392 Oct 01 21:25:47.437778 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1837/5663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:47 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:48.460027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:48.460764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:48.468830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:48.469486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:48.469952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:48.470708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:48.471224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:48.471671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:48.613304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:48.622333 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d525bdc-6812-4acd-a6df-bdaae4640ebe tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1265 microversion: 2.1 time: 0.166236 Oct 01 21:25:48.622974 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3827/5664] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:48 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:49.156023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e808bfda-1352-4567-a43d-8df158a8686e req-5453d620-dd68-4b01-926e-8ad90192566b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677", "name": "network-vif-plugged", "status": "completed", "tag": "9a487a9f-53a0-460a-8557-d29ccbdfd254"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:25:49.165634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e808bfda-1352-4567-a43d-8df158a8686e req-5453d620-dd68-4b01-926e-8ad90192566b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:49.166130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e808bfda-1352-4567-a43d-8df158a8686e req-5453d620-dd68-4b01-926e-8ad90192566b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:49.166869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e808bfda-1352-4567-a43d-8df158a8686e req-5453d620-dd68-4b01-926e-8ad90192566b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:49.171507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:49.183427 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e808bfda-1352-4567-a43d-8df158a8686e req-5453d620-dd68-4b01-926e-8ad90192566b service nova] Creating event network-vif-plugged:9a487a9f-53a0-460a-8557-d29ccbdfd254 for instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 on nch1-master-1 Oct 01 21:25:49.188919 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e808bfda-1352-4567-a43d-8df158a8686e req-5453d620-dd68-4b01-926e-8ad90192566b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199457 Oct 01 21:25:49.189774 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1838/5665] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:25:49.645802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:49.646396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:49.653890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:49.654402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:49.654886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:49.655606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:49.656081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:49.656527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:49.853436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:49.861576 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b180d308-c937-4479-b527-f0a0d1d707fc tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1265 microversion: 2.1 time: 0.220188 Oct 01 21:25:49.862166 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3828/5666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:49 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:50.885584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:50.886986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:50.894768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:50.895329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:50.895692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:50.896401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:50.896865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:50.897391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:51.040585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:51.057253 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2db784a7-ee05-4cf6-ae67-74381fdbe311 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1451 microversion: 2.1 time: 0.176965 Oct 01 21:25:51.058309 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1839/5667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:50 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:51.081749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:25:51.082390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:25:51.089241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:51.089753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:51.090391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:51.091580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:51.092725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:51.093185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:51.137039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:51.161076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:51.232221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:25:51.240527 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4eaadf9f-a6cc-47a4-a30b-c3bbe36cfc9d tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1451 microversion: 2.1 time: 0.162761 Oct 01 21:25:51.241115 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3829/5668] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:25:51 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:25:53.174265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-95cd098f-5e9c-4d36-89b5-e7cd3247558b req-4ef6e37e-8ed1-4a79-8e5d-474ce5fe1742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677", "tag": "9a487a9f-53a0-460a-8557-d29ccbdfd254"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:25:53.180853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:25:53.186125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-95cd098f-5e9c-4d36-89b5-e7cd3247558b req-4ef6e37e-8ed1-4a79-8e5d-474ce5fe1742 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:25:53.186849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-95cd098f-5e9c-4d36-89b5-e7cd3247558b req-4ef6e37e-8ed1-4a79-8e5d-474ce5fe1742 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:25:53.187287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-95cd098f-5e9c-4d36-89b5-e7cd3247558b req-4ef6e37e-8ed1-4a79-8e5d-474ce5fe1742 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:25:53.209864 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-95cd098f-5e9c-4d36-89b5-e7cd3247558b req-4ef6e37e-8ed1-4a79-8e5d-474ce5fe1742 service nova] Creating event network-changed:9a487a9f-53a0-460a-8557-d29ccbdfd254 for instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 on nch1-master-1 Oct 01 21:25:53.217866 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-95cd098f-5e9c-4d36-89b5-e7cd3247558b req-4ef6e37e-8ed1-4a79-8e5d-474ce5fe1742 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047745 Oct 01 21:25:53.218518 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1840/5669] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:26:14.925118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:14.925659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:14.928231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:26:14.929476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=39 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:26:14.936123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:14.936691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:14.937235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:14.938035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:14.938535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:14.939037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:15.030930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lazy-loading 'services' on Instance uuid 663df986-3e91-45fd-82d9-aad3d0f6ee3f {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:26:15.108610 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5e481010-0de7-4abc-8dbf-3d7d05d70153 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "DELETE /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f/os-volume_attachments/7dea6e35-1c10-40b3-8361-2f40a38aaad1" status: 202 len: 0 microversion: 2.1 time: 0.187533 Oct 01 21:26:15.109222 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3830/5670] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:26:14 2022] DELETE /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f/os-volume_attachments/7dea6e35-1c10-40b3-8361-2f40a38aaad1 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:26:16.252798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:26:16.253706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=9 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:26:16.258223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:16.258854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:16.267060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:16.267558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:16.267993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:16.269062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:16.269390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:16.270040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:16.303036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:26:16.398181 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fff740b1-30e9-4569-b71b-512c09b8b9dc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "DELETE /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 204 len: 0 microversion: 2.1 time: 0.146158 Oct 01 21:26:16.402636 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1841/5671] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:26:16 2022] DELETE /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:26:16.409177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:16.409918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:16.416972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:16.417510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:16.417964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:16.418710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:16.419183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:16.419620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:16.567662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:16.578845 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15d62b6b-3508-4c48-a11b-d174794eec6d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1513 microversion: 2.1 time: 0.174793 Oct 01 21:26:16.580189 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3831/5672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:16 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:17.601946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:17.602694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:17.610413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:17.610939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:17.611386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:17.612098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:17.612745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:17.613367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:17.825091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:17.834671 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-94f9e23a-01fe-44b1-81fb-7682008db6da tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1513 microversion: 2.1 time: 0.236921 Oct 01 21:26:17.835241 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1842/5673] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:17 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:26:18.604228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a332785b-0005-4904-a7e0-d8b4027eec91 req-ea4f2e2c-980d-451d-a977-e23fdbc61ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663df986-3e91-45fd-82d9-aad3d0f6ee3f", "name": "network-vif-deleted", "tag": "88496653-8dfa-49b5-b5c5-e0ec0c050ae8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:26:18.615229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a332785b-0005-4904-a7e0-d8b4027eec91 req-ea4f2e2c-980d-451d-a977-e23fdbc61ef5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:18.615732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a332785b-0005-4904-a7e0-d8b4027eec91 req-ea4f2e2c-980d-451d-a977-e23fdbc61ef5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:18.616378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a332785b-0005-4904-a7e0-d8b4027eec91 req-ea4f2e2c-980d-451d-a977-e23fdbc61ef5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:18.629098 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a332785b-0005-4904-a7e0-d8b4027eec91 req-ea4f2e2c-980d-451d-a977-e23fdbc61ef5 service nova] Creating event network-vif-deleted:88496653-8dfa-49b5-b5c5-e0ec0c050ae8 for instance 663df986-3e91-45fd-82d9-aad3d0f6ee3f on nch2-master-1 Oct 01 21:26:18.634825 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a332785b-0005-4904-a7e0-d8b4027eec91 req-ea4f2e2c-980d-451d-a977-e23fdbc61ef5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210816 Oct 01 21:26:18.635432 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3832/5674] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:26:18.864580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:18.866186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:18.878569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:18.879046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:18.879877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:18.880942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:18.881621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:18.882153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:18.931181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:18.931911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:18.932578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:18.933949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lazy-loading 'fault' on Instance uuid 663df986-3e91-45fd-82d9-aad3d0f6ee3f {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:26:18.988958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:18.998326 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4ee89abb-d24b-42fb-a2ee-50d69850ca47 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 200 len: 1308 microversion: 2.1 time: 0.142424 Oct 01 21:26:18.999188 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1843/5675] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:18 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:20.022875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:20.023625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: 663df986-3e91-45fd-82d9-aad3d0f6ee3f] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:20.030558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:20.031074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:20.031543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:20.032272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:20.032908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:20.033362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:20.048239 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] HTTP exception thrown: Instance 663df986-3e91-45fd-82d9-aad3d0f6ee3f could not be found. Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Request method failure captured: Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f HTTP/1.1 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK_245S8cnMMKJzeOfdbHMjSaMxgazH-RCTZmqSB4EWdFuQz-QotaGs4ASiUAy-yw4zzuaHpS9oIoKCSj9be9OKCxT3WsqIzSDz7UFQQ8Kpf0Orss80zclWQhpG93VX4_yhj1BwlHK0f-VwqR1_74pshCjCmxg4QcTwP9XnPrJ3xPtU Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: dd6e51791d934c73bf7d92e7ed1a8909 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1103874744 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dd6e51791d934c73bf7d92e7ed1a8909", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd6e51791d934c73bf7d92e7ed1a8909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dd6e51791d934c73bf7d92e7ed1a8909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd6e51791d934c73bf7d92e7ed1a8909"}]}] Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-VolumesSnapshotTestJSON-1103874744 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: dd6e51791d934c73bf7d92e7ed1a8909 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1103874744 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-VolumesSnapshotTestJSON-1103874744-project Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 98361240b014405cb20cf9c145061be6 Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-VolumesSnapshotTestJSON-1103874744-project Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 663df986-3e91-45fd-82d9-aad3d0f6ee3f could not be found. Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '663df986-3e91-45fd-82d9-aad3d0f6ee3f'} Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663df986-3e91-45fd-82d9-aad3d0f6ee3f could not be found. Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663df986-3e91-45fd-82d9-aad3d0f6ee3f could not be found. Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:26:20.050594 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663df986-3e91-45fd-82d9-aad3d0f6ee3f could not be found. Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Returning 404 to user: Instance 663df986-3e91-45fd-82d9-aad3d0f6ee3f could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb2c724d-2962-4960-994f-5316b9df8bf6 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f" status: 404 len: 111 microversion: 2.1 time: 0.033847 Oct 01 21:26:20.054714 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3833/5676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:20 2022] GET /compute/v2.1/servers/663df986-3e91-45fd-82d9-aad3d0f6ee3f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:26:25.015904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-622876280", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "d10ec7ed-790f-4d26-a4a9-2cf78f4a33f8"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:26:25.079758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] validate_networks() for [('d10ec7ed-790f-4d26-a4a9-2cf78f4a33f8', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:26:25.462395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:26:25.462965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:26:25.463505 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:26:25.464429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:26:25.464849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:26:25.474044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:25.474609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:25.475067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:25.475807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:25.476267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:25.476696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:25.494717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Getting quotas for project dd6e51791d934c73bf7d92e7ed1a8909. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:26:25.499921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Getting quotas for user 98361240b014405cb20cf9c145061be6 and project dd6e51791d934c73bf7d92e7ed1a8909. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:26:25.513198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:26:25.515585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:26:25.561874 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-21525a9c-cb42-44e2-a750-a7e7952b32f4 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549983 Oct 01 21:26:25.562568 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1844/5677] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:26:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:26:25.574857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0358e20c-282b-4cbe-a2b9-78f1a488a40b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:25.575689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0358e20c-282b-4cbe-a2b9-78f1a488a40b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:25.661887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0358e20c-282b-4cbe-a2b9-78f1a488a40b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:25.671496 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0358e20c-282b-4cbe-a2b9-78f1a488a40b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1218 microversion: 2.1 time: 0.101455 Oct 01 21:26:25.672087 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3834/5678] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:25 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:26:26.696085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:26.696702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:26.706256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:26.707023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:26.707632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:26.708493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:26.709113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:26.709538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:26.783275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:26.791987 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-de6b5311-fb10-4bad-83e7-de0915c232c8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1276 microversion: 2.1 time: 0.100998 Oct 01 21:26:26.792620 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1845/5679] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:26 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:27.826953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:27.828744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:27.836821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:27.837351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:27.837833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:27.839123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:27.845545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:27.851163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:28.126587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:28.136525 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-48e1ea37-47c3-4f54-8113-a9f30e966916 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1318 microversion: 2.1 time: 0.323334 Oct 01 21:26:28.146931 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3835/5680] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:27 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:28.301571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-62d03091-8484-487e-80e1-9f70a3ae78f4 req-e5f7cf37-eb34-407c-8ef4-9b395266c10e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0cd88f6-fdea-490f-b366-f20730265bb3", "tag": "28da0d53-3db0-489a-a20e-84cff006ecbe"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:26:28.314801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-62d03091-8484-487e-80e1-9f70a3ae78f4 req-e5f7cf37-eb34-407c-8ef4-9b395266c10e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:28.315650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-62d03091-8484-487e-80e1-9f70a3ae78f4 req-e5f7cf37-eb34-407c-8ef4-9b395266c10e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:28.316306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-62d03091-8484-487e-80e1-9f70a3ae78f4 req-e5f7cf37-eb34-407c-8ef4-9b395266c10e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:28.328328 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-62d03091-8484-487e-80e1-9f70a3ae78f4 req-e5f7cf37-eb34-407c-8ef4-9b395266c10e service nova] Creating event network-changed:28da0d53-3db0-489a-a20e-84cff006ecbe for instance a0cd88f6-fdea-490f-b366-f20730265bb3 on nch2-master-1 Oct 01 21:26:28.333714 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-62d03091-8484-487e-80e1-9f70a3ae78f4 req-e5f7cf37-eb34-407c-8ef4-9b395266c10e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039593 Oct 01 21:26:28.334401 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1846/5681] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:26:29.160687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:29.161317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:29.169228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:29.169793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:29.170255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:29.171121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:29.171610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:29.172065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:29.305163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:29.313071 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84d300a7-607a-405c-a25a-ea5d320fd9cc tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1318 microversion: 2.1 time: 0.156280 Oct 01 21:26:29.313656 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3836/5682] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:29 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:30.336767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:30.337632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:30.344828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:30.345497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:30.345947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:30.346821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:30.347286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:30.347714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:30.554109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:30.562616 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6901447d-2ddb-4b65-837d-b5986bd35bb5 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1318 microversion: 2.1 time: 0.231076 Oct 01 21:26:30.563201 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1847/5683] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:30 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:31.587735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:31.589037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:31.596018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:31.596756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:31.597284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:31.598070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:31.598665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:31.599324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:31.748748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:31.757042 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef26366c-b245-434a-94dd-72abcb074249 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1318 microversion: 2.1 time: 0.173345 Oct 01 21:26:31.757948 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3837/5684] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:31 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:32.781671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:32.782293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:32.789424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:32.789917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:32.790363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:32.791359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:32.792418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:32.792850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:32.930626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:32.938605 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d8e418a0-984d-4e08-b522-6866f4e3e52b tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1318 microversion: 2.1 time: 0.160789 Oct 01 21:26:32.939209 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1848/5685] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:32 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:33.363984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9b2683c5-c429-480d-b214-7b5796b35e7e req-dfb26a30-c591-49c3-9c1e-be57e06a9d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cd88f6-fdea-490f-b366-f20730265bb3", "name": "network-vif-plugged", "status": "completed", "tag": "28da0d53-3db0-489a-a20e-84cff006ecbe"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:26:33.377369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9b2683c5-c429-480d-b214-7b5796b35e7e req-dfb26a30-c591-49c3-9c1e-be57e06a9d3c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:33.378600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9b2683c5-c429-480d-b214-7b5796b35e7e req-dfb26a30-c591-49c3-9c1e-be57e06a9d3c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:33.380749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9b2683c5-c429-480d-b214-7b5796b35e7e req-dfb26a30-c591-49c3-9c1e-be57e06a9d3c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:33.393019 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9b2683c5-c429-480d-b214-7b5796b35e7e req-dfb26a30-c591-49c3-9c1e-be57e06a9d3c service nova] Creating event network-vif-plugged:28da0d53-3db0-489a-a20e-84cff006ecbe for instance a0cd88f6-fdea-490f-b366-f20730265bb3 on nch2-master-1 Oct 01 21:26:33.398666 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9b2683c5-c429-480d-b214-7b5796b35e7e req-dfb26a30-c591-49c3-9c1e-be57e06a9d3c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039011 Oct 01 21:26:33.400028 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3838/5686] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:26:33.961538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:33.962153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:33.969682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:33.971116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:33.971567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:33.972289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:33.972759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:33.973524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:34.119408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:34.127895 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ace81628-d983-424e-a557-3a2a1c2350fe tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1318 microversion: 2.1 time: 0.170325 Oct 01 21:26:34.128570 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1849/5687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:33 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:35.152184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:26:35.152924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:35.160068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:35.160574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:35.161026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:35.161732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:35.162203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:35.162670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:35.371616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:26:35.379914 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b49d498-318b-4058-abeb-507306311ff3 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1507 microversion: 2.1 time: 0.232595 Oct 01 21:26:35.380527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3839/5688] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:26:35 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:26:35.405653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-08428f75-77f3-4483-9ef8-fab8304fd8b8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cda29501-6dd8-4f2b-ba75-8cb61dc80464", "device": "/dev/sdb"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:26:35.408176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-08428f75-77f3-4483-9ef8-fab8304fd8b8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:26:35.415467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08428f75-77f3-4483-9ef8-fab8304fd8b8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:35.416217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08428f75-77f3-4483-9ef8-fab8304fd8b8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:35.416824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08428f75-77f3-4483-9ef8-fab8304fd8b8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:35.417543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08428f75-77f3-4483-9ef8-fab8304fd8b8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:26:35.418009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08428f75-77f3-4483-9ef8-fab8304fd8b8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:26:35.418443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08428f75-77f3-4483-9ef8-fab8304fd8b8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:26:35.485124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:26:35.507975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:26:35.669271 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-08428f75-77f3-4483-9ef8-fab8304fd8b8 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "POST /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268678 Oct 01 21:26:35.670221 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1850/5689] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:26:35 2022] POST /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:27:35.159508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:27:35.160364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=22 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:27:35.161527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:27:35.166671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-299381157", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-78231844", "security_groups": [{"name": "tempest-secgroup-smoke-1901537890"}], "block_device_mapping_v2": [{"uuid": "a61c69d6-7d79-413d-87ad-e254e121f623", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4a3c030a-8624-4d4f-bb7a-67548024ff58"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:27:35.292263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] validate_networks() for [('4a3c030a-8624-4d4f-bb7a-67548024ff58', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:27:36.054209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:27:36.054716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:27:36.055222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:27:36.055664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:27:36.056104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:27:36.065827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:36.066335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:36.066839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:36.067603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:36.068085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:36.068535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:36.085712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:27:36.091600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Getting quotas for user eb0bf5fce885439eaa16a0871c2992ac and project df0e56b020444dd28af868590b1bccf4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:27:36.150654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:27:36.152833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a61c69d6-7d79-413d-87ad-e254e121f623',volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:27:36.287775 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e3d862e7-c25f-443b-bc48-e586196482bf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.130062 Oct 01 21:27:36.288451 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3840/5690] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:27:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:27:36.299902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:27:36.300722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:27:36.302039 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:27:36.319221 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:27:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 (ip 10.222.0.17) !!! Oct 01 21:27:36.328421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-09f210cf-571f-4951-bcae-08416a9070c9 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:36.329134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-09f210cf-571f-4951-bcae-08416a9070c9 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:36.397735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-09f210cf-571f-4951-bcae-08416a9070c9 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:36.405406 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-09f210cf-571f-4951-bcae-08416a9070c9 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1092 microversion: 2.1 time: 0.108762 Oct 01 21:27:36.406096 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1851/5691] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:36 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1092 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:37.430319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:37.431765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:37.438761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:37.440930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:37.440930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:37.441878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:37.442958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:37.443747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:37.547419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:37.556521 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cacd0a46-ac52-4ebd-9c20-741e5e8d0545 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1208 microversion: 2.1 time: 0.131059 Oct 01 21:27:37.557581 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3841/5692] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:37 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1208 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:38.582607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:38.583852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:38.598280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:38.598821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:38.599269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:38.604330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:38.604856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:38.605316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:38.782009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:38.790809 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bdb97633-1d34-4b4d-be76-cbe5c2f5475b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1276 microversion: 2.1 time: 0.213669 Oct 01 21:27:38.791474 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1852/5693] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:38 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:38.875783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1a3721d6-8cdf-4763-b8d4-5ed8c718b34b req-cf71ca13-9e25-45a0-a259-087a5d718038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8354cd48-7193-4d57-bb9a-3ca629823325", "tag": "cf0bcc2a-8144-4744-85ac-0849c4d8d290"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:27:38.886920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a3721d6-8cdf-4763-b8d4-5ed8c718b34b req-cf71ca13-9e25-45a0-a259-087a5d718038 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:38.887455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a3721d6-8cdf-4763-b8d4-5ed8c718b34b req-cf71ca13-9e25-45a0-a259-087a5d718038 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:38.888599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1a3721d6-8cdf-4763-b8d4-5ed8c718b34b req-cf71ca13-9e25-45a0-a259-087a5d718038 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:38.900112 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1a3721d6-8cdf-4763-b8d4-5ed8c718b34b req-cf71ca13-9e25-45a0-a259-087a5d718038 service nova] Creating event network-changed:cf0bcc2a-8144-4744-85ac-0849c4d8d290 for instance 8354cd48-7193-4d57-bb9a-3ca629823325 on nch1-master-1 Oct 01 21:27:38.905063 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1a3721d6-8cdf-4763-b8d4-5ed8c718b34b req-cf71ca13-9e25-45a0-a259-087a5d718038 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034003 Oct 01 21:27:38.905640 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3842/5694] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:27:39.814170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:39.814757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:39.821718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:39.822195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:39.822699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:39.823406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:39.823874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:39.824305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:39.958150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:39.967061 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-264e3606-311c-4305-a35e-8eb619de495f tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1264 microversion: 2.1 time: 0.157568 Oct 01 21:27:39.967768 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1853/5695] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:39 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:40.991548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:40.992270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:40.999165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:40.999851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:41.000320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:41.001045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:41.001528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:41.001972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:41.146370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:41.157188 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d226749c-2d6e-4581-95fe-03dd33535098 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1264 microversion: 2.1 time: 0.170515 Oct 01 21:27:41.157793 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3843/5696] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:40 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:42.181324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:42.181931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:42.189335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:42.189832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:42.190277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:42.191009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:42.191473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:42.191903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:42.334542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:42.344842 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-642d508e-6216-4e7e-ad49-ddd253cc5271 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1264 microversion: 2.1 time: 0.167499 Oct 01 21:27:42.345623 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1854/5697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:42 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:43.368820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:43.369449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:43.376562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:43.377131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:43.377769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:43.378580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:43.379001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:43.379440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:43.456441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7b02dda9-51c7-4af1-966d-ad6a9d99ad66 req-2a9c999d-5b1c-431c-8946-1ae3d1251726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8354cd48-7193-4d57-bb9a-3ca629823325", "name": "network-vif-plugged", "status": "completed", "tag": "cf0bcc2a-8144-4744-85ac-0849c4d8d290"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:27:43.471816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7b02dda9-51c7-4af1-966d-ad6a9d99ad66 req-2a9c999d-5b1c-431c-8946-1ae3d1251726 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:43.473287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7b02dda9-51c7-4af1-966d-ad6a9d99ad66 req-2a9c999d-5b1c-431c-8946-1ae3d1251726 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:43.473890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7b02dda9-51c7-4af1-966d-ad6a9d99ad66 req-2a9c999d-5b1c-431c-8946-1ae3d1251726 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:43.491989 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7b02dda9-51c7-4af1-966d-ad6a9d99ad66 req-2a9c999d-5b1c-431c-8946-1ae3d1251726 service nova] Creating event network-vif-plugged:cf0bcc2a-8144-4744-85ac-0849c4d8d290 for instance 8354cd48-7193-4d57-bb9a-3ca629823325 on nch1-master-1 Oct 01 21:27:43.500319 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7b02dda9-51c7-4af1-966d-ad6a9d99ad66 req-2a9c999d-5b1c-431c-8946-1ae3d1251726 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050908 Oct 01 21:27:43.501444 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1855/5698] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:27:43.550102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:43.569750 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a1bcf11-9038-45ff-91a5-1847e32b0bec tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1264 microversion: 2.1 time: 0.204601 Oct 01 21:27:43.577448 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3844/5699] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:43 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:44.602378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:44.603055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:44.610177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:44.610739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:44.611189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:44.611916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:44.612377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:44.612805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:44.755955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:44.765794 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4c94df40-1dbb-4193-8513-67951358ccfa tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1264 microversion: 2.1 time: 0.168480 Oct 01 21:27:44.766385 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1856/5700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:44 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:45.789903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:45.790584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:45.797740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:45.798248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:45.798742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:45.799465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:45.799945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:45.800393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:45.932753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:45.941096 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1403cd8e-819a-4042-bbcd-bfb5604ac502 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1450 microversion: 2.1 time: 0.155169 Oct 01 21:27:45.941682 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3845/5701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:45 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:45.963973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:27:45.964598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:27:45.971469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:45.971965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:45.972402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:45.973103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:45.973561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:45.973988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:46.110694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:27:46.118621 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-028e62ed-1e4e-4360-beaf-2aed825fcc07 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1450 microversion: 2.1 time: 0.158439 Oct 01 21:27:46.119200 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1857/5702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:27:45 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:27:48.060471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3b008cd6-652e-4204-9bef-5f5eefd6549a req-f6e809b7-e647-473f-a0b7-4b2e1a7702cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8354cd48-7193-4d57-bb9a-3ca629823325", "tag": "cf0bcc2a-8144-4744-85ac-0849c4d8d290"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:27:48.066210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:27:48.067129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:27:48.076637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3b008cd6-652e-4204-9bef-5f5eefd6549a req-f6e809b7-e647-473f-a0b7-4b2e1a7702cd service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:27:48.077635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3b008cd6-652e-4204-9bef-5f5eefd6549a req-f6e809b7-e647-473f-a0b7-4b2e1a7702cd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:27:48.078248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3b008cd6-652e-4204-9bef-5f5eefd6549a req-f6e809b7-e647-473f-a0b7-4b2e1a7702cd service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:27:48.093585 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3b008cd6-652e-4204-9bef-5f5eefd6549a req-f6e809b7-e647-473f-a0b7-4b2e1a7702cd service nova] Creating event network-changed:cf0bcc2a-8144-4744-85ac-0849c4d8d290 for instance 8354cd48-7193-4d57-bb9a-3ca629823325 on nch1-master-1 Oct 01 21:27:48.100238 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3b008cd6-652e-4204-9bef-5f5eefd6549a req-f6e809b7-e647-473f-a0b7-4b2e1a7702cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043393 Oct 01 21:27:48.100856 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3846/5703] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:28:06.909239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:06.912027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=16 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:06.913156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=32 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:07.147663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-87c917ae-1d61-4611-96de-63ce17114be8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Action: 'create', calling method: .version_select at 0x7f41736dcee0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1105539429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXFa3TJR65vmPb37U8CPhaKh9e0X3TOd+orS9uPN2AM6c/nLACWbmprbUy8J4FpS3fccRhQr8en0XUz1JjqJauOIi7HroJjL8wNuZ69Hx4nkN/70Gqoh8qebskNuTbzCg=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:28:07.166527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-87c917ae-1d61-4611-96de-63ce17114be8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Getting quotas for project ff07b6ab40b84bd18a5a44deb9516f00. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:28:07.174393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-87c917ae-1d61-4611-96de-63ce17114be8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Getting quotas for user 1c1fc5de87ed44e7b01229925bf27242 and project ff07b6ab40b84bd18a5a44deb9516f00. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:28:07.211175 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-87c917ae-1d61-4611-96de-63ce17114be8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.306889 Oct 01 21:28:07.213593 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1858/5704] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:28:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:28:08.465396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:08.468052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=30 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:08.473586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1557420740", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1105539429", "security_groups": [{"name": "tempest-secgroup-smoke-1657366112"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "4426f056-db1f-4d59-9915-fadb5fa9da20"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:28:08.613694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] validate_networks() for [('4426f056-db1f-4d59-9915-fadb5fa9da20', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:28:09.065343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Getting quotas for project ff07b6ab40b84bd18a5a44deb9516f00. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:28:09.070773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Getting quotas for user 1c1fc5de87ed44e7b01229925bf27242 and project ff07b6ab40b84bd18a5a44deb9516f00. Resources: dict_keys(['metadata_items']) {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:28:09.084942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:28:09.085983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:28:09.086516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:28:09.086962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:28:09.087409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:28:09.096345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:09.096882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:09.097349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:09.098108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:09.098613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:09.099063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:09.118076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Getting quotas for project ff07b6ab40b84bd18a5a44deb9516f00. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:28:09.124579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Getting quotas for user 1c1fc5de87ed44e7b01229925bf27242 and project ff07b6ab40b84bd18a5a44deb9516f00. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:28:09.140118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:28:09.142882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:28:09.201506 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd069bae-a045-4b32-9d4e-6c1b0d4e5781 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737603 Oct 01 21:28:09.202240 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3847/5705] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:28:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:28:09.213691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2064e1ae-ce7d-43d7-bf87-b477fa9e3d87 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:09.214510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2064e1ae-ce7d-43d7-bf87-b477fa9e3d87 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:09.285086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2064e1ae-ce7d-43d7-bf87-b477fa9e3d87 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:09.296190 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2064e1ae-ce7d-43d7-bf87-b477fa9e3d87 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1303 microversion: 2.1 time: 0.086361 Oct 01 21:28:09.296868 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1859/5706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:09 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:10.323782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:10.324767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:10.334258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:10.335063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:10.335741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:10.336631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:10.337223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:10.337755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:10.457583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:10.469598 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a6ead0a5-41f7-464d-9634-44b05c9dec97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1363 microversion: 2.1 time: 0.151185 Oct 01 21:28:10.470622 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3848/5707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:10 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:11.498685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:11.499315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:11.506656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:11.507160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:11.507603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:11.508324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:11.508904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:11.509548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:11.771871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:11.783199 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e74e2cf9-22ac-4d05-94ca-5f6a93f7b713 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1429 microversion: 2.1 time: 0.288584 Oct 01 21:28:11.784099 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1860/5708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:11 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1429 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:11.948712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0fc51b18-0998-4692-83f4-d646501c942a req-32860cad-e15a-4b34-bbaf-216eda5d90d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc716d95-94d8-45be-9e12-e437f6726f9c", "tag": "2c4753cb-aa83-406a-baa9-bb8feeb120d4"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:28:11.975566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0fc51b18-0998-4692-83f4-d646501c942a req-32860cad-e15a-4b34-bbaf-216eda5d90d1 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:11.976945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0fc51b18-0998-4692-83f4-d646501c942a req-32860cad-e15a-4b34-bbaf-216eda5d90d1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:11.977975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0fc51b18-0998-4692-83f4-d646501c942a req-32860cad-e15a-4b34-bbaf-216eda5d90d1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:11.993992 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0fc51b18-0998-4692-83f4-d646501c942a req-32860cad-e15a-4b34-bbaf-216eda5d90d1 service nova] Creating event network-changed:2c4753cb-aa83-406a-baa9-bb8feeb120d4 for instance fc716d95-94d8-45be-9e12-e437f6726f9c on nch2-master-1 Oct 01 21:28:12.002152 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0fc51b18-0998-4692-83f4-d646501c942a req-32860cad-e15a-4b34-bbaf-216eda5d90d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056749 Oct 01 21:28:12.003067 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3849/5709] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:28:12.806987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:12.807685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:12.815439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:12.815959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:12.816397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:12.817099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:12.817556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:12.817983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:12.956227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:12.964967 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-24dcf5d8-9371-4236-b2bc-3e736d3d49de tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1429 microversion: 2.1 time: 0.161921 Oct 01 21:28:12.965564 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1861/5710] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:12 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1429 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:13.989845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:13.990587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:13.997525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:13.998120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:13.998653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:14.000036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:14.000591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:14.001065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:14.159468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:14.167965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bddc5f44-d48d-491d-81c7-a6d40c600186 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1429 microversion: 2.1 time: 0.182434 Oct 01 21:28:14.168551 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3850/5711] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:13 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1429 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:15.066468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:15.067215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:15.074971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:15.075465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:15.075936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:15.076726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:15.077433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:15.077947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:15.171272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lazy-loading 'services' on Instance uuid a0cd88f6-fdea-490f-b366-f20730265bb3 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:28:15.193521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:15.194283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:15.201674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:15.202754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:15.203231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:15.203971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:15.204485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:15.204944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:15.245923 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b6c8b6a9-a677-4211-9047-960cdcf1843a tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3/os-volume_attachments/cda29501-6dd8-4f2b-ba75-8cb61dc80464" status: 202 len: 0 microversion: 2.1 time: 0.183772 Oct 01 21:28:15.246870 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1862/5712] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:28:15 2022] DELETE /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3/os-volume_attachments/cda29501-6dd8-4f2b-ba75-8cb61dc80464 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:28:15.351339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:15.360033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2fbe1888-1dc2-4eb9-8a31-93fdbf036c0c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1429 microversion: 2.1 time: 0.170833 Oct 01 21:28:15.360615 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3851/5713] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:15 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1429 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:28:15.888411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f9627f1d-77d1-49cf-85db-9fa1af09b59d req-c7cc1a31-2095-4706-afbd-49d69bb938f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc716d95-94d8-45be-9e12-e437f6726f9c", "name": "network-vif-plugged", "status": "completed", "tag": "2c4753cb-aa83-406a-baa9-bb8feeb120d4"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:28:15.903471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f9627f1d-77d1-49cf-85db-9fa1af09b59d req-c7cc1a31-2095-4706-afbd-49d69bb938f2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:15.904076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f9627f1d-77d1-49cf-85db-9fa1af09b59d req-c7cc1a31-2095-4706-afbd-49d69bb938f2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:15.904584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f9627f1d-77d1-49cf-85db-9fa1af09b59d req-c7cc1a31-2095-4706-afbd-49d69bb938f2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:15.919583 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f9627f1d-77d1-49cf-85db-9fa1af09b59d req-c7cc1a31-2095-4706-afbd-49d69bb938f2 service nova] Creating event network-vif-plugged:2c4753cb-aa83-406a-baa9-bb8feeb120d4 for instance fc716d95-94d8-45be-9e12-e437f6726f9c on nch2-master-1 Oct 01 21:28:15.924869 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f9627f1d-77d1-49cf-85db-9fa1af09b59d req-c7cc1a31-2095-4706-afbd-49d69bb938f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041871 Oct 01 21:28:15.925490 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1863/5714] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:28:16.378512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:16.379170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:16.383417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:16.384250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:16.386192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:16.386746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:16.387214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:16.387969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:16.388447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:16.389017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:16.391362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:16.391860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:16.392316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:16.393013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:16.393470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:16.393931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:16.415481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:28:16.495649 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e161181e-e70a-47f1-b5d3-7b2df0466b5d tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 204 len: 0 microversion: 2.1 time: 0.120779 Oct 01 21:28:16.496253 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3852/5715] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:28:16 2022] DELETE /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:28:16.504629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:16.505547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:16.513014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:16.513545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:16.513984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:16.514760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:16.515230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:16.515681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:16.539094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:16.548830 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ac30bb66-3660-4998-bc69-2017f3857aee tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1429 microversion: 2.1 time: 0.170146 Oct 01 21:28:16.549429 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1864/5716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:16 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1429 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:28:16.651580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:16.660733 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88388251-da01-44ec-9c4e-4344e584cfdd tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1513 microversion: 2.1 time: 0.160110 Oct 01 21:28:16.661299 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3853/5717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:16 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:28:17.571917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:17.572543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:17.579790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:17.580289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:17.580742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:17.581448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:17.581917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:17.582355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:17.683812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:17.684454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:17.692053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:17.692568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:17.693030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:17.693755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:17.694237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:17.694773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:17.712337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:17.720249 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1aa1ebbb-9878-45e3-8c4c-9b28b2f3d89e tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1429 microversion: 2.1 time: 0.152277 Oct 01 21:28:17.720829 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1865/5718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:17 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1429 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:18.111461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:18.119697 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-97ab7be4-d1fd-4ff8-94d3-747d6116d600 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1513 microversion: 2.1 time: 0.439702 Oct 01 21:28:18.120479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3854/5719] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:17 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1513 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:28:18.743499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:18.744126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:18.751585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:18.752084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:18.752529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:18.753236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:18.753699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:18.754138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:18.957934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:18.966237 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-920c3871-8534-484d-99d0-f2bfa6f41ee2 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1609 microversion: 2.1 time: 0.226745 Oct 01 21:28:18.966873 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1866/5720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:18 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1609 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:18.989202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:18.989843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:18.997092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:18.997608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:18.998072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:18.998850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:18.999886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:19.000340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:19.105710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:19.107762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-3632a48a-c8aa-416e-aa9a-159827909998 req-33a470ce-de59-4bcb-a5e0-806ac8cccc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cd88f6-fdea-490f-b366-f20730265bb3", "name": "network-vif-deleted", "tag": "28da0d53-3db0-489a-a20e-84cff006ecbe"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:28:19.120584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3632a48a-c8aa-416e-aa9a-159827909998 req-33a470ce-de59-4bcb-a5e0-806ac8cccc3a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:19.121078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3632a48a-c8aa-416e-aa9a-159827909998 req-33a470ce-de59-4bcb-a5e0-806ac8cccc3a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:19.121549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3632a48a-c8aa-416e-aa9a-159827909998 req-33a470ce-de59-4bcb-a5e0-806ac8cccc3a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:19.134181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:19.134622 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-3632a48a-c8aa-416e-aa9a-159827909998 req-33a470ce-de59-4bcb-a5e0-806ac8cccc3a service nova] Creating event network-vif-deleted:28da0d53-3db0-489a-a20e-84cff006ecbe for instance a0cd88f6-fdea-490f-b366-f20730265bb3 on nch2-master-1 Oct 01 21:28:19.140892 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-3632a48a-c8aa-416e-aa9a-159827909998 req-33a470ce-de59-4bcb-a5e0-806ac8cccc3a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037569 Oct 01 21:28:19.142054 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1867/5721] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:28:19.150288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:19.151702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:19.159324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:19.159823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:19.160438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:19.161462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:19.162081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:19.162703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:19.163815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:19.173915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-04dd0b29-8e9c-44bb-a5e8-2a9cc41e39f1 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1609 microversion: 2.1 time: 0.188746 Oct 01 21:28:19.174802 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3855/5722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:18 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1609 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:19.199418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:19.200612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:19.208021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:19.208615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:19.209176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:19.210129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:19.210629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:19.211078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:19.243349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98361240b014405cb20cf9c145061be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6e51791d934c73bf7d92e7ed1a8909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:19.253723 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d8a525a2-1dbd-491c-8343-cd49f3429145 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 200 len: 1303 microversion: 2.1 time: 0.110419 Oct 01 21:28:19.255517 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1868/5723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:19 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:19.352903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:28:19.361483 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95877752-4e19-47fd-a91a-4b30da7f3d17 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1609 microversion: 2.1 time: 0.167172 Oct 01 21:28:19.362060 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3856/5724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:19 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1609 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:28:20.277424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:20.278044 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] [instance: a0cd88f6-fdea-490f-b366-f20730265bb3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:20.280127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:20.286649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:20.287143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:20.287582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:20.288287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:20.288746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:20.289180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:20.303326 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] HTTP exception thrown: Instance a0cd88f6-fdea-490f-b366-f20730265bb3 could not be found. Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Request method failure captured: Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 HTTP/1.1 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK_245S8cnMMKJzeOfdbHMjSaMxgazH-RCTZmqSB4EWdFuQz-QotaGs4ASiUAy-yw4zzuaHpS9oIoKCSj9be9OKCxT3WsqIzSDz7UFQQ8Kpf0Orss80zclWQhpG93VX4_yhj1BwlHK0f-VwqR1_74pshCjCmxg4QcTwP9XnPrJ3xPtU Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: dd6e51791d934c73bf7d92e7ed1a8909 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1103874744 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dd6e51791d934c73bf7d92e7ed1a8909", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd6e51791d934c73bf7d92e7ed1a8909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dd6e51791d934c73bf7d92e7ed1a8909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd6e51791d934c73bf7d92e7ed1a8909"}]}] Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-VolumesSnapshotTestJSON-1103874744 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: dd6e51791d934c73bf7d92e7ed1a8909 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1103874744 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-VolumesSnapshotTestJSON-1103874744-project Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 98361240b014405cb20cf9c145061be6 Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-VolumesSnapshotTestJSON-1103874744-project Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance a0cd88f6-fdea-490f-b366-f20730265bb3 could not be found. Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'a0cd88f6-fdea-490f-b366-f20730265bb3'} Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0cd88f6-fdea-490f-b366-f20730265bb3 could not be found. Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0cd88f6-fdea-490f-b366-f20730265bb3 could not be found. Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:28:20.304914 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0cd88f6-fdea-490f-b366-f20730265bb3 could not be found. Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] Returning 404 to user: Instance a0cd88f6-fdea-490f-b366-f20730265bb3 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-688d2ef5-ea7c-4224-a1d0-277a0d5d3708 tempest-VolumesSnapshotTestJSON-1103874744 tempest-VolumesSnapshotTestJSON-1103874744-project] 10.222.0.17 "GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3" status: 404 len: 111 microversion: 2.1 time: 0.032957 Oct 01 21:28:20.309312 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1869/5725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:28:20 2022] GET /compute/v2.1/servers/a0cd88f6-fdea-490f-b366-f20730265bb3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:28:21.083038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2aaa931b-1cff-42ac-9e44-51fa85b48240 req-c89b119d-754a-4af0-aab9-6b295313bb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc716d95-94d8-45be-9e12-e437f6726f9c", "tag": "2c4753cb-aa83-406a-baa9-bb8feeb120d4"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:28:21.093496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2aaa931b-1cff-42ac-9e44-51fa85b48240 req-c89b119d-754a-4af0-aab9-6b295313bb14 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:21.094075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2aaa931b-1cff-42ac-9e44-51fa85b48240 req-c89b119d-754a-4af0-aab9-6b295313bb14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:21.094625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2aaa931b-1cff-42ac-9e44-51fa85b48240 req-c89b119d-754a-4af0-aab9-6b295313bb14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:21.105802 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2aaa931b-1cff-42ac-9e44-51fa85b48240 req-c89b119d-754a-4af0-aab9-6b295313bb14 service nova] Creating event network-changed:2c4753cb-aa83-406a-baa9-bb8feeb120d4 for instance fc716d95-94d8-45be-9e12-e437f6726f9c on nch2-master-1 Oct 01 21:28:21.111090 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2aaa931b-1cff-42ac-9e44-51fa85b48240 req-c89b119d-754a-4af0-aab9-6b295313bb14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031633 Oct 01 21:28:21.111682 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3857/5726] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:28:56.197356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5758e7ad-0951-48e8-a58e-206050a8a33c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:28:56.197921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5758e7ad-0951-48e8-a58e-206050a8a33c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:28:56.200439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:56.201151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:28:56.206717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5758e7ad-0951-48e8-a58e-206050a8a33c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:56.207219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5758e7ad-0951-48e8-a58e-206050a8a33c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:56.207681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5758e7ad-0951-48e8-a58e-206050a8a33c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:56.208416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5758e7ad-0951-48e8-a58e-206050a8a33c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:28:56.208887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5758e7ad-0951-48e8-a58e-206050a8a33c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:28:56.209362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5758e7ad-0951-48e8-a58e-206050a8a33c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:28:56.238620 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5758e7ad-0951-48e8-a58e-206050a8a33c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.045247 Oct 01 21:28:56.239831 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1870/5727] 10.222.0.17 () {58 vars in 1293 bytes} [Sat Oct 1 21:28:56 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c/os-server-password => generated 116 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:29:28.617141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:29:28.618213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:29:28.619944 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:29:28.620434 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:29:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 (ip 10.222.0.17) !!! Oct 01 21:29:28.622665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-4bebf397-9120-4180-a2d4-9a6947de734c req-e8d3919e-85fa-4281-a94d-746cc27d759e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8354cd48-7193-4d57-bb9a-3ca629823325", "tag": "cf0bcc2a-8144-4744-85ac-0849c4d8d290"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:29:28.626090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:29:28.626673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:29:28.632394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:29:28.633276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=4 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:29:28.634608 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:29:28.634943 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:29:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 01 21:29:28.637991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4bebf397-9120-4180-a2d4-9a6947de734c req-e8d3919e-85fa-4281-a94d-746cc27d759e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:28.638769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4bebf397-9120-4180-a2d4-9a6947de734c req-e8d3919e-85fa-4281-a94d-746cc27d759e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:28.639579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4bebf397-9120-4180-a2d4-9a6947de734c req-e8d3919e-85fa-4281-a94d-746cc27d759e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:28.647554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:28.648079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:28.648540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:28.649771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:28.650240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:28.650876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:28.657517 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-4bebf397-9120-4180-a2d4-9a6947de734c req-e8d3919e-85fa-4281-a94d-746cc27d759e service nova] Creating event network-changed:cf0bcc2a-8144-4744-85ac-0849c4d8d290 for instance 8354cd48-7193-4d57-bb9a-3ca629823325 on nch1-master-1 Oct 01 21:29:28.664973 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-4bebf397-9120-4180-a2d4-9a6947de734c req-e8d3919e-85fa-4281-a94d-746cc27d759e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046953 Oct 01 21:29:28.666869 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1871/5728] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:29:28.685073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:29:28.773317 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d408449e-eaeb-4383-ba1b-d08421f3395e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 204 len: 0 microversion: 2.1 time: 0.158067 Oct 01 21:29:28.778361 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3858/5729] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:29:28 2022] DELETE /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:29:28.784720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:29:28.785536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:29:28.792646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:28.793216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:28.794257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:28.794584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:28.795112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:28.795613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:28.937012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:29:28.945902 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-26b13e33-d69b-40b1-ac65-79f29e1a45cf tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1574 microversion: 2.1 time: 0.166429 Oct 01 21:29:28.947001 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1872/5730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:29:28 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:29:29.971650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:29:29.972382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:29:29.979529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:29.980043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:29.980509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:29.981242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:29.981730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:29.982183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:30.288633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:29:30.297354 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba3ee2d7-35a0-4236-8dcc-3249b1bab886 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1574 microversion: 2.1 time: 0.330097 Oct 01 21:29:30.297979 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3859/5731] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:29:29 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1574 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:29:30.764362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-0351f9cf-9887-4637-83b3-2f3f6703f9b1 req-7d374d58-4839-477b-bc07-238d7c980469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8354cd48-7193-4d57-bb9a-3ca629823325", "name": "network-vif-deleted", "tag": "cf0bcc2a-8144-4744-85ac-0849c4d8d290"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:29:30.776308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0351f9cf-9887-4637-83b3-2f3f6703f9b1 req-7d374d58-4839-477b-bc07-238d7c980469 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:30.776797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0351f9cf-9887-4637-83b3-2f3f6703f9b1 req-7d374d58-4839-477b-bc07-238d7c980469 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:30.777262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0351f9cf-9887-4637-83b3-2f3f6703f9b1 req-7d374d58-4839-477b-bc07-238d7c980469 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:30.789369 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-0351f9cf-9887-4637-83b3-2f3f6703f9b1 req-7d374d58-4839-477b-bc07-238d7c980469 service nova] Creating event network-vif-deleted:cf0bcc2a-8144-4744-85ac-0849c4d8d290 for instance 8354cd48-7193-4d57-bb9a-3ca629823325 on nch1-master-1 Oct 01 21:29:30.794855 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-0351f9cf-9887-4637-83b3-2f3f6703f9b1 req-7d374d58-4839-477b-bc07-238d7c980469 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034170 Oct 01 21:29:30.795467 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1873/5732] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:29:31.321829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:29:31.322463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:29:31.329301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:31.329805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:31.330259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:31.331003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:31.331481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:31.331927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:31.372833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:31.373454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:31.373920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:31.374400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lazy-loading 'fault' on Instance uuid 8354cd48-7193-4d57-bb9a-3ca629823325 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:29:31.695973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:29:31.703659 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-16df60ac-81a2-465d-98f6-cc056d60f12b tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 200 len: 1182 microversion: 2.1 time: 0.386333 Oct 01 21:29:31.704460 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3860/5733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:29:31 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 1182 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:29:32.728554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:29:32.729889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 8354cd48-7193-4d57-bb9a-3ca629823325] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:29:32.736315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:32.736813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:32.737258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:32.737962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:29:32.738424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:29:32.738882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:29:32.752158 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 8354cd48-7193-4d57-bb9a-3ca629823325 could not be found. Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 HTTP/1.1 Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 8354cd48-7193-4d57-bb9a-3ca629823325 could not be found. Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '8354cd48-7193-4d57-bb9a-3ca629823325'} Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8354cd48-7193-4d57-bb9a-3ca629823325 could not be found. Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8354cd48-7193-4d57-bb9a-3ca629823325 could not be found. Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:29:32.753763 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8354cd48-7193-4d57-bb9a-3ca629823325 could not be found. Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 8354cd48-7193-4d57-bb9a-3ca629823325 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6420e6e1-2a68-46ce-9d08-3c3e1afb2fdb tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325" status: 404 len: 111 microversion: 2.1 time: 0.031809 Oct 01 21:29:32.758574 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1874/5734] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:29:32 2022] GET /compute/v2.1/servers/8354cd48-7193-4d57-bb9a-3ca629823325 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:30:05.634836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:30:05.635345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:30:05.638524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:30:05.639185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f28f14fb-162a-44d4-83d7-3133cefddb5c req-0bfb13e7-4288-47a0-95d0-770794b2f0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677", "tag": "9a487a9f-53a0-460a-8557-d29ccbdfd254"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:30:05.639593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:30:05.644555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:05.644817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:30:05.645076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:05.645509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=12 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:30:05.645630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:05.646369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:05.646836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:05.647239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:05.651818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f28f14fb-162a-44d4-83d7-3133cefddb5c req-0bfb13e7-4288-47a0-95d0-770794b2f0be service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:05.652308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f28f14fb-162a-44d4-83d7-3133cefddb5c req-0bfb13e7-4288-47a0-95d0-770794b2f0be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:05.652858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f28f14fb-162a-44d4-83d7-3133cefddb5c req-0bfb13e7-4288-47a0-95d0-770794b2f0be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:05.665581 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f28f14fb-162a-44d4-83d7-3133cefddb5c req-0bfb13e7-4288-47a0-95d0-770794b2f0be service nova] Creating event network-changed:9a487a9f-53a0-460a-8557-d29ccbdfd254 for instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 on nch1-master-1 Oct 01 21:30:05.670786 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f28f14fb-162a-44d4-83d7-3133cefddb5c req-0bfb13e7-4288-47a0-95d0-770794b2f0be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036263 Oct 01 21:30:05.671415 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1875/5735] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:30:05.676999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:30:05.778375 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b2857e25-cfdf-465c-b7df-b332c2b8a31a tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 204 len: 0 microversion: 2.1 time: 0.146848 Oct 01 21:30:05.779136 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3861/5736] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:30:05 2022] DELETE /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:30:05.788059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:30:05.788776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:30:05.795097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:05.795862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:05.796314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:05.797293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:05.797759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:05.798409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:05.997345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:30:06.005660 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0eb81a57-805a-4245-8d39-4ce04d374b0c tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1576 microversion: 2.1 time: 0.221905 Oct 01 21:30:06.006271 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1876/5737] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:30:05 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:30:07.029764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:30:07.030603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:30:07.037903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:07.038426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:07.038896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:07.039618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:07.040143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:07.040595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:07.268130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:30:07.277846 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e70c7561-8c3b-48e1-9380-26db8fe49025 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1576 microversion: 2.1 time: 0.252520 Oct 01 21:30:07.278818 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3862/5738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:30:07 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:30:08.126430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-0f130fd0-4d67-44f3-8674-42de82884bb9 req-d8df5124-9fdd-472c-86fa-53d725011043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677", "name": "network-vif-deleted", "tag": "9a487a9f-53a0-460a-8557-d29ccbdfd254"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:30:08.136745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0f130fd0-4d67-44f3-8674-42de82884bb9 req-d8df5124-9fdd-472c-86fa-53d725011043 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:08.137244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0f130fd0-4d67-44f3-8674-42de82884bb9 req-d8df5124-9fdd-472c-86fa-53d725011043 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:08.137690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0f130fd0-4d67-44f3-8674-42de82884bb9 req-d8df5124-9fdd-472c-86fa-53d725011043 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:08.148852 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-0f130fd0-4d67-44f3-8674-42de82884bb9 req-d8df5124-9fdd-472c-86fa-53d725011043 service nova] Creating event network-vif-deleted:9a487a9f-53a0-460a-8557-d29ccbdfd254 for instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 on nch1-master-1 Oct 01 21:30:08.154786 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-0f130fd0-4d67-44f3-8674-42de82884bb9 req-d8df5124-9fdd-472c-86fa-53d725011043 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105810 Oct 01 21:30:08.155514 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1877/5739] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:30:08.301511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:30:08.302755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:30:08.310577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:08.311093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:08.311554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:08.312336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:08.312817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:08.313434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:08.348643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:08.349227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:08.349709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:08.350192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lazy-loading 'fault' on Instance uuid cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:30:08.404148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0bf5fce885439eaa16a0871c2992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e56b020444dd28af868590b1bccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:30:08.414050 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7546b70-4363-4061-bd65-654cbcf5a3ed tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 200 len: 1229 microversion: 2.1 time: 0.116595 Oct 01 21:30:08.414922 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3863/5740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:30:08 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:30:09.438781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:30:09.439533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:30:09.445857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:09.446352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:09.446836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:09.447543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:09.448007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:09.448443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:09.461783 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 could not be found. Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 HTTP/1.1 Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 could not be found. Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677'} Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 could not be found. Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 could not be found. Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:30:09.463440 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 could not be found. Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7a3b663e-313a-4e4b-a993-ad6f0d50d322 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677" status: 404 len: 111 microversion: 2.1 time: 0.031722 Oct 01 21:30:09.468719 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1878/5741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:30:09 2022] GET /compute/v2.1/servers/cc5134ee-b8d8-46d3-a8d8-fb3d58fdc677 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:30:10.173414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:30:10.173946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:30:10.180793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:10.181295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:10.181751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:10.182464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:10.183494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:10.183944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:10.198462 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 HTTP/1.1 Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '705efbe6-8a41-4a4b-8308-aacfce5ae9c0'} Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:30:10.200809 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8ce9aeba-2197-4cc9-a570-d96e9e3d9d50 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 404 len: 111 microversion: 2.1 time: 0.033109 Oct 01 21:30:10.204953 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3864/5742] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:30:10 2022] DELETE /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:30:10.211174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:30:10.211802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] [instance: 705efbe6-8a41-4a4b-8308-aacfce5ae9c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:30:10.217874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:10.218362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:10.218837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:10.219538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:30:10.220000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:30:10.220429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:30:10.233747 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] HTTP exception thrown: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Request method failure captured: Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 HTTP/1.1 Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOK83JNoB-ocOxqDEshJhY7wtOZzYb4gjH6KlJp1WRsO0KGVw8ZuecL4Drk2bAYK95Q9ZnQGnIdQ9ubw1qYh5-0I0pNEQ2Uh4uSpav5Cf8G1kEqLxAUn2jkvz1agHIY-cxE74zOpfaA0RhUXtZdWOgbvFLxUn5-BdMYGRSMXP2rpKCCg Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df0e56b020444dd28af868590b1bccf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df0e56b020444dd28af868590b1bccf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df0e56b020444dd28af868590b1bccf4"}]}] Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: df0e56b020444dd28af868590b1bccf4 Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestVolumeBootPattern-1545759599 Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: eb0bf5fce885439eaa16a0871c2992ac Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestVolumeBootPattern-1545759599-project Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '705efbe6-8a41-4a4b-8308-aacfce5ae9c0'} Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:30:10.235312 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Returning 404 to user: Instance 705efbe6-8a41-4a4b-8308-aacfce5ae9c0 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1f073acd-61a4-4a3a-8322-309fe0054f70 tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0" status: 404 len: 111 microversion: 2.1 time: 0.029481 Oct 01 21:30:10.240319 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1879/5743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:30:10 2022] GET /compute/v2.1/servers/705efbe6-8a41-4a4b-8308-aacfce5ae9c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:30:12.582754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0d6752ba-2a3c-4904-a6a7-97642c22287e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] Calling method '.version_select at 0x7f4172ff2f70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:30:12.609260 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0d6752ba-2a3c-4904-a6a7-97642c22287e tempest-TestVolumeBootPattern-1545759599 tempest-TestVolumeBootPattern-1545759599-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-78231844" status: 202 len: 0 microversion: 2.1 time: 0.030313 Oct 01 21:30:12.609905 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3865/5744] 10.222.0.17 () {58 vars in 1257 bytes} [Sat Oct 1 21:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-78231844 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:32:59.703684 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 01 21:32:59.704668 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6cf13eb0-b69c-4965-a7b8-83d512cc6864] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 01 21:32:59.705185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=10 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:32:59.705908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=14 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:32:59.707218 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 01 21:32:59.707378 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c (ip 10.222.0.17) !!! Oct 01 21:32:59.708371 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:32:59.708497 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c (ip 10.222.0.17) !!! Oct 01 21:32:59.709567 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 01 21:32:59.709681 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c (ip 10.222.0.17) !!! Oct 01 21:32:59.713693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:32:59.714193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:32:59.728034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:32:59.728520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:32:59.728968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:32:59.729657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:32:59.730114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:32:59.730575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:32:59.758121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:32:59.836033 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ef141ac7-64f1-49c0-9c09-d01841c2dc97 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 204 len: 0 microversion: 2.1 time: 0.134318 Oct 01 21:32:59.836638 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1880/5745] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:32:59 2022] DELETE /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:32:59.843141 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [-] [770c7631-b847-42b2-bd0c-8c7e920b0b1d] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 21:32:59.843976 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74998dba-9c89-4876-a756-a0e4436afa1f] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 21:32:59.844524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:32:59.845278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:32:59.846171 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:32:59.846318 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c (ip 10.222.0.17) !!! Oct 01 21:32:59.847883 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 01 21:32:59.848021 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c (ip 10.222.0.17) !!! Oct 01 21:32:59.849161 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 01 21:32:59.849298 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c (ip 10.222.0.17) !!! Oct 01 21:32:59.854063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:32:59.854726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:32:59.867416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:32:59.867907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:32:59.868348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:32:59.869108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:32:59.869579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:32:59.870022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:00.013163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:00.020931 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e16de234-0b2a-4295-9942-f78b68d94147 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1733 microversion: 2.1 time: 0.179838 Oct 01 21:33:00.021498 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3866/5746] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:32:59 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:01.044646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:01.045836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:01.054855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:01.055346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:01.055792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:01.056494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:01.056949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:01.057374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:01.062926 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54150. Oct 01 21:33:01.065192 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] [6cf13eb0-b69c-4965-a7b8-83d512cc6864] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54152. Oct 01 21:33:01.289439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:01.297470 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9e865d3f-7517-42b3-811a-6db5dedb7635 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1733 microversion: 2.1 time: 0.257066 Oct 01 21:33:01.297987 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1881/5747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:01 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1733 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:01.999208 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] [770c7631-b847-42b2-bd0c-8c7e920b0b1d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54158. Oct 01 21:33:02.000600 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] [74998dba-9c89-4876-a756-a0e4436afa1f] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54160. Oct 01 21:33:02.152956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-e15d53b6-84e6-4ced-a357-3b80e6ee2745 req-3cc54dbc-005f-4f2c-93b7-e19637c516b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc716d95-94d8-45be-9e12-e437f6726f9c", "name": "network-vif-deleted", "tag": "2c4753cb-aa83-406a-baa9-bb8feeb120d4"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:02.179867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e15d53b6-84e6-4ced-a357-3b80e6ee2745 req-3cc54dbc-005f-4f2c-93b7-e19637c516b0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:02.180391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e15d53b6-84e6-4ced-a357-3b80e6ee2745 req-3cc54dbc-005f-4f2c-93b7-e19637c516b0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:02.180857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-e15d53b6-84e6-4ced-a357-3b80e6ee2745 req-3cc54dbc-005f-4f2c-93b7-e19637c516b0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:02.196898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-e15d53b6-84e6-4ced-a357-3b80e6ee2745 req-3cc54dbc-005f-4f2c-93b7-e19637c516b0 service nova] Creating event network-vif-deleted:2c4753cb-aa83-406a-baa9-bb8feeb120d4 for instance fc716d95-94d8-45be-9e12-e437f6726f9c on nch2-master-1 Oct 01 21:33:02.204714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-e15d53b6-84e6-4ced-a357-3b80e6ee2745 req-3cc54dbc-005f-4f2c-93b7-e19637c516b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220537 Oct 01 21:33:02.205596 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3867/5748] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:33:02.321776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:02.322590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:02.329581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:02.330023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:02.330465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:02.331191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:02.332239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:02.332672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:02.364692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:02.365187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:02.365630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:02.366085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lazy-loading 'fault' on Instance uuid fc716d95-94d8-45be-9e12-e437f6726f9c {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:33:02.699855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1fc5de87ed44e7b01229925bf27242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff07b6ab40b84bd18a5a44deb9516f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:02.707204 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cc34cc7a-ae00-45dd-897f-cca2c429b951 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 200 len: 1389 microversion: 2.1 time: 0.389436 Oct 01 21:33:02.707945 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1882/5749] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:02 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 1389 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:03.731029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:03.731759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:03.738001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:03.738523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:03.739000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:03.739714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:03.740192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:03.740640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:03.756901 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] HTTP exception thrown: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Request method failure captured: Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c HTTP/1.1 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLDhtc80EbrkdBcfiqNEjbvrK4FNcsESwGw2rSoV3JX1l6sJxwlkQTIR6OkpHZ9TNvzB11xtlHHSqiGySDaHy_XvLdj_QfP0HnPOxkp5pApnLhrN5peWICaYSJDb8mKaDFqslWUrqq381-9N6HFbHJon-2NfYwafTLkl9F5snxZcgdY Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ff07b6ab40b84bd18a5a44deb9516f00 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestServerBasicOps-2143850883 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff07b6ab40b84bd18a5a44deb9516f00", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff07b6ab40b84bd18a5a44deb9516f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff07b6ab40b84bd18a5a44deb9516f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff07b6ab40b84bd18a5a44deb9516f00"}]}] Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestServerBasicOps-2143850883 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ff07b6ab40b84bd18a5a44deb9516f00 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestServerBasicOps-2143850883 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestServerBasicOps-2143850883-project Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1c1fc5de87ed44e7b01229925bf27242 Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestServerBasicOps-2143850883-project Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'fc716d95-94d8-45be-9e12-e437f6726f9c'} Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:03.758545 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Returning 404 to user: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fa299c43-e324-4f0e-a449-5c848a898eb6 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 404 len: 111 microversion: 2.1 time: 0.034172 Oct 01 21:33:03.763254 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3868/5750] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:03 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:33:04.208829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:04.209347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:04.216258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:04.216756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:04.217207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:04.217916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:04.218385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:04.218855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:04.232136 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] HTTP exception thrown: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Request method failure captured: Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c HTTP/1.1 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLDhtc80EbrkdBcfiqNEjbvrK4FNcsESwGw2rSoV3JX1l6sJxwlkQTIR6OkpHZ9TNvzB11xtlHHSqiGySDaHy_XvLdj_QfP0HnPOxkp5pApnLhrN5peWICaYSJDb8mKaDFqslWUrqq381-9N6HFbHJon-2NfYwafTLkl9F5snxZcgdY Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ff07b6ab40b84bd18a5a44deb9516f00 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestServerBasicOps-2143850883 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff07b6ab40b84bd18a5a44deb9516f00", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff07b6ab40b84bd18a5a44deb9516f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff07b6ab40b84bd18a5a44deb9516f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff07b6ab40b84bd18a5a44deb9516f00"}]}] Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestServerBasicOps-2143850883 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ff07b6ab40b84bd18a5a44deb9516f00 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestServerBasicOps-2143850883 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestServerBasicOps-2143850883-project Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 1c1fc5de87ed44e7b01229925bf27242 Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestServerBasicOps-2143850883-project Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'fc716d95-94d8-45be-9e12-e437f6726f9c'} Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:33:04.233809 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Returning 404 to user: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-82405cfd-bbe0-4d38-9892-f988ecfb876c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 404 len: 111 microversion: 2.1 time: 0.030435 Oct 01 21:33:04.238469 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1883/5751] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:33:04 2022] DELETE /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:33:04.244421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:04.245061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] [instance: fc716d95-94d8-45be-9e12-e437f6726f9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:04.251131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:04.251639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:04.252100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:04.252814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:04.253294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:04.254297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:04.267659 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] HTTP exception thrown: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Request method failure captured: Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c HTTP/1.1 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLDhtc80EbrkdBcfiqNEjbvrK4FNcsESwGw2rSoV3JX1l6sJxwlkQTIR6OkpHZ9TNvzB11xtlHHSqiGySDaHy_XvLdj_QfP0HnPOxkp5pApnLhrN5peWICaYSJDb8mKaDFqslWUrqq381-9N6HFbHJon-2NfYwafTLkl9F5snxZcgdY Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ff07b6ab40b84bd18a5a44deb9516f00 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestServerBasicOps-2143850883 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ff07b6ab40b84bd18a5a44deb9516f00", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff07b6ab40b84bd18a5a44deb9516f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ff07b6ab40b84bd18a5a44deb9516f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ff07b6ab40b84bd18a5a44deb9516f00"}]}] Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestServerBasicOps-2143850883 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ff07b6ab40b84bd18a5a44deb9516f00 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestServerBasicOps-2143850883 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestServerBasicOps-2143850883-project Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 1c1fc5de87ed44e7b01229925bf27242 Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestServerBasicOps-2143850883-project Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'fc716d95-94d8-45be-9e12-e437f6726f9c'} Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:04.269222 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Returning 404 to user: Instance fc716d95-94d8-45be-9e12-e437f6726f9c could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-485739ae-36af-484b-be92-8b171956a6f8 tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c" status: 404 len: 111 microversion: 2.1 time: 0.030187 Oct 01 21:33:04.273851 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3869/5752] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:04 2022] GET /compute/v2.1/servers/fc716d95-94d8-45be-9e12-e437f6726f9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:33:04.430049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8b467d77-2a75-4163-9907-d5a172e7160c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] Calling method '.version_select at 0x7f41738ac820>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:04.454902 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8b467d77-2a75-4163-9907-d5a172e7160c tempest-TestServerBasicOps-2143850883 tempest-TestServerBasicOps-2143850883-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1105539429" status: 202 len: 0 microversion: 2.1 time: 0.029158 Oct 01 21:33:04.455505 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1884/5753] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Oct 1 21:33:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1105539429 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:33:22.576766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:22.577558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:22.700612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1078859369", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:22.752641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] validate_networks() for None {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:33:22.943233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:33:22.943707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:33:22.944200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:33:22.944631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:33:22.945089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:33:22.954177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:22.954724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:22.955179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:22.955921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:22.956391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:22.956833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:22.974616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Getting quotas for project 628d724deda14e28b854c932489f45a4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:33:22.979811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Getting quotas for user da3ac7c63d934f63a3cdda9be0310f24 and project 628d724deda14e28b854c932489f45a4. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:33:22.991970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:33:22.994214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:33:23.039687 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-766e1c23-36b8-46b3-9de1-8e219a9288f1 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.468422 Oct 01 21:33:23.040719 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3870/5754] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:33:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:33:23.051490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:23.052623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:23.056577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c28011ef-b034-41ad-890e-ac018537ba4b tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:23.057205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c28011ef-b034-41ad-890e-ac018537ba4b tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:23.118161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c28011ef-b034-41ad-890e-ac018537ba4b tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:23.125120 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c28011ef-b034-41ad-890e-ac018537ba4b tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1222 microversion: 2.1 time: 0.075828 Oct 01 21:33:23.125690 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1885/5755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:23 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:24.149867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:24.150684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:24.159116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:24.159628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:24.160087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:24.160836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:24.161316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:24.161758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:24.242721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:24.251899 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-897e7265-c0f8-49e2-8b6e-c4b52e3f150d tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1282 microversion: 2.1 time: 0.106934 Oct 01 21:33:24.262798 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3871/5756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:24 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:25.277637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:25.278261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:25.285280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:25.285830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:25.286281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:25.287016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:25.287512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:25.287947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:25.424271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:25.432798 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d1a07cd5-2512-45c6-a63e-dc9fe663007c tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1322 microversion: 2.1 time: 0.159146 Oct 01 21:33:25.433383 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1886/5757] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:25 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:25.661076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-05e2668c-d7bd-498d-9d28-b86e45f1a22f req-6b65bd2e-4ea4-48ae-aef6-b6a8c11421b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b200cd-443e-40e9-b5b8-b3fc68d25221", "tag": "8b42e0c7-3de8-4bfa-9c46-e9ec6f566f3a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:25.672189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-05e2668c-d7bd-498d-9d28-b86e45f1a22f req-6b65bd2e-4ea4-48ae-aef6-b6a8c11421b9 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:25.672690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-05e2668c-d7bd-498d-9d28-b86e45f1a22f req-6b65bd2e-4ea4-48ae-aef6-b6a8c11421b9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:25.673569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-05e2668c-d7bd-498d-9d28-b86e45f1a22f req-6b65bd2e-4ea4-48ae-aef6-b6a8c11421b9 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:25.686871 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-05e2668c-d7bd-498d-9d28-b86e45f1a22f req-6b65bd2e-4ea4-48ae-aef6-b6a8c11421b9 service nova] Creating event network-changed:8b42e0c7-3de8-4bfa-9c46-e9ec6f566f3a for instance 05b200cd-443e-40e9-b5b8-b3fc68d25221 on nch1-master-1 Oct 01 21:33:25.691882 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-05e2668c-d7bd-498d-9d28-b86e45f1a22f req-6b65bd2e-4ea4-48ae-aef6-b6a8c11421b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035349 Oct 01 21:33:25.693553 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3872/5758] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:33:26.457076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:26.458187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:26.465082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:26.465564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:26.466005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:26.466734 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:26.467191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:26.467616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:26.602463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:26.610472 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9c1c5d76-a40b-4167-9780-609642c21ba7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1322 microversion: 2.1 time: 0.157314 Oct 01 21:33:26.611142 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1887/5759] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:26 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:27.635402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:27.636050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:27.642307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:27.642853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:27.643315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:27.644030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:27.644506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:27.644954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:27.772447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:27.780238 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62e2c04a-44b5-4f6a-b012-ac44d4b77b49 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1322 microversion: 2.1 time: 0.150575 Oct 01 21:33:27.780812 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3873/5760] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:27 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:28.803304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:28.803930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:28.811098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:28.811589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:28.812134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:28.812847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:28.813306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:28.813729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:28.943544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:28.951460 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a055f9b5-2fc9-4961-b3ef-d09befa4d4d8 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1322 microversion: 2.1 time: 0.152294 Oct 01 21:33:28.952057 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1888/5761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:28 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:33:29.975185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:29.975813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:29.982640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:29.983142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:29.983597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:29.984334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:29.984809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:29.985251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:30.122292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:30.130750 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9017c2fd-c2b0-43ab-aaa1-cf18256603b7 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1322 microversion: 2.1 time: 0.159464 Oct 01 21:33:30.131407 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3874/5762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:29 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:31.041531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-4998017d-a7d0-4790-9e95-332b3e564ccc req-de1afe5f-73cc-4e50-9580-a5fbeabb93d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b200cd-443e-40e9-b5b8-b3fc68d25221", "name": "network-vif-plugged", "status": "completed", "tag": "8b42e0c7-3de8-4bfa-9c46-e9ec6f566f3a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:31.051680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4998017d-a7d0-4790-9e95-332b3e564ccc req-de1afe5f-73cc-4e50-9580-a5fbeabb93d4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:31.052166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4998017d-a7d0-4790-9e95-332b3e564ccc req-de1afe5f-73cc-4e50-9580-a5fbeabb93d4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:31.052599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4998017d-a7d0-4790-9e95-332b3e564ccc req-de1afe5f-73cc-4e50-9580-a5fbeabb93d4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:31.064071 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-4998017d-a7d0-4790-9e95-332b3e564ccc req-de1afe5f-73cc-4e50-9580-a5fbeabb93d4 service nova] Creating event network-vif-plugged:8b42e0c7-3de8-4bfa-9c46-e9ec6f566f3a for instance 05b200cd-443e-40e9-b5b8-b3fc68d25221 on nch1-master-1 Oct 01 21:33:31.069031 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-4998017d-a7d0-4790-9e95-332b3e564ccc req-de1afe5f-73cc-4e50-9580-a5fbeabb93d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101753 Oct 01 21:33:31.069613 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1889/5763] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:33:31.153255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:31.153905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:31.162540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:31.163062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:31.163527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:31.164262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:31.164745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:31.165196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:31.309021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:31.317376 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5a297c6d-e78d-4932-b502-663c08c41bfe tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1322 microversion: 2.1 time: 0.167488 Oct 01 21:33:31.317870 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3875/5764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:31 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:32.341563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:32.342185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:32.348993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:32.349488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:32.349924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:32.350647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:32.351104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:32.351530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:32.487844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:32.496168 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d331e458-8989-4166-b4eb-0b6a590fb858 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1472 microversion: 2.1 time: 0.159849 Oct 01 21:33:32.496746 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1890/5765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:32 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1472 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:32.573103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26703deb-76c6-43d1-90c3-6a8d70073284 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Calling method '.version_select at 0x7f4172f38430>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:32.643914 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26703deb-76c6-43d1-90c3-6a8d70073284 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/a710d82d35e444218b503619776ae9d7" status: 200 len: 371 microversion: 2.1 time: 0.126609 Oct 01 21:33:32.644505 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3876/5766] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Oct 1 21:33:32 2022] GET /compute/v2.1/os-quota-sets/a710d82d35e444218b503619776ae9d7 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:33:32.657595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6924c266-c3a5-46da-8d29-564e94a28135 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2107082033", "id": 23983786, "os-flavor-access:is_public": "True"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:32.684401 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6924c266-c3a5-46da-8d29-564e94a28135 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.030562 Oct 01 21:33:32.684986 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1891/5767] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:33:32 2022] POST /compute/v2.1/flavors => generated 432 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:33:32.698064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "23983786"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:32.700377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:32.706570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:32.707072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:32.708127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:32.708854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:32.709327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:32.709765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:32.897744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '471c3f34da7d434888f1d7a29c8c2824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a710d82d35e444218b503619776ae9d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:32.903964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2107082033 {{(pid=140438) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:33:32.910637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:32.911131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:32.911579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:32.912318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:32.912786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:32.913226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:32.938099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Getting quotas for project 628d724deda14e28b854c932489f45a4. Resources: {'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:33:32.943563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Getting quotas for user da3ac7c63d934f63a3cdda9be0310f24 and project 628d724deda14e28b854c932489f45a4. Resources: {'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:33:32.955466 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.compute.api [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] ram quota exceeded for a710d82d35e444218b503619776ae9d7, tried to resize instance. Oct 01 21:33:32.956029 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Request method failure captured: Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221/action HTTP/1.1 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 37 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLIifMIqldgidGoWnRZZX2yvEbs8v3-pIh6pr5sPtQvM_yJ5C578gIqNJR_72PkPcgK7Vsroa2bcpHqipfhCaK7vCl2fv9LhDSuzxgG0wvA-WDK65Z90rnf3MTT9zy3mWLlkAd5vXCeqo6WzISrkJj5otKKjI4a3wukJ_8hn47DFQ4c Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: a710d82d35e444218b503619776ae9d7 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1593677862 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,admin,reader Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,admin,reader Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a710d82d35e444218b503619776ae9d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a710d82d35e444218b503619776ae9d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a710d82d35e444218b503619776ae9d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a710d82d35e444218b503619776ae9d7"}]}] Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1593677862 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: a710d82d35e444218b503619776ae9d7 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1593677862 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersAdminNegativeTestJSON-1593677862-project-admin Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 471c3f34da7d434888f1d7a29c8c2824 Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1593677862-project-admin Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: {"resize": {"flavorRef": "23983786"}} Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '05b200cd-443e-40e9-b5b8-b3fc68d25221', 'body': {'resize': {'flavorRef': '23983786'}}} Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:33:32.958734 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a590ac1-b046-4519-867e-eee2ce339330 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221/action" status: 403 len: 118 microversion: 2.1 time: 0.266048 Oct 01 21:33:32.963208 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3877/5768] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:33:32 2022] POST /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221/action => generated 118 bytes in 267 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:33:32.969177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dc7b1a17-00d6-447f-a947-d4ef6b96785e tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:32.986237 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dc7b1a17-00d6-447f-a947-d4ef6b96785e tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/23983786" status: 202 len: 0 microversion: 2.1 time: 0.020920 Oct 01 21:33:32.986861 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1892/5769] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Oct 1 21:33:32 2022] DELETE /compute/v2.1/flavors/23983786 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:33:32.994978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d5cf724-2b38-49cd-8245-10683bb7822c tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:33.015359 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d5cf724-2b38-49cd-8245-10683bb7822c tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023924 Oct 01 21:33:33.015908 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3878/5770] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 21:33:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:33:33.035825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-205bbf9b-1683-4ff3-a377-99c260aa7e4d tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Calling method '.version_select at 0x7f417365d430>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:33.105764 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-205bbf9b-1683-4ff3-a377-99c260aa7e4d tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/a710d82d35e444218b503619776ae9d7" status: 200 len: 371 microversion: 2.1 time: 0.073641 Oct 01 21:33:33.106347 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1893/5771] 10.222.0.17 () {58 vars in 1242 bytes} [Sat Oct 1 21:33:33 2022] GET /compute/v2.1/os-quota-sets/a710d82d35e444218b503619776ae9d7 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:33:33.118459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e4ce21ea-9612-45c6-9e31-cbae62deec11 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-909598590", "id": 1584707199, "os-flavor-access:is_public": "True"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:33.136782 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e4ce21ea-9612-45c6-9e31-cbae62deec11 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.022549 Oct 01 21:33:33.137368 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3879/5772] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:33:33 2022] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:33:33.149502 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1584707199"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:33.151895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:33.157926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:33.158429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:33.158910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:33.159618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:33.160094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:33.160534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:33.302456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '471c3f34da7d434888f1d7a29c8c2824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a710d82d35e444218b503619776ae9d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:33.308674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-909598590 {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:33:33.315591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:33.316085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:33.316527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:33.317886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:33.318351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:33.318816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:33.340085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Getting quotas for project 628d724deda14e28b854c932489f45a4. Resources: {'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:33:33.345244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Getting quotas for user da3ac7c63d934f63a3cdda9be0310f24 and project 628d724deda14e28b854c932489f45a4. Resources: {'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:33:33.358603 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.compute.api [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] cores quota exceeded for a710d82d35e444218b503619776ae9d7, tried to resize instance. Oct 01 21:33:33.359153 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Request method failure captured: Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221/action HTTP/1.1 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 39 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLIifMIqldgidGoWnRZZX2yvEbs8v3-pIh6pr5sPtQvM_yJ5C578gIqNJR_72PkPcgK7Vsroa2bcpHqipfhCaK7vCl2fv9LhDSuzxgG0wvA-WDK65Z90rnf3MTT9zy3mWLlkAd5vXCeqo6WzISrkJj5otKKjI4a3wukJ_8hn47DFQ4c Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: a710d82d35e444218b503619776ae9d7 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1593677862 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,admin,reader Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,admin,reader Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a710d82d35e444218b503619776ae9d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a710d82d35e444218b503619776ae9d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a710d82d35e444218b503619776ae9d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a710d82d35e444218b503619776ae9d7"}]}] Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1593677862 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: a710d82d35e444218b503619776ae9d7 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1593677862 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersAdminNegativeTestJSON-1593677862-project-admin Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 471c3f34da7d434888f1d7a29c8c2824 Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1593677862-project-admin Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: {"resize": {"flavorRef": "1584707199"}} Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '05b200cd-443e-40e9-b5b8-b3fc68d25221', 'body': {'resize': {'flavorRef': '1584707199'}}} Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:33:33.361209 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e888c68e-fa95-4bac-a7a7-19aa3341ba3f tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221/action" status: 403 len: 113 microversion: 2.1 time: 0.217021 Oct 01 21:33:33.366533 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1894/5773] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:33:33 2022] POST /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221/action => generated 113 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:33:33.371857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c3cd654-d8c8-4423-b457-bd4ff50fbd1b tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:33.388307 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c3cd654-d8c8-4423-b457-bd4ff50fbd1b tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1584707199" status: 202 len: 0 microversion: 2.1 time: 0.020230 Oct 01 21:33:33.388857 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3880/5774] 10.222.0.17 () {58 vars in 1161 bytes} [Sat Oct 1 21:33:33 2022] DELETE /compute/v2.1/flavors/1584707199 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:33:33.396719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dd840581-afe1-45c2-9951-98c09b7dcbe6 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:33.417732 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dd840581-afe1-45c2-9951-98c09b7dcbe6 tempest-ServersAdminNegativeTestJSON-1593677862 tempest-ServersAdminNegativeTestJSON-1593677862-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024782 Oct 01 21:33:33.418292 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1895/5775] 10.222.0.17 () {58 vars in 1146 bytes} [Sat Oct 1 21:33:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:33.439684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:33.440209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:33.446388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:33.446929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:33.447386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:33.448107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:33.448584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:33.449030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:33.474015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:33:33.548811 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-41d8ce74-1788-4d6f-9b25-0d3f81d54384 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "DELETE /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 204 len: 0 microversion: 2.1 time: 0.112499 Oct 01 21:33:33.549524 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3881/5776] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:33:33 2022] DELETE /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:33:33.558585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:33.559209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:33.565261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:33.565753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:33.566200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:33.567002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:33.567489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:33.567864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:33.701454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:33.709835 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ba51fab1-4087-4e90-bfaf-1e7e9c5f0369 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1478 microversion: 2.1 time: 0.155224 Oct 01 21:33:33.710413 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1896/5777] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:33 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1478 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:34.734021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:34.734828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:34.743129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:34.743643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:34.744102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:34.744819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:34.745298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:34.745747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:34.913764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3ac7c63d934f63a3cdda9be0310f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628d724deda14e28b854c932489f45a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:34.921795 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b1bd5cc-c928-4dbe-ac54-b1bfed661285 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 200 len: 1478 microversion: 2.1 time: 0.192389 Oct 01 21:33:34.922628 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3882/5778] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:34 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 1478 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:35.335700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-82a589ef-1220-45c2-b348-a326eb48c5c2 req-4737b478-5dfb-4fd3-b89d-22683adc5367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b200cd-443e-40e9-b5b8-b3fc68d25221", "name": "network-vif-deleted", "tag": "8b42e0c7-3de8-4bfa-9c46-e9ec6f566f3a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:35.350980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-82a589ef-1220-45c2-b348-a326eb48c5c2 req-4737b478-5dfb-4fd3-b89d-22683adc5367 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:35.351959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-82a589ef-1220-45c2-b348-a326eb48c5c2 req-4737b478-5dfb-4fd3-b89d-22683adc5367 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:35.352588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-82a589ef-1220-45c2-b348-a326eb48c5c2 req-4737b478-5dfb-4fd3-b89d-22683adc5367 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:35.367899 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-82a589ef-1220-45c2-b348-a326eb48c5c2 req-4737b478-5dfb-4fd3-b89d-22683adc5367 service nova] Creating event network-vif-deleted:8b42e0c7-3de8-4bfa-9c46-e9ec6f566f3a for instance 05b200cd-443e-40e9-b5b8-b3fc68d25221 on nch1-master-1 Oct 01 21:33:35.375165 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-82a589ef-1220-45c2-b348-a326eb48c5c2 req-4737b478-5dfb-4fd3-b89d-22683adc5367 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044420 Oct 01 21:33:35.376026 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1897/5779] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:33:35.946229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:35.946897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] [instance: 05b200cd-443e-40e9-b5b8-b3fc68d25221] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:35.953680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:35.954180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:35.954669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:35.955394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:35.955843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:35.956288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:35.973598 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] HTTP exception thrown: Instance 05b200cd-443e-40e9-b5b8-b3fc68d25221 could not be found. Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Request method failure captured: Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 HTTP/1.1 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLIhEYxHB-K-zy2ZMFr_GcLXa5MCc5te14qC7yo-epH30hjUez5fm4NAzttBimhvCiDxWfw_vsTUwHDICWlIm7KTvFW2AqOGAr5P-lZUBs7oO5qmvXOcNQQBWPyTyUGjUkwKdXUaM5vNkpLCXFPWvM0Ga57iPgGjya0lBFPJ0--SAas Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 628d724deda14e28b854c932489f45a4 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-118681587 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_628d724deda14e28b854c932489f45a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/628d724deda14e28b854c932489f45a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/628d724deda14e28b854c932489f45a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/628d724deda14e28b854c932489f45a4"}]}] Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersAdminNegativeTestJSON-118681587 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 628d724deda14e28b854c932489f45a4 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-118681587 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersAdminNegativeTestJSON-118681587-project Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: da3ac7c63d934f63a3cdda9be0310f24 Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersAdminNegativeTestJSON-118681587-project Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 05b200cd-443e-40e9-b5b8-b3fc68d25221 could not be found. Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '05b200cd-443e-40e9-b5b8-b3fc68d25221'} Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b200cd-443e-40e9-b5b8-b3fc68d25221 could not be found. Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b200cd-443e-40e9-b5b8-b3fc68d25221 could not be found. Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:35.975192 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b200cd-443e-40e9-b5b8-b3fc68d25221 could not be found. Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] Returning 404 to user: Instance 05b200cd-443e-40e9-b5b8-b3fc68d25221 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-649a1f62-17cf-40fb-8e9f-e48135efd7a0 tempest-ServersAdminNegativeTestJSON-118681587 tempest-ServersAdminNegativeTestJSON-118681587-project] 10.222.0.17 "GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221" status: 404 len: 111 microversion: 2.1 time: 0.034816 Oct 01 21:33:35.979796 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3883/5780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:35 2022] GET /compute/v2.1/servers/05b200cd-443e-40e9-b5b8-b3fc68d25221 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:33:42.313250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-621687990", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "4023a683-8986-4df4-ade2-78656d9a0bc0"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:42.367557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] validate_networks() for [('4023a683-8986-4df4-ade2-78656d9a0bc0', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:33:42.787461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:33:42.787893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:33:42.788438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:33:42.788861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:33:42.789334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:33:42.798728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:42.799230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:42.799681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:42.800422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:42.801678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:42.802113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:42.822795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Getting quotas for project 37c9b3e4a1e441e1a92a271f9aa1811e. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:33:42.828864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Getting quotas for user d4671ff245d94e54ac1bf390edd815e5 and project 37c9b3e4a1e441e1a92a271f9aa1811e. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:33:42.842395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:33:42.845015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:33:42.904962 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-75ebf1af-6463-4831-b0b6-81267e32b14e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725663 Oct 01 21:33:42.906658 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1898/5781] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:33:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:33:42.917830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d930b406-8199-45d0-80c4-d963d57e2858 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:42.919134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d930b406-8199-45d0-80c4-d963d57e2858 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:42.923433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:42.926897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=5 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:42.988436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d930b406-8199-45d0-80c4-d963d57e2858 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:42.998405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d930b406-8199-45d0-80c4-d963d57e2858 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1214 microversion: 2.1 time: 0.084703 Oct 01 21:33:42.999346 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3884/5782] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:42 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:44.023552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6044b5f2-a15d-4ef8-90b9-90c4d34445d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:44.024179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6044b5f2-a15d-4ef8-90b9-90c4d34445d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:44.084509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6044b5f2-a15d-4ef8-90b9-90c4d34445d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:44.092353 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6044b5f2-a15d-4ef8-90b9-90c4d34445d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1214 microversion: 2.1 time: 0.073854 Oct 01 21:33:44.092971 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1899/5783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:44 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:45.115588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dfca948c-88bb-4546-bdbb-7a4c296b7909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:45.116218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dfca948c-88bb-4546-bdbb-7a4c296b7909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:45.175246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dfca948c-88bb-4546-bdbb-7a4c296b7909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:45.182915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dfca948c-88bb-4546-bdbb-7a4c296b7909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1214 microversion: 2.1 time: 0.071105 Oct 01 21:33:45.183531 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3885/5784] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:45 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:46.206565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3b0485b9-23c8-4f63-a34e-7b44d5a2dd9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:46.207177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3b0485b9-23c8-4f63-a34e-7b44d5a2dd9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:46.262945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3b0485b9-23c8-4f63-a34e-7b44d5a2dd9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:46.269905 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3b0485b9-23c8-4f63-a34e-7b44d5a2dd9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1214 microversion: 2.1 time: 0.067221 Oct 01 21:33:46.270512 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1900/5785] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:46 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:47.293347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:47.293979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:47.295916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:47.302793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:47.303294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:47.303750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:47.304455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:47.304922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:47.305361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:47.367486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:47.375958 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a98d583-dbd9-4377-aef9-9b3f7d58cc2d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1218 microversion: 2.1 time: 0.086489 Oct 01 21:33:47.376549 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3886/5786] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:47 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:48.402578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:48.403356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:48.413150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:48.414040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:48.414609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:48.415378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:48.415896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:48.416380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:48.482277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:48.490416 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ac9a13fb-6937-45e6-bfda-dc2a47117cb7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1272 microversion: 2.1 time: 0.094615 Oct 01 21:33:48.491221 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1901/5787] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:48 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:49.299436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-60287c8a-04be-41d7-bfad-b660bd14e135 req-d92ab6fe-b72e-4ac9-9add-fa1f339e3a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65c7a753-8bec-43af-b53c-375d5e80ac7c", "tag": "275eb3a0-ffa9-48a2-a33e-6a6a5b919115"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:49.310839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60287c8a-04be-41d7-bfad-b660bd14e135 req-d92ab6fe-b72e-4ac9-9add-fa1f339e3a10 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:49.311345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60287c8a-04be-41d7-bfad-b660bd14e135 req-d92ab6fe-b72e-4ac9-9add-fa1f339e3a10 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:49.311987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60287c8a-04be-41d7-bfad-b660bd14e135 req-d92ab6fe-b72e-4ac9-9add-fa1f339e3a10 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:49.323470 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-60287c8a-04be-41d7-bfad-b660bd14e135 req-d92ab6fe-b72e-4ac9-9add-fa1f339e3a10 service nova] Creating event network-changed:275eb3a0-ffa9-48a2-a33e-6a6a5b919115 for instance 65c7a753-8bec-43af-b53c-375d5e80ac7c on nch1-master-1 Oct 01 21:33:49.329162 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-60287c8a-04be-41d7-bfad-b660bd14e135 req-d92ab6fe-b72e-4ac9-9add-fa1f339e3a10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034747 Oct 01 21:33:49.330030 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3887/5788] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:33:49.515352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:49.515974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:49.523990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:49.524484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:49.524926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:49.525630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:49.526091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:49.526625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:49.656699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:49.665286 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-145dbd53-92b2-4096-92b4-dc4ffccf8abe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1314 microversion: 2.1 time: 0.154079 Oct 01 21:33:49.665869 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1902/5789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:49 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:50.690134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:50.691098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:50.697240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:50.697745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:50.698203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:50.698944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:50.699420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:50.699864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:50.928214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:50.936127 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dd5c1aa0-39e0-4d68-b639-14d644473624 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1314 microversion: 2.1 time: 0.251110 Oct 01 21:33:50.936694 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3888/5790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:50 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:51.959567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:51.960190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:51.967082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:51.967573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:51.968021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:51.968717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:51.969177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:51.969609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:52.101224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:52.108962 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9faeecaf-87a0-4488-9691-8ccc23d06c55 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1314 microversion: 2.1 time: 0.153362 Oct 01 21:33:52.109545 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1903/5791] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:51 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:53.133867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:53.134575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:53.137455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:53.143401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:53.143917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:53.144378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:53.145734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:53.146217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:53.146704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:53.276810 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:53.284669 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7129e21d-cda3-4c44-9be2-850827cf5a85 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1314 microversion: 2.1 time: 0.155311 Oct 01 21:33:53.285346 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3889/5792] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:53 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:54.308049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:54.308618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:54.310642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=5 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:54.312462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:54.318276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:54.318787 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:54.319225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:54.319918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:54.320372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:54.320796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:54.324445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=68 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:54.452345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:54.460842 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a78b97df-0fe9-416b-95bb-866216c55a2f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1314 microversion: 2.1 time: 0.156762 Oct 01 21:33:54.461427 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1904/5793] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:54 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:55.054321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-522349a9-eafc-4b68-8557-60d014a78bfc req-effc281e-bade-4c0b-a0b7-cc0962a5a056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c7a753-8bec-43af-b53c-375d5e80ac7c", "name": "network-vif-plugged", "status": "completed", "tag": "275eb3a0-ffa9-48a2-a33e-6a6a5b919115"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:55.065344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-522349a9-eafc-4b68-8557-60d014a78bfc req-effc281e-bade-4c0b-a0b7-cc0962a5a056 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:55.065845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-522349a9-eafc-4b68-8557-60d014a78bfc req-effc281e-bade-4c0b-a0b7-cc0962a5a056 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:55.066366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-522349a9-eafc-4b68-8557-60d014a78bfc req-effc281e-bade-4c0b-a0b7-cc0962a5a056 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:55.078211 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-522349a9-eafc-4b68-8557-60d014a78bfc req-effc281e-bade-4c0b-a0b7-cc0962a5a056 service nova] Creating event network-vif-plugged:275eb3a0-ffa9-48a2-a33e-6a6a5b919115 for instance 65c7a753-8bec-43af-b53c-375d5e80ac7c on nch1-master-1 Oct 01 21:33:55.083185 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-522349a9-eafc-4b68-8557-60d014a78bfc req-effc281e-bade-4c0b-a0b7-cc0962a5a056 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Oct 01 21:33:55.084059 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3890/5794] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:33:55.483822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:55.484434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:55.491260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:55.491741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:55.492175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:55.492869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:55.493326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:55.493750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:55.627067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:55.634872 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0971510c-2b20-45ed-9d6a-404e507b30ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1314 microversion: 2.1 time: 0.154964 Oct 01 21:33:55.635468 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1905/5795] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:55 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:56.654460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:56.659808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:56.661041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:56.667560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:56.668071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:56.668535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:56.669252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:56.669733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:56.670202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:56.798285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:56.807008 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-51980eb2-6056-41e0-b05e-f49aa850464f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1500 microversion: 2.1 time: 0.153497 Oct 01 21:33:56.807581 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3891/5796] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:56 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:56.828992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:33:56.831371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:56.833230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=14 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:33:56.839269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:56.839759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:56.840203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:56.840902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:56.841362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:56.841792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:56.870302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:56.875682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Old instance type m1.heat2, new instance type m1.heat {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:33:56.882028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:33:56.882455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:33:56.882963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:33:56.883385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:33:56.883803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:33:56.944427 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f81da8f6-5ead-489f-af43-cabb4a1197e7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "POST /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c/action" status: 202 len: 0 microversion: 2.1 time: 0.119291 Oct 01 21:33:56.945046 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1906/5797] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:33:56 2022] POST /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:33:56.953173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:56.953805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:56.960340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:56.960851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:56.961311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:56.962027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:56.962565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:56.963018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:57.105667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:57.114205 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-130e0aa8-fc37-4827-ae0e-75d1cecbc31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1509 microversion: 2.1 time: 0.164925 Oct 01 21:33:57.115042 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3892/5798] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:56 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:58.137979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:58.138632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:58.145812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:58.146306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:58.146792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:58.147497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:58.147960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:58.148394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:58.282458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:58.291312 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6eb1e23b-bd73-4bee-aefd-cb41a4c9f3a1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1509 microversion: 2.1 time: 0.157932 Oct 01 21:33:58.292074 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1907/5799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:58 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:33:59.315441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:33:59.316049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:33:59.323622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:59.324122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:59.324571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:59.325281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:33:59.325749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:33:59.326190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:33:59.459851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:33:59.467627 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6cc54ce5-cd7e-4577-89b3-3ac11ee52766 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.156104 Oct 01 21:33:59.468211 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3893/5800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:33:59 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:00.491139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:00.491766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:00.498774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:00.499267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:00.499715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:00.500422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:00.500892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:00.501325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:00.630871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:00.638859 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c2a6031e-23bc-4e39-bf9e-26184f6766e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.151708 Oct 01 21:34:00.639448 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1908/5801] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:00 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:01.663432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:01.664060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:01.670868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:01.671371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:01.671851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:01.672559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:01.673048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:01.673472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:01.802857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:01.810728 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-90c9fd69-1b1d-4ac1-b9f9-a08d0599705f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.151806 Oct 01 21:34:01.811306 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3894/5802] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:01 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:02.834105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:02.834755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:02.841136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:02.841632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:02.842081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:02.842813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:02.843276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:02.843711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:02.971083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:02.979453 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e1994916-fdb4-4219-b35e-20960e302a31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.149349 Oct 01 21:34:02.980035 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1909/5803] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:02 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:04.002661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:04.003302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:04.010388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:04.010934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:04.011400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:04.012118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:04.012621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:04.013080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:04.143991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:04.151831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d6d6ab18-3053-4035-8113-0f763531796d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.153140 Oct 01 21:34:04.152409 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3895/5804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:03 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:05.176960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:05.177595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:05.183589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:05.184078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:05.184515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:05.185209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:05.185667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:05.186094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:05.320620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:05.328409 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f846bccb-70c5-4c92-b69a-cdaa98b2cdd4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.157042 Oct 01 21:34:05.328985 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1910/5805] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:05 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:06.352435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:06.353006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:06.359965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:06.360466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:06.360919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:06.361627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:06.362098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:06.362561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:06.493678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:06.501469 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-30674db5-7717-40ab-83de-80f27fe9b9fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.153802 Oct 01 21:34:06.502043 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3896/5806] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:06 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:07.525862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:07.526483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:07.533385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:07.533876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:07.534317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:07.535086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:07.536087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:07.536516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:07.666454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:07.674274 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-98f8f0e4-9956-4f3b-adf8-a30c16d602c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.152401 Oct 01 21:34:07.674882 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1911/5807] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:07 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:08.697576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:08.698117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:08.705162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:08.705675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:08.706138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:08.706890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:08.707390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:08.707829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:08.838619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:08.846453 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0956990b-e975-45a2-b9af-ccdd851838df tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.152930 Oct 01 21:34:08.847060 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3897/5808] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:08 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:09.869950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:09.870619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:09.877706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:09.878199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:09.878680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:09.879974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:09.880463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:09.880892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:10.018894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:10.026771 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-67c47ddf-50a4-4e6e-adf7-bfdfef084c83 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.160777 Oct 01 21:34:10.027347 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1912/5809] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:09 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:11.049986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:11.050669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:11.057854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:11.058359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:11.058861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:11.059576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:11.060051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:11.060495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:11.188542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:11.196883 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c94f8257-ecf5-43b0-8972-43c2601ed68b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.150863 Oct 01 21:34:11.197462 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3898/5810] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:11 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:12.220535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:12.221175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:12.228065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:12.228556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:12.228997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:12.229692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:12.230149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:12.230601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:12.361064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:12.369429 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-980412a4-3d5d-40c9-963b-df74b8cad615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.152849 Oct 01 21:34:12.370000 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1913/5811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:12 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:13.392132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:13.392679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:13.400089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:13.400587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:13.401039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:13.401747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:13.402218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:13.402691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:13.533186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:13.541122 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05ab9389-bae7-4c10-aa78-354e3d34244f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.152985 Oct 01 21:34:13.541710 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3899/5812] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:13 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:14.565202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:14.565858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:14.572865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:14.573362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:14.573810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:14.574535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:14.575003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:14.575439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:14.710978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:14.718865 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d23b2f54-7725-42b2-a52e-82357e0d9053 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.157579 Oct 01 21:34:14.719639 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1914/5813] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:14 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:15.742296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:15.743055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:15.750083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:15.750621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:15.751121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:15.751924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:15.752440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:15.752961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:15.885463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:15.893438 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6aed72a3-e87d-43a1-b2f1-d7863be78d76 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.155073 Oct 01 21:34:15.894013 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3900/5814] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:15 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:16.917406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:16.918024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:16.925232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:16.926654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:16.927098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:16.927817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:16.928273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:16.928697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:17.062326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:17.070752 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4d8ec2bd-a291-4745-b398-425474b2760f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.157226 Oct 01 21:34:17.071523 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1915/5815] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:16 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:18.093754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:18.094379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:18.101360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:18.101864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:18.102328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:18.103058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:18.103535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:18.103981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:18.107943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=83 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:34:18.231673 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:18.240247 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49f8fa8b-af58-48d1-a30f-22d7b221f239 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.150440 Oct 01 21:34:18.240818 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3901/5816] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:18 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:19.264007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:19.264625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:19.272149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:19.272634 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:19.273074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:19.273766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:19.274227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:19.274685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:19.403971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:19.412090 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6c6e443b-d587-4b21-8955-f5064be74323 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.151918 Oct 01 21:34:19.412696 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1916/5817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:19 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:20.434898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:20.435526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:20.442400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:20.442933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:20.443388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:20.444091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:20.444562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:20.445000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:20.573690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:20.581536 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fcaa2967-f26f-499e-985e-c54c6cadb62b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.150627 Oct 01 21:34:20.582629 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3902/5818] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:20 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:21.605710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:21.606347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:21.614592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:21.615093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:21.615538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:21.616283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:21.616746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:21.617184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:21.748324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:21.756522 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aab22def-8f77-4e39-8739-f7bb354750fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.154455 Oct 01 21:34:21.757420 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1917/5819] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:21 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:22.781299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:22.781969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:22.788950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:22.789460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:22.789922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:22.790667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:22.791151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:22.791600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:22.922126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:22.930986 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-73524201-255e-4865-865a-221b96dba7aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.153527 Oct 01 21:34:22.931569 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3903/5820] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:22 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:23.953410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:23.954030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:23.961747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:23.962251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:23.962728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:23.963428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:23.963894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:23.964329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:24.093198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:24.101018 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-63bb4280-debd-4879-8d10-b5a69155f13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.151498 Oct 01 21:34:24.101601 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1918/5821] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:23 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:25.124601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:25.125226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:25.127966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=30 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:34:25.134404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:25.134880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:25.135339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:25.136065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:25.136538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:25.136983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:25.263212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:25.271580 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5feff69f-9f12-477c-a49e-f1723d60c13b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1514 microversion: 2.1 time: 0.150991 Oct 01 21:34:25.272160 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3904/5822] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:25 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:26.228132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f2798606-2b38-4aba-bb64-e0b5fa3de2cc req-711b0fa4-d355-49f0-aa49-61ef24d8f569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c7a753-8bec-43af-b53c-375d5e80ac7c", "name": "network-vif-unplugged", "status": "completed", "tag": "275eb3a0-ffa9-48a2-a33e-6a6a5b919115"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:34:26.234016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=34 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:34:26.240272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f2798606-2b38-4aba-bb64-e0b5fa3de2cc req-711b0fa4-d355-49f0-aa49-61ef24d8f569 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:26.240761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f2798606-2b38-4aba-bb64-e0b5fa3de2cc req-711b0fa4-d355-49f0-aa49-61ef24d8f569 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:26.241201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f2798606-2b38-4aba-bb64-e0b5fa3de2cc req-711b0fa4-d355-49f0-aa49-61ef24d8f569 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:26.245308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:34:26.253954 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f2798606-2b38-4aba-bb64-e0b5fa3de2cc req-711b0fa4-d355-49f0-aa49-61ef24d8f569 service nova] Creating event network-vif-unplugged:275eb3a0-ffa9-48a2-a33e-6a6a5b919115 for instance 65c7a753-8bec-43af-b53c-375d5e80ac7c on nch2-master-1 Oct 01 21:34:26.260687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-f2798606-2b38-4aba-bb64-e0b5fa3de2cc req-711b0fa4-d355-49f0-aa49-61ef24d8f569 service nova] Instance 65c7a753-8bec-43af-b53c-375d5e80ac7c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:34:26.272433 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f2798606-2b38-4aba-bb64-e0b5fa3de2cc req-711b0fa4-d355-49f0-aa49-61ef24d8f569 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048146 Oct 01 21:34:26.273065 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1919/5823] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:34:26.298161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:26.299269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:26.306699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:26.307207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:26.307694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:26.308414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:26.308886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:26.309325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:26.447619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:26.455521 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15dfe73a-bccc-40ea-965d-ee52458644e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1513 microversion: 2.1 time: 0.164248 Oct 01 21:34:26.456125 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3905/5824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:26 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:27.480755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:27.481458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:27.489504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:27.489997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:27.490450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:27.491156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:27.491616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:27.492042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:27.623754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:27.631834 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b78eab92-3d4d-4427-825a-8e4412014c9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1511 microversion: 2.1 time: 0.156255 Oct 01 21:34:27.632413 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1920/5825] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:27 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:28.292142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-14b3f975-a552-40ef-b8a7-faca43bb09c4 req-ab926db3-03f0-4d3c-9b6e-b6cfab6bdac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65c7a753-8bec-43af-b53c-375d5e80ac7c", "tag": "275eb3a0-ffa9-48a2-a33e-6a6a5b919115"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:34:28.303091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-14b3f975-a552-40ef-b8a7-faca43bb09c4 req-ab926db3-03f0-4d3c-9b6e-b6cfab6bdac8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:28.303523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-14b3f975-a552-40ef-b8a7-faca43bb09c4 req-ab926db3-03f0-4d3c-9b6e-b6cfab6bdac8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:28.303968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-14b3f975-a552-40ef-b8a7-faca43bb09c4 req-ab926db3-03f0-4d3c-9b6e-b6cfab6bdac8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:28.318817 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-14b3f975-a552-40ef-b8a7-faca43bb09c4 req-ab926db3-03f0-4d3c-9b6e-b6cfab6bdac8 service nova] Creating event network-changed:275eb3a0-ffa9-48a2-a33e-6a6a5b919115 for instance 65c7a753-8bec-43af-b53c-375d5e80ac7c on nch2-master-1 Oct 01 21:34:28.324113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-14b3f975-a552-40ef-b8a7-faca43bb09c4 req-ab926db3-03f0-4d3c-9b6e-b6cfab6bdac8 service nova] Instance 65c7a753-8bec-43af-b53c-375d5e80ac7c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:34:28.335233 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-14b3f975-a552-40ef-b8a7-faca43bb09c4 req-ab926db3-03f0-4d3c-9b6e-b6cfab6bdac8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046765 Oct 01 21:34:28.336051 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3906/5826] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:34:28.655101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:28.656219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:28.664318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:28.664820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:28.665270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:28.665992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:28.666529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:28.667145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:29.096074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:29.103973 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-94a00654-9fd5-433d-887d-85ede0c58c63 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1508 microversion: 2.1 time: 0.452780 Oct 01 21:34:29.104613 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1921/5827] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:28 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1508 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:29.126804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:29.127416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:29.134189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:29.134750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:29.135213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:29.135939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:29.136417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:29.136864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:29.163386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:34:29.215909 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.compute.api [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Found an unconfirmed migration during delete, id: 16, status: finished Oct 01 21:34:30.645815 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c28a03dd-1816-4508-9c89-5ffb65ce4393 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "DELETE /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 204 len: 0 microversion: 2.1 time: 1.522846 Oct 01 21:34:30.646516 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3907/5828] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:34:29 2022] DELETE /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 0 bytes in 1525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:34:30.654692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:30.655316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:30.662788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:30.663284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:30.663726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:30.664428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:30.664891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:30.665318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:30.798258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:30.806442 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-039dc337-e70e-4eef-ac74-269c5f297866 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1500 microversion: 2.1 time: 0.155620 Oct 01 21:34:30.807049 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1922/5829] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:30 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:34:31.829965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:31.830714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:31.838629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:31.839524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:31.840242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:31.841189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:31.841879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:31.842564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:32.068011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:32.076064 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d43b4a4-0593-4dba-ac86-176e8057a55d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1500 microversion: 2.1 time: 0.250422 Oct 01 21:34:32.076650 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3908/5830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:31 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1500 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:32.279679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c8da4a8a-33f1-457a-8a43-8045fa7d2e9f req-2644601b-ab2d-4f6a-bbcf-50763f5e14da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c7a753-8bec-43af-b53c-375d5e80ac7c", "name": "network-vif-deleted", "tag": "275eb3a0-ffa9-48a2-a33e-6a6a5b919115"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:34:32.290606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8da4a8a-33f1-457a-8a43-8045fa7d2e9f req-2644601b-ab2d-4f6a-bbcf-50763f5e14da service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:32.291089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8da4a8a-33f1-457a-8a43-8045fa7d2e9f req-2644601b-ab2d-4f6a-bbcf-50763f5e14da service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:32.291771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8da4a8a-33f1-457a-8a43-8045fa7d2e9f req-2644601b-ab2d-4f6a-bbcf-50763f5e14da service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:32.313242 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c8da4a8a-33f1-457a-8a43-8045fa7d2e9f req-2644601b-ab2d-4f6a-bbcf-50763f5e14da service nova] Creating event network-vif-deleted:275eb3a0-ffa9-48a2-a33e-6a6a5b919115 for instance 65c7a753-8bec-43af-b53c-375d5e80ac7c on nch2-master-1 Oct 01 21:34:32.318342 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c8da4a8a-33f1-457a-8a43-8045fa7d2e9f req-2644601b-ab2d-4f6a-bbcf-50763f5e14da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043168 Oct 01 21:34:32.319019 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1923/5831] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:34:33.099225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:33.099863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:33.106800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:33.107309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:33.107770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:33.108490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:33.108974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:33.109424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:33.170202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:33.179381 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6e9552c6-ef1e-4f11-a8e3-a98449f8a1be tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084145 Oct 01 21:34:33.179968 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3909/5832] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:33 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:34.203856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:34.204566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:34.211625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:34.212112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:34.212551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:34.213245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:34.213703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:34.214127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:34.275984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:34.283686 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f57dccc4-831e-4ce2-9d8c-1ed0ca393880 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084131 Oct 01 21:34:34.284258 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1924/5833] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:34 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:34:35.308055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:35.308625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:35.315642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:35.316153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:35.316618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:35.317964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:35.318446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:35.318920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:35.386511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:35.395510 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-afa7ec6a-7075-4da3-a4dc-26c909eaf853 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.091428 Oct 01 21:34:35.396096 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3910/5834] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:35 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:36.418342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:36.418920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:36.425784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:36.426971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:36.427414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:36.428102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:36.428580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:36.429003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:36.493445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:36.501342 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-580decbb-a8f2-47f4-b390-74906374f9fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086992 Oct 01 21:34:36.501909 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1925/5835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:36 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:37.524265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:37.524930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:37.531938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:37.532445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:37.532936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:37.533655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:37.534132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:37.534602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:37.596344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:37.604086 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-741f2e6e-2263-439f-83b9-3755185f9628 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083761 Oct 01 21:34:37.604662 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3911/5836] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:37 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:38.628001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:38.629895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:38.637092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:38.637746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:38.638332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:38.639155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:38.639652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:38.640253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:38.703770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:38.712128 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0eeffd7f-e8ca-4707-96bc-90e7dec3bad4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088193 Oct 01 21:34:38.712701 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1926/5837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:38 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:39.734716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:39.735354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:39.742363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:39.742900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:39.743358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:39.744068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:39.744544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:39.744989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:39.806994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:39.814911 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-115a9b79-9ba7-44e7-83f2-bb358f58d29e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084124 Oct 01 21:34:39.815485 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3912/5838] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:39 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:40.838313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:40.838963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:40.846513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:40.847012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:40.847458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:40.848150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:40.848607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:40.849032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:40.910476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:40.918297 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bf3e972d-1943-418e-83d2-a445fe060250 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083980 Oct 01 21:34:40.918908 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1927/5839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:40 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:41.941255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:41.941906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:41.949512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:41.950013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:41.950463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:41.951190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:41.951669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:41.952108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:42.013444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:42.021624 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bbd71f72-4d17-49fb-aae2-4ae1dc059100 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084288 Oct 01 21:34:42.022191 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3913/5840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:41 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:43.045057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:43.046113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:43.052761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:43.053243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:43.053677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:43.054370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:43.054858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:43.055288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:43.116903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:43.124559 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3a23dc90-6b23-41aa-b9d9-6380fbf823b9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083417 Oct 01 21:34:43.125131 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1928/5841] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:43 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:44.148554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:44.149185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:44.156087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:44.156585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:44.157039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:44.157743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:44.158214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:44.158694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:44.224985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:44.232711 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a75156c2-d777-46d2-bc5b-32178ab80f9e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088737 Oct 01 21:34:44.233283 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3914/5842] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:44 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:45.255535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:45.256143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:45.262981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:45.263470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:45.263909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:45.264601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:45.265059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:45.265485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:45.329581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:45.337993 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-915b86dc-c7f6-48f6-a1d1-34a0f6de5763 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086866 Oct 01 21:34:45.338596 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1929/5843] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:45 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:46.361008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:46.361581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:46.368635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:46.369133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:46.369586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:46.370290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:46.370795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:46.371237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:46.432530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:46.434894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:34:46.441633 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf77f552-a515-4542-ab8c-8a4536914875 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084608 Oct 01 21:34:46.442192 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3915/5844] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:46 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:47.465366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:47.465983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:47.473440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:47.473931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:47.474373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:47.475113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:47.475575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:47.476008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:47.541533 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:47.549380 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1fdfeca6-a495-441a-92a3-0a501a920084 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088897 Oct 01 21:34:47.549987 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1930/5845] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:47 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:48.573322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:48.573945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:48.581559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:48.582056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:48.582530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:48.583240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:48.583711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:48.584149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:48.649058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:48.656872 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-895defb5-854d-4a39-8b59-9281ddcdbccc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088287 Oct 01 21:34:48.657453 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3916/5846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:48 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:49.679915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:49.680430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:49.687368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:49.687859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:49.688334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:49.689026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:49.689483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:49.689908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:49.750844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:49.759010 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7a465ed8-540e-4d05-8569-b68eff62761e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083410 Oct 01 21:34:49.759563 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1931/5847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:49 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:50.782302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:50.782880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:50.790586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:50.791089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:50.791538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:50.792240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:50.792711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:50.793153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:50.853643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:50.861763 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e065c0c4-1b92-4b43-afdb-c53c64b0f4c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083411 Oct 01 21:34:50.862343 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3917/5848] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:50 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:51.884944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:51.885602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:51.892794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:51.893289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:51.893735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:51.894446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:51.895037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:51.895475 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:51.959038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:51.966924 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-be8d58c1-5c11-43b3-ae6f-3a5c8d133216 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085889 Oct 01 21:34:51.967504 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1932/5849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:51 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:52.991225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:52.991845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:52.998798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:52.999297 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:52.999746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:53.000450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:53.000924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:53.001363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:53.067208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:53.074972 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f230e97b-4ae6-42d2-97b9-465686c4351a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088239 Oct 01 21:34:53.075557 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3918/5850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:52 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:54.098858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:54.099755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:54.106555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:54.107043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:54.107486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:54.108178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:54.108637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:54.109061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:54.169927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:54.178861 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1a8067fc-255e-494f-9b31-2b72bc0021d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084422 Oct 01 21:34:54.179432 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1933/5851] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:54 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:55.201461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:55.202077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:55.204807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:34:55.210169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:55.210706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:55.211162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:55.211875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:55.212347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:55.212789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:55.274543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:55.282316 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c281279a-5b12-42fc-aa3c-b0d4b398da7f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084973 Oct 01 21:34:55.282921 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3919/5852] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:55 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:56.305181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:56.305750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:56.308576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=30 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:34:56.314045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:56.314567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:56.315011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:56.315700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:56.316158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:56.317082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:56.381421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:56.389236 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2a0d3fb4-e6d0-4ef7-9e5e-97ec5a209909 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088390 Oct 01 21:34:56.389803 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1934/5853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:56 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:57.413844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:57.414381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:57.421315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:57.421820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:57.422342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:57.423099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:57.423574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:57.424012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:57.485981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:57.493874 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-55f7c2e4-a5b0-4b40-8fe2-8b04929864bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084592 Oct 01 21:34:57.494445 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3920/5854] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:57 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:58.516775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:58.517431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:58.524369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:58.524862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:58.525310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:58.526011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:58.526476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:58.526933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:58.530896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=90 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:34:58.591449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:58.599738 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-df8be5fc-9a06-45aa-b58f-e609eae405cf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086912 Oct 01 21:34:58.600320 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1935/5855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:58 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:34:59.623247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:34:59.624003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:34:59.631665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:59.632174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:59.632636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:59.633354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:34:59.633836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:34:59.634312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:34:59.696582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:34:59.704376 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84840a26-26dc-4cf5-ae5a-731eac1dd946 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085112 Oct 01 21:34:59.704959 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3921/5856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:34:59 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:00.727849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:00.728470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:00.735609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:00.736109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:00.736553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:00.737270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:00.737727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:00.738151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:00.799696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:00.807597 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-050e7db0-9eab-496e-a062-8ba3840007b7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083799 Oct 01 21:35:00.808171 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1936/5857] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:00 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:01.831071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:01.831697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:01.838992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:01.839488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:01.839937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:01.840638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:01.841103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:01.841541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:01.909951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:01.918455 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a218668b-4e86-40bd-b59d-3804662872f1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.091325 Oct 01 21:35:01.919072 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3922/5858] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:01 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:35:02.941819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:02.942449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:02.948921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:02.949416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:02.949861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:02.950586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:02.951068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:02.951479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:03.014582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:03.022386 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4d96f889-c3bd-49b2-be6d-ed3b408d245f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085086 Oct 01 21:35:03.022994 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1937/5859] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:02 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:04.046133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:04.046567 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:04.053329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:04.053836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:04.054303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:04.055051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:04.055535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:04.055983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:04.117284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:04.125054 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ef5d941f-a4e4-4da4-88f7-d0371492c90b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083192 Oct 01 21:35:04.125636 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3923/5860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:04 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:05.148010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:05.148641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:05.155553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:05.156041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:05.156486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:05.157193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:05.157659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:05.158091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:05.222323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:05.230680 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f52a8507-a5bd-4f37-8021-1dc532a4d646 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087041 Oct 01 21:35:05.231259 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1938/5861] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:05 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:06.253375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:06.254036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:06.260928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:06.261434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:06.261878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:06.262603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:06.263075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:06.263513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:06.324813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:06.333169 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d3435ced-f093-460f-9951-428ec1ac44a2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083657 Oct 01 21:35:06.333745 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3924/5862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:06 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:07.356762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:07.357290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:07.364652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:07.365135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:07.365573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:07.366262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:07.366742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:07.367167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:07.487641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:07.496059 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7f993aa2-c478-40a2-ac33-293f2731ebcf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.143345 Oct 01 21:35:07.496634 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1939/5863] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:07 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:08.519107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:08.520398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:08.527583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:08.528182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:08.528647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:08.529372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:08.529849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:08.530293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:08.591700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:08.599551 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0dac6c57-8af6-467b-b338-b786cb86b31d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084370 Oct 01 21:35:08.600127 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3925/5864] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:08 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:09.623168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:09.623788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:09.630971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:09.631462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:09.631903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:09.632594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:09.633059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:09.633486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:09.694844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:09.702657 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ffbce976-7429-48dc-b84b-8fc02edb202e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083369 Oct 01 21:35:09.703229 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1940/5865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:09 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:10.726484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:10.727137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:10.734849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:10.735356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:10.735816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:10.736582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:10.737008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:10.737455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:10.804731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:10.812595 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-518f56fe-2593-4f86-b97c-5ad9c2a2c20f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.090544 Oct 01 21:35:10.813231 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3926/5866] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:10 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:11.835215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:11.835921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:11.842979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:11.843463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:11.843901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:11.844597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:11.845056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:11.845481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:11.906236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:11.913877 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-33d7c5fd-4e14-4dee-8e9a-963bd4d38c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082584 Oct 01 21:35:11.914444 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1941/5867] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:11 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:12.937687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:12.938357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:12.945789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:12.946298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:12.946841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:12.947565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:12.948041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:12.948490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:13.009502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:13.017296 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bea509ed-d18b-4c74-9d30-6f44178683fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083752 Oct 01 21:35:13.017876 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3927/5868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:12 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:14.041385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:14.042270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:14.049241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:14.049679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:14.050127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:14.050881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:14.051345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:14.051776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:14.133977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:14.141772 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4b2ba776-d934-449a-9c35-774d84228dc2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.104419 Oct 01 21:35:14.142358 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1942/5869] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:14 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:15.165628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:15.166261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:15.173199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:15.173700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:15.174155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:15.175070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:15.175410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:15.176475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:15.237019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:15.245352 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8e74edd4-cbe1-476f-ba78-335dc8dadecc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083635 Oct 01 21:35:15.245923 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3928/5870] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:15 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:16.271278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:16.272148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:16.279604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:16.280115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:16.280567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:16.281504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:16.281978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:16.282416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:16.343511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:16.351402 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-845cfd1d-8f53-453a-885c-2d98549132e0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084925 Oct 01 21:35:16.351985 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1943/5871] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:16 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:17.374868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:17.375422 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:17.383343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:17.383885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:17.384343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:17.385074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:17.385550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:17.385995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:17.450940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:17.459397 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3bf2dfb3-116c-4883-81cb-2b5714310296 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088648 Oct 01 21:35:17.459990 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3929/5872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:17 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:18.482448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:18.483095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:18.490450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:18.490965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:18.491408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:18.492106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:18.492567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:18.492990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:18.553917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:18.561541 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7171571f-ab7f-497a-98c8-47dbbe05d59a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083331 Oct 01 21:35:18.562119 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1944/5873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:18 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:19.583692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:19.584476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:19.591410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:19.591917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:19.592371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:19.593080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:19.593559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:19.594000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:19.598014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=86 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:35:19.658440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:19.666834 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ee4b5d1-e6ae-46aa-a2c5-0eaa8573fab2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087116 Oct 01 21:35:19.667416 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3930/5874] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:19 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:20.690476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:20.691076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:20.698820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:20.699314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:20.699766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:20.700497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:20.700991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:20.701397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:20.765649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:20.773562 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3798113c-59c5-47e2-a100-c9864f261c00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087136 Oct 01 21:35:20.774150 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1945/5875] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:20 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:21.796434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:21.797068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:21.804300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:21.804802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:21.805258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:21.805983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:21.806449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:21.806920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:21.868061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:21.876027 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0603e9e1-f679-4d33-95a8-205b7b8c6d3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083567 Oct 01 21:35:21.876608 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3931/5876] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:21 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:22.899262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:22.899878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:22.906969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:22.907463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:22.907923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:22.908597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:22.909053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:22.909478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:22.971099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:22.979960 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c28373fb-635d-4531-a815-85455f78f39c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084873 Oct 01 21:35:22.980578 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1946/5877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:22 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:24.002946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:24.003600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:24.010482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:24.011015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:24.011471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:24.012176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:24.012651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:24.013089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:24.075260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:24.083082 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd0db152-9b76-4489-a202-b2bbff107143 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084165 Oct 01 21:35:24.083652 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3932/5878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:23 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:25.105820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:25.106517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:25.113438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:25.113936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:25.114917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:25.115621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:25.116086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:25.116518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:25.179161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:25.186962 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c8191ffe-5e48-4f5b-bd2e-f763ba9298c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085057 Oct 01 21:35:25.187538 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1947/5879] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:25 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:26.210737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:26.211363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:26.214098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:35:26.219634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:26.220185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:26.220649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:26.221372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:26.221879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:26.222330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:26.283500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:26.291901 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-62bbda61-d8f0-4a31-bfb6-89136df1f486 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085108 Oct 01 21:35:26.292478 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3933/5880] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:26 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:27.314727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:27.315279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:27.317974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:35:27.323231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:27.323724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:27.324167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:27.324865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:27.325328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:27.325765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:27.389871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:27.398176 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-159629d0-5aa9-461c-97f6-9d047bd7f10a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087526 Oct 01 21:35:27.398798 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1948/5881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:27 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:28.421581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:28.422215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:28.429837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:28.430340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:28.430825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:28.431539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:28.432014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:28.432488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:28.497000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:28.504819 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0484d91e-78f3-447e-8ec5-c8b763aa3327 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087205 Oct 01 21:35:28.505394 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3934/5882] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:28 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:29.528078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:29.528705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:29.535596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:29.536104 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:29.536544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:29.537248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:29.537709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:29.538142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:29.542106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:35:29.602718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:29.610560 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fa5fa66b-5475-4242-9d99-1382498c7f38 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086456 Oct 01 21:35:29.611135 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1949/5883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:29 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:30.633290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:30.633908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:30.640966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:30.641468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:30.641924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:30.642684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:30.643192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:30.643636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:30.710347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:30.718338 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-58dfe1ae-f877-42a5-81e6-02a14b096ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.089032 Oct 01 21:35:30.718963 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3935/5884] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:30 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:31.742152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:31.742809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:31.748887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:31.749383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:31.749842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:31.750571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:31.751036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:31.751468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:31.812173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:31.819986 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dd5e9705-4b30-4e6c-8404-7a0801d29e19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082674 Oct 01 21:35:31.820557 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1950/5885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:31 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:32.843891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:32.844445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:32.850643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:32.851148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:32.851609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:32.852317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:32.852821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:32.853270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:32.916950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:32.925853 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98b11b08-f9be-45ff-9ca7-7446a0cca3da tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086204 Oct 01 21:35:32.927505 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3936/5886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:32 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:33.949211 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:33.949859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:33.956782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:33.957271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:33.958287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:33.959007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:33.959466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:33.959892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:34.022843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:34.030747 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a5e87177-f493-4db2-8fcd-aa20a2f5e1d2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085444 Oct 01 21:35:34.031363 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1951/5887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:33 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:35.053984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:35.054661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:35.061584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:35.062095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:35.062586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:35.063307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:35.063789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:35.064238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:35.125376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:35.133143 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4049c117-f109-4281-9705-ebf808a3980a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083331 Oct 01 21:35:35.133755 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3937/5888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:35 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:36.156349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:36.156963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:36.164451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:36.164940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:36.165378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:36.166073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:36.166571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:36.167003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:36.227682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:36.235380 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-41aceb12-7e91-4dbc-8d41-fe577d960c3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082965 Oct 01 21:35:36.235951 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1952/5889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:36 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:37.258714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:37.259345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:37.266275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:37.266808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:37.267287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:37.267974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:37.268446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:37.268884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:37.333534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:37.341289 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7685e547-1110-4e94-a95c-46d54f522eb1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086619 Oct 01 21:35:37.341866 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3938/5890] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:37 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:38.365882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:38.366425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:38.373273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:38.373760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:38.374197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:38.374928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:38.375385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:38.375810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:38.440080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:38.447991 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c583e04e-c184-403e-98f0-90cee7878c87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086735 Oct 01 21:35:38.448562 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1953/5891] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:38 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:39.470183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:39.470840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:39.477739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:39.478243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:39.478729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:39.479439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:39.479907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:39.480350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:39.541205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:39.548994 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b1f5887c-96f7-45ea-bece-110a10400ecb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082733 Oct 01 21:35:39.549563 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3939/5892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:39 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:40.573119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:40.573742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:40.580615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:40.581106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:40.581552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:40.582249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:40.583365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:40.583797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:40.649014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:40.657956 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3515dc01-7610-406c-8508-4f3597cae634 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088722 Oct 01 21:35:40.658652 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1954/5893] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:40 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:41.681492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:41.682119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:41.688947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:41.689446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:41.689898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:41.690626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:41.691110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:41.691550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:41.752357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:41.760196 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d7769c16-e6d8-4f1d-8561-4aebcbde3ce6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082875 Oct 01 21:35:41.760772 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3940/5894] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:41 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:42.783795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:42.784410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:42.791666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:42.792155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:42.792596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:42.793288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:42.793746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:42.794474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:42.855001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:42.862666 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5d318d06-cf4e-408d-87e9-dc8f35550f0f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082750 Oct 01 21:35:42.863236 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1955/5895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:42 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:43.886886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:43.887514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:43.894597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:43.895100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:43.895590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:43.896337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:43.896806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:43.897246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:43.960586 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:43.968491 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24f461da-2009-4b22-844c-4d7da89417c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085597 Oct 01 21:35:43.969113 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3941/5896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:43 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:35:44.991418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:44.992045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:44.999080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:44.999572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:45.000016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:45.000722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:45.001186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:45.001617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:45.064067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:45.072514 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d975b2bf-0a6c-4079-b36a-84566ee967bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085068 Oct 01 21:35:45.073092 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1956/5897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:44 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:46.095561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:46.096198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:46.103744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:46.104257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:46.104720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:46.105445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:46.105924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:46.106377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:46.170900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:46.179130 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1eec5e8d-2eb8-472a-abb7-e8d08d1214c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087503 Oct 01 21:35:46.179712 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3942/5898] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:46 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:47.201367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:47.201991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:47.208911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:47.209397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:47.209838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:47.210556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:47.211017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:47.211446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:47.274655 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:47.282314 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5372c912-c0ec-43e6-9b2a-ce107e4f1d96 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084970 Oct 01 21:35:47.282922 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1957/5899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:47 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:48.306230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:48.306806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:48.313686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:48.314189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:48.314681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:48.315393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:48.315869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:48.316316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:48.377424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:48.386026 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95f7a481-c00c-4763-87b3-8254ffeaabcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084572 Oct 01 21:35:48.386634 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3943/5900] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:48 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:49.408814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:49.409397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:49.416902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:49.417398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:49.417892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:49.418631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:49.419099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:49.419534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:49.480385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:49.488194 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d56fae3e-fd44-4900-9123-a2d1e6a6cb56 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083377 Oct 01 21:35:49.488768 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1958/5901] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:49 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:50.511159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:50.511811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:50.518808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:50.519317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:50.519775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:50.520490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:50.520973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:50.521413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:50.524306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:35:50.584499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:50.592263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f00f5976-d2e3-42fd-8678-9b4828a93497 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085052 Oct 01 21:35:50.592835 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3944/5902] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:50 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:51.615784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:51.616431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:51.623284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:51.623771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:51.624206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:51.624893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:51.625348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:51.625771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:51.688193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:51.696490 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-29f9665e-a611-4e76-89c8-a3d7b440cd54 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084664 Oct 01 21:35:51.697059 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1959/5903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:51 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:52.719476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:52.720103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:52.726919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:52.727421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:52.727876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:52.728634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:52.729099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:52.729558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:52.791082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:52.798939 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71cf421d-2224-49a1-afb3-7f3262c88973 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083331 Oct 01 21:35:52.799515 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3945/5904] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:52 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:53.822415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:53.823084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:53.830338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:53.830861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:53.831306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:53.832013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:53.832476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:53.833442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:53.898423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:53.906562 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1547f18a-79a9-4bcf-8392-4feafa07568d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087870 Oct 01 21:35:53.907242 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1960/5905] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:53 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:54.931196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:54.931855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:54.938779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:54.939283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:54.939740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:54.940452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:54.940930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:54.941386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:55.005222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:55.013086 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5aab82bb-19b8-478e-ba60-17e19212e97b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086699 Oct 01 21:35:55.013660 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3946/5906] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:54 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:56.036318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:56.036946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:56.043979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:56.044509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:56.044959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:56.046018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:56.046117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:56.046566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:56.111139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:56.120272 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-551bbcfa-0140-459a-becb-761663780f74 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088024 Oct 01 21:35:56.120852 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1961/5907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:56 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:57.143936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:57.144598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:57.147969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:35:57.153678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:57.154186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:57.154689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:57.155415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:57.155928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:57.156359 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:57.220777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:57.228633 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-539efe30-01bb-48f3-ba9b-e7b0513e9fb9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088641 Oct 01 21:35:57.229221 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3947/5908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:57 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:58.251071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:58.251724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:58.254465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:35:58.259871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:58.260362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:58.260803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:58.261504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:58.261963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:58.262396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:58.323519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:58.332249 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5c68b08a-58de-4132-b142-d489e5ff3943 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085121 Oct 01 21:35:58.333317 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1962/5909] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:58 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:35:59.355527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:35:59.356096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:35:59.362977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:59.363475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:59.364536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:59.365245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:35:59.365716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:35:59.366157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:35:59.426195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:35:59.434688 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e661b8ce-bacb-4eb8-84c5-73bb5c34508a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083154 Oct 01 21:35:59.435254 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3948/5910] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:35:59 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:00.457255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:00.457878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:00.464763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:00.465249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:00.465687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:00.466378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:00.466863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:00.467287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:00.471230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:36:00.528947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:00.536928 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-de2da4f4-8748-4a9e-ac0f-4256037bdbc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083569 Oct 01 21:36:00.537502 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1963/5911] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:00 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:01.560503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:01.561128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:01.568513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:01.569015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:01.569492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:01.570201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:01.570706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:01.571204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:01.633082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:01.640836 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb4ce1ef-2d03-4709-bc76-1d24a8b46431 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084198 Oct 01 21:36:01.641394 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3949/5912] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:01 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:02.664278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:02.664910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:02.671500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:02.672004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:02.672451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:02.673223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:02.673624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:02.674060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:02.735431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:02.743279 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-79873841-7944-471f-b187-dcb3f22b0759 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083632 Oct 01 21:36:02.743854 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1964/5913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:02 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:03.765529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:03.766155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:03.772858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:03.773364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:03.773823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:03.774568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:03.775071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:03.775512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:03.842555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:03.851369 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6744ab5e-f6f3-4ec9-af55-024352cb4125 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.089999 Oct 01 21:36:03.851943 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3950/5914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:03 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:04.874149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:04.874746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:04.882220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:04.882737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:04.883182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:04.883879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:04.884342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:04.884774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:04.950817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:04.958729 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4ac92ce2-14b3-44f5-96b4-7e53c369dd2b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088586 Oct 01 21:36:04.959306 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1965/5915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:04 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:05.981372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:05.982011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:05.989031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:05.989541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:05.990001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:05.990754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:05.991240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:05.991688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:06.054113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:06.062076 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9226ef2a-89d6-425c-822f-78705b97069e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084682 Oct 01 21:36:06.062676 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3951/5916] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:05 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:07.085877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:07.086512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:07.093539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:07.094013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:07.094454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:07.095183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:07.095683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:07.096120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:07.157252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:07.165704 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e4c557a3-b48b-4cfe-85c9-403eb952daf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084273 Oct 01 21:36:07.166272 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1966/5917] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:07 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:08.188177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:08.188811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:08.195728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:08.196235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:08.196696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:08.197409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:08.197884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:08.198331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:08.260074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:08.268066 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c42dd0e1-12e9-4642-8b74-11348e06424e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083827 Oct 01 21:36:08.268641 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3952/5918] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:08 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:09.291053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:09.291674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:09.298694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:09.299135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:09.299581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:09.300286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:09.300747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:09.301176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:09.364890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:09.373311 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a33c311e-db24-46d5-90c7-9fee200cf569 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086188 Oct 01 21:36:09.373893 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1967/5919] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:09 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:10.397398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:10.398028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:10.404968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:10.405479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:10.405936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:10.406735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:10.407213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:10.407660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:10.469674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:10.477471 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-24ab7a5a-96e6-4a4c-879e-d303a9dbb3f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084661 Oct 01 21:36:10.478042 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3953/5920] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:10 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:11.500002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:11.500629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:11.507601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:11.508132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:11.508602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:11.509325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:11.509766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:11.510194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:11.571181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:11.578881 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-854fdc45-95e1-4a91-8856-616f2daf9bc3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082830 Oct 01 21:36:11.579454 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1968/5921] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:11 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:12.601666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:12.602294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:12.609174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:12.609678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:12.610128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:12.610865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:12.611339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:12.611793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:12.683620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:12.691484 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da4e52f2-b2b8-4d2b-b9cd-3cb631bc7bc9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.094365 Oct 01 21:36:12.692066 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3954/5922] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:12 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:13.715217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:13.715841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:13.723180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:13.723668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:13.724111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:13.724801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:13.725261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:13.725692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:13.787996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:13.795870 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-568c948d-ab3e-4803-951c-a683b7527cf0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084531 Oct 01 21:36:13.796442 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1969/5923] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:13 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:14.820235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:14.820863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:14.827726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:14.828223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:14.828672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:14.829382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:14.829849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:14.830288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:14.890481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:14.898355 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4af3198d-317e-436d-aace-d82cd5eb71c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082591 Oct 01 21:36:14.898957 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3955/5924] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:14 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:15.921405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:15.922026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:15.929691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:15.930178 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:15.930646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:15.931338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:15.931791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:15.932216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:15.996568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:16.004374 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-68328a74-6029-4cc2-bdaa-07c83bdf8f3b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086886 Oct 01 21:36:16.004949 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1970/5925] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:15 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:17.027095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:17.027733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:17.034845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:17.035356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:17.035817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:17.036541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:17.037022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:17.037474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:17.099333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:17.107689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b36a6316-1fd2-4cc6-9023-527f39ef6094 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084513 Oct 01 21:36:17.108270 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3956/5926] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:17 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:18.131004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:18.131645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:18.138552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:18.139045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:18.139528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:18.140226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:18.140686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:18.141116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:18.218531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:18.226904 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe8a046f-e681-40ce-aec8-115ec2a93aa2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.099797 Oct 01 21:36:18.227474 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1971/5927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:18 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:19.249929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:19.250587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:19.258148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:19.258696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:19.259160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:19.259877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:19.260361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:19.260812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:19.322222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:19.330061 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e252de83-c7ad-4d6d-8885-65c83328b112 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084101 Oct 01 21:36:19.330665 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3957/5928] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:19 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:20.353518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:20.354080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:20.360982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:20.361507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:20.361952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:20.362678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:20.363147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:20.363576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:20.424232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:20.432178 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b27f4748-23aa-4765-9899-aa3f783f2780 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082676 Oct 01 21:36:20.432754 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1972/5929] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:20 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:21.456666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:21.457299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:21.464722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:21.465227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:21.465693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:21.466408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:21.466945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:21.467654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:21.471340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:36:21.533777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:21.541554 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e9e1008b-3167-4433-965b-f136723cd4e8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.089658 Oct 01 21:36:21.542132 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3958/5930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:21 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:36:22.565229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:22.565878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:22.567898 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:36:22.568047 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:36:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:36:22.569396 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:36:22.569508 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:36:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:36:22.580870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:22.581326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:22.581775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:22.582484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:22.582970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:22.583403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:22.645283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:22.653147 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f4195aac-f7d6-4f32-b612-d362d5a7dd7a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.091806 Oct 01 21:36:22.653730 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1973/5931] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:22 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:23.676612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:23.677378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:23.679580 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:36:23.679771 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:36:23.681251 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:36:23.681365 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:36:23.690765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:23.691281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:23.691785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:23.692560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:23.693043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:23.693494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:23.770761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:23.779740 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eaf3e0e9-d947-44c6-a28a-83d8482311a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.107031 Oct 01 21:36:23.780336 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3959/5932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:23 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:24.803077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:24.803738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:24.810667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:24.811161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:24.811606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:24.812307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:24.812773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:24.813205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:24.878034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:24.886531 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0347ab61-9b26-4b75-b04f-dfabfffd9f0a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087636 Oct 01 21:36:24.887119 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1974/5933] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:24 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:25.910593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:25.911225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:25.918750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:25.919254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:25.919709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:25.920421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:25.920896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:25.921337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:25.985632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:25.993467 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4a35636a-58dd-4e00-9796-c9ec9095361a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086929 Oct 01 21:36:25.994038 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3960/5934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:25 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:27.016468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:27.017091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:27.024020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:27.024508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:27.024948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:27.025646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:27.026107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:27.026554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:27.088423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:27.096176 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6530d93c-97e4-4d1b-8f9b-a9b2e9457186 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083618 Oct 01 21:36:27.096752 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1975/5935] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:27 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:28.119619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:28.120241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:28.123084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:36:28.128320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:28.128825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:28.129277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:28.129988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:28.130462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:28.130930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:28.192908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:28.201310 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-161ae813-05e5-4c9e-925e-a41659550522 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086112 Oct 01 21:36:28.201904 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3961/5936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:28 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:29.224416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:29.225043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:29.227865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:36:29.233322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:29.233824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:29.234273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:29.235011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:29.235480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:29.235917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:29.296926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:29.304892 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fd084fa9-7fe5-42d2-aba8-d5519a8b0c3c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084471 Oct 01 21:36:29.305472 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1976/5937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:29 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:30.327596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:30.328150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:30.335061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:30.335562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:30.336010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:30.337207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:30.337713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:30.338151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:30.402043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:30.409845 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c83ddf42-e8f9-412b-9f23-9e2bcfad5fe7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086229 Oct 01 21:36:30.410422 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3962/5938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:30 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:31.434777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:31.435430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:31.441469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:31.441967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:31.442412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:31.443131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:31.443597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:31.444027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:31.448002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:36:31.505120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:31.512874 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f3eb793f-730f-4a77-9cd4-27fbd0f97c62 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082923 Oct 01 21:36:31.513393 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1977/5939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:31 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:36:32.535101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:32.535730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:32.542828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:32.543314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:32.543765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:32.544468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:32.544936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:32.545376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:32.607478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:32.615425 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a7ad65a-a105-4e34-b7c1-a2fcd6cf4358 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084238 Oct 01 21:36:32.615992 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3963/5940] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:32 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:33.638377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:33.639040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:33.645862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:33.646295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:33.646766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:33.647455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:33.647909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:33.648336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:33.714772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:33.722683 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ef6effc5-797c-4722-886f-2587b45f18f8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088157 Oct 01 21:36:33.723257 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1978/5941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:33 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:34.745940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:34.746634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:34.753408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:34.753909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:34.754358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:34.755090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:34.755564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:34.756001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:34.824111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:34.831847 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9934516b-66f9-43f6-ae41-d67a937cc221 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.090432 Oct 01 21:36:34.832409 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3964/5942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:34 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:35.854031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:35.854710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:35.861661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:35.862161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:35.862645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:35.863350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:35.863813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:35.864246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:35.929325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:35.937010 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6b56f831-a19d-4466-bad8-e457af596ed0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086957 Oct 01 21:36:35.937591 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1979/5943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:35 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:36.960389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:36.961019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:36.968608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:36.969107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:36.969560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:36.970265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:36.970764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:36.971206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:37.032928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:37.040843 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebaf30bd-f378-43e9-9a0d-0abaa4bc07a7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084362 Oct 01 21:36:37.046005 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3965/5944] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:36 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:38.064961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:38.065574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:38.072915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:38.073406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:38.073858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:38.074580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:38.075045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:38.075477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:38.135815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:38.143548 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-11a07b80-d34d-4201-a562-1fcb5023b517 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082514 Oct 01 21:36:38.144115 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1980/5945] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:38 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:39.167475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:39.168103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:39.175078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:39.175582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:39.176033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:39.176740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:39.177212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:39.177907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:39.245210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:39.253140 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c92880ae-7c4c-45e3-a83f-373307c86bd0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.090298 Oct 01 21:36:39.253713 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3966/5946] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:39 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:40.276077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:40.276694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:40.283641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:40.284127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:40.284569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:40.285262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:40.285720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:40.286146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:40.346974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:40.355185 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-46a3865f-f811-48e8-b735-52d39b80fd21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083026 Oct 01 21:36:40.355758 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1981/5947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:40 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:41.378786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:41.379354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:41.386857 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:41.387367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:41.387825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:41.388539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:41.389015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:41.389459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:41.451728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:41.459531 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7117d3de-da46-4fc6-8f4e-4b77c5f809d9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084798 Oct 01 21:36:41.460109 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3967/5948] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:41 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:42.483285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:42.483909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:42.490825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:42.491316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:42.491763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:42.492454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:42.492922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:42.493352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:42.557205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:42.565119 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9638a39c-2dad-46f9-b01b-3262537541bd tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086378 Oct 01 21:36:42.565723 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1982/5949] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:42 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:43.589096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:43.589718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:43.596696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:43.597197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:43.597650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:43.598358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:43.598861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:43.599304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:43.660868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:43.668883 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ad1182d-25f5-405d-b290-75dab828674b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084366 Oct 01 21:36:43.669462 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3968/5950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:43 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:44.692706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:44.693328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:44.700873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:44.701370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:44.701822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:44.702552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:44.703053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:44.703491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:44.764173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:44.772082 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0ee435d7-c902-4b25-9413-5a31f16c2553 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083313 Oct 01 21:36:44.772661 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1983/5951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:44 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:36:45.796394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:45.797023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:45.804224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:45.804734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:45.805196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:45.805919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:45.806395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:45.806867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:45.868358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:45.876308 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4ae6599a-b2fa-4b3d-b240-1225506ed7d4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083878 Oct 01 21:36:45.876887 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3969/5952] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:45 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:46.899944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:46.900534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:46.907471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:46.907998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:46.908449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:46.909153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:46.909627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:46.910062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:46.971384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:46.979327 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ab6124e2-dfd1-41ec-bca5-cd2bcdf71827 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083395 Oct 01 21:36:46.979910 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1984/5953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:46 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:48.002755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:48.003381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:48.010737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:48.011237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:48.011690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:48.012392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:48.012860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:48.013296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:48.077844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:48.085660 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0fba2b18-9fbd-46ed-ac5d-4c037df555ba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086909 Oct 01 21:36:48.086229 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3970/5954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:47 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:49.109716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:49.110334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:49.117222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:49.117711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:49.118152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:49.118885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:49.119340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:49.119770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:49.183222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:49.191664 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-caf381ca-197b-47ec-b801-c509784b52bb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085851 Oct 01 21:36:49.192251 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1985/5955] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:49 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:50.214638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:50.215300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:50.222257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:50.222794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:50.223254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:50.223970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:50.224447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:50.224893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:50.285578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:50.293761 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-621eb6f7-b72c-4202-9dd3-e2cd42c9f7a0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083157 Oct 01 21:36:50.294337 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3971/5956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:50 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:51.317353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:51.317889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:51.325426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:51.325912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:51.326352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:51.327077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:51.327536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:51.327963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:51.392190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:51.400176 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b0362ec7-645b-4e14-913d-82a2c7dfe468 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086846 Oct 01 21:36:51.400759 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1986/5957] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:51 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:52.423073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:52.423632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:52.430770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:52.431278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:52.431736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:52.432450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:52.432922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:52.433364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:52.435973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:36:52.498158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:52.505914 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a16f1b17-59d8-4f59-90e2-9d45900f1dec tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086905 Oct 01 21:36:52.506516 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3972/5958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:52 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:53.530073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:53.530720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:53.537628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:53.538122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:53.538594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:53.539291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:53.539759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:53.540191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:53.600941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:53.609330 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c015c38a-39cf-4043-ab28-37e48f57542b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083170 Oct 01 21:36:53.609887 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1987/5959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:53 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:54.631472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:54.632110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:54.639325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:54.639839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:54.640445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:54.641173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:54.641654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:54.642103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:54.703949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:54.711802 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-81036de7-5186-4e73-99c9-ca53575f77ff tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084309 Oct 01 21:36:54.712382 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3973/5960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:54 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:55.735719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:55.736326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:55.743330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:55.744316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:55.744758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:55.745458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:55.745918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:55.746353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:55.810765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:55.818591 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-45a5e937-8c12-4757-a5bc-9d86301bc5fb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086771 Oct 01 21:36:55.819763 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1988/5961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:55 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:56.842210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:56.842870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:56.849796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:56.850307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:56.850806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:56.851526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:56.852006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:56.852455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:56.917543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:56.925426 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-963fea25-85f6-4385-b81a-8c3c4e0b5015 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087211 Oct 01 21:36:56.926003 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3974/5962] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:56 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:57.949521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:57.950072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:57.956998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:57.957474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:57.957911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:57.958630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:57.959088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:57.959511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:58.019700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:58.027513 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e956ffcd-c3da-4e10-b36b-7e3467b5a7dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082575 Oct 01 21:36:58.028088 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1989/5963] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:57 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:36:59.050526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:36:59.051194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:36:59.054157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:36:59.059853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:59.060362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:59.060814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:59.061529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:36:59.062008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:36:59.062452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:36:59.123246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:36:59.131003 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-22d5e527-13b6-4b3a-836e-1b667aeafdee tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084419 Oct 01 21:36:59.131590 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3975/5964] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:36:59 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:00.153820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:00.154438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:00.157163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:37:00.162389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:00.162902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:00.163345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:00.164037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:00.164499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:00.164924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:00.229498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:00.237191 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b3c43a63-e8c5-4eea-8fbf-0f7c1ba5ad13 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087781 Oct 01 21:37:00.237768 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1990/5965] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:00 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:01.260031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:01.260651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:01.267601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:01.268101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:01.268547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:01.269254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:01.269720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:01.270582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:01.332197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:01.340117 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d6ffe8c-0534-4da1-be50-dc03416cab67 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084628 Oct 01 21:37:01.340674 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3976/5966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:01 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:02.363618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:02.364249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:02.370408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:02.370939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:02.371391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:02.372123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:02.372591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:02.373029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:02.375640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:37:02.438777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:02.447283 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e7cb58d7-a982-4768-a90f-bbfdcc38ac23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087226 Oct 01 21:37:02.447865 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1991/5967] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:02 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:03.470329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:03.470983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:03.477353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:03.478448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:03.478936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:03.479642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:03.480113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:03.480550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:03.542631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:03.550578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6614e298-bfc0-4fe5-bc32-1fd798264564 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084118 Oct 01 21:37:03.551163 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3977/5968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:03 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:04.573374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:04.573987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:04.580839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:04.581328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:04.581765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:04.582451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:04.582928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:04.583349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:04.643735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:04.651975 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-67b30a95-91ec-4ded-a829-87e114df12f3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082617 Oct 01 21:37:04.652553 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1992/5969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:04 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:05.680145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:05.680773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:05.688194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:05.688691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:05.689143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:05.689848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:05.690317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:05.690782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:05.758553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:05.766972 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-46784c6e-d95b-41a0-b7b5-96627d2e07a5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.091040 Oct 01 21:37:05.767541 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3978/5970] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:05 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:06.789945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:06.790589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:06.797498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:06.797997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:06.798438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:06.799183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:06.799646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:06.800081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:06.862875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:06.870740 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-670e58c9-70dc-4765-b89e-76d78e1dbcb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084697 Oct 01 21:37:06.871788 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1993/5971] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:06 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:37:07.894240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:07.894895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:07.902264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:07.902799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:07.903256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:07.903967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:07.904445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:07.904893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:07.966676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:07.974405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7fdaedb3-c2c5-4ce2-bacd-b5d49de34682 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084167 Oct 01 21:37:07.975003 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3979/5972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:07 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:08.998725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:08.999356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:09.006329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:09.006870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:09.007323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:09.008025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:09.008490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:09.008925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:09.073177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:09.080926 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e6e614a8-6aab-4177-a59f-1f762ed28bf8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086840 Oct 01 21:37:09.081509 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1994/5973] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:08 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:10.103717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:10.104474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:10.111372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:10.111872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:10.112326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:10.113028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:10.113509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:10.113946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:10.175251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:10.183780 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-49e4447e-9ba1-4e51-9ff8-8334a1a7ea8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084052 Oct 01 21:37:10.184372 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3980/5974] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:10 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:11.207659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:11.208346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:11.215916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:11.216414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:11.216862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:11.217563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:11.218028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:11.218461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:11.279459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:11.287170 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b73ec5ec-b5ca-408b-8586-26b58a9cdb15 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083450 Oct 01 21:37:11.287751 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1995/5975] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:11 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:37:12.309694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:12.310237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:12.317325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:12.317843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:12.318305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:12.319059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:12.319541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:12.319991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:12.382542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:12.390388 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e6cfd5ef-1837-4e01-956d-087a626ba969 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084739 Oct 01 21:37:12.390997 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3981/5976] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:12 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:13.413511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:13.414058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:13.421368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:13.421858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:13.422297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:13.423026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:13.423484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:13.423910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:13.484767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:13.492556 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-36dee38c-eb0a-4543-b4b8-0f996a871c4a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083097 Oct 01 21:37:13.493130 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1996/5977] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:13 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:14.515901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:14.516524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:14.523598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:14.524100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:14.524551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:14.525255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:14.525730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:14.526167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:14.594064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:14.601987 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-73926b20-c786-43bc-bcff-2e76e2260f2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.090119 Oct 01 21:37:14.602588 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3982/5978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:14 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:15.625942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:15.626585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:15.633424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:15.633913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:15.634353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:15.635136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:15.635594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:15.636019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:15.699310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:15.707004 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7580f088-9d0c-4830-9740-8442861fbeab tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085006 Oct 01 21:37:15.707594 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1997/5979] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:15 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:16.730827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:16.731463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:16.738410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:16.738942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:16.739395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:16.740101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:16.740570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:16.741039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:16.801850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:16.810451 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-307687ca-75b6-4604-9e32-db298b53ff2a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083566 Oct 01 21:37:16.811048 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3983/5980] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:16 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:17.833812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:17.835080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:17.843024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:17.843509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:17.843978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:17.844674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:17.845130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:17.845553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:17.905908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:17.913663 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-70ae906e-a34d-481e-beb1-34b9b188a707 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083786 Oct 01 21:37:17.914243 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1998/5981] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:17 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:18.936920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:18.937460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:18.944423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:18.944919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:18.945372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:18.946075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:18.946599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:18.947037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:19.010090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:19.017825 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ff8a20f-176a-42b2-8edd-ef3560eb675f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084949 Oct 01 21:37:19.018410 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3984/5982] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:18 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:20.041215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:20.041835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:20.049409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:20.049909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:20.050354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:20.051095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:20.051561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:20.051993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:20.112608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:20.121100 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5a3ad344-9ab7-41af-9ba1-e241cd6ab9af tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083156 Oct 01 21:37:20.121672 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 1999/5983] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:20 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:37:21.143934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:21.144571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:21.151507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:21.152019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:21.152517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:21.153334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:21.153716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:21.154168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:21.216815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:21.224832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-724ca6ee-39a0-4c6f-952a-674c6f433302 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084800 Oct 01 21:37:21.225417 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3985/5984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:21 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:22.248512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:22.249166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:22.256033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:22.256523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:22.256962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:22.257654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:22.258112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:22.258562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:22.323594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:22.331241 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a3fe3d0a-f929-4672-8e39-51f1e324ee0e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086941 Oct 01 21:37:22.331815 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2000/5985] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:22 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:23.355363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:23.355996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:23.362920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:23.363421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:23.363873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:23.364576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:23.365048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:23.365490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:23.368072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:37:23.436054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:23.443925 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-65a2331d-efed-4999-9fe8-21a548a95edb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.093119 Oct 01 21:37:23.444495 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3986/5986] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:23 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:24.465753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:24.466433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:24.473455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:24.473949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:24.474398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:24.475124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:24.475592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:24.476024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:24.537891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:24.546162 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-908007f2-4954-435f-abdd-6d7250e6d737 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084351 Oct 01 21:37:24.546776 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2001/5987] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:24 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:25.570056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:25.570714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:25.577999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:25.578516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:25.578989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:25.579694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:25.580164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:25.580604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:25.641989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:25.649744 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cbed828c-7042-4d07-9933-3c05e658292c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083703 Oct 01 21:37:25.650321 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3987/5988] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:25 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:26.673902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:26.674535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:26.681712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:26.682207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:26.682681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:26.683374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:26.683830 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:26.684256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:26.744876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:26.752604 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-84f2ce7b-1372-4609-af50-ced56265cdc5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082742 Oct 01 21:37:26.753176 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2002/5989] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:26 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:27.776081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:27.776654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:27.783647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:27.784148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:27.784606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:27.785346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:27.785820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:27.786271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:27.848351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:27.856882 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3840711a-3a52-4b17-b4e0-812ee4320872 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084852 Oct 01 21:37:27.857464 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3988/5990] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:27 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:28.879774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:28.880429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:28.887311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:28.887799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:28.888238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:28.888926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:28.889382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:28.889806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:28.953495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:28.962070 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-501950a6-99e8-4a79-bc3f-e6cd617ac52a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086157 Oct 01 21:37:28.962680 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2003/5991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:28 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:29.985287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:29.985954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:29.988700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:37:29.994153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:29.994686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:29.995143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:29.995871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:29.996334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:29.996778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:30.059776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:30.067820 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-379345c4-376c-4313-adcc-1a54fb8a0385 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086425 Oct 01 21:37:30.068544 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3989/5992] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:29 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:31.091983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:31.092595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:31.094506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:37:31.102175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:31.102804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:31.103252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:31.103955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:31.105057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:31.105484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:31.169132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:31.176876 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2097b384-0ea3-4531-a127-1388bca384d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.089717 Oct 01 21:37:31.177453 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2004/5993] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:31 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:32.200028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:32.200662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:32.206749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:32.207255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:32.207714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:32.208427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:32.208900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:32.209345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:32.275760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:32.283751 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-03c53d17-3b06-4e6d-ac32-3f054ebe713d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087982 Oct 01 21:37:32.284335 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3990/5994] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:32 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:33.307848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:33.308426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:33.315268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:33.315755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:33.316196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:33.316900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:33.317361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:33.317791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:33.320382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:37:33.381819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:33.391196 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ae4c8559-c74a-4c26-9ab6-4731719f505f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088131 Oct 01 21:37:33.391990 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2005/5995] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:33 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:34.414746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:34.415295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:34.422302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:34.422836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:34.423292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:34.423991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:34.424459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:34.424896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:34.488043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:34.495796 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bc579f9d-49d3-4aaa-baf8-95a88cf62fe1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085101 Oct 01 21:37:34.496384 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3991/5996] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:34 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:35.518783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:35.519456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:35.526863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:35.527353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:35.527797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:35.528637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:35.529177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:35.529612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:35.590481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:35.598155 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aef2c619-6600-42d6-bdb0-d2fce734967c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083353 Oct 01 21:37:35.598779 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2006/5997] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:35 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:36.622356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:36.623017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:36.629884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:36.630385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:36.630878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:36.631583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:36.632053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:36.632496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:36.694920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:36.702793 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-542edeea-51d9-42bd-a798-83fc8ec29f0d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085026 Oct 01 21:37:36.703369 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3992/5998] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:36 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:37.726817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:37.727378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:37.734258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:37.734783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:37.735228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:37.735919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:37.736374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:37.736800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:37.799864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:37.808464 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-10b517db-d806-491e-ba78-775996be5c07 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085763 Oct 01 21:37:37.809032 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2007/5999] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:37 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:38.833489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:38.834130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:38.841844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:38.842339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:38.842825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:38.843538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:38.844008 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:38.844447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:38.905180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:38.913051 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e32f0fc8-fe99-4f08-a9e2-0442675c56ce tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085257 Oct 01 21:37:38.913636 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3993/6000] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:38 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:39.936179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:39.937443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:39.944894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:39.945500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:39.946002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:39.946882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:39.947352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:39.947786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:40.012437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:40.020198 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-37033176-d382-4e02-83e1-4a1815ded4cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088010 Oct 01 21:37:40.020783 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2008/6001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:39 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:41.043634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:41.044259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:41.051184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:41.051684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:41.052146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:41.052840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:41.053570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:41.054005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:41.117623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:41.126151 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5f2eaf8c-f7f8-4c11-a962-a47fdbb5ad8b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087026 Oct 01 21:37:41.126769 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3994/6002] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:41 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:42.148581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:42.149202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:42.156302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:42.156791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:42.157234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:42.157933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:42.158421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:42.158872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:42.219685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:42.227455 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-668096a5-c446-4f7b-b9b2-fa38ad8cdb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082795 Oct 01 21:37:42.228027 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2009/6003] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:42 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:43.249924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:43.250593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:43.257594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:43.258135 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:43.258631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:43.259348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:43.259828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:43.260773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:43.320930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:43.329364 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5c658d51-1fd9-4400-853a-cfd458ae87c3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083430 Oct 01 21:37:43.329946 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3995/6004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:43 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:44.352619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:44.353183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:44.359977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:44.360465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:44.360905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:44.361595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:44.362074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:44.362524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:44.426305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:44.434890 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-512ac865-8811-4398-a86b-b5e71b6bf56c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086231 Oct 01 21:37:44.435490 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2010/6005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:44 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:45.462283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:45.462945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:45.470637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:45.471142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:45.471596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:45.472313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:45.472783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:45.473219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:45.538294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:45.546062 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-89931fab-7860-4c34-b29a-3881416fcb87 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087689 Oct 01 21:37:45.546677 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3996/6006] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:45 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:46.568881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:46.569495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:46.576912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:46.577398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:46.577844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:46.578626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:46.579005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:46.579428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:46.640684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:46.648716 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-009daa9c-a376-4058-a01f-cf1ee3c03f33 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083672 Oct 01 21:37:46.649281 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2011/6007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:46 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:47.672199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:47.672826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:47.679956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:47.680459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:47.680917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:47.681629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:47.682104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:47.682577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:47.743744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:47.751579 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b5eedf89-cb54-4e99-ace2-df1a3d7d7442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083355 Oct 01 21:37:47.752155 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3997/6008] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:47 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:48.775640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:48.776887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:48.783919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:48.784412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:48.784862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:48.785564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:48.786027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:48.786452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:48.850459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:48.858349 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-72a217a2-e12d-4922-93f6-15b933387bdc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086897 Oct 01 21:37:48.858955 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2012/6009] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:48 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:49.881890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:49.882583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:49.889539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:49.890045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:49.890524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:49.891244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:49.891723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:49.892189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:49.956872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:49.965263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1fc1b54b-4ece-4c0d-8cd6-39116db20ad2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087356 Oct 01 21:37:49.965835 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3998/6010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:49 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:50.988347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:50.988973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:50.997321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:50.997818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:50.998264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:50.999004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:50.999472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:50.999910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:51.062203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:51.070897 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bb0d0828-0268-4460-bf6f-9cc0b349e807 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086401 Oct 01 21:37:51.071510 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2013/6011] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:50 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:52.093840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:52.094469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:52.101424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:52.101930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:52.102384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:52.103111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:52.103583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:52.104021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:52.169316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:52.177189 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d52b4f0d-7693-4784-93da-a01045ef0de1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087239 Oct 01 21:37:52.177764 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 3999/6012] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:52 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:53.201911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:53.202547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:53.209407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:53.209900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:53.210342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:53.211063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:53.211520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:53.211952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:53.274027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:53.282403 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5e0cf4a8-3a70-4f1a-8201-9cd9ce0baf23 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084934 Oct 01 21:37:53.283015 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2014/6013] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:53 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:54.305524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:54.306150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:54.312922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:54.313421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:54.313873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:54.314611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:54.315081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:54.315517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:54.318053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:37:54.377695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:54.385511 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0e835234-134c-4016-aebe-f410ca16ebf6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084263 Oct 01 21:37:54.386094 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4000/6014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:54 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:55.408898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:55.409432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:55.416792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:55.417282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:55.417727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:55.418436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:55.418915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:55.419348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:55.480733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:55.488429 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-968d525d-6b01-4fc5-8c62-0c3efc238e2e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083560 Oct 01 21:37:55.489000 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2015/6015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:55 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:56.512147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:56.512780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:56.519756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:56.520259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:56.520709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:56.521424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:56.521893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:56.522334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:56.583059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:56.590761 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-151559f4-bf9e-49ba-9f1e-3f5931513372 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083134 Oct 01 21:37:56.591331 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4001/6016] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:56 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:57.613220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:57.613872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:57.620875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:57.621388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:57.621832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:57.622551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:57.623014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:57.623443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:57.692392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:57.700750 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-697e5da0-c69e-4e62-828d-f68e28ad26a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.091435 Oct 01 21:37:57.701331 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2016/6017] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:57 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:58.723778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:58.724419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:58.732057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:58.732572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:58.733035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:58.733758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:58.734243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:58.734729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:58.803963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:58.812738 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c9aa7e1-6bf7-4ece-833d-33f8dcae6348 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.092590 Oct 01 21:37:58.813486 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4002/6018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:58 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:37:59.835314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:37:59.835936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:37:59.842975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:59.843469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:59.843920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:59.844624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:37:59.845091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:37:59.845524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:37:59.906636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:37:59.914518 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5e2cfd34-28e0-4c6b-96fa-94ca8066801a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083066 Oct 01 21:37:59.915106 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2017/6019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:37:59 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:00.938532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:00.939084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:00.941823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:38:00.947181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:00.948222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:00.948670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:00.949376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:00.949841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:00.950283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:01.011784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:01.019498 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-404749e6-58c6-4218-9038-1d9099e09a4d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084959 Oct 01 21:38:01.020068 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4003/6020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:00 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:02.042027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:02.042677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:02.044884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:38:02.050298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:02.050847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:02.051321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:02.052023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:02.052483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:02.052912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:02.113819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:02.121444 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b2a70b15-9d88-45d8-87e5-b6ad26ae019a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083328 Oct 01 21:38:02.122014 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2018/6021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:02 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:03.144866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:03.145504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:03.152505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:03.153014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:03.153475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:03.154196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:03.154784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:03.155261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:03.216688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:03.224332 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd09e99b-c291-44ea-b7d8-7f70b898b867 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083469 Oct 01 21:38:03.224898 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4004/6022] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:03 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:04.248355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:04.248977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:04.256608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:04.257097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:04.257543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:04.258271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:04.258755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:04.259187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:04.261736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:38:04.321258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:04.329002 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c9333722-e665-48c2-a887-e3ac160e8e86 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085117 Oct 01 21:38:04.329579 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2019/6023] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:04 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:05.351949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:05.352513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:05.360286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:05.360793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:05.361261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:05.361977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:05.362455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:05.362928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:05.424843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:05.433448 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b5393840-08b1-4079-a793-c9298c36d441 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085562 Oct 01 21:38:05.434035 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4005/6024] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:05 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:06.456408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:06.457066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:06.464482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:06.464975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:06.465441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:06.466141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:06.466635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:06.467068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:06.531390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:06.539111 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eb34eb99-4986-41a1-bd77-b3040fc04a21 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086605 Oct 01 21:38:06.539684 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2020/6025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:06 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:38:07.562869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:07.563532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:07.570433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:07.570978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:07.571442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:07.572169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:07.572646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:07.573097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:07.638520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:07.646424 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-959ea54c-0f49-49c8-8af1-493b08a1ff51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087552 Oct 01 21:38:07.647033 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4006/6026] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:07 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:08.669839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:08.670463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:08.677504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:08.677999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:08.678732 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:08.679435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:08.679898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:08.680330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:08.743114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:08.751749 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-27cfd77e-7e42-4554-b57c-82413ebd00c0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085885 Oct 01 21:38:08.752336 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2021/6027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:08 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:09.774630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:09.776048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:09.782890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:09.783391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:09.783845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:09.784548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:09.785021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:09.785464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:09.847667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:09.855485 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac6afc80-6aa5-432d-b1b6-ec2711c10d19 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084780 Oct 01 21:38:09.856055 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4007/6028] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:09 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:10.878997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:10.879619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:10.886550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:10.887052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:10.887498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:10.888195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:10.888657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:10.889085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:10.952924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:10.960854 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3e109cef-cc42-4b90-bbbc-21adc813f19b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085833 Oct 01 21:38:10.961487 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2022/6029] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:10 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:11.984767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:11.985391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:11.992425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:11.992926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:11.993378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:11.994777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:11.995254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:11.995697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:12.056231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:12.064691 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a9d6fa3-f9cc-47f6-9fe6-3d4a7ee335e3 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083906 Oct 01 21:38:12.065265 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4008/6030] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:11 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:13.087298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:13.087923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:13.094786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:13.095281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:13.095726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:13.096423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:13.096886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:13.097317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:13.158131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:13.166810 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1cd9efa8-3df8-4ffc-b761-c073ba6cc615 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083327 Oct 01 21:38:13.167438 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2023/6031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:13 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:14.189928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:14.190674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:14.199157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:14.199687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:14.200139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:14.200850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:14.201317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:14.201755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:14.264689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:14.272431 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d8527b97-c485-4b7c-ad4c-02801913e5a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086523 Oct 01 21:38:14.273007 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4009/6032] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:14 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:15.296482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:15.297058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:15.304169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:15.304660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:15.305103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:15.305796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:15.306258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:15.306723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:15.370461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:15.378261 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2868aff7-a7dd-49d7-a7d2-25f5c1c72981 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085817 Oct 01 21:38:15.378944 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2024/6033] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:15 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:16.401915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:16.402517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:16.409386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:16.409889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:16.410350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:16.411084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:16.411560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:16.412004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:16.476373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:16.484226 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-13e8b8d9-5f79-4392-a74f-dd1ec701acca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086929 Oct 01 21:38:16.484797 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4010/6034] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:16 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:17.507747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:17.508500 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:17.515770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:17.516260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:17.516702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:17.517399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:17.517849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:17.518276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:17.580372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:17.588675 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0051c0fe-f50b-4906-bc37-b914f981f07c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084864 Oct 01 21:38:17.589244 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2025/6035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:17 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:18.612027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:18.612659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:18.620207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:18.620707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:18.621164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:18.621864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:18.622334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:18.622805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:18.683809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:18.691586 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-54c822be-bdc9-4d3e-9b31-c773580d62c8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083496 Oct 01 21:38:18.692160 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4011/6036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:18 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:19.714346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:19.715012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:19.721958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:19.722448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:19.722927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:19.723623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:19.724118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:19.724543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:19.789409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:19.797242 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ba5cb2af-a91b-417b-b484-b4d409f4bb7e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086823 Oct 01 21:38:19.797813 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2026/6037] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:19 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:20.820598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:20.821237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:20.828692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:20.829203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:20.829666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:20.830403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:20.830911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:20.831362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:20.892000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:20.899751 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c985a58-e0b7-49ab-b140-f43da664082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083204 Oct 01 21:38:20.900335 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4012/6038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:20 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:21.924002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:21.924617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:21.931957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:21.932444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:21.932886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:21.933582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:21.934042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:21.934471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:21.995429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:22.003187 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a2fdccb0-a016-4ced-98f3-2a2f166f82ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083127 Oct 01 21:38:22.003764 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2027/6039] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:21 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:23.026514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:23.027146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:23.034432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:23.034976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:23.035432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:23.036158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:23.036635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:23.037079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:23.098451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:23.106829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b8b14040-7df9-41ff-b3f0-20b2d4256c91 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084269 Oct 01 21:38:23.107393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4013/6040] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:23 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:24.130530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:24.131160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:24.138580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:24.139103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:24.139546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:24.140244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:24.140704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:24.141132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:24.204794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:24.212549 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fb557de6-79a6-46f2-b020-e53af051b0fc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085973 Oct 01 21:38:24.217268 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2028/6041] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:24 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:25.235438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:25.236071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:25.243024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:25.243533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:25.243988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:25.244708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:25.245188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:25.245633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:25.249644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:38:25.311363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:25.319177 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3c56defe-72b9-43d9-9ee6-a2fab14a2604 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087647 Oct 01 21:38:25.319755 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4014/6042] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:25 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:26.342440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:26.343016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:26.349841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:26.350335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:26.350818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:26.351523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:26.351987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:26.352419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:26.413528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:26.421531 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fd0b09e2-4ef8-48c9-8d22-6655ee248ae4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083121 Oct 01 21:38:26.422116 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2029/6043] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:26 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:27.445130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:27.445711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:27.454138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:27.454679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:27.455268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:27.456035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:27.456529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:27.457006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:27.534180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:27.545428 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0771d550-f259-4548-a1da-34ed8698c1b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.103853 Oct 01 21:38:27.546462 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4015/6044] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:27 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:28.574859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:28.575485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:28.582349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:28.582874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:28.583325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:28.584031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:28.584496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:28.584930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:28.649453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:28.657243 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4cc038ba-e538-47bc-9c75-fd47d3ae8160 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087001 Oct 01 21:38:28.657816 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2030/6045] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:28 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:29.680295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:29.680923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:29.688345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:29.688850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:29.689306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:29.690015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:29.690504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:29.690956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:29.752124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:29.760425 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-99e35fc6-4cd1-4fb0-a61c-18b72bd1da5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083815 Oct 01 21:38:29.761000 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4016/6046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:29 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:30.783075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:30.783693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:30.790622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:30.791600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:30.792038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:30.792726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:30.793179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:30.793601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:30.855064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:30.862700 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b8152c74-1f13-4345-b5ed-5a46fa36dca8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083513 Oct 01 21:38:30.863273 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2031/6047] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:30 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:31.885927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:31.886587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:31.889337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:38:31.894717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:31.895228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:31.895689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:31.896410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:31.896889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:31.897342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:31.960182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:31.968028 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4fcae6fd-3903-4893-a35e-8a57f434d234 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086682 Oct 01 21:38:31.968599 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4017/6048] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:31 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:32.991797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:32.992442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:32.994553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:38:32.999699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:33.000185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:33.000627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:33.001325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:33.001783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:33.002206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:33.065761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:33.074573 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-95f0e261-4cc6-4f1e-a143-9764e635c13e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087013 Oct 01 21:38:33.075145 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2032/6049] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:32 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:34.097432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:34.098063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:34.104925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:34.105428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:34.105883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:34.106628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:34.107109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:34.107554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:34.170329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:34.178081 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-da8ebab1-c181-4bfa-88a5-64c31d91dbaa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084888 Oct 01 21:38:34.178958 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4018/6050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:34 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:35.201569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:35.202182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:35.208961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:35.209447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:35.209881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:35.210593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:35.211053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:35.211477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:35.214700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:38:35.273608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:35.281994 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3ddc5663-f981-4996-bcb1-479d0fd8aea2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084812 Oct 01 21:38:35.282584 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2033/6051] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:35 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:36.305069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:36.305652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:36.312552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:36.313063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:36.313519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:36.314231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:36.314738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:36.315186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:36.377225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:36.385120 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-de6e1f49-3eb4-4246-9b2a-db5da4d393e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084308 Oct 01 21:38:36.385701 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4019/6052] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:36 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:37.408187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:37.408723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:37.415674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:37.416674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:37.417179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:37.417906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:37.418375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:37.418838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:37.483117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:37.490936 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-794bed3d-b088-43e7-8aad-e1457b3d37d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086772 Oct 01 21:38:37.491518 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2034/6053] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:37 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:38.514234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:38.514889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:38.521780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:38.522304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:38.522769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:38.523487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:38.523961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:38.524403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:38.585038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:38.593319 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-285b5149-8be5-428b-bfda-c2ca4e5b0fc7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082980 Oct 01 21:38:38.593889 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4020/6054] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:38 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:39.616942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:39.617557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:39.625032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:39.625544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:39.625982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:39.626713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:39.627169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:39.627592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:39.692345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:39.700090 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-848f95af-66c3-4864-9fb0-acba962a84b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087045 Oct 01 21:38:39.700664 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2035/6055] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:39 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:40.727309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:40.727942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:40.735410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:40.735922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:40.736370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:40.737087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:40.737557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:40.737997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:40.806015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:40.814252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07de17cf-e273-4939-861e-245aa8e69953 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.090881 Oct 01 21:38:40.814849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4021/6056] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:40 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:41.837438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:41.838716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:41.845564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:41.846051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:41.846507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:41.847210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:41.847670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:41.848098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:41.909305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:41.917186 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-59823ff3-94f0-400d-b160-bd387c8e2127 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083698 Oct 01 21:38:41.917762 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2036/6057] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:41 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:43.013006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:43.013650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:43.019784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:43.020291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:43.020754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:43.021466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:43.021948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:43.022392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:43.088755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:43.096468 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fe6da0c9-a32a-4f83-95d3-6cf4fbc40656 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.159982 Oct 01 21:38:43.097070 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4022/6058] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:42 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:44.121121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:44.121747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:44.128708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:44.129202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:44.129650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:44.130354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:44.130845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:44.131282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:44.195812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:44.203653 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b9f5c93f-472d-46a6-af77-ace55e1306d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087164 Oct 01 21:38:44.204235 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2037/6059] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:44 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:45.225802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:45.226436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:45.233604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:45.234115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:45.234608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:45.235326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:45.235804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:45.236256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:45.297518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:45.305543 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-72df4b3d-51c4-4cda-bb05-ba7f2ba4127c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083690 Oct 01 21:38:45.306118 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4023/6060] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:45 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:46.329179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:46.329716 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:46.336548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:46.337027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:46.337462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:46.338776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:46.339235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:46.339658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:46.406039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:46.413897 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d1f673da-993b-4b50-abd1-77af6569dbb0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088663 Oct 01 21:38:46.414478 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2038/6061] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:46 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:47.437250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:47.437832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:47.444752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:47.445287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:47.445742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:47.446452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:47.446955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:47.447399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:47.508085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:47.515902 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98a2403f-548d-490e-a11c-0f5947ec752b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082711 Oct 01 21:38:47.516479 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4024/6062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:47 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:48.539103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:48.539727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:48.546604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:48.547098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:48.547541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:48.548241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:48.548707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:48.549138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:48.609946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:48.617649 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-870b3c58-a6b9-4e65-9750-482320a659ea tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082543 Oct 01 21:38:48.618220 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2039/6063] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:48 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:49.640675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:49.641346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:49.648272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:49.648774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:49.649228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:49.649944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:49.650420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:49.651440 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:49.716291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:49.724110 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-df5fdcdc-955e-451b-8ba1-c51310080f77 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087704 Oct 01 21:38:49.724687 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4025/6064] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:49 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:38:50.751013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:50.751635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:50.758694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:50.759179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:50.759617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:50.760394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:50.760894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:50.761315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:50.822893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:50.830480 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7399eccb-ab96-49de-93f5-6ef80849bc22 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085445 Oct 01 21:38:50.831067 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2040/6065] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:50 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:51.853389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:51.854017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:51.860956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:51.861457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:51.861910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:51.862650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:51.863121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:51.863565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:51.927527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:51.936500 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-37738915-3e70-4755-9d3c-e21547fb10d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087073 Oct 01 21:38:51.937064 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4026/6066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:51 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:38:52.960351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:52.960966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:52.967811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:52.968292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:52.968731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:52.969420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:52.969873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:52.970295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:53.034421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:53.042771 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b1da563f-a888-4186-b0a1-8d8b25bcd550 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086349 Oct 01 21:38:53.043355 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2041/6067] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:52 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:54.067349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:54.067978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:54.075430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:54.075931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:54.076382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:54.077119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:54.077592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:54.078029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:54.141188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:54.148832 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b9a051b-851f-4594-a5b3-82f1cd9f7678 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085529 Oct 01 21:38:54.149413 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4027/6068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:54 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:55.172567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:55.173188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:55.180622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:55.181109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:55.181547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:55.182318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:55.182805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:55.183232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:55.247114 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:55.254878 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e3c9c30e-7e76-47de-b51d-564abc116a69 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086192 Oct 01 21:38:55.255479 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2042/6069] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:55 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:56.277372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:56.278009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:56.285074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:56.285585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:56.286047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:56.286803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:56.287286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:56.287737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:56.292334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:38:56.349824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:56.358245 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a9812a4-56ae-4149-9000-7f39324bef8a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084943 Oct 01 21:38:56.358850 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4028/6070] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:56 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:57.381298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:57.381832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:57.389312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:57.389794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:57.390259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:57.390983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:57.391438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:57.391865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:57.452723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:57.460390 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-047490d4-0a88-4020-9295-c074bdceeb5b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083117 Oct 01 21:38:57.460991 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2043/6071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:57 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:58.484096 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:58.484733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:58.491559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:58.492057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:58.492510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:58.493214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:58.493683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:58.494124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:58.555037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:58.563478 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84548619-e8ec-4195-a27a-0ca8b3d6b59b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083451 Oct 01 21:38:58.564054 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4029/6072] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:58 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:38:59.586954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:38:59.587567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:38:59.594646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:59.595133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:59.595570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:59.596264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:38:59.596720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:38:59.597147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:38:59.658161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:38:59.667125 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-48a3e259-455b-45b2-9238-77d66886b8f6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083435 Oct 01 21:38:59.667729 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2044/6073] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:38:59 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:00.690972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:00.691608 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:00.699060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:00.699566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:00.700023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:00.700739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:00.701216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:00.701658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:00.765520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:00.773443 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4584396-67fb-4458-9d0d-d8333d5cd77c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086370 Oct 01 21:39:00.774016 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4030/6074] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:00 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:01.797160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:01.797779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:01.804460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:01.804947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:01.805389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:01.806086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:01.806578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:01.807057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:01.867965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:01.875721 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9de50904-53dd-48e6-a019-4c3feff99792 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082477 Oct 01 21:39:01.876295 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2045/6075] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:01 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:02.897510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:02.898091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:02.900435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:39:02.905687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:02.906191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:02.906672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:02.907382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:02.907854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:02.908301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:03.244601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:03.252512 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1c46b137-0a1a-4037-9301-594b2ca80cb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.358992 Oct 01 21:39:03.253090 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4031/6076] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:02 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:04.275184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:04.275786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:04.278528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:39:04.283719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:04.284206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:04.284642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:04.285336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:04.285786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:04.286209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:04.351408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:04.359648 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-01be2e3f-fef9-4ac3-aa42-506a262a0249 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088346 Oct 01 21:39:04.360223 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2046/6077] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:04 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:05.382348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:05.382950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:05.390443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:05.390982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:05.391444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:05.392163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:05.392643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:05.393098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:05.454018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:05.461903 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e0d734fc-648e-4b4f-95f5-61e7ebffd8c7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083623 Oct 01 21:39:05.462523 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4032/6078] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:05 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:06.484865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:06.485483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:06.492394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:06.492875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:06.493310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:06.493998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:06.494450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:06.494900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:06.497423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:39:06.558431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:06.566092 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b8d0cfc5-2146-44f1-8e89-f80e5753b9e6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085183 Oct 01 21:39:06.566691 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2047/6079] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:06 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:07.589136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:07.589793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:07.596731 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:07.597232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:07.597690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:07.598394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:07.598893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:07.599360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:07.660110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:07.668490 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f1b000e-7df8-4d72-9a60-1ef07c646c8c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083743 Oct 01 21:39:07.669058 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4033/6080] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:07 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:08.690879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:08.691423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:08.698282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:08.698800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:08.699240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:08.699928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:08.700381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:08.700808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:08.765472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:08.773299 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c6d2e848-40b8-470f-ac43-958996bc0787 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086505 Oct 01 21:39:08.773868 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2048/6081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:08 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:09.796497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:09.797115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:09.804292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:09.804797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:09.805256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:09.805976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:09.806452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:09.807508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:09.870438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:09.878137 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-16a8200e-d191-4f77-aabd-41e8fd2b741d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085553 Oct 01 21:39:09.878765 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4034/6082] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:09 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:10.901096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:10.901723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:10.908832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:10.909487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:10.909786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:10.910526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:10.910998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:10.911431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:10.975167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:10.983425 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b37a6549-3222-405e-949a-6313381e32e9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086405 Oct 01 21:39:10.984013 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2049/6083] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:10 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:12.006844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:12.007476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:12.014838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:12.015347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:12.015807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:12.016521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:12.016997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:12.017446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:12.081835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:12.089830 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f90f9d98-112e-4871-88f5-c6fe1c2096d5 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087027 Oct 01 21:39:12.090395 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4035/6084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:12 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:13.112383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:13.112945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:13.120320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:13.120821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:13.121241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:13.121935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:13.122391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:13.122839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:13.188856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:13.197153 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ef4e320e-ea69-4ff6-9eb0-9615f7009013 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088585 Oct 01 21:39:13.197746 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2050/6085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:13 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:14.219484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:14.220126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:14.227093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:14.227606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:14.228064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:14.228785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:14.229264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:14.229717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:14.291580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:14.299511 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4255bbac-278e-4361-9fdf-3789754861a8 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083906 Oct 01 21:39:14.300216 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4036/6086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:14 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:15.322580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:15.323143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:15.330073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:15.330598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:15.331047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:15.331747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:15.332209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:15.332640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:15.393903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:15.402122 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d9db0091-39f3-44db-ac31-afd1994efc12 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083530 Oct 01 21:39:15.402722 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2051/6087] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:15 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:16.425805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:16.426390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:16.433511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:16.434026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:16.434504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:16.435232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:16.435715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:16.436170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:16.496913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:16.504728 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebc56de6-b771-49ae-b4af-66030cf82fbb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082916 Oct 01 21:39:16.505314 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4037/6088] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:16 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:17.528948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:17.529572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:17.536545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:17.537026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:17.537473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:17.538170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:17.538691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:17.539123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:17.599914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:17.608329 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aef2ba98-39f1-4e59-90ea-ea48d5abbb31 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083873 Oct 01 21:39:17.608900 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2052/6089] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:17 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:18.631025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:18.631648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:18.639493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:18.639936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:18.640416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:18.641153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:18.641620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:18.642059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:18.702850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:18.710578 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8506594a-8a77-405b-a2b5-996820816ab0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083440 Oct 01 21:39:18.711212 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4038/6090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:18 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:19.733768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:19.734436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:19.741356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:19.741850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:19.742300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:19.743040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:19.743506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:19.743937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:19.809300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:19.817109 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3be10478-1324-4c54-be90-9eaf182f3198 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087824 Oct 01 21:39:19.817698 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2053/6091] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:19 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:20.840006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:20.841206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:20.848118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:20.848620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:20.849072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:20.849780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:20.850253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:20.850733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:20.913737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:20.921570 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b3f20e21-9227-44cf-b23b-5326956b56b6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085550 Oct 01 21:39:20.922145 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4039/6092] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:20 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:21.944376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:21.944984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:21.951779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:21.952261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:21.952702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:21.953386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:21.953842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:21.954265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:22.015578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:22.023210 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-888c10d5-647d-4389-b74d-ec65dc67330e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082757 Oct 01 21:39:22.023778 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2054/6093] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:21 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:23.046917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:23.047545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:23.054746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:23.055246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:23.055698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:23.056400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:23.056870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:23.057970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:23.120664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:23.128256 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a079e981-3423-4298-a258-8a7411daeae2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085312 Oct 01 21:39:23.128830 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4040/6094] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:23 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:24.150245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:24.151410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:24.158818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:24.159314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:24.159764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:24.160464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:24.160929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:24.161360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:24.227267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:24.235742 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c5101cc5-a496-49e7-8875-fbafea446e46 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.089424 Oct 01 21:39:24.236322 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2055/6095] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:24 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:25.258823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:25.259487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:25.266690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:25.267197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:25.267656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:25.268367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:25.268845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:25.269293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:25.330114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:25.337932 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dc020429-3b09-4537-b194-e553268865d6 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083080 Oct 01 21:39:25.338631 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4041/6096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:25 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:26.361432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:26.362005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:26.368798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:26.369288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:26.369725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:26.370415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:26.370903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:26.371326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:26.432606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:26.440309 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2299b41f-ba19-4835-a269-ff71a243daf2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082944 Oct 01 21:39:26.440877 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2056/6097] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:26 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:27.463206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:27.464450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:27.471452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:27.471965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:27.472428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:27.473154 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:27.473630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:27.474080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:27.478225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:39:27.536995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:27.545041 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-52279b70-0c7b-4f53-92c4-1a50959c03d1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085861 Oct 01 21:39:27.545619 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4042/6098] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:27 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:28.568443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:28.569055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:28.576574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:28.577059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:28.577499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:28.578187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:28.578679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:28.579105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:28.639079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:28.646816 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6fb236b9-5bfe-414a-839d-80b89cacd8cb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082204 Oct 01 21:39:28.647330 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2057/6099] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:28 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:29.669417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:29.670054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:29.677105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:29.677612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:29.678074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:29.679173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:29.679658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:29.680109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:29.743488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:29.751328 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-80fd95fd-e31d-4d6c-b52e-35eebc44e451 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086457 Oct 01 21:39:29.751912 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4043/6100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:29 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:30.774353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:30.775008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:30.782340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:30.782863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:30.783312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:30.784018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:30.784479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:30.784925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:30.846267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:30.854296 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-93bc573f-0345-4a9b-8093-932229e4e02c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083827 Oct 01 21:39:30.855540 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2058/6101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:30 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:31.880005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:31.880636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:31.888196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:31.888703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:31.889163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:31.889878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:31.890354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:31.890846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:31.953335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:31.961117 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2e64c157-b51f-45b3-b953-7ad014858f81 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085053 Oct 01 21:39:31.961688 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4044/6102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:31 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:32.984188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:32.984708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:32.990756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:32.991243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:32.991682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:32.992378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:32.992833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:32.993259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:33.060466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:33.068455 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7d268df6-6c89-4be1-bfca-613578eeba3f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088390 Oct 01 21:39:33.069029 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2059/6103] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:32 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:34.092306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:34.092941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:34.095047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:39:34.100343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:34.100851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:34.101309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:34.102022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:34.102511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:34.102967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:34.300993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:34.309142 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6906048e-ba4e-4cc2-aa3f-292e3baf2809 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.221492 Oct 01 21:39:34.309729 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4045/6104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:34 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:35.332625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:35.333162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:35.335976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:39:35.341823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:35.342310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:35.342774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:35.343499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:35.343960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:35.344380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:35.405660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:35.413407 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aca92711-1b0d-4baf-aac5-8f5a66638995 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084742 Oct 01 21:39:35.414151 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2060/6105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:35 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:36.438158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:36.438783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:36.445683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:36.446187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:36.446680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:36.447396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:36.447878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:36.448327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:36.512216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:36.520058 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-71ab27e9-26b4-4a8b-8cd8-23714ccb74dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086037 Oct 01 21:39:36.520635 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4046/6106] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:36 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:37.542824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:37.543441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:37.550313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:37.550847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:37.551286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:37.551975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:37.552429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:37.552853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:37.555667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:39:37.614384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:37.622515 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c77c648b-f245-44f0-bd9a-82326a27f57b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083611 Oct 01 21:39:37.623092 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2061/6107] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:37 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:38.645594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:38.646215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:38.653114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:38.653609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:38.654058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:38.654785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:38.655282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:38.655719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:38.720018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:38.727816 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-925d60e4-7b2f-40e1-bcaa-ab8834fd5966 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086104 Oct 01 21:39:38.728377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4047/6108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:38 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:39.751242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:39.751859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:39.758683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:39.759176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:39.759614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:39.760308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:39.760765 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:39.761191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:39.823153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:39.831576 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d6c050a7-c8c2-48b6-9d6f-5c65954d49fe tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084271 Oct 01 21:39:39.832180 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2062/6109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:39 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:40.863544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:40.864280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:40.872305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:40.872816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:40.873281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:40.874002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:40.874479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:40.874948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:40.936980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:40.944807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-851b37b3-1ab4-4af4-83f6-c2b7d7ebac34 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085231 Oct 01 21:39:40.945380 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4048/6110] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:40 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:41.967668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:41.968293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:41.975216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:41.975708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:41.976153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:41.976852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:41.977310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:41.977737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:42.044391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:42.052328 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-463c81e2-d59a-4fa1-92bc-ff313a400900 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088614 Oct 01 21:39:42.052905 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2063/6111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:41 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:43.076166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:43.076804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:43.083724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:43.084232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:43.084693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:43.085405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:43.085880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:43.086324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:43.146775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:43.154485 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9cb1e5ee-673e-475a-b25f-028a7a0a0f0b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082875 Oct 01 21:39:43.155083 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4049/6112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:43 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:44.177229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:44.177843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:44.185590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:44.186077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:44.186536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:44.187237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:44.187693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:44.188118 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:44.249719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:44.255693 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:39:44.255872 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:39:44.258056 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:39:44.258204 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:39:44.259973 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:39:44.260092 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:39:44.266380 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e6e267c0-870b-4dc2-b51a-d1c759c28174 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.092992 Oct 01 21:39:44.266996 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2064/6113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:44 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:39:45.291885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:45.292624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:45.299773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:45.300223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:45.300681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:45.301430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:45.301937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:45.302382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:45.358226 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:39:45.358401 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:39:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:39:45.359508 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:39:45.359649 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:39:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:39:45.360530 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:39:45.360649 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:39:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c (ip 10.222.0.17) !!! Oct 01 21:39:45.372246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:45.380309 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68326b75-28b2-4b55-a7f2-e360900bfd51 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.092744 Oct 01 21:39:45.380884 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4050/6114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:45 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:39:46.405093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:46.405626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:46.417692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:46.418185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:46.418657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:46.419365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:46.419827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:46.420256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:46.484773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:46.492567 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-be77fd11-8118-48dd-bf0f-108f80b91f0c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.092632 Oct 01 21:39:46.493157 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2065/6115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:46 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:47.515516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:47.516161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:47.523772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:47.524283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:47.524745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:47.525464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:47.525945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:47.526917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:47.590659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:47.598464 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ea395ac-8c94-4777-a952-cfba9827622e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086868 Oct 01 21:39:47.599069 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4051/6116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:47 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:48.622425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:48.623068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:48.630038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:48.630617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:48.631064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:48.631759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:48.632247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:48.632738 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:48.694389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:48.702158 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2fa0e378-86b7-41ec-8e07-1030d967176a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084280 Oct 01 21:39:48.702765 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2066/6117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:48 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:49.724888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:49.725518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:49.732495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:49.733001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:49.733456 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:49.734167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:49.734682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:49.735126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:49.798842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:49.806859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4dc266a-91b2-49de-a86c-73cbeed7d8bf tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085947 Oct 01 21:39:49.807454 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4052/6118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:49 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:50.831346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:50.831894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:50.838946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:50.840009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:50.840450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:50.841151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:50.841606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:50.842031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:50.905914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:50.913852 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ea013f15-e061-4e8f-a69c-d24f7cd4c5d7 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086472 Oct 01 21:39:50.914424 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2067/6119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:50 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:51.936029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:51.936667 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:51.943641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:51.944176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:51.944631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:51.945339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:51.945831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:51.946274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:52.008343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:52.016166 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-572e7550-2fbc-4c8a-9574-e45bba41e243 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084009 Oct 01 21:39:52.016750 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4053/6120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:51 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:53.039514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:53.040042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:53.047545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:53.048034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:53.048471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:53.049168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:53.049646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:53.050067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:53.117067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:53.125691 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3f01a7b9-3b59-4cb7-9d6a-c0d40f2dbb28 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.090341 Oct 01 21:39:53.126261 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2068/6121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:53 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:54.147973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:54.148604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:54.156037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:54.156543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:54.157004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:54.157721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:54.158197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:54.158686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:54.219594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:54.227456 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e47aae97-7c74-4d9a-92e2-006c1f777558 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083440 Oct 01 21:39:54.228039 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4054/6122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:54 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:55.250918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:55.251545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:55.258506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:55.259020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:55.259469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:55.260175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:55.260643 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:55.261080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:55.323298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:55.331132 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b18de03f-cdd7-46cb-adc0-3951aea6a022 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084792 Oct 01 21:39:55.331725 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2069/6123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:55 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:56.353958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:56.354559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:56.361533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:56.362039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:56.362515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:56.363240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:56.363719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:56.364169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:56.428003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:56.436864 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9983eec-20d8-4544-be58-2733f0872cdb tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086881 Oct 01 21:39:56.437461 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4055/6124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:56 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:57.460390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:57.461050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:57.468575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:57.469066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:57.469507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:57.470215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:57.470712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:57.471147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:57.534115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:57.542036 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dcf15a3d-5f05-4f3e-97ca-8c4b9a589bb4 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085584 Oct 01 21:39:57.542634 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2070/6125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:57 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:58.565468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:58.566098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:58.573032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:58.573540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:58.573993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:58.574728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:58.575201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:58.575640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:58.579566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:39:58.636692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:58.644581 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f5063d35-3448-4b60-9757-3baf8a0aff24 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083017 Oct 01 21:39:58.645125 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4056/6126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:58 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:39:59.667800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:39:59.668964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:39:59.675916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:59.676433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:59.676878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:59.677582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:39:59.678045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:39:59.678478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:39:59.745768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:39:59.754303 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-81867bc7-7e49-4087-8a32-946533d32d00 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.090462 Oct 01 21:39:59.754927 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2071/6127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:39:59 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:00.777716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:00.778369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:00.785205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:00.785709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:00.786162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:00.786920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:00.787394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:00.787834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:00.850256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:00.857987 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6de5724f-ed9c-47e6-bb73-e585ea88359a tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084706 Oct 01 21:40:00.858575 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4057/6128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:00 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:01.880933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:01.881548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:01.888332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:01.888820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:01.889258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:01.889952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:01.890410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:01.890865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:02.218157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:02.225904 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8316536d-240d-48dc-a0ff-b7a9e8242108 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.349042 Oct 01 21:40:02.226474 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2072/6129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:01 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:03.249879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:03.250521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:03.256685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:03.257186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:03.257635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:03.258337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:03.258832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:03.259274 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:03.322110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:03.330529 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1f167911-73a1-448a-8e8b-683b9f247977 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085366 Oct 01 21:40:03.331101 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4058/6130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:03 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:04.354288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:04.354862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:04.361782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:04.362284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:04.362759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:04.363497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:04.363958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:04.364385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:04.425435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:04.433469 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d07daacf-30c1-4739-bb7f-05ba198271dc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083926 Oct 01 21:40:04.434031 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2073/6131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:04 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:05.456337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:05.456966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:05.459670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:05.464736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:05.465239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:05.467622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:05.471157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:05.471661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:05.472119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:05.538235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:05.546770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64c717be-d638-4e82-9f9e-e6e845f1bb3e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.094274 Oct 01 21:40:05.547339 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4059/6132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:05 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:06.570153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:06.570829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:06.573473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:06.578786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:06.579274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:06.579717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:06.580408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:06.580862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:06.581286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:06.641896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:06.649582 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5cbda9fe-269d-4494-8126-5a83581ddc6d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083371 Oct 01 21:40:06.650136 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2074/6133] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:06 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:40:07.671472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:07.672111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:07.679376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:07.679886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:07.680345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:07.681070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:07.681547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:07.681993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:07.742991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:07.751264 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3c5e36cc-332b-4e60-9847-7ffff9a1e442 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083778 Oct 01 21:40:07.751849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4060/6134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:07 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:08.776251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:08.776887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:08.783638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:08.784142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:08.784595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:08.785315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:08.785781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:08.786215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:08.790301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=84 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:08.934158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:08.941985 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6c15c12f-f983-445b-8a2c-1c155c3f4531 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.170672 Oct 01 21:40:08.942568 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2075/6135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:08 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:09.965326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:09.966438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:09.973458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:09.973964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:09.974425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:09.975198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:09.975665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:09.976107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:10.038380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:10.047093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b05b3374-bf49-4ea3-9bd5-3772f0b55d88 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085782 Oct 01 21:40:10.047683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4061/6136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:09 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:11.069165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:11.069789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:11.077300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:11.077794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:11.078237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:11.078964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:11.079428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:11.079855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:11.140183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:11.147858 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b559684a-c12e-49cf-a6cf-163947c70dcc tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082580 Oct 01 21:40:11.148421 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2076/6137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:11 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:12.171814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:12.172504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:12.179689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:12.180194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:12.180647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:12.181361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:12.181836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:12.182283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:12.244029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:12.251792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b68e3b7e-9fd2-4e19-bde0-448e409d98ca tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084535 Oct 01 21:40:12.252369 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4062/6138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:12 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:13.274266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:13.274926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:13.281988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:13.282510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:13.282983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:13.283726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:13.284194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:13.284628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:13.347024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:13.354818 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-28903150-1a20-4bfa-9b43-d0195e86c188 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084479 Oct 01 21:40:13.355392 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2077/6139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:13 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:14.378475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:14.379039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:14.385906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:14.386423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:14.386899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:14.388263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:14.388740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:14.389186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:14.454189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:14.461975 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c0a94e9-a51a-4616-b15f-f4b5d00b1ea1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087455 Oct 01 21:40:14.462561 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4063/6140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:14 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:15.485083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:15.485737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:15.492999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:15.493487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:15.493925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:15.494661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:15.495122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:15.495551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:15.561083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:15.569381 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-064f6378-0c19-47a8-9918-5474a81705d0 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088036 Oct 01 21:40:15.569964 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2078/6141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:15 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:16.592588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:16.593224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:16.600372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:16.600879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:16.601338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:16.602049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:16.602546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:16.603016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:16.666591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:16.674477 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c0327d0-5181-47d9-adb0-08765d9d2e04 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.085767 Oct 01 21:40:16.675086 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4064/6142] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:16 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:17.698151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:17.698836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:17.706125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:17.706648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:17.707094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:17.707792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:17.708253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:17.708681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:17.772036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:17.780349 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f0f366ec-1d2d-49cc-bc5c-a06016cf6a9f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.086203 Oct 01 21:40:17.780924 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2079/6143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:17 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:18.803371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:18.804288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:18.811166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:18.811669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:18.812127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:18.812839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:18.813312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:18.813754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:18.875379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:18.883239 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4e6e7fa-0074-40e5-8a0e-8757aa62d78e tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083927 Oct 01 21:40:18.883815 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4065/6144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:18 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:19.906337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:19.907135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:19.914023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:19.914561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:19.915018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:19.915730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:19.916207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:19.916647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:19.983086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:19.990944 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-17f33986-8ff9-4114-8b4c-8319e36f907b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.088522 Oct 01 21:40:19.991566 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2080/6145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:19 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:21.014480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:21.015078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:21.021963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:21.022466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:21.022987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:21.023699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:21.024175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:21.024624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:21.085803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:21.093552 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d8221487-74b6-4e66-9bbe-0dcdba04d396 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083733 Oct 01 21:40:21.094121 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4066/6146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:21 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:22.116146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:22.116757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:22.123614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:22.124106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:22.124542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:22.125235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:22.125688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:22.126111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:22.186584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:22.194218 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-19c88ce7-5673-4c7d-975c-06175c43bcba tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082006 Oct 01 21:40:22.194823 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2081/6147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:22 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:23.218067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:23.218727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:23.225625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:23.226131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:23.226616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:23.227335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:23.227808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:23.228253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:23.292235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:23.300774 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e537e8db-70e7-4f2f-b75e-32a5f5363095 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087049 Oct 01 21:40:23.301296 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4067/6148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:23 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:24.324389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:24.325564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:24.332419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:24.332907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:24.333347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:24.334048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:24.334531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:24.334964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:24.395314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:24.403091 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-94a0f13a-a79e-49e1-b161-c8f6a5b2b94d tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.082663 Oct 01 21:40:24.403654 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2082/6149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:24 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:25.425846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:25.426399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:25.433675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:25.434192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:25.434674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:25.435773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:25.436379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:25.436965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:25.498882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:25.506640 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0999bf15-e2a7-4255-a47d-0a6004264ec9 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084810 Oct 01 21:40:25.507227 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4068/6150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:25 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:26.531681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:26.532318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:26.539431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:26.539920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:26.540363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:26.541060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:26.541517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:26.541944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:26.603038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:26.611437 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-32634479-4f56-48c8-b770-e9bc7728632f tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084264 Oct 01 21:40:26.612039 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2083/6151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:26 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:27.634014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:27.634685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:27.642016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:27.642540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:27.642997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:27.643702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:27.644169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:27.644607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:27.705915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:27.713589 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8643a10d-017a-47df-970f-893b06abec6c tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.083493 Oct 01 21:40:27.714156 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4069/6152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:27 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:28.736930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:28.737576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:28.744458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:28.744953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:28.745401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:28.746110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:28.747090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:28.747521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:28.818294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:28.827827 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e9ee0204-b58a-4c52-a843-49f550f254aa tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.094898 Oct 01 21:40:28.828415 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2084/6153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:28 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:29.851605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:29.852230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:29.859390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:29.859898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:29.860356 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:29.861072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:29.861551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:29.861993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:29.864733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:29.926635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:29.934721 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2f9d155a-479e-417b-824a-c7a02ec745e1 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.087599 Oct 01 21:40:29.935308 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4070/6154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:29 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:40:30.957839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:30.958457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:30.965803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:30.966291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:30.966761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:30.967457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:30.967918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:30.968345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:31.030527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:31.038805 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cbdc8101-3dad-4c48-abfc-6ccd20ff3da2 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1280 microversion: 2.1 time: 0.084882 Oct 01 21:40:31.039400 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2085/6155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:30 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:31.143838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:31.144414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:31.151390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:31.151903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:31.152362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:31.153771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:31.154247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:31.154726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:31.179926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:40:31.253610 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-215f1313-f508-4c24-b987-6377f8d4082b tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "DELETE /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 204 len: 0 microversion: 2.1 time: 0.113493 Oct 01 21:40:31.254208 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4071/6156] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:40:31 2022] DELETE /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:40:31.263093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:31.263867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:31.269892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:31.270383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:31.270858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:31.271560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:31.272023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:31.272455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:31.361907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4671ff245d94e54ac1bf390edd815e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c9b3e4a1e441e1a92a271f9aa1811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:31.369966 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-02e213f9-9252-4b6c-91af-d9e19108b242 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 200 len: 1286 microversion: 2.1 time: 0.111503 Oct 01 21:40:31.370572 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2086/6157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:31 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 1286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:40:32.392749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:32.393511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] [instance: 65c7a753-8bec-43af-b53c-375d5e80ac7c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:32.399594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:32.400093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:32.400543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:32.401247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:32.401718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:32.402156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:32.415898 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] HTTP exception thrown: Instance 65c7a753-8bec-43af-b53c-375d5e80ac7c could not be found. Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Request method failure captured: Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c HTTP/1.1 Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLI2ndTZ0wzdto1sGrBu4ddIwmcuPL7-q728gysqpugS5ixOL6U3eRl517CBNZrZ0hMcI2OBwTfZj47IyYpkyWHN8GjD18A3XXQK30zBgFH2nb1alHEKAXEFtowzh5VKy4QNRi9BZk33cmqy62o5i31AAqJeotCSWjMhHf2SblKU3To Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 37c9b3e4a1e441e1a92a271f9aa1811e Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-DeleteServersTestJSON-375425543 Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_37c9b3e4a1e441e1a92a271f9aa1811e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/37c9b3e4a1e441e1a92a271f9aa1811e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/37c9b3e4a1e441e1a92a271f9aa1811e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/37c9b3e4a1e441e1a92a271f9aa1811e"}]}] Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-DeleteServersTestJSON-375425543 Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 37c9b3e4a1e441e1a92a271f9aa1811e Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-DeleteServersTestJSON-375425543 Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-DeleteServersTestJSON-375425543-project Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d4671ff245d94e54ac1bf390edd815e5 Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-DeleteServersTestJSON-375425543-project Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 65c7a753-8bec-43af-b53c-375d5e80ac7c could not be found. Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '65c7a753-8bec-43af-b53c-375d5e80ac7c'} Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c7a753-8bec-43af-b53c-375d5e80ac7c could not be found. Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c7a753-8bec-43af-b53c-375d5e80ac7c could not be found. Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:40:32.417512 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c7a753-8bec-43af-b53c-375d5e80ac7c could not be found. Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] Returning 404 to user: Instance 65c7a753-8bec-43af-b53c-375d5e80ac7c could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60f19afc-3098-4989-9dca-4caa97ba0605 tempest-DeleteServersTestJSON-375425543 tempest-DeleteServersTestJSON-375425543-project] 10.222.0.17 "GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c" status: 404 len: 111 microversion: 2.1 time: 0.031300 Oct 01 21:40:32.422593 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4072/6158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:32 2022] GET /compute/v2.1/servers/65c7a753-8bec-43af-b53c-375d5e80ac7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:40:41.131245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-448687697", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "8c8fe73d-e7d3-45c8-bea7-f1214a20b107"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:40:41.149875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=26 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:41.193833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] validate_networks() for [('8c8fe73d-e7d3-45c8-bea7-f1214a20b107', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:40:41.366057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=71 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:41.629699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:40:41.630238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:40:41.630845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:40:41.631339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:40:41.631769 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:40:41.641428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:41.641921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:41.642359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:41.643128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:41.643590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:41.644086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:41.663181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Getting quotas for project 556938530bd8414b99541d920b467ab8. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:40:41.668429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Getting quotas for user d66e970d7ba14adcb41f1789c7af8509 and project 556938530bd8414b99541d920b467ab8. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:40:41.681031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:40:41.683492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:40:41.734988 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e344bb4c-7e14-4c4c-8fd2-a6056ac83d62 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745089 Oct 01 21:40:41.736035 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2087/6159] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:40:41.746914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-545925f5-3d6c-4794-9e5d-73f7c94d86ee tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:41.747548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-545925f5-3d6c-4794-9e5d-73f7c94d86ee tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:41.750578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=33 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:41.809668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-545925f5-3d6c-4794-9e5d-73f7c94d86ee tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:41.816757 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-545925f5-3d6c-4794-9e5d-73f7c94d86ee tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1217 microversion: 2.1 time: 0.073749 Oct 01 21:40:41.817502 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4073/6160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:41 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:42.841598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:42.842218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:42.849167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:42.849657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:42.850105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:42.850838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:42.851298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:42.851727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:42.919495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:42.929993 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-73c0b50a-621c-4270-8fe6-b0a08d77e041 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1269 microversion: 2.1 time: 0.092843 Oct 01 21:40:42.932750 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2088/6161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:42 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:43.956864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:43.957609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:43.961157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:43.967441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:43.968039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:43.968631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:43.969443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:43.969998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:43.970445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:44.189014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:44.197109 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f01bb79-a0a1-4467-a868-fce14a59ff03 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1317 microversion: 2.1 time: 0.244435 Oct 01 21:40:44.198041 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4074/6162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:43 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:44.641003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-31d4c1de-436d-46bc-97ea-87a2a7ca9e10 req-f99e8cc9-496f-4281-901a-fda3072b8261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8b0f2c-15f7-4b18-97ae-6f3d199e3460", "tag": "a82f2e5e-07aa-4571-8824-9116e8cb15e7"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:40:44.651059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-31d4c1de-436d-46bc-97ea-87a2a7ca9e10 req-f99e8cc9-496f-4281-901a-fda3072b8261 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:44.651723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-31d4c1de-436d-46bc-97ea-87a2a7ca9e10 req-f99e8cc9-496f-4281-901a-fda3072b8261 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:44.652202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-31d4c1de-436d-46bc-97ea-87a2a7ca9e10 req-f99e8cc9-496f-4281-901a-fda3072b8261 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:44.666286 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-31d4c1de-436d-46bc-97ea-87a2a7ca9e10 req-f99e8cc9-496f-4281-901a-fda3072b8261 service nova] Creating event network-changed:a82f2e5e-07aa-4571-8824-9116e8cb15e7 for instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 on nch1-master-1 Oct 01 21:40:44.673534 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-31d4c1de-436d-46bc-97ea-87a2a7ca9e10 req-f99e8cc9-496f-4281-901a-fda3072b8261 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107208 Oct 01 21:40:44.674323 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2089/6163] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:40:45.221433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:45.222099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:45.229043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:45.229583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:45.230047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:45.231428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:45.231910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:45.232411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:45.361444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:45.369512 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac7257cf-f489-4a77-af56-4e55be5224d6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1317 microversion: 2.1 time: 0.152059 Oct 01 21:40:45.370087 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4075/6164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:45 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:46.393622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:46.394331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:46.401382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:46.401872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:46.402987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:46.403684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:46.404144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:46.404572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:46.536540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:46.544499 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ac470829-afa2-4df7-b35e-5ab0abe3cf9b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1317 microversion: 2.1 time: 0.155146 Oct 01 21:40:46.545085 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2090/6165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:46 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:47.568277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:47.568910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:47.575889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:47.576397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:47.576853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:47.577569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:47.578043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:47.578511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:47.706239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:47.715263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a72ebf4d-3b3f-4614-b897-63cd8be696ff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1317 microversion: 2.1 time: 0.150254 Oct 01 21:40:47.715850 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4076/6166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:47 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:48.737497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:48.738129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:48.745047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:48.745544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:48.745994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:48.746727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:48.747194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:48.747629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:48.878873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:48.886806 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1a60359a-c606-4d47-bb79-3d97585aa029 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1317 microversion: 2.1 time: 0.153270 Oct 01 21:40:48.887394 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2091/6167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:48 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:49.909579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:49.910117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:49.917103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:49.918101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:49.918573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:49.919286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:49.919758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:49.920197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:50.056652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:50.065005 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fb71969-8318-4e8e-8f75-f27999313347 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1317 microversion: 2.1 time: 0.159522 Oct 01 21:40:50.065572 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4077/6168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:49 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:40:51.087938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:51.088645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:51.100232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:51.100817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:51.101285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:51.102019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:51.102518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:51.102991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:51.104495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-d87b329c-cab1-42c7-ae02-48a739615257 req-e1dd2100-5da7-427d-bb49-bbd001ada10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8b0f2c-15f7-4b18-97ae-6f3d199e3460", "name": "network-vif-plugged", "status": "completed", "tag": "a82f2e5e-07aa-4571-8824-9116e8cb15e7"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:40:51.114588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d87b329c-cab1-42c7-ae02-48a739615257 req-e1dd2100-5da7-427d-bb49-bbd001ada10f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:51.115101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d87b329c-cab1-42c7-ae02-48a739615257 req-e1dd2100-5da7-427d-bb49-bbd001ada10f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:51.115786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-d87b329c-cab1-42c7-ae02-48a739615257 req-e1dd2100-5da7-427d-bb49-bbd001ada10f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:51.127720 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-d87b329c-cab1-42c7-ae02-48a739615257 req-e1dd2100-5da7-427d-bb49-bbd001ada10f service nova] Creating event network-vif-plugged:a82f2e5e-07aa-4571-8824-9116e8cb15e7 for instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 on nch1-master-1 Oct 01 21:40:51.133081 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-d87b329c-cab1-42c7-ae02-48a739615257 req-e1dd2100-5da7-427d-bb49-bbd001ada10f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103512 Oct 01 21:40:51.134104 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2092/6169] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:40:51.264656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:51.272683 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f77320c-19c7-4853-b028-0f9507a9be12 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1317 microversion: 2.1 time: 0.188728 Oct 01 21:40:51.273264 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4078/6170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:51 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:40:52.296961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:52.297620 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:52.299584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:52.300260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:52.307199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:52.307688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:52.308130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:52.309458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:52.309911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:52.310337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:52.441443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:52.449497 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3687838b-5a70-4061-83e0-d51d139c0f87 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1317 microversion: 2.1 time: 0.157337 Oct 01 21:40:52.450138 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2093/6171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:52 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:53.472799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:53.473425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:53.475420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:40:53.481707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:53.482202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:53.482691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:53.483391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:53.483858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:53.484296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:53.613081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:53.621717 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88782a3f-ad4b-48d6-a7b5-24af18345d9a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1508 microversion: 2.1 time: 0.152121 Oct 01 21:40:53.622296 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4079/6172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:53 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:53.643865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:53.644517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:53.651477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:53.651971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:53.652492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:53.653203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:53.653670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:53.654106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:53.787650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:53.796204 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0359d95f-e4a8-4b60-8109-8cfd69548e50 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1508 microversion: 2.1 time: 0.156190 Oct 01 21:40:53.796790 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2094/6173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:53 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:53.820116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-11294bf0-59a3-4bbb-b2d1-698895ab9eb9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:40:53.823950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-11294bf0-59a3-4bbb-b2d1-698895ab9eb9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:53.832577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11294bf0-59a3-4bbb-b2d1-698895ab9eb9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:53.833136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11294bf0-59a3-4bbb-b2d1-698895ab9eb9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:53.833686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11294bf0-59a3-4bbb-b2d1-698895ab9eb9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:53.834457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11294bf0-59a3-4bbb-b2d1-698895ab9eb9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:53.834960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11294bf0-59a3-4bbb-b2d1-698895ab9eb9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:53.835428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11294bf0-59a3-4bbb-b2d1-698895ab9eb9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:53.897333 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-11294bf0-59a3-4bbb-b2d1-698895ab9eb9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "PUT /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1080 microversion: 2.1 time: 0.082201 Oct 01 21:40:53.897956 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4080/6174] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Oct 1 21:40:53 2022] PUT /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1080 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:53.916267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:53.916890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:53.923373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:53.923862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:53.924307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:53.925006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:53.925466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:53.925897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:54.054414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:54.062292 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d9d8af0c-a74f-445b-b46f-89c87d2d216c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1506 microversion: 2.1 time: 0.149880 Oct 01 21:40:54.062902 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2095/6175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:53 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:54.084308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:54.084981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:54.091543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:54.092055 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:54.092553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:54.093273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:54.093763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:54.094203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:54.220725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:54.228460 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7911bf68-95ed-4c34-8d42-46b11092b67f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1506 microversion: 2.1 time: 0.148184 Oct 01 21:40:54.229034 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4081/6176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:54 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:54.250909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:40:54.253292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:54.259237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:54.259724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:54.260168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:54.260868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:54.261333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:54.261767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:54.289850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:54.295930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Old instance type m1.heat2, new instance type m1.heat {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:40:54.302421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:40:54.302873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:40:54.303356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:40:54.303773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:40:54.304462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:40:54.366750 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-07fb970a-fac5-47a4-b89f-1827a033bfec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "POST /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460/action" status: 202 len: 0 microversion: 2.1 time: 0.119739 Oct 01 21:40:54.367364 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2096/6177] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:40:54 2022] POST /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:40:54.375594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:54.376236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:54.382405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:54.382951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:54.383412 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:54.384130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:54.384616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:54.385197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:54.523946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:54.532083 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d441e915-da52-4cc0-bcea-5fed93e90eab tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1517 microversion: 2.1 time: 0.160450 Oct 01 21:40:54.532661 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4082/6178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:54 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:55.563777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:55.564396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:55.571314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:55.571805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:55.572248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:55.572953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:55.573413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:55.574451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:55.707426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:55.715311 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7e86807f-7670-4944-82d8-e08e1eab3910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1517 microversion: 2.1 time: 0.156845 Oct 01 21:40:55.715889 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2097/6179] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:55 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:56.738473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:56.739226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:56.746317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:56.746868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:56.747321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:56.748028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:56.748499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:56.748935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:56.878316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:56.887465 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-943de93c-522f-408d-aec6-4447d65b5d75 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.152909 Oct 01 21:40:56.888045 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4083/6180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:56 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:57.914068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:57.915175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:57.924931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:57.925429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:57.925877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:57.926628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:57.927093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:57.927531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:58.060151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:58.067985 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8628bf2f-2679-4788-b586-168deed7a2dd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.159887 Oct 01 21:40:58.068552 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2098/6181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:57 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:40:59.091117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:40:59.091847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:40:59.098733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:59.099236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:59.099688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:59.100397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:40:59.100869 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:40:59.101307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:40:59.240015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:40:59.247951 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1935879f-ba5d-43de-972b-5a6302b9c3a0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.160876 Oct 01 21:40:59.248522 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4084/6182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:40:59 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:00.271119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:00.271737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:00.278665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:00.279225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:00.279598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:00.280296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:00.280756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:00.281183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:00.407800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:00.415635 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-32bafe07-e70c-4a81-b54e-22a28b8c0a6c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.148473 Oct 01 21:41:00.416212 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2099/6183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:00 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:01.438672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:01.439340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:01.446226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:01.446771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:01.447232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:01.447946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:01.448418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:01.449353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:01.862138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:01.870129 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-36470af4-8a66-4211-90fb-b53b32d9699e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.435398 Oct 01 21:41:01.871392 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4085/6184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:01 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:02.894212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:02.894869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:02.901137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:02.901570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:02.902766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:02.903466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:02.903921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:02.904348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:03.032039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:03.039998 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-478a2e1d-6f40-4009-98d7-da888711150e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.149966 Oct 01 21:41:03.040583 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2100/6185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:02 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:04.062434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:04.063098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:04.069461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:04.069962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:04.070420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:04.071157 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:04.071630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:04.072075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:04.198267 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:04.207597 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5f767c95-e733-4b8c-9e82-5c5395b9bd01 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.149151 Oct 01 21:41:04.208216 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4086/6186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:04 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:05.232223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:05.232851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:05.239858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:05.240351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:05.240797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:05.241499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:05.241964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:05.242395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:05.373639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:05.381509 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0948a2cf-2688-4d5d-9c9e-9dccc5345e3d tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.153830 Oct 01 21:41:05.382090 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2101/6187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:05 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:06.404607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:06.405161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:06.412024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:06.412527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:06.412976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:06.413681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:06.414151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:06.414621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:06.545027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:06.552965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2a5558f-f951-444e-be63-0af161075f43 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.152407 Oct 01 21:41:06.553543 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4087/6188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:06 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:07.577403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:07.578020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:07.584895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:07.585379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:07.585817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:07.586529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:07.586996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:07.587424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:07.714927 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:07.722613 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1aef6459-59b4-4797-bb58-f7817ef8b1fd tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.149741 Oct 01 21:41:07.723187 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2102/6189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:07 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:08.745833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:08.746446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:08.753352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:08.753849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:08.754302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:08.755034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:08.755502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:08.755941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:08.885145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:08.893404 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9449f8d0-c38d-4938-95d7-3c003396d264 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.151507 Oct 01 21:41:08.893982 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4088/6190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:08 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:09.917111 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:09.918347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:09.925351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:09.925848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:09.926311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:09.927042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:09.927512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:09.927950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:10.064649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:10.072518 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8062fa20-6c5d-4de7-842c-518cd2ee47e3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.159359 Oct 01 21:41:10.073096 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2103/6191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:09 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:11.095338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:11.095979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:11.102884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:11.103389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:11.103847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:11.104560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:11.105526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:11.105978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:11.240067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:11.243640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:11.248847 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e244b9fa-efb8-46e1-8df8-7454c858b8e1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.157365 Oct 01 21:41:11.249552 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4089/6192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:11 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:12.272098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:12.272755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:12.275489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:12.280809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:12.281303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:12.281750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:12.282453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:12.282941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:12.283372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:12.288099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:12.415812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:12.424143 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bee3ead5-e74e-41c1-8cf8-a1b81aa0f98c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.155930 Oct 01 21:41:12.424736 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2104/6193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:12 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:13.449976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:13.450629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:13.453220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=36 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:13.459308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:13.459806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:13.460257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:13.460961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:13.461431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:13.461872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:13.862780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:13.871402 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4b26cc06-2e88-4854-9929-3f0b50956f3b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.427106 Oct 01 21:41:13.871968 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4090/6194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:13 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:14.894476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:14.895212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:14.903154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:14.903645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:14.904086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:14.904778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:14.905235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:14.905659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:15.036962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:15.044916 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e917ef8b-c68e-47cc-8c03-0f2fdc34404a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.154376 Oct 01 21:41:15.045934 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2105/6195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:14 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:16.068584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:16.069222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:16.076184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:16.076722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:16.077182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:16.077893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:16.078369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:16.078859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:16.210801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:16.219450 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1531c379-20ec-4ca3-be05-87927162bd47 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.154816 Oct 01 21:41:16.220011 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4091/6196] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:16 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:17.242158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:17.242844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:17.249763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:17.250256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:17.250737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:17.251442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:17.251906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:17.252340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:17.379134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:17.386932 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-893f144f-dc6e-46a6-ba89-34d9a2efcf40 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.148659 Oct 01 21:41:17.387624 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2106/6197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:17 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:18.410656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:18.411292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:18.418630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:18.419138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:18.419599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:18.420314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:18.420792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:18.421239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:18.548963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:18.557006 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7b7d89bb-fdde-4276-b37f-02f030f2e672 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.150294 Oct 01 21:41:18.558199 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4092/6198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:18 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:19.581074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:19.581687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:19.588510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:19.588998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:19.589437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:19.590135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:19.590670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:19.591045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:19.720512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:19.728388 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c2403488-9153-49ad-9577-c868040eb4f1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.151347 Oct 01 21:41:19.728971 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2107/6199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:19 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:20.754940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:20.755584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:20.762447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:20.762999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:20.763461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:20.764177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:20.764653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:20.765102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:20.894453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:20.902332 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a91e33dd-607c-4f6a-af13-6fce01288d1f tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.151433 Oct 01 21:41:20.902929 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4093/6200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:20 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:21.925853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:21.926470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:21.934160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:21.934690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:21.935138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:21.935944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:21.936659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:21.937135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:22.073724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:22.081820 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-07625b1a-f3e9-49c8-b782-fdacd3227b0a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.159882 Oct 01 21:41:22.082407 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2108/6201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:21 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:23.105131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:23.105775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:23.112727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:23.113238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:23.113698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:23.114439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:23.114978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:23.115428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:23.252393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:23.261376 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf46c8cd-daac-4a7f-93ec-b2c2b8455906 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1522 microversion: 2.1 time: 0.159609 Oct 01 21:41:23.262558 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4094/6202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:23 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:23.775511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-2fbb3480-da91-4656-adcf-5fb21cd4e3e6 req-d69a5830-189f-42de-aede-242daf92c69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8b0f2c-15f7-4b18-97ae-6f3d199e3460", "name": "network-vif-unplugged", "status": "completed", "tag": "a82f2e5e-07aa-4571-8824-9116e8cb15e7"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:23.786394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2fbb3480-da91-4656-adcf-5fb21cd4e3e6 req-d69a5830-189f-42de-aede-242daf92c69f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:23.786990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2fbb3480-da91-4656-adcf-5fb21cd4e3e6 req-d69a5830-189f-42de-aede-242daf92c69f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:23.787512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-2fbb3480-da91-4656-adcf-5fb21cd4e3e6 req-d69a5830-189f-42de-aede-242daf92c69f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:23.800295 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-2fbb3480-da91-4656-adcf-5fb21cd4e3e6 req-d69a5830-189f-42de-aede-242daf92c69f service nova] Creating event network-vif-unplugged:a82f2e5e-07aa-4571-8824-9116e8cb15e7 for instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 on nch2-master-1 Oct 01 21:41:23.806121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-2fbb3480-da91-4656-adcf-5fb21cd4e3e6 req-d69a5830-189f-42de-aede-242daf92c69f service nova] Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:41:23.817826 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-2fbb3480-da91-4656-adcf-5fb21cd4e3e6 req-d69a5830-189f-42de-aede-242daf92c69f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125665 Oct 01 21:41:23.818792 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2109/6203] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:41:24.287114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:24.287748 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:24.295526 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:24.296040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:24.296495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:24.297268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:24.297802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:24.298466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:24.433815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:24.442263 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e4a93d20-1583-4742-9c13-80a581f28874 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1521 microversion: 2.1 time: 0.159201 Oct 01 21:41:24.442875 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4095/6204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:24 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:25.467789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:25.468492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:25.474772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:25.475265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:25.475709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:25.476432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:25.476893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:25.477325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:25.609410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:25.617202 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ac4e1ac4-1926-4473-9b46-1b7784d3670e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1519 microversion: 2.1 time: 0.155242 Oct 01 21:41:25.617787 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2110/6205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:25 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:25.840242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-59bcf442-48b4-4a13-a54a-8b19ed9f9a13 req-22faa1a1-77f9-4280-bdc0-93cb29462b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8b0f2c-15f7-4b18-97ae-6f3d199e3460", "tag": "a82f2e5e-07aa-4571-8824-9116e8cb15e7"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:25.852160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-59bcf442-48b4-4a13-a54a-8b19ed9f9a13 req-22faa1a1-77f9-4280-bdc0-93cb29462b52 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:25.852659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-59bcf442-48b4-4a13-a54a-8b19ed9f9a13 req-22faa1a1-77f9-4280-bdc0-93cb29462b52 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:25.853108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-59bcf442-48b4-4a13-a54a-8b19ed9f9a13 req-22faa1a1-77f9-4280-bdc0-93cb29462b52 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:25.866993 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-59bcf442-48b4-4a13-a54a-8b19ed9f9a13 req-22faa1a1-77f9-4280-bdc0-93cb29462b52 service nova] Creating event network-changed:a82f2e5e-07aa-4571-8824-9116e8cb15e7 for instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 on nch2-master-1 Oct 01 21:41:25.872713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-59bcf442-48b4-4a13-a54a-8b19ed9f9a13 req-22faa1a1-77f9-4280-bdc0-93cb29462b52 service nova] Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:41:25.885348 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-59bcf442-48b4-4a13-a54a-8b19ed9f9a13 req-22faa1a1-77f9-4280-bdc0-93cb29462b52 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049275 Oct 01 21:41:25.886469 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4096/6206] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:41:26.640644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:26.641181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:26.648717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:26.649210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:26.649658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:26.650369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:26.650866 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:26.651306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:26.779329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:26.787180 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5c42c336-7d34-409d-8b84-3a3ec6df9a95 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1516 microversion: 2.1 time: 0.150510 Oct 01 21:41:26.787760 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2111/6207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:26 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:26.811480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76363824-0362-4a7a-adf8-08b8db7415b5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:26.812121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76363824-0362-4a7a-adf8-08b8db7415b5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:26.818628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76363824-0362-4a7a-adf8-08b8db7415b5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:26.819130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76363824-0362-4a7a-adf8-08b8db7415b5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:26.819582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76363824-0362-4a7a-adf8-08b8db7415b5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:26.820286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76363824-0362-4a7a-adf8-08b8db7415b5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:26.820757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76363824-0362-4a7a-adf8-08b8db7415b5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:26.821198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76363824-0362-4a7a-adf8-08b8db7415b5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:26.879551 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76363824-0362-4a7a-adf8-08b8db7415b5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "POST /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460/action" status: 204 len: 0 microversion: 2.1 time: 0.072775 Oct 01 21:41:26.880248 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4097/6208] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:41:26 2022] POST /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:41:26.889267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:26.889863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:26.896141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:26.896739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:26.897357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:26.898482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:26.899005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:26.899640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:27.046808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:27.054964 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e9c93147-c828-447a-9c41-eac6c3820c80 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1516 microversion: 2.1 time: 0.170327 Oct 01 21:41:27.055556 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2112/6209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:26 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:28.079683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:28.080469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:28.087714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:28.088224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:28.088681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:28.089400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:28.089871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:28.090326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:28.227060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:28.235344 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5196dd90-b970-4090-901d-045d766453f5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1508 microversion: 2.1 time: 0.160032 Oct 01 21:41:28.235909 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4098/6210] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:28 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:28.258371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:28.259022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:28.265810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:28.266306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:28.266795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:28.267504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:28.267968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:28.268404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:28.395343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:28.404356 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-840b170a-c5bf-4622-807c-85cde4390fc7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1508 microversion: 2.1 time: 0.149762 Oct 01 21:41:28.404946 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2113/6211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:28 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:28.430192 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d15e3142-bd51-41b5-8302-9268a63e2e93 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Action: 'create', calling method: .version_select at 0x7f417283a3a0>, body: {"keypair": {"name": "tempest-keypair-739003956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEor0oEl027JTQPI/JwQnRsT5nwp71qcX0biAvm87kime5uNOMByl7USXECNqqbfwG2qCohzAD43TTuTjnLooS5zgT1GyDiUlVoKIEz9LswYEpriRQtHvs7IbyFuqz67UA=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:28.447019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d15e3142-bd51-41b5-8302-9268a63e2e93 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Getting quotas for project 556938530bd8414b99541d920b467ab8. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:41:28.452155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d15e3142-bd51-41b5-8302-9268a63e2e93 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Getting quotas for user d66e970d7ba14adcb41f1789c7af8509 and project 556938530bd8414b99541d920b467ab8. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:41:28.480692 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d15e3142-bd51-41b5-8302-9268a63e2e93 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053884 Oct 01 21:41:28.481317 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4099/6212] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:41:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:41:29.489777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-5a98598c-a304-4396-bf33-c9ddcb0056a9 req-9522379e-0e33-4bbc-a54b-6f42954b939b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8b0f2c-15f7-4b18-97ae-6f3d199e3460", "name": "network-vif-plugged", "status": "completed", "tag": "a82f2e5e-07aa-4571-8824-9116e8cb15e7"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:29.502063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5a98598c-a304-4396-bf33-c9ddcb0056a9 req-9522379e-0e33-4bbc-a54b-6f42954b939b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:29.502063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5a98598c-a304-4396-bf33-c9ddcb0056a9 req-9522379e-0e33-4bbc-a54b-6f42954b939b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:29.502435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5a98598c-a304-4396-bf33-c9ddcb0056a9 req-9522379e-0e33-4bbc-a54b-6f42954b939b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:29.514660 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-5a98598c-a304-4396-bf33-c9ddcb0056a9 req-9522379e-0e33-4bbc-a54b-6f42954b939b service nova] Creating event network-vif-plugged:a82f2e5e-07aa-4571-8824-9116e8cb15e7 for instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 on nch2-master-1 Oct 01 21:41:29.519878 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-5a98598c-a304-4396-bf33-c9ddcb0056a9 req-9522379e-0e33-4bbc-a54b-6f42954b939b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034089 Oct 01 21:41:29.520591 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2114/6213] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:41:29.653520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:29.654301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:29.661407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:29.661948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:29.662407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:29.663169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:29.663649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:29.664098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:29.798604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:29.806744 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7bc7e1b4-fa20-4ea7-8b05-e17b81279607 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 200 len: 1508 microversion: 2.1 time: 0.158147 Oct 01 21:41:29.807319 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4100/6214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:29 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:29.829964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:29.830590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:29.836762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:29.837248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:29.837687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:29.838384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:29.838909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:29.839365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:29.865092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:41:29.940986 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5e0f6d3f-f340-4b68-b01c-4556b0e3b755 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 204 len: 0 microversion: 2.1 time: 0.115080 Oct 01 21:41:29.941767 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2115/6215] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:41:29 2022] DELETE /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:41:30.002212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1347092201", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "8c8fe73d-e7d3-45c8-bea7-f1214a20b107"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:30.056233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] validate_networks() for [('8c8fe73d-e7d3-45c8-bea7-f1214a20b107', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:41:30.482372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:41:30.482860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:41:30.483386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:41:30.483820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:41:30.484256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:41:30.493279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:30.493785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:30.494246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:30.495043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:30.495523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:30.496534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:30.513095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Getting quotas for project 556938530bd8414b99541d920b467ab8. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:41:30.518330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Getting quotas for user d66e970d7ba14adcb41f1789c7af8509 and project 556938530bd8414b99541d920b467ab8. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:41:30.530581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:41:30.532891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:41:30.579550 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf6b0d18-222a-4f8a-86f9-08bbd5a9a8d4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581216 Oct 01 21:41:30.580209 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4101/6216] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:41:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:41:30.591956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e5874e8a-a15f-41e1-9fc9-6881fc58b3c0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:30.592680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e5874e8a-a15f-41e1-9fc9-6881fc58b3c0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:30.648921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e5874e8a-a15f-41e1-9fc9-6881fc58b3c0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:30.656700 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e5874e8a-a15f-41e1-9fc9-6881fc58b3c0 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1218 microversion: 2.1 time: 0.069143 Oct 01 21:41:30.657271 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2116/6217] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:30 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:31.690971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:31.692279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:31.703503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:31.704041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:31.704492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:31.705221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:31.706587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:31.707536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:31.741677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-51702095-c5de-4f35-b214-dc1bd7b66818 req-ee632f51-fb02-4cad-92d7-e2d0b8891ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8b0f2c-15f7-4b18-97ae-6f3d199e3460", "name": "network-vif-deleted", "tag": "a82f2e5e-07aa-4571-8824-9116e8cb15e7"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:31.764237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-51702095-c5de-4f35-b214-dc1bd7b66818 req-ee632f51-fb02-4cad-92d7-e2d0b8891ae1 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:31.764891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-51702095-c5de-4f35-b214-dc1bd7b66818 req-ee632f51-fb02-4cad-92d7-e2d0b8891ae1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:31.765437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-51702095-c5de-4f35-b214-dc1bd7b66818 req-ee632f51-fb02-4cad-92d7-e2d0b8891ae1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:31.774285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:31.780977 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-51702095-c5de-4f35-b214-dc1bd7b66818 req-ee632f51-fb02-4cad-92d7-e2d0b8891ae1 service nova] Creating event network-vif-deleted:a82f2e5e-07aa-4571-8824-9116e8cb15e7 for instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 on nch2-master-1 Oct 01 21:41:31.783584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f024521-c3e5-43cc-a8cf-5573bf76b438 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1270 microversion: 2.1 time: 0.105314 Oct 01 21:41:31.784440 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4102/6218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:31 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:31.787795 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-51702095-c5de-4f35-b214-dc1bd7b66818 req-ee632f51-fb02-4cad-92d7-e2d0b8891ae1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050350 Oct 01 21:41:31.788551 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2117/6219] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:41:32.808983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:32.809972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:32.817334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:32.817863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:32.818326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:32.819141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:32.819829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:32.820289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:32.961979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:32.970079 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ab2bd902-98c3-494f-9511-391ee33130ca tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1318 microversion: 2.1 time: 0.165653 Oct 01 21:41:32.970742 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4103/6220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:32 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:33.812339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a38bc697-4439-4477-bf36-76601b10c6b5 req-53528856-b637-4a43-9534-4c62ad4540e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01145964-33e1-4040-8355-9496b84d63d4", "tag": "e773bf25-fdd3-4d27-8446-b08dc99a96c4"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:33.823566 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a38bc697-4439-4477-bf36-76601b10c6b5 req-53528856-b637-4a43-9534-4c62ad4540e2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:33.824335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a38bc697-4439-4477-bf36-76601b10c6b5 req-53528856-b637-4a43-9534-4c62ad4540e2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:33.825226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a38bc697-4439-4477-bf36-76601b10c6b5 req-53528856-b637-4a43-9534-4c62ad4540e2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:33.837223 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a38bc697-4439-4477-bf36-76601b10c6b5 req-53528856-b637-4a43-9534-4c62ad4540e2 service nova] Creating event network-changed:e773bf25-fdd3-4d27-8446-b08dc99a96c4 for instance 01145964-33e1-4040-8355-9496b84d63d4 on nch2-master-1 Oct 01 21:41:33.842976 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a38bc697-4439-4477-bf36-76601b10c6b5 req-53528856-b637-4a43-9534-4c62ad4540e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036330 Oct 01 21:41:33.843572 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2118/6221] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:41:33.993215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:33.993870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:34.000917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:34.001419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:34.001874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:34.002632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:34.003105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:34.003547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:34.138253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:34.146664 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bf045cd0-1596-4803-b9c6-3955d153ea42 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1318 microversion: 2.1 time: 0.156988 Oct 01 21:41:34.147243 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4104/6222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:33 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:41:35.172236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:35.172955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:35.179454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:35.179950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:35.180402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:35.181222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:35.181703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:35.182140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:35.316010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:35.324014 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9c4969f9-8046-4a3c-ac0e-bb221e934852 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1318 microversion: 2.1 time: 0.157422 Oct 01 21:41:35.324598 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2119/6223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:35 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:36.346286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:36.346871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:36.353672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:36.354174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:36.354662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:36.355903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:36.356375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:36.356816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:36.484524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:36.492226 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-02116181-4a62-4d33-9792-74e2ffe83b5b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1318 microversion: 2.1 time: 0.149921 Oct 01 21:41:36.492791 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4105/6224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:36 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:37.516267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:37.516899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:37.523829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:37.524331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:37.524780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:37.525508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:37.525949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:37.526380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:37.656592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:37.664433 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6da4560b-8d69-42c6-945b-9c6d762ad795 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1318 microversion: 2.1 time: 0.152115 Oct 01 21:41:37.665004 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2120/6225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:37 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:38.687260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:38.687923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:38.694763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:38.695265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:38.695723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:38.696433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:38.696906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:38.697345 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:38.832007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:38.840462 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-10131569-70f0-4cc1-8aef-273270dbdecf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1318 microversion: 2.1 time: 0.157111 Oct 01 21:41:38.841036 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4106/6226] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:38 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:39.538170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-fd034f68-e922-44a5-973c-8a9b834db526 req-31959ffc-953a-4ed1-b005-201fb4421d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01145964-33e1-4040-8355-9496b84d63d4", "name": "network-vif-plugged", "status": "completed", "tag": "e773bf25-fdd3-4d27-8446-b08dc99a96c4"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:39.549309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fd034f68-e922-44a5-973c-8a9b834db526 req-31959ffc-953a-4ed1-b005-201fb4421d40 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:39.549811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fd034f68-e922-44a5-973c-8a9b834db526 req-31959ffc-953a-4ed1-b005-201fb4421d40 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:39.550264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fd034f68-e922-44a5-973c-8a9b834db526 req-31959ffc-953a-4ed1-b005-201fb4421d40 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:39.562453 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-fd034f68-e922-44a5-973c-8a9b834db526 req-31959ffc-953a-4ed1-b005-201fb4421d40 service nova] Creating event network-vif-plugged:e773bf25-fdd3-4d27-8446-b08dc99a96c4 for instance 01145964-33e1-4040-8355-9496b84d63d4 on nch2-master-1 Oct 01 21:41:39.567562 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-fd034f68-e922-44a5-973c-8a9b834db526 req-31959ffc-953a-4ed1-b005-201fb4421d40 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033233 Oct 01 21:41:39.568180 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2121/6227] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:41:39.863384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:39.864048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:39.870979 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:39.871485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:39.871945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:39.872653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:39.873126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:39.873568 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:39.888206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:40.007995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:40.015782 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c1ac7f27-383c-436d-9cc7-d3dae6593925 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1318 microversion: 2.1 time: 0.156363 Oct 01 21:41:40.016357 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4107/6228] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:39 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:41.039154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:41.044275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:41.045037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:41.051692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:41.052194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:41.052645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:41.053363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:41.053842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:41.054605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:41.186015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:41.193855 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-12da6a07-2acc-465a-b240-534ab7f47956 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1509 microversion: 2.1 time: 0.156820 Oct 01 21:41:41.194438 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2122/6229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:41 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:41:41.218254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:41.218887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:41.220817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:41.221527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:41.228474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:41.229010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:41.229474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:41.230866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:41.231344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:41.231794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:41.362188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:41.370195 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-039d7042-fa4d-4049-86e8-89c9e3475954 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1509 microversion: 2.1 time: 0.156469 Oct 01 21:41:41.370811 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4108/6230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:41 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:41.392152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:41:41.394455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:41.400439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:41.400934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:41.401407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:41.402695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:41.403162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:41.403598 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:41.406200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:41.433847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:41.439238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Old instance type m1.heat2, new instance type m1.heat {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:41:41.445755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:41:41.446180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:41:41.446693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:41:41.447117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:41:41.447539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:41:41.510672 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fce4c15d-a8c3-496f-8ef0-744f04470212 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "POST /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4/action" status: 202 len: 0 microversion: 2.1 time: 0.122374 Oct 01 21:41:41.511323 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2123/6231] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:41:41 2022] POST /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:41:41.519425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:41.520072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:41.526028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:41.527174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:41.527709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:41.528509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:41.529059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:41.529581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:41.663928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:41.672029 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f147429f-b64c-49b4-8a81-9cd09db86955 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1516 microversion: 2.1 time: 0.156477 Oct 01 21:41:41.672811 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4109/6232] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:41 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:42.696627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:42.697270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:42.699353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:42.710063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:42.710063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:42.710540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:42.711256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:42.711717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:42.712149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:42.944253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:42.952189 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f361a1ca-a097-4b31-adfd-8df89998cc1b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1516 microversion: 2.1 time: 0.260605 Oct 01 21:41:42.952781 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2124/6233] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:42 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:43.976132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:43.976775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:43.980026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:41:43.985351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:43.985862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:43.986322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:43.987144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:43.987653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:43.988100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:44.119780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:44.131345 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1e0f2e7-3a3c-403f-8666-0b6d371b8fe5 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.159126 Oct 01 21:41:44.131947 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4110/6234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:43 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:45.154564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:45.155185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:45.162032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:45.162555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:45.162999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:45.163694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:45.164154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:45.164583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:45.292306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:45.300053 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cd625cc8-8489-45c9-9ac4-7523b4886b09 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.149450 Oct 01 21:41:45.300573 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2125/6235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:45 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:46.324430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:46.325020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:46.331882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:46.332386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:46.332846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:46.333565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:46.334044 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:46.334511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:46.471122 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:46.478925 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc5ed47c-f751-4a42-a2dc-ae05b97fd117 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.158973 Oct 01 21:41:46.479530 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4111/6236] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:46 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:47.501497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:47.502117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:47.509063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:47.509547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:47.509986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:47.510711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:47.511166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:47.511593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:47.642512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:47.650243 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8f7b795f-68e8-48fe-b431-087cf116dbcc tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.152855 Oct 01 21:41:47.650849 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2126/6237] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:47 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:48.673745 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:48.674393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:48.681652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:48.682167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:48.682663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:48.683393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:48.684501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:48.684987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:48.814011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:48.822829 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f2ee94d-e0e0-46f5-83b3-3035ed54d1b1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.152826 Oct 01 21:41:48.823418 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4112/6238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:48 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:49.846860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:49.847581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:49.854582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:49.855040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:49.855995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:49.856700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:49.857160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:49.857619 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:49.988990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:49.997811 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-627810a4-d4ca-4638-b5f5-7497d4ccd959 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.154937 Oct 01 21:41:49.998403 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2127/6239] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:49 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:51.020989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:51.021622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:51.033687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:51.034208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:51.034702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:51.035444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:51.035951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:51.036382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:51.169962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:51.177831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0770a53d-79d3-4778-be60-f0ea04f4194c tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.160813 Oct 01 21:41:51.178406 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4113/6240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:51 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:52.201766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:52.202401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:52.210216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:52.210696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:52.211148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:52.211902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:52.212369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:52.212809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:52.341853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:52.349655 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b6c013f9-c266-4ddd-a18c-673b88413ce7 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.152390 Oct 01 21:41:52.350233 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2128/6241] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:52 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:53.372973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:53.373542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:53.380705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:53.381213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:53.381674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:53.382392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:53.382896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:53.383351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:53.511339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:53.519418 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-14957a61-263a-4bd9-8254-8d55508436c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.150448 Oct 01 21:41:53.520013 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4114/6242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:53 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:54.542207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:54.543360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:54.550315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:54.550844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:54.551295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:54.552000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:54.552464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:54.552898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:54.683272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:54.691706 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-92538537-697a-4ee6-8fe2-e67a6196f94a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.153470 Oct 01 21:41:54.692281 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2129/6243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:54 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:55.717272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:55.717900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:55.724776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:55.725286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:55.725743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:55.726470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:55.726970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:55.727420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:55.856798 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:55.864618 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-18a57efe-237c-4f58-9d7d-10baca68faa9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.151345 Oct 01 21:41:55.865193 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4115/6244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:55 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:56.888951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:56.889608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:56.896687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:56.897212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:56.897654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:56.898354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:56.898845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:56.899281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:57.030203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:57.038049 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d2616df6-e3c8-4546-8571-17efe35473f2 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.153636 Oct 01 21:41:57.038656 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2130/6245] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:56 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:58.061178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:58.061818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:58.068770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:58.069276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:58.069772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:58.070505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:58.070996 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:58.071447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:58.204971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:58.213629 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-95aacfe7-78eb-4850-b20b-60da3917d8c1 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.156347 Oct 01 21:41:58.214216 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4116/6246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:58 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:41:59.237589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:41:59.238217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:41:59.245184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:59.245677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:59.246120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:59.246848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:41:59.247312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:41:59.247742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:41:59.378128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:41:59.385948 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f1f8eda9-e610-4c56-b7ce-b5101d626076 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.152399 Oct 01 21:41:59.386585 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2131/6247] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:41:59 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:00.409699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:00.410282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:00.417156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:00.418167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:00.418657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:00.419378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:00.419852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:00.420302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:00.548871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:00.556991 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bafd38ec-64fa-4a86-97db-51f76d8f6fd3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.151356 Oct 01 21:42:00.557571 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4117/6248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:00 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:01.581461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:01.582084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:01.588474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:01.588968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:01.589417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:01.590120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:01.590614 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:01.591053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:01.718123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:01.726012 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-71d55b21-9426-4e9f-891b-d72715d1a0a3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.148679 Oct 01 21:42:01.726617 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2132/6249] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:01 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:02.749763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:02.750403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:02.756679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:02.757193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:02.757656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:02.758377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:02.758889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:02.759340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:02.895663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:02.904370 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b38cd14-4881-438f-a01f-8f3ba0a05fa3 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.158954 Oct 01 21:42:02.904891 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4118/6250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:02 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:03.927466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:03.928073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:03.935331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:03.935821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:03.936263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:03.936967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:03.937429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:03.937862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:04.071623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:04.080026 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7c64a1d9-a5ac-4646-b93a-fe75d6cc2188 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.156507 Oct 01 21:42:04.080607 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2133/6251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:03 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:05.103969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:05.104602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:05.112202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:05.112705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:05.113160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:05.113870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:05.114341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:05.114828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:05.245237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:05.253185 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aad95ccc-9f64-43aa-beee-38d2852c800e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.153188 Oct 01 21:42:05.253763 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4119/6252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:05 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:06.276276 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:06.276908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:06.284965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:06.285464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:06.285915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:06.286673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:06.287142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:06.287585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:06.414976 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:06.423259 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b907d8d7-8846-4fee-8e8b-3b9ddf295c06 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.150974 Oct 01 21:42:06.423837 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2134/6253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:06 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:07.447472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:07.448035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:07.455631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:07.456140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:07.456599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:07.457314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:07.457795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:07.458246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:07.588375 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:07.596279 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c3482f75-6586-4a1d-b43a-784f7c0d67d9 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.152835 Oct 01 21:42:07.596863 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4120/6254] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:07 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:08.619309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:08.619941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:08.626890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:08.627388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:08.627840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:08.628554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:08.629021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:08.629462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:08.757389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:08.765820 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7e8f9ebd-b19e-43fd-ad74-d134f0a1b910 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.150430 Oct 01 21:42:08.766402 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2135/6255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:08 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:09.788779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:09.789430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:09.796358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:09.796872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:09.797340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:09.798063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:09.798573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:09.799027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:09.926370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:09.928633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=86 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:42:09.936164 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4afe20f2-1a10-4cf8-a5ad-284167532961 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1521 microversion: 2.1 time: 0.151335 Oct 01 21:42:09.936746 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4121/6256] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:09 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:10.617477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-8dc10a2b-c3ad-485e-80f7-226e3c949cee req-066ba0b3-91ed-441a-a2da-21f90473987b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01145964-33e1-4040-8355-9496b84d63d4", "name": "network-vif-unplugged", "status": "completed", "tag": "e773bf25-fdd3-4d27-8446-b08dc99a96c4"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:10.628105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8dc10a2b-c3ad-485e-80f7-226e3c949cee req-066ba0b3-91ed-441a-a2da-21f90473987b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:10.628671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8dc10a2b-c3ad-485e-80f7-226e3c949cee req-066ba0b3-91ed-441a-a2da-21f90473987b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:10.629160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8dc10a2b-c3ad-485e-80f7-226e3c949cee req-066ba0b3-91ed-441a-a2da-21f90473987b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:10.641380 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-8dc10a2b-c3ad-485e-80f7-226e3c949cee req-066ba0b3-91ed-441a-a2da-21f90473987b service nova] Creating event network-vif-unplugged:e773bf25-fdd3-4d27-8446-b08dc99a96c4 for instance 01145964-33e1-4040-8355-9496b84d63d4 on nch1-master-1 Oct 01 21:42:10.646859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-8dc10a2b-c3ad-485e-80f7-226e3c949cee req-066ba0b3-91ed-441a-a2da-21f90473987b service nova] Instance 01145964-33e1-4040-8355-9496b84d63d4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:42:10.658164 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-8dc10a2b-c3ad-485e-80f7-226e3c949cee req-066ba0b3-91ed-441a-a2da-21f90473987b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044484 Oct 01 21:42:10.659029 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2136/6257] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:42:10.959863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:10.960610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:10.968557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:10.969474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:10.969600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:10.970265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:10.970781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:10.971433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:11.201772 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:11.209893 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e818651a-174d-460a-b954-48eab9b4c86b tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1520 microversion: 2.1 time: 0.253912 Oct 01 21:42:11.210854 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4122/6258] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:10 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:12.236173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:12.236884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:12.243199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:12.243689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:12.244133 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:12.244825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:12.245285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:12.245757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:12.248425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:42:12.379045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:12.387287 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-20ee6ebd-b729-48ab-bca5-3cd6372f7dff tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1518 microversion: 2.1 time: 0.156353 Oct 01 21:42:12.387882 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2137/6259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:12 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:12.673369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-22dd5d9f-2c53-40ad-bebd-3648f10cc4a2 req-db32848b-6eb5-4a98-a08b-069593e19d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01145964-33e1-4040-8355-9496b84d63d4", "tag": "e773bf25-fdd3-4d27-8446-b08dc99a96c4"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:12.684444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-22dd5d9f-2c53-40ad-bebd-3648f10cc4a2 req-db32848b-6eb5-4a98-a08b-069593e19d26 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:12.684949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-22dd5d9f-2c53-40ad-bebd-3648f10cc4a2 req-db32848b-6eb5-4a98-a08b-069593e19d26 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:12.685386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-22dd5d9f-2c53-40ad-bebd-3648f10cc4a2 req-db32848b-6eb5-4a98-a08b-069593e19d26 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:12.696951 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-22dd5d9f-2c53-40ad-bebd-3648f10cc4a2 req-db32848b-6eb5-4a98-a08b-069593e19d26 service nova] Creating event network-changed:e773bf25-fdd3-4d27-8446-b08dc99a96c4 for instance 01145964-33e1-4040-8355-9496b84d63d4 on nch1-master-1 Oct 01 21:42:12.702913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-22dd5d9f-2c53-40ad-bebd-3648f10cc4a2 req-db32848b-6eb5-4a98-a08b-069593e19d26 service nova] Instance 01145964-33e1-4040-8355-9496b84d63d4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:42:12.713419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-22dd5d9f-2c53-40ad-bebd-3648f10cc4a2 req-db32848b-6eb5-4a98-a08b-069593e19d26 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043838 Oct 01 21:42:12.714003 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4123/6260] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:42:13.411660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:13.412291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:13.414981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:42:13.420506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:13.421049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:13.421530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:13.422245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:13.422746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:13.423185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:13.553952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:13.562615 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5eada369-f4fd-4038-8f4f-232ce4a2cebf tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1515 microversion: 2.1 time: 0.154912 Oct 01 21:42:13.563226 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2138/6261] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:13 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:13.586244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-581f55c9-4e1d-42da-a61e-fa5539f8d5df tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:13.586980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-581f55c9-4e1d-42da-a61e-fa5539f8d5df tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:13.593222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-581f55c9-4e1d-42da-a61e-fa5539f8d5df tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:13.593737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-581f55c9-4e1d-42da-a61e-fa5539f8d5df tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:13.594204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-581f55c9-4e1d-42da-a61e-fa5539f8d5df tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:13.594961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-581f55c9-4e1d-42da-a61e-fa5539f8d5df tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:13.595443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-581f55c9-4e1d-42da-a61e-fa5539f8d5df tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:13.595895 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-581f55c9-4e1d-42da-a61e-fa5539f8d5df tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:13.652894 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-581f55c9-4e1d-42da-a61e-fa5539f8d5df tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "POST /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4/action" status: 204 len: 0 microversion: 2.1 time: 0.070924 Oct 01 21:42:13.653531 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4124/6262] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:42:13 2022] POST /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:42:13.661800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:13.662436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:13.668578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:13.668997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:13.669422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:13.670521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:13.671254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:13.671700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:13.921579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:13.930051 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7756618a-799f-4864-b9f6-d89fce2cf7ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1515 microversion: 2.1 time: 0.272250 Oct 01 21:42:13.930690 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2139/6263] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:13 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:14.955488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:14.956213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:14.958199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=30 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:42:14.963612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:14.964127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:14.965073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:14.965781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:14.966251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:14.966728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:15.397665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:15.406396 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b84a70dc-3cba-467d-a39b-4b0ed9c7aa73 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1507 microversion: 2.1 time: 0.455924 Oct 01 21:42:15.407040 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4125/6264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:14 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:42:15.428639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:15.429550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:15.436778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:15.437304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:15.437754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:15.438476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:15.438964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:15.439403 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:15.578055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:15.586258 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6338cf79-866a-4582-8d33-e09b8c1ff867 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1507 microversion: 2.1 time: 0.161602 Oct 01 21:42:15.586885 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2140/6265] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:15 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:15.609548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:15.610196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:15.616865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:15.617384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:15.617875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:15.618637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:15.619124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:15.619577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:15.747788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:15.759113 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07f2206d-730f-4cda-aa33-6927188bcd26 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1507 microversion: 2.1 time: 0.153185 Oct 01 21:42:15.759997 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4126/6266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:15 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:42:15.782206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:15.782755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:15.788771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:15.789269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:15.789718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:15.790431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:15.790926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:15.791364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:15.817207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:42:15.896141 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4ea2bde0-9e6f-4f0f-a144-c24ce9efc751 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "DELETE /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 204 len: 0 microversion: 2.1 time: 0.117415 Oct 01 21:42:15.896839 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2141/6267] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:42:15 2022] DELETE /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:42:15.913790 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:15.914307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:15.920416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:15.920943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:15.921389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:15.922101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:15.922603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:15.923046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:15.949313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:42:15.994272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.compute.api [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Instance is already in deleting state, ignoring this request Oct 01 21:42:15.995170 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c150e0ff-01af-4baa-b5a9-f9ee232f747a tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "DELETE /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 204 len: 0 microversion: 2.1 time: 0.085601 Oct 01 21:42:15.996255 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4127/6268] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:42:15 2022] DELETE /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 21:42:16.004993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:16.005705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:16.012270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:16.012758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:16.013201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:16.013895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:16.014352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:16.014806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:16.146974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:16.154737 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0850b510-c68e-4aa8-8057-e87b5e9613ec tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1513 microversion: 2.1 time: 0.153953 Oct 01 21:42:16.155312 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2142/6269] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:15 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:17.178292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:17.178881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:17.187391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:17.187927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:17.188388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:17.189117 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:17.189631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:17.190078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:17.416912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66e970d7ba14adcb41f1789c7af8509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556938530bd8414b99541d920b467ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:17.427109 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a4e09e1b-0bac-4f25-80f7-f2f1ddda4dc6 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 200 len: 1513 microversion: 2.1 time: 0.252254 Oct 01 21:42:17.438832 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4128/6270] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:17 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:17.533256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-3b7e64e6-32e8-4199-a066-852624fed6b1 req-44025fd7-aac6-4c3e-8568-79bee13fa9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01145964-33e1-4040-8355-9496b84d63d4", "name": "network-vif-plugged", "status": "completed", "tag": "e773bf25-fdd3-4d27-8446-b08dc99a96c4"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:17.544524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3b7e64e6-32e8-4199-a066-852624fed6b1 req-44025fd7-aac6-4c3e-8568-79bee13fa9af service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:17.545020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3b7e64e6-32e8-4199-a066-852624fed6b1 req-44025fd7-aac6-4c3e-8568-79bee13fa9af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:17.545460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3b7e64e6-32e8-4199-a066-852624fed6b1 req-44025fd7-aac6-4c3e-8568-79bee13fa9af service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:17.560780 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-3b7e64e6-32e8-4199-a066-852624fed6b1 req-44025fd7-aac6-4c3e-8568-79bee13fa9af service nova] Creating event network-vif-plugged:e773bf25-fdd3-4d27-8446-b08dc99a96c4 for instance 01145964-33e1-4040-8355-9496b84d63d4 on nch1-master-1 Oct 01 21:42:17.565759 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-3b7e64e6-32e8-4199-a066-852624fed6b1 req-44025fd7-aac6-4c3e-8568-79bee13fa9af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036279 Oct 01 21:42:17.566558 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2143/6271] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:42:17.767127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-34f268ba-8a37-42ad-bc35-6c69ac238592 req-48293e91-54c4-45e8-9e6a-c53e53fb6904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01145964-33e1-4040-8355-9496b84d63d4", "name": "network-vif-deleted", "tag": "e773bf25-fdd3-4d27-8446-b08dc99a96c4"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:17.777618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-34f268ba-8a37-42ad-bc35-6c69ac238592 req-48293e91-54c4-45e8-9e6a-c53e53fb6904 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:17.778404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-34f268ba-8a37-42ad-bc35-6c69ac238592 req-48293e91-54c4-45e8-9e6a-c53e53fb6904 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:17.779064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-34f268ba-8a37-42ad-bc35-6c69ac238592 req-48293e91-54c4-45e8-9e6a-c53e53fb6904 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:17.791802 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-34f268ba-8a37-42ad-bc35-6c69ac238592 req-48293e91-54c4-45e8-9e6a-c53e53fb6904 service nova] Creating event network-vif-deleted:e773bf25-fdd3-4d27-8446-b08dc99a96c4 for instance 01145964-33e1-4040-8355-9496b84d63d4 on nch1-master-1 Oct 01 21:42:17.797616 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-34f268ba-8a37-42ad-bc35-6c69ac238592 req-48293e91-54c4-45e8-9e6a-c53e53fb6904 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034813 Oct 01 21:42:17.798536 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4129/6272] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:42:18.450434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:18.451236 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: 01145964-33e1-4040-8355-9496b84d63d4] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:18.457462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:18.457949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:18.458387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:18.459108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:18.459567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:18.459992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:18.473214 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] HTTP exception thrown: Instance 01145964-33e1-4040-8355-9496b84d63d4 could not be found. Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Request method failure captured: Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 HTTP/1.1 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLPY3hzcpGW9gYqxLpMpuWhsbQiPvxCb5tpK0lhbz_psQ69nRoqnKp8vsmHKU2y7p_CmTdAZjRPLHpL2OXNtHuTvf8jk-WH87dNDpEKNKJfGncBfPtvHZ-d208HciqbxkotyORSRBb4LUzs3bKWDl_lfm7eVIkmmPXMHY4nOo-wLxGo Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 556938530bd8414b99541d920b467ab8 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1092741948 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_556938530bd8414b99541d920b467ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/556938530bd8414b99541d920b467ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/556938530bd8414b99541d920b467ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/556938530bd8414b99541d920b467ab8"}]}] Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerDiskConfigTestJSON-1092741948 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 556938530bd8414b99541d920b467ab8 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1092741948 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerDiskConfigTestJSON-1092741948-project Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: d66e970d7ba14adcb41f1789c7af8509 Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerDiskConfigTestJSON-1092741948-project Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 01145964-33e1-4040-8355-9496b84d63d4 could not be found. Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '01145964-33e1-4040-8355-9496b84d63d4'} Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01145964-33e1-4040-8355-9496b84d63d4 could not be found. Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01145964-33e1-4040-8355-9496b84d63d4 could not be found. Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:42:18.474876 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01145964-33e1-4040-8355-9496b84d63d4 could not be found. Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Returning 404 to user: Instance 01145964-33e1-4040-8355-9496b84d63d4 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b1879ebc-8a10-4ecc-806a-4a8aa7255333 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4" status: 404 len: 111 microversion: 2.1 time: 0.030115 Oct 01 21:42:18.480348 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2144/6273] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:18 2022] GET /compute/v2.1/servers/01145964-33e1-4040-8355-9496b84d63d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:42:18.487817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6af05efe-39f1-46d9-84c2-20b468afbc2e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '.version_select at 0x7f41726c0af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:18.509085 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6af05efe-39f1-46d9-84c2-20b468afbc2e tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-739003956" status: 202 len: 0 microversion: 2.1 time: 0.026502 Oct 01 21:42:18.509682 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4130/6274] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Oct 1 21:42:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-739003956 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:42:19.108447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:19.108974 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:19.115862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:19.116353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:19.116802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:19.117511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:19.117987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:19.118424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:19.132175 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] HTTP exception thrown: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Request method failure captured: Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 HTTP/1.1 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLPY3hzcpGW9gYqxLpMpuWhsbQiPvxCb5tpK0lhbz_psQ69nRoqnKp8vsmHKU2y7p_CmTdAZjRPLHpL2OXNtHuTvf8jk-WH87dNDpEKNKJfGncBfPtvHZ-d208HciqbxkotyORSRBb4LUzs3bKWDl_lfm7eVIkmmPXMHY4nOo-wLxGo Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 556938530bd8414b99541d920b467ab8 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1092741948 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_556938530bd8414b99541d920b467ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/556938530bd8414b99541d920b467ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/556938530bd8414b99541d920b467ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/556938530bd8414b99541d920b467ab8"}]}] Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerDiskConfigTestJSON-1092741948 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 556938530bd8414b99541d920b467ab8 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1092741948 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerDiskConfigTestJSON-1092741948-project Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: d66e970d7ba14adcb41f1789c7af8509 Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerDiskConfigTestJSON-1092741948-project Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'dc8b0f2c-15f7-4b18-97ae-6f3d199e3460'} Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:42:19.133740 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Returning 404 to user: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4555d370-aedf-4048-a003-b28e9b0e80f4 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 404 len: 111 microversion: 2.1 time: 0.030744 Oct 01 21:42:19.138755 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2145/6275] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:42:19 2022] DELETE /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:42:19.144302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:19.145066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] [instance: dc8b0f2c-15f7-4b18-97ae-6f3d199e3460] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:19.155108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:19.155630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:19.156095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:19.156825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:19.157312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:19.157765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:19.170999 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] HTTP exception thrown: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Request method failure captured: Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 HTTP/1.1 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLPY3hzcpGW9gYqxLpMpuWhsbQiPvxCb5tpK0lhbz_psQ69nRoqnKp8vsmHKU2y7p_CmTdAZjRPLHpL2OXNtHuTvf8jk-WH87dNDpEKNKJfGncBfPtvHZ-d208HciqbxkotyORSRBb4LUzs3bKWDl_lfm7eVIkmmPXMHY4nOo-wLxGo Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 556938530bd8414b99541d920b467ab8 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1092741948 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_556938530bd8414b99541d920b467ab8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/556938530bd8414b99541d920b467ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/556938530bd8414b99541d920b467ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/556938530bd8414b99541d920b467ab8"}]}] Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerDiskConfigTestJSON-1092741948 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 556938530bd8414b99541d920b467ab8 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1092741948 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerDiskConfigTestJSON-1092741948-project Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: d66e970d7ba14adcb41f1789c7af8509 Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerDiskConfigTestJSON-1092741948-project Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'dc8b0f2c-15f7-4b18-97ae-6f3d199e3460'} Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:42:19.172670 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] Returning 404 to user: Instance dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8bcc6e4a-9911-4784-8d30-10d9c4f76c32 tempest-ServerDiskConfigTestJSON-1092741948 tempest-ServerDiskConfigTestJSON-1092741948-project] 10.222.0.17 "GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460" status: 404 len: 111 microversion: 2.1 time: 0.033749 Oct 01 21:42:19.177580 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4131/6276] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:19 2022] GET /compute/v2.1/servers/dc8b0f2c-15f7-4b18-97ae-6f3d199e3460 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:42:27.642344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-69dce5b6-ff98-4575-b7cc-07cb18ac4cb5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'create', calling method: .version_select at 0x7f417359c040>, body: {"keypair": {"name": "tempest-keypair-1928138378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHobm3CzYjbfqfGta0OVlS/zpnPvmFjvbWnpLj0O7RSHEQjBFFdXKaf77OtTOS09O1HFB+p/nkyo381uJ0ddQyjZnwKy9SfxUCn+8HzdYuVxKcMCXqvU+W86OV8iVn4JpA=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:27.659978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-69dce5b6-ff98-4575-b7cc-07cb18ac4cb5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for project ae55f903ff94436b8d907d865581cffd. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:42:27.665254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-69dce5b6-ff98-4575-b7cc-07cb18ac4cb5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for user 87e5b194ad2745b6af1f6ad76dd94881 and project ae55f903ff94436b8d907d865581cffd. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:42:27.697096 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-69dce5b6-ff98-4575-b7cc-07cb18ac4cb5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184437 Oct 01 21:42:27.697830 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2146/6277] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:42:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:42:29.057134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1751920044", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d21fbd12-b67f-4878-847d-9b5f3a740b75"}], "security_groups": [{"name": "tempest-securitygroup--168964952"}], "key_name": "tempest-keypair-1928138378", "user_data": "}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:29.162461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:42:29.165121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] validate_networks() for [('d21fbd12-b67f-4878-847d-9b5f3a740b75', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:42:29.547506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:42:29.547963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:42:29.548482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:42:29.548924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:42:29.549358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:42:29.559370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:29.559876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:29.560363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:29.561123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:29.561603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:29.562058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:29.579124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for project ae55f903ff94436b8d907d865581cffd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:42:29.584815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for user 87e5b194ad2745b6af1f6ad76dd94881 and project ae55f903ff94436b8d907d865581cffd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:42:29.599104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:42:29.601484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:42:29.650191 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a15cee17-d565-4540-abd7-6c02e18eced0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.598246 Oct 01 21:42:29.651127 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4132/6278] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:42:29 2022] POST /compute/v2.1/servers => generated 408 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:42:29.659723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:42:29.665758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b0b8b840-9b1c-47d6-a311-cc31fe8cc896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:29.666672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b0b8b840-9b1c-47d6-a311-cc31fe8cc896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:29.731820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b0b8b840-9b1c-47d6-a311-cc31fe8cc896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:29.740095 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b0b8b840-9b1c-47d6-a311-cc31fe8cc896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1239 microversion: 2.1 time: 0.081893 Oct 01 21:42:29.740564 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2147/6279] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:29 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:30.763876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:30.765263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:30.773972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:30.775444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:30.776324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:30.777131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:30.777829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:30.778510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:30.871760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:30.881835 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4061ae8-a259-4281-9994-f2260c0ee306 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1309 microversion: 2.1 time: 0.122083 Oct 01 21:42:30.883128 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4133/6280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:30 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:31.906858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:31.907396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:31.914302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:31.914834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:31.915291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:31.916005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:31.916479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:31.916917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:32.054556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:32.062274 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-27c00140-7890-41d7-87bb-41d36cc9c0ab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1364 microversion: 2.1 time: 0.160965 Oct 01 21:42:32.062889 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2148/6281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:31 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:32.250349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-59ebba0b-e057-490c-8cb6-429bd0b2b367 req-c312f4c9-4763-429d-8237-a03d3ff4e686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e397d496-340e-4ec6-9c99-42c52713f796", "tag": "a09c16e7-d672-4693-bc87-4f0df3b7688a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:32.264108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-59ebba0b-e057-490c-8cb6-429bd0b2b367 req-c312f4c9-4763-429d-8237-a03d3ff4e686 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:32.264873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-59ebba0b-e057-490c-8cb6-429bd0b2b367 req-c312f4c9-4763-429d-8237-a03d3ff4e686 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:32.265522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-59ebba0b-e057-490c-8cb6-429bd0b2b367 req-c312f4c9-4763-429d-8237-a03d3ff4e686 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:32.278609 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-59ebba0b-e057-490c-8cb6-429bd0b2b367 req-c312f4c9-4763-429d-8237-a03d3ff4e686 service nova] Creating event network-changed:a09c16e7-d672-4693-bc87-4f0df3b7688a for instance e397d496-340e-4ec6-9c99-42c52713f796 on nch1-master-1 Oct 01 21:42:32.283736 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-59ebba0b-e057-490c-8cb6-429bd0b2b367 req-c312f4c9-4763-429d-8237-a03d3ff4e686 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037637 Oct 01 21:42:32.284350 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4134/6282] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:42:33.085470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:33.086072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:33.093747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:33.094244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:33.094724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:33.095436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:33.095908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:33.096391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:33.222151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:33.230626 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-942ca68f-e67b-4fa0-b76a-089d01a7e9a2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1364 microversion: 2.1 time: 0.149129 Oct 01 21:42:33.231207 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2149/6283] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:33 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:34.253794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:34.254528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:34.261947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:34.262437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:34.262928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:34.263642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:34.264116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:34.264560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:34.398001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:34.405860 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6e7b0bf7-775d-4f49-b0a7-6c3be946809b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1364 microversion: 2.1 time: 0.156306 Oct 01 21:42:34.406446 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4135/6284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:34 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:35.429128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:35.429997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:35.437508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:35.438002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:35.438451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:35.439193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:35.439660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:35.440096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:35.574368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:35.583056 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-811dc39a-9ef3-40ba-a95c-0e8b7460b011 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1364 microversion: 2.1 time: 0.157926 Oct 01 21:42:35.583951 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2150/6285] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:35 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:36.605293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:36.605924 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:36.612851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:36.613355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:36.613841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:36.614577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:36.615050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:36.615501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:36.743284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:36.751625 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6c236c90-18bc-4417-9781-cfbb02eb2072 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1364 microversion: 2.1 time: 0.150366 Oct 01 21:42:36.752197 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4136/6286] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:36 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:37.620949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-682b070f-1555-4fe4-ab2a-5f24c1f7ee0d req-37e29803-cda4-4b4c-b124-372a19eb33fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e397d496-340e-4ec6-9c99-42c52713f796", "name": "network-vif-plugged", "status": "completed", "tag": "a09c16e7-d672-4693-bc87-4f0df3b7688a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:37.632165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-682b070f-1555-4fe4-ab2a-5f24c1f7ee0d req-37e29803-cda4-4b4c-b124-372a19eb33fa service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:37.632518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-682b070f-1555-4fe4-ab2a-5f24c1f7ee0d req-37e29803-cda4-4b4c-b124-372a19eb33fa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:37.632954 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-682b070f-1555-4fe4-ab2a-5f24c1f7ee0d req-37e29803-cda4-4b4c-b124-372a19eb33fa service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:37.644769 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-682b070f-1555-4fe4-ab2a-5f24c1f7ee0d req-37e29803-cda4-4b4c-b124-372a19eb33fa service nova] Creating event network-vif-plugged:a09c16e7-d672-4693-bc87-4f0df3b7688a for instance e397d496-340e-4ec6-9c99-42c52713f796 on nch1-master-1 Oct 01 21:42:37.649740 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-682b070f-1555-4fe4-ab2a-5f24c1f7ee0d req-37e29803-cda4-4b4c-b124-372a19eb33fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032687 Oct 01 21:42:37.650342 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2151/6287] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:42:37.775219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:37.775861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:37.783251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:37.783786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:37.784247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:37.784971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:37.785454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:37.785903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:37.913965 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:37.921770 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8d1c148a-a3c0-4b31-929d-2e26a8cbea30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1364 microversion: 2.1 time: 0.150569 Oct 01 21:42:37.922343 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4137/6288] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:37 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:38.946101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:38.946874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:38.953064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:38.953550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:38.953992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:38.954711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:38.955172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:38.955597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:39.088124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:42:39.096411 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7a36767c-d50b-4cfc-bb81-2a0fd5ac8d90 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1551 microversion: 2.1 time: 0.155555 Oct 01 21:42:39.096999 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2152/6289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:42:38 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:42:39.119575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4040a75-9b41-454e-af45-838b13aeab30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:42:39.120091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4040a75-9b41-454e-af45-838b13aeab30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:42:39.126972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4040a75-9b41-454e-af45-838b13aeab30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:39.127477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4040a75-9b41-454e-af45-838b13aeab30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:39.127933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4040a75-9b41-454e-af45-838b13aeab30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:39.128652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4040a75-9b41-454e-af45-838b13aeab30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:39.129129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4040a75-9b41-454e-af45-838b13aeab30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:39.129578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4040a75-9b41-454e-af45-838b13aeab30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:39.207222 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4040a75-9b41-454e-af45-838b13aeab30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091476 Oct 01 21:42:39.207836 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4138/6290] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:42:39 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:42:40.422522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-97b19eeb-0cf0-4738-b499-5b0b27f3f601 req-7bb43e01-b471-491f-ae89-87ce07aaae92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e397d496-340e-4ec6-9c99-42c52713f796", "tag": "a09c16e7-d672-4693-bc87-4f0df3b7688a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:42:40.427490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:42:40.435140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-97b19eeb-0cf0-4738-b499-5b0b27f3f601 req-7bb43e01-b471-491f-ae89-87ce07aaae92 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:42:40.435623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-97b19eeb-0cf0-4738-b499-5b0b27f3f601 req-7bb43e01-b471-491f-ae89-87ce07aaae92 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:42:40.436057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-97b19eeb-0cf0-4738-b499-5b0b27f3f601 req-7bb43e01-b471-491f-ae89-87ce07aaae92 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:42:40.447075 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-97b19eeb-0cf0-4738-b499-5b0b27f3f601 req-7bb43e01-b471-491f-ae89-87ce07aaae92 service nova] Creating event network-changed:a09c16e7-d672-4693-bc87-4f0df3b7688a for instance e397d496-340e-4ec6-9c99-42c52713f796 on nch1-master-1 Oct 01 21:42:40.453253 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-97b19eeb-0cf0-4738-b499-5b0b27f3f601 req-7bb43e01-b471-491f-ae89-87ce07aaae92 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033816 Oct 01 21:42:40.453253 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2153/6291] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:43:16.195764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:16.196552 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:16.199039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:16.199696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=32 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:16.204743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:16.205376 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:16.213574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.214736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.215181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:16.215897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.216366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.216814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:16.349784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:16.357555 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f01563b-37e5-436f-a5c6-59f1045d3156 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1670 microversion: 2.1 time: 0.162721 Oct 01 21:43:16.358124 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4139/6292] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:16 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:16.381799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:16.382546 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:16.384818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:16.385537 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:16.394434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.394964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.395416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:16.396129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.396597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.397041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:16.533366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:16.541376 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dc144d8a-1203-44e5-bc2b-fdfe55a7dfd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1670 microversion: 2.1 time: 0.164025 Oct 01 21:43:16.541963 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2154/6293] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:16 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:16.564173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:16.564758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:16.570730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.571245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.571714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:16.572432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.572915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.574030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:16.701465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:16.709427 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1769e5a7-1e16-457f-98ce-fe26532990ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1670 microversion: 2.1 time: 0.149239 Oct 01 21:43:16.710029 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4140/6294] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:16 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:16.731607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:16.733851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:16.744454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.744949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.745893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:16.746636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.747093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.747519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:16.776040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:16.781365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Old instance type m1.heat2, new instance type m1.heat {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:43:16.788005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:43:16.788429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:43:16.788913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:43:16.789321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:43:16.789736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:43:16.853126 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4a9a711e-a570-4a5f-ad9c-f6d34e35c62a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796/action" status: 202 len: 0 microversion: 2.1 time: 0.125386 Oct 01 21:43:16.853741 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2155/6295] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:43:16 2022] POST /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:43:16.862588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:16.863240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:16.869554 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.870723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.871194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:16.871931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:16.872415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:16.872870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:17.010092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:17.018111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b187ad02-6dc9-4142-a60d-0e481d37da3d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1679 microversion: 2.1 time: 0.159570 Oct 01 21:43:17.018735 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4141/6296] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:16 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:18.042165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:18.042810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:18.049892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:18.050386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:18.050855 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:18.051567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:18.052027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:18.052458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:18.187016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:18.198032 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c66bfe5c-7954-4ac3-9689-48d0ab3d4c78 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1679 microversion: 2.1 time: 0.160690 Oct 01 21:43:18.199229 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2156/6297] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:18 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:19.223281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:19.223918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:19.230867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:19.231377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:19.231838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:19.232555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:19.233033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:19.233482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:19.365618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:19.374054 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6121dec0-b233-4981-91d9-6b1c37c5b9e4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.154697 Oct 01 21:43:19.374654 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4142/6298] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:19 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:20.398394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:20.399067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:20.406808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:20.407313 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:20.407780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:20.408482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:20.408951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:20.409389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:20.555339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:20.563804 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b1262d60-e97b-4e06-9f00-afa899b0502f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.169291 Oct 01 21:43:20.564393 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2157/6299] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:20 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:21.588604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:21.589235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:21.596278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:21.596785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:21.597240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:21.597958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:21.598437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:21.598910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:21.728090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:21.736522 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-79ad9aa6-47a7-41b8-82fc-3c6752ad45f3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.151979 Oct 01 21:43:21.737095 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4143/6300] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:21 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:22.759848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:22.760476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:22.767369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:22.767893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:22.768347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:22.769050 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:22.769530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:22.769951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:22.898109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:22.906273 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-adb369ba-92ef-4897-89ca-43410eaa5659 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.150376 Oct 01 21:43:22.906891 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2158/6301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:22 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:23.930626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:23.931283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:23.938743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:23.939249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:23.939706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:23.940452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:23.940926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:23.941370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:24.074726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:24.082524 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6230ff96-4e79-47dc-8999-fa11361bb32a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.156216 Oct 01 21:43:24.083106 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4144/6302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:23 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:25.104797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:25.105497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:25.112484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:25.112983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:25.113436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:25.114147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:25.114654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:25.115092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:25.250778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:25.258699 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-004912c4-d2d8-4450-83dd-c734d48dee62 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.157890 Oct 01 21:43:25.259279 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2159/6303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:25 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:26.283318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:26.283950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:26.290900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:26.291405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:26.291863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:26.292573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:26.293651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:26.294128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:26.422525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:26.430561 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f4964c36-c82f-474e-8e36-48129d9fbe26 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.151288 Oct 01 21:43:26.431139 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4145/6304] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:26 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:43:27.453382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:27.454192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:27.461004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:27.461498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:27.461946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:27.462685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:27.463160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:27.463597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:27.596260 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:27.604235 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5ab0d7c9-70b9-479d-9504-4c0ab8a8afbf tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.155268 Oct 01 21:43:27.604819 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2160/6305] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:27 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:28.628328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:28.628958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:28.635932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:28.636441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:28.637531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:28.638246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:28.638764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:28.639211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:28.769542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:28.777403 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-91bd4350-1341-449c-983e-1f20ce5b7e55 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.153071 Oct 01 21:43:28.778061 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4146/6306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:28 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:29.801850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:29.802528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:29.809618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:29.810106 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:29.810576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:29.811273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:29.811735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:29.812164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:29.943649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:29.952456 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-77f20a52-7c87-4afa-a119-b07673f29ab8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.154602 Oct 01 21:43:29.958234 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2161/6307] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:29 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:30.982073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:30.982743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:30.989670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:30.990182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:30.990683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:30.991402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:30.991910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:30.992358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:31.125607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:31.133519 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-438ebdf4-2ae3-48c8-a655-2610aab90e94 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.156008 Oct 01 21:43:31.134100 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4147/6308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:30 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:32.157818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:32.158472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:32.164555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:32.165047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:32.165496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:32.166194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:32.166687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:32.167122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:32.295803 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:32.303543 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2f213fbd-8461-49d7-b655-5ddc825a796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.149652 Oct 01 21:43:32.304124 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2162/6309] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:32 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:43:33.327977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:33.328611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:33.334722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:33.335230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:33.335691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:33.336406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:33.336886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:33.337336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:33.464201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:33.472720 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5f6ff420-7f44-456e-bf4a-35a48c8960ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.149571 Oct 01 21:43:33.473287 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4148/6310] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:33 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:34.495200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:34.495885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:34.502839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:34.503329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:34.503772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:34.504466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:34.504958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:34.505394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:34.632664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:34.640569 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f063f21d-1787-43fa-88de-de13e17b3a24 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.149297 Oct 01 21:43:34.641162 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2163/6311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:34 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:35.664163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:35.664800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:35.672697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:35.673214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:35.673671 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:35.674401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:35.674911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:35.675357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:35.812851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:35.820800 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aba05f3e-230d-4b93-ab15-5184a499f5a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1684 microversion: 2.1 time: 0.160645 Oct 01 21:43:35.821621 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4149/6312] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:35 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:36.179910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c8de5ebf-94e4-4c27-9b81-f6fb2e504739 req-10211e7a-7d00-4836-9ac0-fb17b36037be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e397d496-340e-4ec6-9c99-42c52713f796", "name": "network-vif-unplugged", "status": "completed", "tag": "a09c16e7-d672-4693-bc87-4f0df3b7688a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:36.190571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8de5ebf-94e4-4c27-9b81-f6fb2e504739 req-10211e7a-7d00-4836-9ac0-fb17b36037be service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:36.191072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8de5ebf-94e4-4c27-9b81-f6fb2e504739 req-10211e7a-7d00-4836-9ac0-fb17b36037be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:36.191511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8de5ebf-94e4-4c27-9b81-f6fb2e504739 req-10211e7a-7d00-4836-9ac0-fb17b36037be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:36.203593 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c8de5ebf-94e4-4c27-9b81-f6fb2e504739 req-10211e7a-7d00-4836-9ac0-fb17b36037be service nova] Creating event network-vif-unplugged:a09c16e7-d672-4693-bc87-4f0df3b7688a for instance e397d496-340e-4ec6-9c99-42c52713f796 on nch2-master-1 Oct 01 21:43:36.209026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-c8de5ebf-94e4-4c27-9b81-f6fb2e504739 req-10211e7a-7d00-4836-9ac0-fb17b36037be service nova] Instance e397d496-340e-4ec6-9c99-42c52713f796 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:43:36.220670 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c8de5ebf-94e4-4c27-9b81-f6fb2e504739 req-10211e7a-7d00-4836-9ac0-fb17b36037be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044877 Oct 01 21:43:36.221293 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2164/6313] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:43:36.844498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:36.845469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:36.853373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:36.853988 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:36.854536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:36.855364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:36.855931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:36.856392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:36.988242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:36.997074 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c4e79caf-a5fc-4b34-8bd8-455479bff026 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1683 microversion: 2.1 time: 0.156808 Oct 01 21:43:36.997665 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4150/6314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:36 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:38.022326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:38.023057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:38.029366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:38.029864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:38.030301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:38.031030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:38.031489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:38.031917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:38.164141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:38.172660 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e34815bb-0aef-4d85-ae20-12a44f4ac8b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1681 microversion: 2.1 time: 0.155614 Oct 01 21:43:38.173240 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2165/6315] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:38 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:38.247871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9067b089-a46c-47a9-a27b-c3699d688016 req-f2771775-d2e8-4f68-9139-79bb905e2917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e397d496-340e-4ec6-9c99-42c52713f796", "tag": "a09c16e7-d672-4693-bc87-4f0df3b7688a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:38.258234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9067b089-a46c-47a9-a27b-c3699d688016 req-f2771775-d2e8-4f68-9139-79bb905e2917 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:38.258754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9067b089-a46c-47a9-a27b-c3699d688016 req-f2771775-d2e8-4f68-9139-79bb905e2917 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:38.259217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9067b089-a46c-47a9-a27b-c3699d688016 req-f2771775-d2e8-4f68-9139-79bb905e2917 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:38.270689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9067b089-a46c-47a9-a27b-c3699d688016 req-f2771775-d2e8-4f68-9139-79bb905e2917 service nova] Creating event network-changed:a09c16e7-d672-4693-bc87-4f0df3b7688a for instance e397d496-340e-4ec6-9c99-42c52713f796 on nch2-master-1 Oct 01 21:43:38.276062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-9067b089-a46c-47a9-a27b-c3699d688016 req-f2771775-d2e8-4f68-9139-79bb905e2917 service nova] Instance e397d496-340e-4ec6-9c99-42c52713f796 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:43:38.287034 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9067b089-a46c-47a9-a27b-c3699d688016 req-f2771775-d2e8-4f68-9139-79bb905e2917 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042838 Oct 01 21:43:38.287613 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4151/6316] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:43:39.203652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:39.204373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:39.211232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:39.211733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:39.212181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:39.212890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:39.213351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:39.213789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:39.351437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:39.359829 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c970291e-6e57-4272-9643-b42304f65727 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1678 microversion: 2.1 time: 0.160823 Oct 01 21:43:39.360423 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2166/6317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:39 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:39.385048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b80a80c-8955-4471-8cda-7272fce76889 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:39.385696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b80a80c-8955-4471-8cda-7272fce76889 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:39.391941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b80a80c-8955-4471-8cda-7272fce76889 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:39.392458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b80a80c-8955-4471-8cda-7272fce76889 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:39.392923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b80a80c-8955-4471-8cda-7272fce76889 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:39.393851 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b80a80c-8955-4471-8cda-7272fce76889 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:39.394289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b80a80c-8955-4471-8cda-7272fce76889 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:39.394789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b80a80c-8955-4471-8cda-7272fce76889 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:39.452831 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b80a80c-8955-4471-8cda-7272fce76889 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796/action" status: 204 len: 0 microversion: 2.1 time: 0.072546 Oct 01 21:43:39.453485 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4152/6318] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:43:39 2022] POST /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:43:39.461816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:39.462509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:39.471165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:39.471697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:39.472250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:39.473026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:39.473492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:39.473988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:39.607516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:39.615446 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-66528fe9-d245-4d0b-a517-8d6836f8110d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1678 microversion: 2.1 time: 0.157691 Oct 01 21:43:39.616031 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2167/6319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:39 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:40.640336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:40.641330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:40.648182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:40.648704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:40.649171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:40.649894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:40.650377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:40.650854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:40.788974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:40.797399 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7df67f5f-8490-41a8-a914-54e8f32ec058 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1670 microversion: 2.1 time: 0.161994 Oct 01 21:43:40.797979 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4153/6320] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:40 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:43:40.820472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:40.821421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:40.828405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:40.828903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:40.829354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:40.830061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:40.830551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:40.830991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:40.962515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:40.970826 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4653857c-8058-4b9b-85b0-b2dcc717e1b6 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1670 microversion: 2.1 time: 0.154191 Oct 01 21:43:40.971412 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2168/6321] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:40 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:40.992925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:40.993555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:40.999592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:41.000121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:41.000573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:41.001280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:41.001753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:41.002195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:41.133300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:41.135664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:41.143728 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0b6f589f-2187-4b9c-9b13-74f15b48f9fe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1670 microversion: 2.1 time: 0.154675 Oct 01 21:43:41.144311 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4154/6322] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:40 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:41.165671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:41.166184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:41.172259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:41.172753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:41.173204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:41.173909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:41.174377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:41.174842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:41.193795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:41.203094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:43:41.278739 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d41f70ba-9200-4d87-b995-0fa5b61af2ff tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 204 len: 0 microversion: 2.1 time: 0.116645 Oct 01 21:43:41.279504 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2169/6323] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:43:41 2022] DELETE /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:43:41.288319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:41.289094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:41.296264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:41.296775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:41.297238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:41.297964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:41.298443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:41.298948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:41.426247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:41.434867 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8fef648c-b83d-4902-8a82-9ae1b43e345e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1676 microversion: 2.1 time: 0.150592 Oct 01 21:43:41.435446 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4155/6324] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:41 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:42.037920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-834b0b2c-a5cc-48e8-a100-d82a291f7bed req-cab033c4-847f-43dc-a2e2-0e0cc7a1327b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e397d496-340e-4ec6-9c99-42c52713f796", "name": "network-vif-plugged", "status": "completed", "tag": "a09c16e7-d672-4693-bc87-4f0df3b7688a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:42.050146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-834b0b2c-a5cc-48e8-a100-d82a291f7bed req-cab033c4-847f-43dc-a2e2-0e0cc7a1327b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:42.050673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-834b0b2c-a5cc-48e8-a100-d82a291f7bed req-cab033c4-847f-43dc-a2e2-0e0cc7a1327b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:42.051120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-834b0b2c-a5cc-48e8-a100-d82a291f7bed req-cab033c4-847f-43dc-a2e2-0e0cc7a1327b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:42.062460 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-834b0b2c-a5cc-48e8-a100-d82a291f7bed req-cab033c4-847f-43dc-a2e2-0e0cc7a1327b service nova] Creating event network-vif-plugged:a09c16e7-d672-4693-bc87-4f0df3b7688a for instance e397d496-340e-4ec6-9c99-42c52713f796 on nch2-master-1 Oct 01 21:43:42.067748 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-834b0b2c-a5cc-48e8-a100-d82a291f7bed req-cab033c4-847f-43dc-a2e2-0e0cc7a1327b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033978 Oct 01 21:43:42.068398 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2170/6325] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:43:42.458922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:42.459597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:42.467114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:42.467616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:42.468071 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:42.468782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:42.469257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:42.469702 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:42.604740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:42.612730 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-165f919a-e44e-4096-8b92-13e920af6c93 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 200 len: 1676 microversion: 2.1 time: 0.157896 Oct 01 21:43:42.613312 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4156/6326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:42 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:43.409852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-9e2d4fdb-40b7-475e-a4c7-a127a41b5367 req-ddf37d6b-9384-44c5-92e0-6222ba999697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e397d496-340e-4ec6-9c99-42c52713f796", "name": "network-vif-deleted", "tag": "a09c16e7-d672-4693-bc87-4f0df3b7688a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:43.420325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9e2d4fdb-40b7-475e-a4c7-a127a41b5367 req-ddf37d6b-9384-44c5-92e0-6222ba999697 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:43.420833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9e2d4fdb-40b7-475e-a4c7-a127a41b5367 req-ddf37d6b-9384-44c5-92e0-6222ba999697 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:43.421262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9e2d4fdb-40b7-475e-a4c7-a127a41b5367 req-ddf37d6b-9384-44c5-92e0-6222ba999697 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:43.433420 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-9e2d4fdb-40b7-475e-a4c7-a127a41b5367 req-ddf37d6b-9384-44c5-92e0-6222ba999697 service nova] Creating event network-vif-deleted:a09c16e7-d672-4693-bc87-4f0df3b7688a for instance e397d496-340e-4ec6-9c99-42c52713f796 on nch2-master-1 Oct 01 21:43:43.438347 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-9e2d4fdb-40b7-475e-a4c7-a127a41b5367 req-ddf37d6b-9384-44c5-92e0-6222ba999697 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033630 Oct 01 21:43:43.439013 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2171/6327] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:43:43.637594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:43.638775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:43.646956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:43.647560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:43.648021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:43.648779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:43.649258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:43.649703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:43.664689 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 HTTP/1.1 Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e397d496-340e-4ec6-9c99-42c52713f796'} Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:43:43.666578 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-633d7096-4d67-485a-9274-fa5d8f79b69a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 404 len: 111 microversion: 2.1 time: 0.035955 Oct 01 21:43:43.672349 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4157/6328] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:43 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:43:43.681370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:43.682172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:43.688708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:43.689203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:43.689652 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:43.690360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:43.690856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:43.691291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:43.704906 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 HTTP/1.1 Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e397d496-340e-4ec6-9c99-42c52713f796'} Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:43:43.706605 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-75f43956-de5b-494c-ad34-7a25f883ff51 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 404 len: 111 microversion: 2.1 time: 0.031209 Oct 01 21:43:43.711531 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2172/6329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:43 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:43:43.834294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1964068342", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "d21fbd12-b67f-4878-847d-9b5f3a740b75"}], "security_groups": [{"name": "tempest-securitygroup--168964952"}], "key_name": "tempest-keypair-1928138378", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:43.940545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] validate_networks() for [('d21fbd12-b67f-4878-847d-9b5f3a740b75', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:43:44.320948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:43:44.321408 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:43:44.321910 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:43:44.322342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:43:44.322814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:43:44.332691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:44.333203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:44.333664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:44.334429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:44.334950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:44.335399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:44.352940 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for project ae55f903ff94436b8d907d865581cffd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:43:44.358566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for user 87e5b194ad2745b6af1f6ad76dd94881 and project ae55f903ff94436b8d907d865581cffd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:43:44.371984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:43:44.374425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:43:44.423965 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8d9bbf65-8c65-41fa-a512-7f696c65f496 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.593484 Oct 01 21:43:44.424633 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4158/6330] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:43:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:43:44.437130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-aa6c3041-f402-4ef5-9f12-9233ad572a81 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:44.437762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-aa6c3041-f402-4ef5-9f12-9233ad572a81 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:44.505644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-aa6c3041-f402-4ef5-9f12-9233ad572a81 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:44.517801 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-aa6c3041-f402-4ef5-9f12-9233ad572a81 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1239 microversion: 2.1 time: 0.085015 Oct 01 21:43:44.518770 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2173/6331] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:44 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:45.542444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:45.543110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:45.550174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:45.550719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:45.551190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:45.551914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:45.552389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:45.552841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:45.649889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:45.657933 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-577bab18-3e24-4a76-99e4-705574103ec9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1297 microversion: 2.1 time: 0.120339 Oct 01 21:43:45.658550 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4159/6332] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:45 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:46.681674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:46.682304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:46.685243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:46.690758 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:46.691295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:46.691748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:46.692471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:46.692947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:46.693394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:46.812051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0e5ebd32-af1c-41af-889a-0e8ebef53e84 req-a7f2acf8-49f4-4589-aab1-c075ef4f2d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9527b1f5-695e-4e73-acfe-be646ed69669", "tag": "ae076eee-7106-4ab4-87cb-421de8f09935"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:46.819547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:46.827026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0e5ebd32-af1c-41af-889a-0e8ebef53e84 req-a7f2acf8-49f4-4589-aab1-c075ef4f2d98 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:46.827569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0e5ebd32-af1c-41af-889a-0e8ebef53e84 req-a7f2acf8-49f4-4589-aab1-c075ef4f2d98 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:46.828025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0e5ebd32-af1c-41af-889a-0e8ebef53e84 req-a7f2acf8-49f4-4589-aab1-c075ef4f2d98 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:46.841233 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0e5ebd32-af1c-41af-889a-0e8ebef53e84 req-a7f2acf8-49f4-4589-aab1-c075ef4f2d98 service nova] Creating event network-changed:ae076eee-7106-4ab4-87cb-421de8f09935 for instance 9527b1f5-695e-4e73-acfe-be646ed69669 on nch1-master-1 Oct 01 21:43:46.848807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0e5ebd32-af1c-41af-889a-0e8ebef53e84 req-a7f2acf8-49f4-4589-aab1-c075ef4f2d98 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040380 Oct 01 21:43:46.850206 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4160/6333] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:43:46.850418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:46.859073 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0351a079-89cc-46dc-9ab0-56f760068a76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1364 microversion: 2.1 time: 0.181641 Oct 01 21:43:46.859646 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2174/6334] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:46 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:47.884330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:47.885046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:47.891354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:47.891854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:47.892311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:47.893022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:47.893494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:47.893936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:48.028713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:48.036629 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae4421a4-e336-494b-b95a-50eea255bf57 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1364 microversion: 2.1 time: 0.157468 Oct 01 21:43:48.037194 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4161/6335] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:47 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:49.061437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:49.062097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:49.069024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:49.069511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:49.069951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:49.070677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:49.071139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:49.071570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:49.197931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:49.205919 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-34732bd2-e774-4752-8e81-7f1e0b67aefb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1364 microversion: 2.1 time: 0.149136 Oct 01 21:43:49.206517 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2175/6336] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:49 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:50.231480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:50.232113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:50.239346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:50.239953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:50.240417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:50.241169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:50.241651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:50.242099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:50.372448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:50.380208 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ccaf341f-33fe-4ddf-8546-1fae118370ea tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1364 microversion: 2.1 time: 0.152998 Oct 01 21:43:50.380780 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4162/6337] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:50 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:51.404775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:51.405397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:51.412339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:51.412829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:51.413271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:51.413972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:51.414431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:51.414884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:51.547134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:51.555263 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-82dccb14-96ca-4b7a-bfd8-d607456d7c25 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1364 microversion: 2.1 time: 0.155104 Oct 01 21:43:51.555849 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2176/6338] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:51 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:43:51.987834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b3757bd4-9942-4dc8-bf4c-d7db9b45c71d req-6813bb84-54ee-4fe5-9238-24ab00975a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9527b1f5-695e-4e73-acfe-be646ed69669", "name": "network-vif-plugged", "status": "completed", "tag": "ae076eee-7106-4ab4-87cb-421de8f09935"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:51.999442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b3757bd4-9942-4dc8-bf4c-d7db9b45c71d req-6813bb84-54ee-4fe5-9238-24ab00975a77 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:52.000039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b3757bd4-9942-4dc8-bf4c-d7db9b45c71d req-6813bb84-54ee-4fe5-9238-24ab00975a77 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:52.000539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b3757bd4-9942-4dc8-bf4c-d7db9b45c71d req-6813bb84-54ee-4fe5-9238-24ab00975a77 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:52.011991 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b3757bd4-9942-4dc8-bf4c-d7db9b45c71d req-6813bb84-54ee-4fe5-9238-24ab00975a77 service nova] Creating event network-vif-plugged:ae076eee-7106-4ab4-87cb-421de8f09935 for instance 9527b1f5-695e-4e73-acfe-be646ed69669 on nch1-master-1 Oct 01 21:43:52.016938 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b3757bd4-9942-4dc8-bf4c-d7db9b45c71d req-6813bb84-54ee-4fe5-9238-24ab00975a77 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032938 Oct 01 21:43:52.017544 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4163/6339] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:43:52.578555 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:52.579189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:52.586043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:52.586571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:52.587024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:52.587728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:52.588196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:52.588632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:52.717253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:52.725189 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8680824c-2f43-4e0b-9850-092d2cd861a4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1364 microversion: 2.1 time: 0.150589 Oct 01 21:43:52.725773 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2177/6340] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:52 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:53.750713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:53.751429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:53.757697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:53.758200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:53.758691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:53.759405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:53.759880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:53.760324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:53.892129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:43:53.900077 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ccb6994-8826-4cba-86cc-664641241103 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1551 microversion: 2.1 time: 0.155350 Oct 01 21:43:53.900660 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4164/6341] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:43:53 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:43:53.923850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-113ad089-2fdf-479f-885a-edfbc6b6d053 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:43:53.924341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-113ad089-2fdf-479f-885a-edfbc6b6d053 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:43:53.931480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-113ad089-2fdf-479f-885a-edfbc6b6d053 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:53.931978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-113ad089-2fdf-479f-885a-edfbc6b6d053 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:53.932430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-113ad089-2fdf-479f-885a-edfbc6b6d053 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:53.933170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-113ad089-2fdf-479f-885a-edfbc6b6d053 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:53.933636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-113ad089-2fdf-479f-885a-edfbc6b6d053 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:53.934073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-113ad089-2fdf-479f-885a-edfbc6b6d053 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:54.013797 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-113ad089-2fdf-479f-885a-edfbc6b6d053 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093735 Oct 01 21:43:54.014399 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2178/6342] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:43:53 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:43:54.941579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b934e87b-0b7c-4e5f-9616-975875230d45 req-b55e012e-35cb-4183-b2e8-4d79b68b5c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9527b1f5-695e-4e73-acfe-be646ed69669", "tag": "ae076eee-7106-4ab4-87cb-421de8f09935"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:43:54.946701 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:54.947592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:43:54.955758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b934e87b-0b7c-4e5f-9616-975875230d45 req-b55e012e-35cb-4183-b2e8-4d79b68b5c9e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:43:54.956278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b934e87b-0b7c-4e5f-9616-975875230d45 req-b55e012e-35cb-4183-b2e8-4d79b68b5c9e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:43:54.956744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b934e87b-0b7c-4e5f-9616-975875230d45 req-b55e012e-35cb-4183-b2e8-4d79b68b5c9e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:43:54.968630 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b934e87b-0b7c-4e5f-9616-975875230d45 req-b55e012e-35cb-4183-b2e8-4d79b68b5c9e service nova] Creating event network-changed:ae076eee-7106-4ab4-87cb-421de8f09935 for instance 9527b1f5-695e-4e73-acfe-be646ed69669 on nch1-master-1 Oct 01 21:43:54.974119 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b934e87b-0b7c-4e5f-9616-975875230d45 req-b55e012e-35cb-4183-b2e8-4d79b68b5c9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036327 Oct 01 21:43:54.974875 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4165/6343] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:44:29.896449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:44:29.898308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=9 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:44:29.898992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:44:29.903496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-577cc235-100f-4bba-87b8-115bf7ccf160 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:44:29.911188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-577cc235-100f-4bba-87b8-115bf7ccf160 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:29.911674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-577cc235-100f-4bba-87b8-115bf7ccf160 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:29.912115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-577cc235-100f-4bba-87b8-115bf7ccf160 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:29.935656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-577cc235-100f-4bba-87b8-115bf7ccf160 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Going to try to stop instance {{(pid=140437) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 21:44:29.976723 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-577cc235-100f-4bba-87b8-115bf7ccf160 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/action" status: 202 len: 0 microversion: 2.1 time: 0.080710 Oct 01 21:44:29.981715 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2179/6344] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:44:29 2022] POST /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:44:29.986707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:29.987433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:29.990623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=11 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:44:29.991397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=47 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:44:29.997585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:29.998095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:29.998622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:29.999310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:29.999782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:30.000227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:30.130331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:30.138298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07a4551d-90d4-487f-91fd-9e8989661f74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.155812 Oct 01 21:44:30.138910 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4166/6345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:29 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:31.165568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:31.166209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:31.173024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:31.173523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:31.173975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:31.174725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:31.175192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:31.175630 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:31.307626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:31.316163 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1698e312-d7f3-4d9c-8420-a2551cd8c5e3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.156048 Oct 01 21:44:31.316764 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2180/6346] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:31 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:32.339690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:32.340326 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:32.346666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:32.347168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:32.347621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:32.348322 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:32.348793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:32.349232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:32.481470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:32.489240 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5293f41c-e6d8-4dd7-9ff6-087b265e8f6a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.153565 Oct 01 21:44:32.489793 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4167/6347] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:32 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:33.514037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:33.514722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:33.521617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:33.522112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:33.522591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:33.523306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:33.523795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:33.524229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:33.652924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:33.660826 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a4b24b15-0a06-4f5b-aaf2-4284f2a9c2c8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.151243 Oct 01 21:44:33.661406 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2181/6348] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:33 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:34.684951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:34.685629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:34.695488 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:34.696035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:34.696503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:34.697230 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:34.697715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:34.698168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:34.910460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:34.918330 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-db35ac9c-f7e0-4e35-a10a-2d870a6d0941 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.237396 Oct 01 21:44:34.918934 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4168/6349] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:34 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:35.942121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:35.942702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:35.949618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:35.950107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:35.950576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:35.951280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:35.951745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:35.952174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:36.085203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:36.093583 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-230755e8-10e8-474a-8658-c2aa8c611b1a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.155523 Oct 01 21:44:36.094169 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2182/6350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:35 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:37.117592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:37.118257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:37.125733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:37.126288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:37.126727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:37.127563 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:37.128040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:37.128486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:37.262272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:37.270130 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3a5bd85d-1eda-47a9-8485-f3972f9e5cb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.156496 Oct 01 21:44:37.270753 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4169/6351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:37 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:38.293882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:38.294521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:38.301703 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:38.302139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:38.302610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:38.303319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:38.303783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:38.304218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:38.434380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:38.442238 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8e575f59-9a0f-4b46-9dec-333c85654082 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.152939 Oct 01 21:44:38.442886 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2183/6352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:38 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:39.466838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:39.467472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:39.474535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:39.475048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:39.475509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:39.476227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:39.476707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:39.477191 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:39.606182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:39.614362 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e95009ed-894e-45c2-af13-712c852b6bb3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.151524 Oct 01 21:44:39.614962 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4170/6353] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:39 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:40.638793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:40.639415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:40.646454 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:40.646984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:40.647431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:40.648169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:40.648636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:40.649071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:40.782416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:40.790363 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e107f46f-49df-42ff-9de0-d258b06c0cbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.156415 Oct 01 21:44:40.790974 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2184/6354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:40 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:41.814761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:41.815396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:41.822351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:41.822882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:41.823339 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:41.824047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:41.824522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:41.825529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:41.952909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:41.960683 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5141ed99-a92e-46d9-910d-dc61326e53f0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.149913 Oct 01 21:44:41.961334 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4171/6355] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:41 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:42.984243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:42.984904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:42.991859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:42.992356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:42.992802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:42.993510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:42.993975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:42.994414 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:43.122608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:43.130644 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0c5dec1a-d43f-43ca-89b4-d3ac065aab65 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.150319 Oct 01 21:44:43.131209 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2185/6356] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:42 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:44.154604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:44.155242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:44.162129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:44.162706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:44.163172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:44.163889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:44.164378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:44.164833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:44.298590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:44.306805 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-203b59dc-2e75-45dd-97ae-4e59941ee187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.156641 Oct 01 21:44:44.307388 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4172/6357] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:44 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:45.329794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:45.330453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:45.337809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:45.338311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:45.338798 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:45.339525 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:45.339995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:45.340429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:45.472740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:45.480632 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c3cdbd73-19ba-4ee6-84e6-606f71d76527 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1657 microversion: 2.1 time: 0.154917 Oct 01 21:44:45.481715 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2186/6358] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:45 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:45.504289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:44:45.506662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:45.513572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:45.514436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:45.514943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:45.515669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:45.516150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:45.516604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:45.607597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:45.613660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Old instance type m1.heat2, new instance type m1.heat {{(pid=140438) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:44:45.620383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:44:45.620827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:44:45.621333 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:44:45.621795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:44:45.622229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:44:45.731879 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-570ea6bf-4a12-4e0d-a035-0cf117c363e7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/action" status: 202 len: 0 microversion: 2.1 time: 0.230862 Oct 01 21:44:45.732519 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4173/6359] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:44:45 2022] POST /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:44:45.741243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:45.741860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:45.747933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:45.748511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:45.748965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:45.749673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:45.750148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:45.750610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:45.904469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:45.912479 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-066809a0-419b-4cc6-9814-f3ce20ea3204 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.175696 Oct 01 21:44:45.913068 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2187/6360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:45 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:46.937065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:46.937705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:46.945518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:46.946029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:46.946510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:46.947233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:46.947713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:46.948162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:47.080704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:47.092664 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2261cf60-7316-4857-9290-d1862ecd7a0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1680 microversion: 2.1 time: 0.159817 Oct 01 21:44:47.093270 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4174/6361] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:46 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:48.117337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:48.117957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:48.125299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:48.125788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:48.126227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:48.126953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:48.127415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:48.127847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:48.260698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:48.268519 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-32bb99ac-40a0-4a36-b97a-0a5914990cc3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1685 microversion: 2.1 time: 0.155174 Oct 01 21:44:48.269095 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2188/6362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:48 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:44:49.291948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:49.292662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:49.299419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:49.299927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:49.300385 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:49.301105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:49.301579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:49.302020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:49.732606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:49.740422 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0f7ea66-fc5c-43d4-871d-65ef8cac3a4b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1685 microversion: 2.1 time: 0.452358 Oct 01 21:44:49.741011 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4175/6363] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:49 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1685 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:49.914971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7937efd0-8731-4abf-a996-890c4f4cc8fb req-dcf9ff39-6d2d-4554-ac25-27d87cf3b857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9527b1f5-695e-4e73-acfe-be646ed69669", "name": "network-vif-unplugged", "status": "completed", "tag": "ae076eee-7106-4ab4-87cb-421de8f09935"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:44:49.926052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7937efd0-8731-4abf-a996-890c4f4cc8fb req-dcf9ff39-6d2d-4554-ac25-27d87cf3b857 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:49.926535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7937efd0-8731-4abf-a996-890c4f4cc8fb req-dcf9ff39-6d2d-4554-ac25-27d87cf3b857 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:49.926989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7937efd0-8731-4abf-a996-890c4f4cc8fb req-dcf9ff39-6d2d-4554-ac25-27d87cf3b857 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:49.939949 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7937efd0-8731-4abf-a996-890c4f4cc8fb req-dcf9ff39-6d2d-4554-ac25-27d87cf3b857 service nova] Creating event network-vif-unplugged:ae076eee-7106-4ab4-87cb-421de8f09935 for instance 9527b1f5-695e-4e73-acfe-be646ed69669 on nch2-master-1 Oct 01 21:44:49.945422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-7937efd0-8731-4abf-a996-890c4f4cc8fb req-dcf9ff39-6d2d-4554-ac25-27d87cf3b857 service nova] Instance 9527b1f5-695e-4e73-acfe-be646ed69669 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:44:49.956226 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7937efd0-8731-4abf-a996-890c4f4cc8fb req-dcf9ff39-6d2d-4554-ac25-27d87cf3b857 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045278 Oct 01 21:44:49.956849 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2189/6364] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:44:50.764914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:50.765686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:50.772391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:50.772904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:50.773367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:50.774090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:50.774729 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:50.775185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:50.907855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:50.916025 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6d8b8f0e-22c6-430c-97c8-71a1ac1736b9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1684 microversion: 2.1 time: 0.155619 Oct 01 21:44:50.916621 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4176/6365] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:50 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:51.942282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:51.943059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:51.949320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:51.950333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:51.950812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:51.951538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:51.951994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:51.952436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:52.005597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-15caa0d8-f75b-47ca-a997-fbbecee36476 req-f1ac909b-37ac-45e9-ad91-8fa8fffa4241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9527b1f5-695e-4e73-acfe-be646ed69669", "tag": "ae076eee-7106-4ab4-87cb-421de8f09935"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:44:52.016437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-15caa0d8-f75b-47ca-a997-fbbecee36476 req-f1ac909b-37ac-45e9-ad91-8fa8fffa4241 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:52.016938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-15caa0d8-f75b-47ca-a997-fbbecee36476 req-f1ac909b-37ac-45e9-ad91-8fa8fffa4241 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:52.017396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-15caa0d8-f75b-47ca-a997-fbbecee36476 req-f1ac909b-37ac-45e9-ad91-8fa8fffa4241 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:52.030326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-15caa0d8-f75b-47ca-a997-fbbecee36476 req-f1ac909b-37ac-45e9-ad91-8fa8fffa4241 service nova] Creating event network-changed:ae076eee-7106-4ab4-87cb-421de8f09935 for instance 9527b1f5-695e-4e73-acfe-be646ed69669 on nch2-master-1 Oct 01 21:44:52.036269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-15caa0d8-f75b-47ca-a997-fbbecee36476 req-f1ac909b-37ac-45e9-ad91-8fa8fffa4241 service nova] Instance 9527b1f5-695e-4e73-acfe-be646ed69669 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:44:52.051111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-15caa0d8-f75b-47ca-a997-fbbecee36476 req-f1ac909b-37ac-45e9-ad91-8fa8fffa4241 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049038 Oct 01 21:44:52.052033 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4177/6366] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:44:52.143907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:52.154217 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c773a636-eafb-4c9a-b42c-21116a27842a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1682 microversion: 2.1 time: 0.217172 Oct 01 21:44:52.155467 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2190/6367] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:51 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:53.180753 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:53.181433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:53.187763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:53.188273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:53.188738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:53.189457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:53.189939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:53.190386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:53.328590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:53.336443 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6dced5f8-f6ee-418e-9b87-1137c3535302 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1678 microversion: 2.1 time: 0.161893 Oct 01 21:44:53.337024 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4178/6368] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:53 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:53.359908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-61d5798e-8207-4b9c-b099-cf9bd5ff6a72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:44:53.360456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-61d5798e-8207-4b9c-b099-cf9bd5ff6a72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:53.367334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61d5798e-8207-4b9c-b099-cf9bd5ff6a72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:53.367863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61d5798e-8207-4b9c-b099-cf9bd5ff6a72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:53.368311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61d5798e-8207-4b9c-b099-cf9bd5ff6a72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:53.369018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61d5798e-8207-4b9c-b099-cf9bd5ff6a72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:53.369485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61d5798e-8207-4b9c-b099-cf9bd5ff6a72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:53.369920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-61d5798e-8207-4b9c-b099-cf9bd5ff6a72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:53.426754 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-61d5798e-8207-4b9c-b099-cf9bd5ff6a72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/action" status: 204 len: 0 microversion: 2.1 time: 0.071063 Oct 01 21:44:53.427414 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2191/6369] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:44:53 2022] POST /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:44:53.435896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:53.436471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:53.442542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:53.443054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:53.443718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:53.444445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:53.444944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:53.445362 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:53.649450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:53.658259 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84da32da-668e-435e-8c41-8ad5f3d2d896 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1678 microversion: 2.1 time: 0.226355 Oct 01 21:44:53.658861 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4179/6370] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:53 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:54.683378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:54.684123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:54.690850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:54.691402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:54.691904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:54.692724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:54.693223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:54.693691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:54.837545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:54.846517 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0d06a59e-ad6e-4d6a-855d-606a0b201c38 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1657 microversion: 2.1 time: 0.168640 Oct 01 21:44:54.847125 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2192/6371] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:54 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1657 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:54.870639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:54.871271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:54.878330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:54.878954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:54.879492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:54.880301 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:54.881036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:54.881722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:55.013866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:55.021733 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3837eb15-7c93-4151-9ae6-d8d72ba2501d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1657 microversion: 2.1 time: 0.155470 Oct 01 21:44:55.022311 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4180/6372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:54 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:55.045786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3ab3aae5-c845-48c7-940d-fa0f6c30ef4e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:44:55.051543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ab3aae5-c845-48c7-940d-fa0f6c30ef4e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:55.052038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ab3aae5-c845-48c7-940d-fa0f6c30ef4e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:55.052487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3ab3aae5-c845-48c7-940d-fa0f6c30ef4e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:55.078623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3ab3aae5-c845-48c7-940d-fa0f6c30ef4e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Going to try to start instance {{(pid=140437) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 01 21:44:55.083343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:44:55.121388 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3ab3aae5-c845-48c7-940d-fa0f6c30ef4e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/action" status: 202 len: 0 microversion: 2.1 time: 0.079788 Oct 01 21:44:55.121940 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2193/6373] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:44:55 2022] POST /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:44:55.131389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:55.132324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:55.140700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:55.141216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:55.141681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:55.142761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:55.143244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:55.143699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:55.164865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:44:55.292601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:55.300572 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-17424e1e-ce93-4da7-b19e-8494514fe731 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1666 microversion: 2.1 time: 0.173757 Oct 01 21:44:55.301156 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4181/6374] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:55 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1666 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:56.324482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:56.325439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:56.329075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-43dc37d4-6520-41f7-ad4b-4fa3be9dc869 req-4df95594-d866-403c-83c7-98621b715440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9527b1f5-695e-4e73-acfe-be646ed69669", "name": "network-vif-plugged", "status": "completed", "tag": "ae076eee-7106-4ab4-87cb-421de8f09935"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:44:56.333536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:56.334037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:56.334511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:56.335366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:56.336091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:56.336532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:56.339310 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:44:56.339479 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 01 21:44:56.350871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-43dc37d4-6520-41f7-ad4b-4fa3be9dc869 req-4df95594-d866-403c-83c7-98621b715440 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:56.351389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-43dc37d4-6520-41f7-ad4b-4fa3be9dc869 req-4df95594-d866-403c-83c7-98621b715440 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:56.351847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-43dc37d4-6520-41f7-ad4b-4fa3be9dc869 req-4df95594-d866-403c-83c7-98621b715440 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:56.364859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-43dc37d4-6520-41f7-ad4b-4fa3be9dc869 req-4df95594-d866-403c-83c7-98621b715440 service nova] Creating event network-vif-plugged:ae076eee-7106-4ab4-87cb-421de8f09935 for instance 9527b1f5-695e-4e73-acfe-be646ed69669 on nch2-master-1 Oct 01 21:44:56.371500 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-43dc37d4-6520-41f7-ad4b-4fa3be9dc869 req-4df95594-d866-403c-83c7-98621b715440 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045698 Oct 01 21:44:56.372322 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4182/6375] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:44:56.390693 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:44:56.390910 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 (ip 10.222.0.17) !!! Oct 01 21:44:56.479447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:56.487460 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e935f455-422a-45fb-a0d7-66c4321d85b1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1670 microversion: 2.1 time: 0.167349 Oct 01 21:44:56.488044 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2194/6376] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:56 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:56.510583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:56.511199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:56.517966 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:56.518475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:56.518960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:56.519723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:56.520149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:56.520606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:56.545839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:44:56.620156 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9b46084-d113-445d-96f9-55a58cbc8fe3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 204 len: 0 microversion: 2.1 time: 0.113605 Oct 01 21:44:56.620728 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4183/6377] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:44:56 2022] DELETE /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:44:56.628877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:56.629495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:56.635576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:56.636065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:56.636508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:56.637699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:56.638158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:56.638621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:56.769187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:56.776965 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-72d0ad7e-8483-4a82-b6ee-3fac781ae094 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1676 microversion: 2.1 time: 0.151937 Oct 01 21:44:56.778157 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2195/6378] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:56 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:57.801711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:57.802341 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:57.809497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:57.809999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:57.810528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:57.811243 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:57.811721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:57.812163 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:57.944401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:57.952661 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a24d3af3-6c49-47ad-84df-fe63d2f2e7f4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 200 len: 1676 microversion: 2.1 time: 0.155301 Oct 01 21:44:57.953243 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4184/6379] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:57 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:44:58.724563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-ee747765-52b1-4780-be44-fbed3f2726ac req-740dedb2-0f61-4705-b7a3-7fe55165e47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9527b1f5-695e-4e73-acfe-be646ed69669", "name": "network-vif-deleted", "tag": "ae076eee-7106-4ab4-87cb-421de8f09935"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:44:58.739029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ee747765-52b1-4780-be44-fbed3f2726ac req-740dedb2-0f61-4705-b7a3-7fe55165e47b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:58.739610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ee747765-52b1-4780-be44-fbed3f2726ac req-740dedb2-0f61-4705-b7a3-7fe55165e47b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:58.740129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-ee747765-52b1-4780-be44-fbed3f2726ac req-740dedb2-0f61-4705-b7a3-7fe55165e47b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:58.754125 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-ee747765-52b1-4780-be44-fbed3f2726ac req-740dedb2-0f61-4705-b7a3-7fe55165e47b service nova] Creating event network-vif-deleted:ae076eee-7106-4ab4-87cb-421de8f09935 for instance 9527b1f5-695e-4e73-acfe-be646ed69669 on nch2-master-1 Oct 01 21:44:58.759870 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-ee747765-52b1-4780-be44-fbed3f2726ac req-740dedb2-0f61-4705-b7a3-7fe55165e47b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039640 Oct 01 21:44:58.760489 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2196/6380] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:44:58.976726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:58.977419 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:58.984736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:58.985247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:58.985712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:58.986442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:58.986930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:58.987378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:59.001647 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 HTTP/1.1 Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '9527b1f5-695e-4e73-acfe-be646ed69669'} Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:44:59.003473 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8c8199af-c9ec-4653-84d3-8c9757c007cb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 404 len: 111 microversion: 2.1 time: 0.032145 Oct 01 21:44:59.008165 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4185/6381] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:58 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:44:59.018921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:59.019627 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:59.026028 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:59.026470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:59.026945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:59.028285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:59.028644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:59.029345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:59.043818 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 HTTP/1.1 Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '9527b1f5-695e-4e73-acfe-be646ed69669'} Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:44:59.045510 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ff5615fe-21aa-4d41-9f2c-0e1a8bdf867f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 404 len: 111 microversion: 2.1 time: 0.032406 Oct 01 21:44:59.049559 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2197/6382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:59 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:44:59.095624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-587231942", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "d21fbd12-b67f-4878-847d-9b5f3a740b75"}], "security_groups": [{"name": "tempest-securitygroup--168964952"}], "key_name": "tempest-keypair-1928138378", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:44:59.201239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] validate_networks() for [('d21fbd12-b67f-4878-847d-9b5f3a740b75', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:44:59.586142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:44:59.586746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:44:59.587323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:44:59.587918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:44:59.588539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:44:59.597981 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:59.598503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:59.598971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:59.599736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:44:59.600212 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:44:59.600659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:44:59.618255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for project ae55f903ff94436b8d907d865581cffd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:44:59.624351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for user 87e5b194ad2745b6af1f6ad76dd94881 and project ae55f903ff94436b8d907d865581cffd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:44:59.637800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:44:59.640205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:44:59.688107 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6ab8d34f-2868-4cc4-be5c-e0642a91750f tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.596237 Oct 01 21:44:59.689016 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4186/6383] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:44:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:44:59.700279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d2dc3879-5c3d-4c45-8a15-d24b2ea9f715 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:44:59.701330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d2dc3879-5c3d-4c45-8a15-d24b2ea9f715 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:44:59.762274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d2dc3879-5c3d-4c45-8a15-d24b2ea9f715 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:44:59.770528 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d2dc3879-5c3d-4c45-8a15-d24b2ea9f715 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1238 microversion: 2.1 time: 0.074207 Oct 01 21:44:59.771263 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2198/6384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:44:59 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:45:00.794350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:00.795017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:00.797066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:45:00.803448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:00.803958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:00.804677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:00.805394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:00.805867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:00.806313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:00.884045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:00.893363 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7538643b-d8e7-4750-a08c-fbb86a12a187 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1296 microversion: 2.1 time: 0.103900 Oct 01 21:45:00.893944 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4187/6385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:00 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:01.917089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:01.917824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:01.920138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=43 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:45:01.925373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:01.925870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:01.926316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:01.927057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:01.927513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:01.927948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:02.061259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-fb47d32c-1520-4a91-9eb8-10a27a1987c6 req-0d0d9f1e-deb6-4da7-a9ad-bb6f9437154b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d01772-9636-4eac-ae93-7d15d92858e3", "tag": "caecc4d3-9ae3-48f0-8a54-50c35eba9616"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:45:02.072615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fb47d32c-1520-4a91-9eb8-10a27a1987c6 req-0d0d9f1e-deb6-4da7-a9ad-bb6f9437154b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:02.073134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fb47d32c-1520-4a91-9eb8-10a27a1987c6 req-0d0d9f1e-deb6-4da7-a9ad-bb6f9437154b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:02.073654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fb47d32c-1520-4a91-9eb8-10a27a1987c6 req-0d0d9f1e-deb6-4da7-a9ad-bb6f9437154b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:02.086657 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-fb47d32c-1520-4a91-9eb8-10a27a1987c6 req-0d0d9f1e-deb6-4da7-a9ad-bb6f9437154b service nova] Creating event network-changed:caecc4d3-9ae3-48f0-8a54-50c35eba9616 for instance e7d01772-9636-4eac-ae93-7d15d92858e3 on nch1-master-1 Oct 01 21:45:02.092160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:02.094295 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-fb47d32c-1520-4a91-9eb8-10a27a1987c6 req-0d0d9f1e-deb6-4da7-a9ad-bb6f9437154b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040532 Oct 01 21:45:02.095448 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4188/6386] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:45:02.100620 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-56870a57-2d74-4480-bedf-01ff3700e40e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1363 microversion: 2.1 time: 0.187488 Oct 01 21:45:02.101136 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2199/6387] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:01 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:03.125619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:03.126335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:03.132620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:03.133124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:03.133580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:03.134287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:03.134781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:03.135225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:03.264919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:03.273527 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5cfcbb3d-74d7-4c93-bf0b-ba0ea675bda0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1363 microversion: 2.1 time: 0.152549 Oct 01 21:45:03.274117 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4189/6388] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:03 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:04.298561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:04.299142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:04.306723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:04.307224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:04.307672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:04.308507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:04.308862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:04.309298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:04.443992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:04.451985 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7958d7ca-84fc-4eb7-af15-c9219d5eadbc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1363 microversion: 2.1 time: 0.157521 Oct 01 21:45:04.452709 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2200/6389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:04 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:05.476723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:05.477396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:05.484507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:05.485019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:05.485480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:05.486207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:05.486714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:05.487165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:05.624582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:05.632280 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7f7609bb-e604-45ec-89f2-2fe69ab739d0 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1363 microversion: 2.1 time: 0.159541 Oct 01 21:45:05.632849 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4190/6390] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:05 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:06.443051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-1106c3d8-4ce9-4407-9434-90255454a058 req-0d72c1a2-ba28-45bc-8108-3cfd511083d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d01772-9636-4eac-ae93-7d15d92858e3", "name": "network-vif-plugged", "status": "completed", "tag": "caecc4d3-9ae3-48f0-8a54-50c35eba9616"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:45:06.453485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1106c3d8-4ce9-4407-9434-90255454a058 req-0d72c1a2-ba28-45bc-8108-3cfd511083d1 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:06.453971 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1106c3d8-4ce9-4407-9434-90255454a058 req-0d72c1a2-ba28-45bc-8108-3cfd511083d1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:06.454407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1106c3d8-4ce9-4407-9434-90255454a058 req-0d72c1a2-ba28-45bc-8108-3cfd511083d1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:06.465973 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-1106c3d8-4ce9-4407-9434-90255454a058 req-0d72c1a2-ba28-45bc-8108-3cfd511083d1 service nova] Creating event network-vif-plugged:caecc4d3-9ae3-48f0-8a54-50c35eba9616 for instance e7d01772-9636-4eac-ae93-7d15d92858e3 on nch1-master-1 Oct 01 21:45:06.471096 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-1106c3d8-4ce9-4407-9434-90255454a058 req-0d72c1a2-ba28-45bc-8108-3cfd511083d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031716 Oct 01 21:45:06.471704 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2201/6391] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:45:06.657132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:06.657766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:06.664632 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:06.665134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:06.665623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:06.666335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:06.666832 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:06.667276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:06.797153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:06.805214 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-920c6caf-701b-4a94-baa3-58ce38746fce tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1363 microversion: 2.1 time: 0.152143 Oct 01 21:45:06.805784 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4191/6392] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:06 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:07.830816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:07.831523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:07.837696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:07.838183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:07.838661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:07.839359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:07.840466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:07.840903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:08.274179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:08.282095 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-64ef6195-0faa-4902-8e02-0ed5dc269a5c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1549 microversion: 2.1 time: 0.456432 Oct 01 21:45:08.282708 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2202/6393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:07 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1549 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:08.305021 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-be00ce7e-7a89-457a-8db5-a147e5973cc5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:08.305495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-be00ce7e-7a89-457a-8db5-a147e5973cc5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:08.313360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be00ce7e-7a89-457a-8db5-a147e5973cc5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:08.313937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be00ce7e-7a89-457a-8db5-a147e5973cc5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:08.314392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be00ce7e-7a89-457a-8db5-a147e5973cc5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:08.315311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be00ce7e-7a89-457a-8db5-a147e5973cc5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:08.315824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be00ce7e-7a89-457a-8db5-a147e5973cc5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:08.316305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-be00ce7e-7a89-457a-8db5-a147e5973cc5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:08.397020 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-be00ce7e-7a89-457a-8db5-a147e5973cc5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096144 Oct 01 21:45:08.397749 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4192/6394] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:45:08 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:45:09.606646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-3b3b2902-e683-4b97-8b7f-318cc55a94ed req-f8d809b0-f429-4d1f-8254-3c6f44e826ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d01772-9636-4eac-ae93-7d15d92858e3", "tag": "caecc4d3-9ae3-48f0-8a54-50c35eba9616"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:45:09.616989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3b3b2902-e683-4b97-8b7f-318cc55a94ed req-f8d809b0-f429-4d1f-8254-3c6f44e826ef service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:09.617481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3b3b2902-e683-4b97-8b7f-318cc55a94ed req-f8d809b0-f429-4d1f-8254-3c6f44e826ef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:09.617920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3b3b2902-e683-4b97-8b7f-318cc55a94ed req-f8d809b0-f429-4d1f-8254-3c6f44e826ef service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:09.629997 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-3b3b2902-e683-4b97-8b7f-318cc55a94ed req-f8d809b0-f429-4d1f-8254-3c6f44e826ef service nova] Creating event network-changed:caecc4d3-9ae3-48f0-8a54-50c35eba9616 for instance e7d01772-9636-4eac-ae93-7d15d92858e3 on nch1-master-1 Oct 01 21:45:09.635125 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-3b3b2902-e683-4b97-8b7f-318cc55a94ed req-f8d809b0-f429-4d1f-8254-3c6f44e826ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032222 Oct 01 21:45:09.635993 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2203/6395] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:45:44.491881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:45:44.492693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:45:44.493478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=11 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:45:44.494207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:45:44.498443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:45:44.500862 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:44.509292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:44.509804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:44.510262 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:44.511013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:44.511495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:44.511946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:44.541396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:44.546802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Old instance type m1.heat2, new instance type m1.heat {{(pid=140438) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:45:44.553352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:45:44.553794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:45:44.554587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:45:44.555025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:45:44.555460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:45:44.617339 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-036c5221-4596-433b-a150-f099f38eb641 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3/action" status: 202 len: 0 microversion: 2.1 time: 0.127424 Oct 01 21:45:44.617988 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4193/6396] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:45:44 2022] POST /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:45:44.626826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:44.627615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:44.629909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:45:44.630890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=9 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:45:44.631823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:45:44.640043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:44.640662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:44.641095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:44.641928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:44.642468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:44.642916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:44.848979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:44.857139 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0e77e5ae-f353-4cee-911a-bdb61097cb75 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1677 microversion: 2.1 time: 0.234576 Oct 01 21:45:44.858049 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2204/6397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:44 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:45.882244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:45.882952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:45.890529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:45.891047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:45.891513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:45.892236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:45.892819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:45.893277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:46.084207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:46.092915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-717e1d1d-7ffa-4891-98ee-8ddbd2a26379 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1677 microversion: 2.1 time: 0.215518 Oct 01 21:45:46.093509 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4194/6398] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:45 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:47.118078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:47.118770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:47.125821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:47.126318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:47.126829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:47.127545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:47.128013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:47.128455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:47.255664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:47.263589 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a6099974-9f66-4978-82ec-4cfe8fa4c1ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.149487 Oct 01 21:45:47.264171 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2205/6399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:47 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:48.287645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:48.288282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:48.295833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:48.296283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:48.296749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:48.297468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:48.297949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:48.298423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:48.426788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:48.434862 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7395b3c8-5192-4bea-9ee2-d5b9b4944787 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.151140 Oct 01 21:45:48.436333 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4195/6400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:48 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:45:49.459206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:49.459864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:49.466770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:49.467266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:49.467714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:49.468421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:49.468886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:49.469328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:49.606282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:49.614623 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-97b6e222-c970-4b89-a1fc-8d53b771ea46 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.159440 Oct 01 21:45:49.615207 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2206/6401] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:49 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:50.639991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:50.640623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:50.647643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:50.648148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:50.648596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:50.649316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:50.649789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:50.650234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:50.783831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:50.791665 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b7bb22b7-79b1-4217-8467-0faebe71db79 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.156157 Oct 01 21:45:50.792236 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4196/6402] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:50 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:51.815283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:51.815903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:51.822799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:51.823286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:51.823729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:51.824424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:51.824882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:51.825312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:51.956023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:51.963849 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7adf8c2b-883e-4e24-b1dd-46aadaff6feb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.152518 Oct 01 21:45:51.964447 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2207/6403] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:51 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:52.987735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:52.988372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:52.995293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:52.995796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:52.996253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:52.996969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:52.997465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:52.997894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:53.130423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:53.138282 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7d648810-dea6-4a08-af12-ace5e16b0985 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.154524 Oct 01 21:45:53.138913 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4197/6404] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:52 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:54.161419 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:54.162073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:54.169617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:54.170109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:54.170585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:54.171283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:54.171742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:54.172166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:54.299101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:54.307141 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1a3bf32b-70c8-4fb4-a8d2-0c0bd3614e76 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.149736 Oct 01 21:45:54.307721 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2208/6405] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:54 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:55.331963 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:55.332534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:55.339542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:55.340047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:55.340508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:55.341256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:55.341733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:55.342179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:55.471227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:55.479156 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eca9e918-016b-41ea-8793-5eab8dc74005 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.151181 Oct 01 21:45:55.479741 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4198/6406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:55 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:56.501893 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:56.502536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:56.509960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:56.510467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:56.510940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:56.511658 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:56.512123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:56.512556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:56.644258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:56.652075 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c04fae20-6e2a-47c3-b001-707eeb2b9803 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.154094 Oct 01 21:45:56.652630 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2209/6407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:56 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:57.676515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:57.677182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:57.684415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:57.684936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:57.685382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:57.686131 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:57.686642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:57.687092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:57.820918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:57.829295 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e4deec08-5f49-4de4-8cb6-d44d05a56092 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.156793 Oct 01 21:45:57.829892 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4199/6408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:57 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:45:58.853472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:45:58.854113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:45:58.861464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:58.861953 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:58.862390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:58.863107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:45:58.863568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:45:58.864000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:45:58.991782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:45:58.999644 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-695add5c-3367-4626-8510-9ba1cb249d9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.150183 Oct 01 21:45:59.000217 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2210/6409] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:45:58 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:00.022715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:00.023976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:00.031506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:00.032022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:00.032485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:00.033209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:00.033688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:00.034134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:00.165329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:00.173203 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7347854-a588-44c1-80f3-b70383661069 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.154509 Oct 01 21:46:00.173793 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4200/6410] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:00 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:01.196375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:01.196917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:01.203395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:01.203894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:01.204343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:01.205049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:01.205520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:01.205957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:01.336477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:01.344814 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7b793e3e-eb3b-4f44-a555-af7bd4e1e060 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.152427 Oct 01 21:46:01.345399 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2211/6411] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:01 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:02.369538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:02.370091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:02.376894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:02.377411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:02.377875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:02.378620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:02.379100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:02.379553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:02.510034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:02.517953 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d4c63afb-36ef-4c4f-ac48-ef0bb40c5460 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1682 microversion: 2.1 time: 0.152821 Oct 01 21:46:02.518622 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4201/6412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:02 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:03.541891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:03.542556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:03.549558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:03.550057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:03.550524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:03.551240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:03.551713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:03.552146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:03.777540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:03.785828 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a2e68f77-8a4e-4b7a-a3bd-fc32d19a06f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1681 microversion: 2.1 time: 0.247867 Oct 01 21:46:03.786938 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2212/6413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:03 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:03.873901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-94d34826-6285-467e-b719-57a3735afd25 req-94736664-b632-443a-87d3-f0dc34b7b094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d01772-9636-4eac-ae93-7d15d92858e3", "name": "network-vif-unplugged", "status": "completed", "tag": "caecc4d3-9ae3-48f0-8a54-50c35eba9616"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:03.885146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-94d34826-6285-467e-b719-57a3735afd25 req-94736664-b632-443a-87d3-f0dc34b7b094 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:03.885657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-94d34826-6285-467e-b719-57a3735afd25 req-94736664-b632-443a-87d3-f0dc34b7b094 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:03.886110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-94d34826-6285-467e-b719-57a3735afd25 req-94736664-b632-443a-87d3-f0dc34b7b094 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:03.898288 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-94d34826-6285-467e-b719-57a3735afd25 req-94736664-b632-443a-87d3-f0dc34b7b094 service nova] Creating event network-vif-unplugged:caecc4d3-9ae3-48f0-8a54-50c35eba9616 for instance e7d01772-9636-4eac-ae93-7d15d92858e3 on nch2-master-1 Oct 01 21:46:03.904217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-94d34826-6285-467e-b719-57a3735afd25 req-94736664-b632-443a-87d3-f0dc34b7b094 service nova] Instance e7d01772-9636-4eac-ae93-7d15d92858e3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:46:03.920566 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-94d34826-6285-467e-b719-57a3735afd25 req-94736664-b632-443a-87d3-f0dc34b7b094 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049700 Oct 01 21:46:03.921206 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4202/6414] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:46:04.811071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:04.811720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:04.818795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:04.819299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:04.819750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:04.820463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:04.820935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:04.821371 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:04.958343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:04.966885 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-78221521-6b87-4d66-88cc-2337a5637e0c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1681 microversion: 2.1 time: 0.159811 Oct 01 21:46:04.967467 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2213/6415] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:04 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:05.952438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-609d14dd-aed9-4f9a-891b-1e8b084891d8 req-9e838b88-3128-4ceb-85fe-3af2604bb877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d01772-9636-4eac-ae93-7d15d92858e3", "tag": "caecc4d3-9ae3-48f0-8a54-50c35eba9616"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:05.962909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-609d14dd-aed9-4f9a-891b-1e8b084891d8 req-9e838b88-3128-4ceb-85fe-3af2604bb877 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:05.963405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-609d14dd-aed9-4f9a-891b-1e8b084891d8 req-9e838b88-3128-4ceb-85fe-3af2604bb877 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:05.963852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-609d14dd-aed9-4f9a-891b-1e8b084891d8 req-9e838b88-3128-4ceb-85fe-3af2604bb877 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:05.975782 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-609d14dd-aed9-4f9a-891b-1e8b084891d8 req-9e838b88-3128-4ceb-85fe-3af2604bb877 service nova] Creating event network-changed:caecc4d3-9ae3-48f0-8a54-50c35eba9616 for instance e7d01772-9636-4eac-ae93-7d15d92858e3 on nch2-master-1 Oct 01 21:46:05.981176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-609d14dd-aed9-4f9a-891b-1e8b084891d8 req-9e838b88-3128-4ceb-85fe-3af2604bb877 service nova] Instance e7d01772-9636-4eac-ae93-7d15d92858e3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:46:05.989731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:05.990356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:05.992757 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-609d14dd-aed9-4f9a-891b-1e8b084891d8 req-9e838b88-3128-4ceb-85fe-3af2604bb877 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044354 Oct 01 21:46:05.993340 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4203/6416] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:46:06.000249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:06.001426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:06.001900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:06.003013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:06.003484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:06.003950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:06.227843 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:06.237539 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cb09fe31-dbae-41cd-8dc1-a8a228ebc692 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1679 microversion: 2.1 time: 0.252027 Oct 01 21:46:06.238181 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2214/6417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:05 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:46:07.262885 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:07.263645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:07.270515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:07.271025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:07.271486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:07.272204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:07.272683 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:07.273134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:07.409651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:07.418012 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a858f14-63d5-4d66-92f1-54fc1a807d9b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1676 microversion: 2.1 time: 0.160316 Oct 01 21:46:07.418645 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4204/6418] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:07 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:07.441373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:07.441910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:07.448995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:07.449492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:07.449937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:07.450675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:07.451145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:07.451576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:07.489727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:07.490216 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:07.490702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:07.491439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:07.491907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:07.492341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:07.513565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for project ae55f903ff94436b8d907d865581cffd. Resources: {'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:46:07.518802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for user 87e5b194ad2745b6af1f6ad76dd94881 and project ae55f903ff94436b8d907d865581cffd. Resources: {'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:46:07.619345 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d9c01bd0-009f-4ac7-8303-2c1d1010805a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3/action" status: 202 len: 0 microversion: 2.1 time: 0.181854 Oct 01 21:46:07.619965 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2215/6419] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:46:07 2022] POST /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:46:07.629298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:07.629974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:07.636272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:07.637155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:07.638955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:07.639718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:07.640361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:07.640844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:07.781023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:07.789177 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2635b3d1-4c80-451e-8529-a6a1305f2304 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1675 microversion: 2.1 time: 0.164953 Oct 01 21:46:07.789768 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4205/6420] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:07 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:08.814477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:08.815243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:08.822666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:08.823163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:08.823608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:08.824314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:08.824776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:08.825212 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:08.958474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:08.967282 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1e5b7621-3d15-4e96-b433-e4da4d2df27b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1675 microversion: 2.1 time: 0.158048 Oct 01 21:46:08.967873 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2216/6421] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:08 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:09.992061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:09.993640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:10.001313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:10.001843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:10.002952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:10.003688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:10.004165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:10.004614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:10.136592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:10.144735 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-21569227-d148-41f9-8c18-09d851d975b8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1675 microversion: 2.1 time: 0.157166 Oct 01 21:46:10.145330 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4206/6422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:09 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:11.169172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:11.170716 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:11.180252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:11.180853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:11.181379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:11.182182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:11.182930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:11.183511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:11.194752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-cbd5066e-c571-4361-a790-edc5174ad4f7 req-9bcff3c2-1a16-49e3-8e24-672f72910fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d01772-9636-4eac-ae93-7d15d92858e3", "tag": "caecc4d3-9ae3-48f0-8a54-50c35eba9616"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:11.210782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cbd5066e-c571-4361-a790-edc5174ad4f7 req-9bcff3c2-1a16-49e3-8e24-672f72910fe7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:11.211275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cbd5066e-c571-4361-a790-edc5174ad4f7 req-9bcff3c2-1a16-49e3-8e24-672f72910fe7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:11.212697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cbd5066e-c571-4361-a790-edc5174ad4f7 req-9bcff3c2-1a16-49e3-8e24-672f72910fe7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:11.239988 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-cbd5066e-c571-4361-a790-edc5174ad4f7 req-9bcff3c2-1a16-49e3-8e24-672f72910fe7 service nova] Creating event network-changed:caecc4d3-9ae3-48f0-8a54-50c35eba9616 for instance e7d01772-9636-4eac-ae93-7d15d92858e3 on nch1-master-1 Oct 01 21:46:11.244330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:46:11.251428 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-cbd5066e-c571-4361-a790-edc5174ad4f7 req-9bcff3c2-1a16-49e3-8e24-672f72910fe7 service nova] Instance e7d01772-9636-4eac-ae93-7d15d92858e3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:46:11.265704 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-cbd5066e-c571-4361-a790-edc5174ad4f7 req-9bcff3c2-1a16-49e3-8e24-672f72910fe7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146506 Oct 01 21:46:11.266464 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2217/6423] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:46:11.373582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-0544058e-d5f9-4c60-96ed-db5babd777e6 req-415e4b3a-0005-4642-8547-6331c5d45854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d01772-9636-4eac-ae93-7d15d92858e3", "name": "network-vif-plugged", "status": "completed", "tag": "caecc4d3-9ae3-48f0-8a54-50c35eba9616"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:11.384432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0544058e-d5f9-4c60-96ed-db5babd777e6 req-415e4b3a-0005-4642-8547-6331c5d45854 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:11.385017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0544058e-d5f9-4c60-96ed-db5babd777e6 req-415e4b3a-0005-4642-8547-6331c5d45854 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:11.386217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-0544058e-d5f9-4c60-96ed-db5babd777e6 req-415e4b3a-0005-4642-8547-6331c5d45854 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:11.399709 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-0544058e-d5f9-4c60-96ed-db5babd777e6 req-415e4b3a-0005-4642-8547-6331c5d45854 service nova] Creating event network-vif-plugged:caecc4d3-9ae3-48f0-8a54-50c35eba9616 for instance e7d01772-9636-4eac-ae93-7d15d92858e3 on nch1-master-1 Oct 01 21:46:11.405793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-0544058e-d5f9-4c60-96ed-db5babd777e6 req-415e4b3a-0005-4642-8547-6331c5d45854 service nova] Instance e7d01772-9636-4eac-ae93-7d15d92858e3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:46:11.417267 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-0544058e-d5f9-4c60-96ed-db5babd777e6 req-415e4b3a-0005-4642-8547-6331c5d45854 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149383 Oct 01 21:46:11.417980 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2218/6424] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:46:11.450140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:11.458239 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d1613e27-3c51-42fa-85d5-9d5cdccd2371 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1675 microversion: 2.1 time: 0.293818 Oct 01 21:46:11.459145 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4207/6425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:11 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1675 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:12.484022 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:12.484745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:12.491079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:12.491575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:12.492023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:12.492726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:12.493218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:12.493650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:12.626707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:12.634615 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c3242587-d8a8-4661-8c7c-809b931c913e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1675 microversion: 2.1 time: 0.155783 Oct 01 21:46:12.635201 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2219/6426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:12 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:13.659181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:13.659945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:13.666947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:13.667542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:13.668011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:13.668740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:13.669221 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:13.669670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:13.801528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:13.805483 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:46:13.810647 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-888a3f99-0003-4330-bdc5-8d14ac2808eb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1668 microversion: 2.1 time: 0.155500 Oct 01 21:46:13.811226 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4208/6427] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:13 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:13.833363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:13.833990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:13.841527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:13.842027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:13.842484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:13.843295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:13.843763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:13.844197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:13.979147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:13.987137 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-10f706b1-9e2d-4eec-91bf-b9d3c4776bdb tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1668 microversion: 2.1 time: 0.157625 Oct 01 21:46:13.987885 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2220/6428] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:13 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:14.010588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:14.011224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:14.018674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:14.019187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:14.019648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:14.020368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:14.020847 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:14.021296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:14.155273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:14.163017 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-12583806-110c-4abb-88b5-1f266c90c744 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1668 microversion: 2.1 time: 0.157160 Oct 01 21:46:14.163630 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4209/6429] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:14 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:46:14.186000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:14.186531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:14.192517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:14.193015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:14.193459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:14.194163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:14.194664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:14.195101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:14.220366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:46:14.298426 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-694d4099-53ac-403f-8f28-7c98e4c6e129 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 204 len: 0 microversion: 2.1 time: 0.116142 Oct 01 21:46:14.299304 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2221/6430] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:46:14 2022] DELETE /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:46:14.308056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:14.308689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:14.315415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:14.315918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:14.316374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:14.317084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:14.317556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:14.317998 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:14.448818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:14.456639 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a0b847a3-e616-4bed-9534-8c5ce7b82fab tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1674 microversion: 2.1 time: 0.152882 Oct 01 21:46:14.457213 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4210/6431] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:14 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:46:15.480914 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:15.481664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:15.484443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:46:15.489728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:15.490214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:15.490682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:15.491382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:15.491839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:15.492267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:15.630880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:15.640364 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-10155dbf-4659-4715-9cf6-21547d74e231 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1674 microversion: 2.1 time: 0.163656 Oct 01 21:46:15.641013 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2222/6432] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:15 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:16.377126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-50b08a45-3f32-4281-8834-b9411fc466ca req-5bc8a6c3-564b-4e03-8c63-42cd2d9d2f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d01772-9636-4eac-ae93-7d15d92858e3", "name": "network-vif-deleted", "tag": "caecc4d3-9ae3-48f0-8a54-50c35eba9616"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:16.383257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=41 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:46:16.390197 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-50b08a45-3f32-4281-8834-b9411fc466ca req-5bc8a6c3-564b-4e03-8c63-42cd2d9d2f01 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:16.390866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-50b08a45-3f32-4281-8834-b9411fc466ca req-5bc8a6c3-564b-4e03-8c63-42cd2d9d2f01 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:16.391315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-50b08a45-3f32-4281-8834-b9411fc466ca req-5bc8a6c3-564b-4e03-8c63-42cd2d9d2f01 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:16.404483 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-50b08a45-3f32-4281-8834-b9411fc466ca req-5bc8a6c3-564b-4e03-8c63-42cd2d9d2f01 service nova] Creating event network-vif-deleted:caecc4d3-9ae3-48f0-8a54-50c35eba9616 for instance e7d01772-9636-4eac-ae93-7d15d92858e3 on nch1-master-1 Oct 01 21:46:16.409500 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-50b08a45-3f32-4281-8834-b9411fc466ca req-5bc8a6c3-564b-4e03-8c63-42cd2d9d2f01 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036256 Oct 01 21:46:16.410296 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4211/6433] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:46:16.663981 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:16.664898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:16.672033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:16.672527 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:16.672970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:16.673681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:16.674164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:16.674622 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:16.707198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:16.707688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:16.708129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:16.708581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lazy-loading 'fault' on Instance uuid e7d01772-9636-4eac-ae93-7d15d92858e3 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:46:16.755674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:16.764558 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5a21a1c2-3ec3-4103-ba62-b8fbd76cd520 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 200 len: 1328 microversion: 2.1 time: 0.104477 Oct 01 21:46:16.765155 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2223/6434] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:16 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:17.790789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:17.791432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:17.798278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:17.798831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:17.799303 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:17.800029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:17.800514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:17.800970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:17.814731 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 HTTP/1.1 Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e7d01772-9636-4eac-ae93-7d15d92858e3'} Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:46:17.816363 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1918c459-d8c3-45e6-be2e-c0b97ff50c64 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 404 len: 111 microversion: 2.1 time: 0.032331 Oct 01 21:46:17.821279 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4212/6435] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:17 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:46:17.833826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:17.834531 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:17.836479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:46:17.843074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:17.843568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:17.844043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:17.844740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:17.845205 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:17.845638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:17.859940 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 HTTP/1.1 Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e7d01772-9636-4eac-ae93-7d15d92858e3'} Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:46:17.861601 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b1acccf-bf3f-41d3-b027-d43618e66a74 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 404 len: 111 microversion: 2.1 time: 0.033133 Oct 01 21:46:17.866608 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2224/6436] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:17 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:46:17.910308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-787832329", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "d21fbd12-b67f-4878-847d-9b5f3a740b75"}], "security_groups": [{"name": "tempest-securitygroup--168964952"}], "key_name": "tempest-keypair-1928138378", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:18.014677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] validate_networks() for [('d21fbd12-b67f-4878-847d-9b5f3a740b75', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:46:18.385233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:46:18.385680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:46:18.386180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:46:18.386650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:46:18.387612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:46:18.396658 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:18.397160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:18.397620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:18.398374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:18.398878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:18.399328 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:18.417532 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for project ae55f903ff94436b8d907d865581cffd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:46:18.423063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for user 87e5b194ad2745b6af1f6ad76dd94881 and project ae55f903ff94436b8d907d865581cffd. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:46:18.435859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:46:18.438249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:46:18.489933 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ebbb959f-4961-431a-a5c6-f0dd28d56ba9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.583445 Oct 01 21:46:18.490611 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4213/6437] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:46:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:46:18.502353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-12c5914b-cbd2-4497-a64b-530766ef386a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:18.503011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-12c5914b-cbd2-4497-a64b-530766ef386a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:18.556676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-12c5914b-cbd2-4497-a64b-530766ef386a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:18.564259 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-12c5914b-cbd2-4497-a64b-530766ef386a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1238 microversion: 2.1 time: 0.065770 Oct 01 21:46:18.564921 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2225/6438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:18 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:19.589179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:19.591357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:19.598838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:19.599490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:19.599742 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:19.600657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:19.601316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:19.602028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:19.686531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:19.695572 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-03fe32cf-3194-44a2-8f16-7a55dea6b6cc tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1308 microversion: 2.1 time: 0.111132 Oct 01 21:46:19.696144 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4214/6439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:19 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:20.720501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:20.721143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:20.729027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:20.729488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:20.729936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:20.730670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:20.731690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:20.732117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:20.867548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:20.875971 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fb62e4d9-2596-4893-ac7f-753919ba8943 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1363 microversion: 2.1 time: 0.159557 Oct 01 21:46:20.876563 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2226/6440] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:20 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:21.097242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-bc7d74e7-5735-41e5-af76-a5f45e5cb554 req-46f4de07-88d7-4e12-a6d6-83d9d6a28eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:21.107710 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bc7d74e7-5735-41e5-af76-a5f45e5cb554 req-46f4de07-88d7-4e12-a6d6-83d9d6a28eed service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:21.108211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bc7d74e7-5735-41e5-af76-a5f45e5cb554 req-46f4de07-88d7-4e12-a6d6-83d9d6a28eed service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:21.108666 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-bc7d74e7-5735-41e5-af76-a5f45e5cb554 req-46f4de07-88d7-4e12-a6d6-83d9d6a28eed service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:21.120404 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-bc7d74e7-5735-41e5-af76-a5f45e5cb554 req-46f4de07-88d7-4e12-a6d6-83d9d6a28eed service nova] Creating event network-changed:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch1-master-1 Oct 01 21:46:21.125199 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-bc7d74e7-5735-41e5-af76-a5f45e5cb554 req-46f4de07-88d7-4e12-a6d6-83d9d6a28eed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031741 Oct 01 21:46:21.125812 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4215/6441] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:46:21.899778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:21.900409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:21.907444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:21.907941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:21.908387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:21.909090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:21.909556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:21.909989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:22.040127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:22.048687 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-84ec196a-b2f3-4999-aa66-ea979c07b9d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1363 microversion: 2.1 time: 0.152806 Oct 01 21:46:22.050674 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2227/6442] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:21 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:23.075565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:23.076281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:23.083785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:23.084691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:23.085525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:23.086838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:23.087665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:23.088218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:23.215967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:23.223703 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3ded375f-c8b2-44af-9d58-3d8866e6a463 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1363 microversion: 2.1 time: 0.154131 Oct 01 21:46:23.224271 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4216/6443] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:23 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:24.245895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:24.246539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:24.253681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:24.254176 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:24.254649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:24.255361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:24.255858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:24.256295 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:24.386781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:24.395007 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-def72ed6-d31c-4892-90ab-1808c6517cfe tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1363 microversion: 2.1 time: 0.153061 Oct 01 21:46:24.395598 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2228/6444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:24 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:25.419873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:25.420513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:25.427494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:25.428009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:25.428476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:25.429441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:25.429934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:25.430398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:25.566512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:25.574317 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-11cf7350-b1ed-473a-b7c7-7e296b9d7a30 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1363 microversion: 2.1 time: 0.159086 Oct 01 21:46:25.575412 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4217/6445] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:25 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:26.598731 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:26.599360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:26.606259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:26.606781 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:26.607737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:26.608445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:26.608919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:26.609360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:26.741078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:26.749176 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-462f3571-193f-40a1-9c5b-ae1585a7409d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1363 microversion: 2.1 time: 0.154581 Oct 01 21:46:26.749976 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2229/6446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:26 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:26.843399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7254388e-8a48-4c95-9554-06ccfac0782b req-96fe7e27-cee4-4565-8136-57ea25f08fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "name": "network-vif-plugged", "status": "completed", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:26.854555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7254388e-8a48-4c95-9554-06ccfac0782b req-96fe7e27-cee4-4565-8136-57ea25f08fd2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:26.855075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7254388e-8a48-4c95-9554-06ccfac0782b req-96fe7e27-cee4-4565-8136-57ea25f08fd2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:26.855720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7254388e-8a48-4c95-9554-06ccfac0782b req-96fe7e27-cee4-4565-8136-57ea25f08fd2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:26.867764 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7254388e-8a48-4c95-9554-06ccfac0782b req-96fe7e27-cee4-4565-8136-57ea25f08fd2 service nova] Creating event network-vif-plugged:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch1-master-1 Oct 01 21:46:26.872882 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7254388e-8a48-4c95-9554-06ccfac0782b req-96fe7e27-cee4-4565-8136-57ea25f08fd2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033870 Oct 01 21:46:26.873529 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4218/6447] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:46:27.772834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:27.773387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:27.780391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:27.780883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:27.781332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:27.782037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:27.782518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:27.782952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:27.917440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:27.926895 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4dfab569-37b9-4692-855f-f20f2bfe6331 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1363 microversion: 2.1 time: 0.157992 Oct 01 21:46:27.927488 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2230/6448] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:27 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:28.950743 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:46:28.952146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:46:28.956263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:28.957010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:28.964077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:28.964581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:28.965039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:28.965752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:28.966261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:28.966760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:29.101006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:46:29.108944 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c788744e-4a57-4db8-a2cc-10b2b554170c tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1550 microversion: 2.1 time: 0.160018 Oct 01 21:46:29.109522 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4219/6449] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:46:28 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:46:29.132161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bee6b244-b88b-459e-9bac-824658713e0b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:46:29.132698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bee6b244-b88b-459e-9bac-824658713e0b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:46:29.134635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:46:29.141778 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee6b244-b88b-459e-9bac-824658713e0b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:29.142274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee6b244-b88b-459e-9bac-824658713e0b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:29.142753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee6b244-b88b-459e-9bac-824658713e0b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:29.143466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee6b244-b88b-459e-9bac-824658713e0b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:29.143938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee6b244-b88b-459e-9bac-824658713e0b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:29.144379 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bee6b244-b88b-459e-9bac-824658713e0b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:29.220102 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bee6b244-b88b-459e-9bac-824658713e0b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091908 Oct 01 21:46:29.220710 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2231/6450] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Oct 1 21:46:29 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:46:30.421309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-0967c337-de11-44ae-b519-76edf99cb5b5 req-1de08a34-b5e6-476b-92b9-ec0de0d33608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:46:30.431819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0967c337-de11-44ae-b519-76edf99cb5b5 req-1de08a34-b5e6-476b-92b9-ec0de0d33608 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:46:30.432330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0967c337-de11-44ae-b519-76edf99cb5b5 req-1de08a34-b5e6-476b-92b9-ec0de0d33608 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:46:30.432813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-0967c337-de11-44ae-b519-76edf99cb5b5 req-1de08a34-b5e6-476b-92b9-ec0de0d33608 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:46:30.444395 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-0967c337-de11-44ae-b519-76edf99cb5b5 req-1de08a34-b5e6-476b-92b9-ec0de0d33608 service nova] Creating event network-changed:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch1-master-1 Oct 01 21:46:30.449257 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-0967c337-de11-44ae-b519-76edf99cb5b5 req-1de08a34-b5e6-476b-92b9-ec0de0d33608 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031662 Oct 01 21:46:30.449868 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4220/6451] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:47:02.160374 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:47:02.160895 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:47:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa (ip 10.222.0.17) !!! Oct 01 21:47:02.162092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=23 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:02.162977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:02.167788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:02.168416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:02.178805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:02.179574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:02.180025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:02.180735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:02.181204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:02.181639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:02.446639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:02.454640 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f960b992-eb8d-4b4c-9d3c-26aad8d13dfa tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1669 microversion: 2.1 time: 0.296341 Oct 01 21:47:02.455220 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2232/6452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:02 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1669 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:02.475932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:02.476801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=48 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:02.481288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a4fed070-2df0-4258-88f1-16f6c80052d7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87451133-1fee-4ceb-b64f-d489f8a25985"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:02.483774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a4fed070-2df0-4258-88f1-16f6c80052d7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:02.492028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4fed070-2df0-4258-88f1-16f6c80052d7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:02.492550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4fed070-2df0-4258-88f1-16f6c80052d7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:02.492995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4fed070-2df0-4258-88f1-16f6c80052d7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:02.493711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4fed070-2df0-4258-88f1-16f6c80052d7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:02.494195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4fed070-2df0-4258-88f1-16f6c80052d7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:02.494678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a4fed070-2df0-4258-88f1-16f6c80052d7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:02.962741 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a4fed070-2df0-4258-88f1-16f6c80052d7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489377 Oct 01 21:47:02.963457 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4221/6453] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:47:02 2022] POST /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:47:06.273698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:06.276143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:06.283006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:06.283989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:06.284430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:06.285127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:06.285584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:06.286013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:06.373220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:06.379423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Old instance type m1.heat2, new instance type m1.heat {{(pid=140437) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:47:06.386582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:47:06.387014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:47:06.387489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:47:06.387902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:47:06.388314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:47:06.451392 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-942befe8-1224-4d7c-9014-7bc445ee1c6e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/action" status: 202 len: 0 microversion: 2.1 time: 0.181685 Oct 01 21:47:06.452180 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2233/6454] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:47:06 2022] POST /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:47:06.461840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:06.462588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:06.468968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:06.469485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:06.469957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:06.470741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:06.471720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:06.472166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:06.607750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:06.617059 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-83a9d20a-8b94-4e7a-9204-17167f0b1fb1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1724 microversion: 2.1 time: 0.160393 Oct 01 21:47:06.617644 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4222/6455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:06 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:07.641127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:07.641671 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:07.652554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:07.653048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:07.653494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:07.654199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:07.654699 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:07.655131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:07.785661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:07.794280 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-12b3b156-8c0d-487d-8d0f-f9bd46f8b8f7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1724 microversion: 2.1 time: 0.158224 Oct 01 21:47:07.794914 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2234/6456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:07 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:08.819533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:08.820171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:08.827118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:08.827649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:08.828110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:08.828823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:08.829304 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:08.829751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:08.957417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:08.965410 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-58fd7648-9b5f-4c0c-8d74-a9b4d28c94dd tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.149817 Oct 01 21:47:08.965988 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4223/6457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:08 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:09.989039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:09.989763 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:09.996960 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:09.997813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:09.998257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:09.998987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:09.999450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:09.999877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:10.131314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:10.140077 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-31e89439-3c4a-4e18-a7a7-9487b2e72602 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.155705 Oct 01 21:47:10.140652 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2235/6458] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:09 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:11.163991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:11.164628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:11.171863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:11.172373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:11.172825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:11.173536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:11.174674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:11.175119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:11.309066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:11.318135 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c9bf9001-b34b-4d3a-9c4d-4ba1503b2284 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.158165 Oct 01 21:47:11.318747 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4224/6459] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:11 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:12.341621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:12.342162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:12.349153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:12.349647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:12.350089 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:12.350814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:12.351285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:12.351714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:12.484486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:12.493023 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-83eac3a4-63e4-478e-8a10-c5f404dc3fc4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.155437 Oct 01 21:47:12.493602 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2236/6460] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:12 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:13.517227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:13.518340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:13.525463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:13.525968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:13.526426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:13.527165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:13.527644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:13.528091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:13.660527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:13.669075 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c7d0388-0bd4-4dd9-abaf-4d0f046fe89e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.155853 Oct 01 21:47:13.669642 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4225/6461] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:13 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:14.693865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:14.694485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:14.701398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:14.701885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:14.702325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:14.703048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:14.703508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:14.703933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:14.834274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:14.842644 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c2fe5bb0-174e-4095-baab-748e4f89d0af tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.152702 Oct 01 21:47:14.843220 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2237/6462] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:14 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:15.866939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:15.867582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:15.874381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:15.874915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:15.875370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:15.876073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:15.876545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:15.877595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:16.004884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:16.013608 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4dd09435-6b1b-4ded-bc4c-a63d0248f874 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.150587 Oct 01 21:47:16.014191 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4226/6463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:15 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:17.036018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:17.036633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:17.043662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:17.044147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:17.044588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:17.045283 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:17.045929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:17.046154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:17.172955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:17.182078 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e0f4af1e-8b61-4df4-9c06-8f19be020f2d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.149995 Oct 01 21:47:17.182698 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2238/6464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:17 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:18.205687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:18.206361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:18.213349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:18.213860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:18.214320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:18.215066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:18.215539 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:18.215987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:18.349394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:18.357819 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a5d83bcd-4d15-46bf-a61a-975d04cb6969 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.156672 Oct 01 21:47:18.358400 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4227/6465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:18 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:19.381272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:19.381816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:19.388730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:19.389228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:19.389675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:19.390383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:19.390879 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:19.391317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:19.519987 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:19.528352 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c456b8c7-c740-4dd8-90cf-70792e8aed96 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.151209 Oct 01 21:47:19.528934 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2239/6466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:19 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:20.552707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:20.553377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:20.560947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:20.561495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:20.561987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:20.562739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:20.563256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:20.563706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:20.696069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:20.704564 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3445b347-b9a6-4e96-be8a-5a8f03cc8e6d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.156374 Oct 01 21:47:20.705134 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4228/6467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:20 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:21.728053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:21.728593 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:21.735656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:21.736660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:21.737102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:21.737816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:21.738286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:21.738761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:21.876253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:21.885265 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a015a9cf-4654-433a-b468-b22374fb28a5 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.161240 Oct 01 21:47:21.885856 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2240/6468] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:21 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:22.909161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:22.909804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:22.916789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:22.917302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:22.917767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:22.918511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:22.918999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:22.919499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:23.054668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:23.063281 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7321587f-6816-47e8-b258-3f33cd91f821 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.158156 Oct 01 21:47:23.063903 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4229/6469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:22 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:24.086977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:24.087613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:24.094767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:24.095267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:24.096361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:24.097071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:24.097541 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:24.097979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:24.225451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:24.234933 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1ffada57-e88c-4ed5-bb2e-e4c00a5b0f4d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.151815 Oct 01 21:47:24.235689 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2241/6470] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:24 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:25.258248 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:25.259141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:25.266985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:25.267603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:25.268151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:25.269214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:25.269961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:25.270822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:25.479184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:25.487685 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cd378ef7-bab1-4997-b826-5d83300254ed tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1729 microversion: 2.1 time: 0.233425 Oct 01 21:47:25.488282 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4230/6471] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:25 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:26.511479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:26.512210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:26.519396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:26.519895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:26.520344 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:26.521094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:26.521594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:26.522027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:26.750822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:26.759642 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bc9182f8-c6be-4073-bb40-1c6fbec27dd7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1728 microversion: 2.1 time: 0.252185 Oct 01 21:47:26.760238 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2242/6472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:26 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1728 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:27.014593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-2a476bc8-a208-49b1-ba7d-e33d5fb9d263 req-b1a6f573-8090-4cb4-b60d-c09ea5e55988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "name": "network-vif-unplugged", "status": "completed", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:27.024503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2a476bc8-a208-49b1-ba7d-e33d5fb9d263 req-b1a6f573-8090-4cb4-b60d-c09ea5e55988 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:27.025029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2a476bc8-a208-49b1-ba7d-e33d5fb9d263 req-b1a6f573-8090-4cb4-b60d-c09ea5e55988 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:27.025738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-2a476bc8-a208-49b1-ba7d-e33d5fb9d263 req-b1a6f573-8090-4cb4-b60d-c09ea5e55988 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:27.043972 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-2a476bc8-a208-49b1-ba7d-e33d5fb9d263 req-b1a6f573-8090-4cb4-b60d-c09ea5e55988 service nova] Creating event network-vif-unplugged:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch2-master-1 Oct 01 21:47:27.050387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-2a476bc8-a208-49b1-ba7d-e33d5fb9d263 req-b1a6f573-8090-4cb4-b60d-c09ea5e55988 service nova] Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:47:27.061859 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-2a476bc8-a208-49b1-ba7d-e33d5fb9d263 req-b1a6f573-8090-4cb4-b60d-c09ea5e55988 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101741 Oct 01 21:47:27.062945 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4231/6473] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:47:27.832264 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:27.832896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:27.838948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:27.839444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:27.839890 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:27.840599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:27.841132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:27.841571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:28.025695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:28.034510 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f0d5f4f1-5926-4b64-a8ca-9726516f9c0e tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1728 microversion: 2.1 time: 0.253206 Oct 01 21:47:28.035834 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2243/6474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:27 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1728 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:29.060768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:29.061551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:29.068405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:29.068893 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:29.069364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:29.070090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:29.070596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:29.071051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:29.100124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-69c32d41-1a02-475b-abea-4f54f7f21e71 req-e33b9ef6-0f0a-4af9-896b-d5c6fd99ee8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:29.111785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-69c32d41-1a02-475b-abea-4f54f7f21e71 req-e33b9ef6-0f0a-4af9-896b-d5c6fd99ee8f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:29.112366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-69c32d41-1a02-475b-abea-4f54f7f21e71 req-e33b9ef6-0f0a-4af9-896b-d5c6fd99ee8f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:29.112882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-69c32d41-1a02-475b-abea-4f54f7f21e71 req-e33b9ef6-0f0a-4af9-896b-d5c6fd99ee8f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:29.125540 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-69c32d41-1a02-475b-abea-4f54f7f21e71 req-e33b9ef6-0f0a-4af9-896b-d5c6fd99ee8f service nova] Creating event network-changed:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch2-master-1 Oct 01 21:47:29.132189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-69c32d41-1a02-475b-abea-4f54f7f21e71 req-e33b9ef6-0f0a-4af9-896b-d5c6fd99ee8f service nova] Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:47:29.145570 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-69c32d41-1a02-475b-abea-4f54f7f21e71 req-e33b9ef6-0f0a-4af9-896b-d5c6fd99ee8f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049108 Oct 01 21:47:29.146522 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2244/6475] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:47:29.271524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:29.281792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-223f09a2-9811-4ed9-8a5d-07a364609db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1726 microversion: 2.1 time: 0.226166 Oct 01 21:47:29.283281 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4232/6476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:29 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1726 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:30.310241 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:30.311006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:30.317322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:30.317814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:30.318261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:30.318998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:30.319523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:30.319995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:30.540086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:30.549073 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0658deca-0d10-4cc7-b38f-f1435ce60646 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1726 microversion: 2.1 time: 0.243436 Oct 01 21:47:30.549656 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2245/6477] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:30 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1726 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:31.573025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:31.573709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:31.581164 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:31.581668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:31.582128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:31.582884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:31.583363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:31.583808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:31.716497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:31.725455 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b01e4d30-3730-47c1-ae81-3b185fb4f844 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1726 microversion: 2.1 time: 0.156460 Oct 01 21:47:31.726044 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4233/6478] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:31 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:32.749355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:32.749908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:32.751932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=33 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:32.757438 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:32.757934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:32.758411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:32.759139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:32.759607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:32.760042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:32.762735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:32.896554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:32.905098 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dcc2d10d-0c1d-4fdd-932c-a8501c6a6c71 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1723 microversion: 2.1 time: 0.159972 Oct 01 21:47:32.905919 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2246/6479] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:32 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:32.928380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:32.928987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:32.931987 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=27 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:32.937368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:32.937881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:32.938334 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:32.939106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:32.939578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:32.940024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:32.945454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:32.983877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:32.984380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:32.984834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:32.985780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:32.986564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:32.987010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:33.007912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for project ae55f903ff94436b8d907d865581cffd. Resources: {'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:47:33.013217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Getting quotas for user 87e5b194ad2745b6af1f6ad76dd94881 and project ae55f903ff94436b8d907d865581cffd. Resources: {'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:47:33.115943 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-187e19a9-a7c3-4bf7-b5cf-23be54706ec7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "POST /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/action" status: 202 len: 0 microversion: 2.1 time: 0.191346 Oct 01 21:47:33.116567 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4234/6480] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:47:32 2022] POST /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:47:33.125005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:33.125636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:33.131947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:33.132450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:33.132902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:33.133664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:33.134221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:33.134794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:33.342589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:33.351420 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-239b4aaa-476b-4678-8e06-9bcd598b7af4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1722 microversion: 2.1 time: 0.230493 Oct 01 21:47:33.352033 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2247/6481] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:33 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:34.376914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:34.377645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:34.384052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:34.384562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:34.385051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:34.385767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:34.386247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:34.386734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:34.520003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:34.528379 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82a70867-bb57-4ccb-bb39-a1fa9d857579 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1722 microversion: 2.1 time: 0.156608 Oct 01 21:47:34.528963 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4235/6482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:34 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:35.050597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-1b7607c6-a24f-452e-b999-bfcef248048b req-ea07d6d4-04ba-49cc-9ebb-34be17631856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "name": "network-vif-plugged", "status": "completed", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:35.060515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b7607c6-a24f-452e-b999-bfcef248048b req-ea07d6d4-04ba-49cc-9ebb-34be17631856 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:35.061006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b7607c6-a24f-452e-b999-bfcef248048b req-ea07d6d4-04ba-49cc-9ebb-34be17631856 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:35.061455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-1b7607c6-a24f-452e-b999-bfcef248048b req-ea07d6d4-04ba-49cc-9ebb-34be17631856 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:35.073932 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-1b7607c6-a24f-452e-b999-bfcef248048b req-ea07d6d4-04ba-49cc-9ebb-34be17631856 service nova] Creating event network-vif-plugged:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch2-master-1 Oct 01 21:47:35.079473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [req-1b7607c6-a24f-452e-b999-bfcef248048b req-ea07d6d4-04ba-49cc-9ebb-34be17631856 service nova] Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140437) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:47:35.091236 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-1b7607c6-a24f-452e-b999-bfcef248048b req-ea07d6d4-04ba-49cc-9ebb-34be17631856 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100024 Oct 01 21:47:35.091861 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2248/6483] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:47:35.553427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:35.554078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:35.561428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:35.561943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:35.562405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:35.563168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:35.563654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:35.564101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:35.703788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:35.712400 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-029b5f5b-c12d-40bf-84ed-8cf1735185ae tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1722 microversion: 2.1 time: 0.163843 Oct 01 21:47:35.713418 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4236/6484] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:35 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:36.738723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:36.739562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:36.746436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:36.746973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:36.747422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:36.748146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:36.748802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:36.749724 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:36.871261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-df516f22-9bed-4e69-8b38-d1ec218d2f97 req-64e5499d-437c-4ee0-9918-abd01a778fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "name": "network-vif-unplugged", "status": "completed", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:36.882863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-df516f22-9bed-4e69-8b38-d1ec218d2f97 req-64e5499d-437c-4ee0-9918-abd01a778fdc service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:36.883615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-df516f22-9bed-4e69-8b38-d1ec218d2f97 req-64e5499d-437c-4ee0-9918-abd01a778fdc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:36.884240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-df516f22-9bed-4e69-8b38-d1ec218d2f97 req-64e5499d-437c-4ee0-9918-abd01a778fdc service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:36.901251 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-df516f22-9bed-4e69-8b38-d1ec218d2f97 req-64e5499d-437c-4ee0-9918-abd01a778fdc service nova] Creating event network-vif-unplugged:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch1-master-1 Oct 01 21:47:36.906251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:36.907170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-df516f22-9bed-4e69-8b38-d1ec218d2f97 req-64e5499d-437c-4ee0-9918-abd01a778fdc service nova] Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:47:36.917193 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eca0d9ca-2aab-44ea-b785-8f324e6f10ca tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1722 microversion: 2.1 time: 0.183722 Oct 01 21:47:36.934161 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2249/6485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:36 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:36.934318 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-df516f22-9bed-4e69-8b38-d1ec218d2f97 req-64e5499d-437c-4ee0-9918-abd01a778fdc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105958 Oct 01 21:47:36.934318 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4237/6486] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:47:37.941841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:37.942467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:37.949720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:37.950225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:37.950717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:37.951437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:37.951911 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:37.952347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:38.088580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:38.097141 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d89d03bb-65ac-4938-bd59-4afe5ad8cdf7 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1722 microversion: 2.1 time: 0.159789 Oct 01 21:47:38.097718 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2250/6487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:37 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:38.958136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-1d68501e-fc19-4e68-a1bb-3b4d38ae13ec req-5f0c5f48-11dc-4500-89ae-35d4bedc60fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:38.967676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d68501e-fc19-4e68-a1bb-3b4d38ae13ec req-5f0c5f48-11dc-4500-89ae-35d4bedc60fe service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:38.968179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d68501e-fc19-4e68-a1bb-3b4d38ae13ec req-5f0c5f48-11dc-4500-89ae-35d4bedc60fe service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:38.968623 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-1d68501e-fc19-4e68-a1bb-3b4d38ae13ec req-5f0c5f48-11dc-4500-89ae-35d4bedc60fe service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:38.980304 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-1d68501e-fc19-4e68-a1bb-3b4d38ae13ec req-5f0c5f48-11dc-4500-89ae-35d4bedc60fe service nova] Creating event network-changed:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch1-master-1 Oct 01 21:47:38.985621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-1d68501e-fc19-4e68-a1bb-3b4d38ae13ec req-5f0c5f48-11dc-4500-89ae-35d4bedc60fe service nova] Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:47:38.996676 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-1d68501e-fc19-4e68-a1bb-3b4d38ae13ec req-5f0c5f48-11dc-4500-89ae-35d4bedc60fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043519 Oct 01 21:47:38.997277 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4238/6488] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:47:39.121041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:39.121788 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:39.129357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:39.129856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:39.130310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:39.131054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:39.131520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:39.131958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:39.349240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:39.358998 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-71adc5a6-3d77-44db-b7a1-c759235eac31 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1722 microversion: 2.1 time: 0.241825 Oct 01 21:47:39.359928 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2251/6489] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:39 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:40.382929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:40.383578 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:40.389894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:40.390400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:40.390888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:40.391612 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:40.392092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:40.392541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:40.527773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:40.536774 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2b2990d8-8f88-4df6-bbc5-d9b0fe558381 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1722 microversion: 2.1 time: 0.159215 Oct 01 21:47:40.537355 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4239/6490] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:40 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:41.561020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:41.561588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:41.568394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:41.568887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:41.569332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:41.570035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:41.570521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:41.570946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:41.701129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:41.709493 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-faaf2604-6105-4828-b06c-8f9faa4703ec tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1715 microversion: 2.1 time: 0.152509 Oct 01 21:47:41.710066 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2252/6491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:41 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:41.732196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:41.732830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:41.740545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:41.741047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:41.741530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:41.742246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:41.742756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:41.743203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:41.874853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:41.883229 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c61ea447-7d23-453a-a507-8aa114000db2 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1715 microversion: 2.1 time: 0.154990 Oct 01 21:47:41.883804 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4240/6492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:41 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:41.905773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:41.906398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:41.913902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:41.914394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:41.914904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:41.915607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:41.916070 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:41.916501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:42.043742 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:42.052149 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d150d775-df0e-4cd7-883c-18d61359ce72 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1715 microversion: 2.1 time: 0.150270 Oct 01 21:47:42.052731 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2253/6493] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:41 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:42.074778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:42.075247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:42.081778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:42.082290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:42.082801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:42.083528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:42.084017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:42.084472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:42.109754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:47:42.184648 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4201b969-5057-4828-af63-3ef24e3632d9 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "DELETE /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 204 len: 0 microversion: 2.1 time: 0.113646 Oct 01 21:47:42.185248 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4241/6494] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:47:42 2022] DELETE /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:47:42.194770 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:42.195408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:42.201350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:42.201839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:42.202594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:42.203322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:42.203792 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:42.204204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:42.339776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:42.348460 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-078b2b44-3fa4-4b62-b72c-0f7ebdaf796a tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1721 microversion: 2.1 time: 0.158048 Oct 01 21:47:42.349042 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2254/6495] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:42 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:43.150905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-25944df4-ae06-4323-ab46-da0d52455bbb req-62d8b522-7d17-42b4-a8ba-7b823b1602eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "name": "network-vif-plugged", "status": "completed", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:43.157542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:43.165952 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-25944df4-ae06-4323-ab46-da0d52455bbb req-62d8b522-7d17-42b4-a8ba-7b823b1602eb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:43.166505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-25944df4-ae06-4323-ab46-da0d52455bbb req-62d8b522-7d17-42b4-a8ba-7b823b1602eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:43.167108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-25944df4-ae06-4323-ab46-da0d52455bbb req-62d8b522-7d17-42b4-a8ba-7b823b1602eb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:43.178559 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-25944df4-ae06-4323-ab46-da0d52455bbb req-62d8b522-7d17-42b4-a8ba-7b823b1602eb service nova] Creating event network-vif-plugged:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch1-master-1 Oct 01 21:47:43.183690 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-25944df4-ae06-4323-ab46-da0d52455bbb req-62d8b522-7d17-42b4-a8ba-7b823b1602eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036962 Oct 01 21:47:43.184311 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4242/6496] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:47:43.371949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:43.372578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:43.379490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:43.379986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:43.380439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:43.381175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:43.381644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:43.382103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:43.510637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:43.519500 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fe58b8c1-5a1f-411d-aa45-ea9c8eb45c0d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1721 microversion: 2.1 time: 0.151496 Oct 01 21:47:43.520083 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2255/6497] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:43 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:44.545063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:44.545807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:44.552635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:44.553134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:44.553590 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:44.554602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:44.555074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:44.555516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:44.637865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e5b194ad2745b6af1f6ad76dd94881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae55f903ff94436b8d907d865581cffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:44.648862 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c4a3876e-7c93-406f-92d1-f7669a63532b tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 200 len: 1654 microversion: 2.1 time: 0.108866 Oct 01 21:47:44.649651 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4243/6498] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:44 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 1654 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:44.924816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-698aecb0-5f26-4018-933c-14a6cc2c0cc9 req-7e29c999-7382-4c80-81ad-5416481f8408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa", "name": "network-vif-deleted", "tag": "af6be929-7e78-4a5f-8d42-e40be7aabf3b"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:44.935066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-698aecb0-5f26-4018-933c-14a6cc2c0cc9 req-7e29c999-7382-4c80-81ad-5416481f8408 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:44.935486 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-698aecb0-5f26-4018-933c-14a6cc2c0cc9 req-7e29c999-7382-4c80-81ad-5416481f8408 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:44.937776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-698aecb0-5f26-4018-933c-14a6cc2c0cc9 req-7e29c999-7382-4c80-81ad-5416481f8408 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:44.948017 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-698aecb0-5f26-4018-933c-14a6cc2c0cc9 req-7e29c999-7382-4c80-81ad-5416481f8408 service nova] Creating event network-vif-deleted:af6be929-7e78-4a5f-8d42-e40be7aabf3b for instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa on nch1-master-1 Oct 01 21:47:44.953178 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-698aecb0-5f26-4018-933c-14a6cc2c0cc9 req-7e29c999-7382-4c80-81ad-5416481f8408 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032346 Oct 01 21:47:44.954645 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2256/6499] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:47:45.676565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:45.677205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:45.685198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:45.685709 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:45.686162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:45.686932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:45.687403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:45.687871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:45.703531 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa HTTP/1.1 Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa'} Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:45.705214 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ee586e9c-88e7-4a50-9d79-bad81f37e1ad tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 404 len: 111 microversion: 2.1 time: 0.034879 Oct 01 21:47:45.711144 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4244/6500] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:45 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:47:45.770853 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:45.773506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:45.779968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:45.780462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:45.780900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:45.781628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:45.782088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:45.782542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:45.795874 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/os-volume_attachments HTTP/1.1 Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'server_id': '19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa'} Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:45.805941 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:45.810786 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e5ec2cb6-432b-4c95-a339-170f26453d10 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041325 Oct 01 21:47:45.811832 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2257/6501] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:47:45 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:47:47.030634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:47.031182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:47.038110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.038644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.039109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.039821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.040295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.040737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.057601 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa HTTP/1.1 Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa'} Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:47.059201 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f745d3d-be01-4d7b-a5c7-05755f9dd52d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "DELETE /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 404 len: 111 microversion: 2.1 time: 0.034345 Oct 01 21:47:47.063819 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4245/6502] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:47:47 2022] DELETE /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:47:47.069795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:47.070418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:47.077389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.077882 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.078331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.079061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.079532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.079968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.094272 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa HTTP/1.1 Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa'} Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.095845 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance 19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6edef919-2963-4410-bf49-14e3d34942be tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa" status: 404 len: 111 microversion: 2.1 time: 0.031410 Oct 01 21:47:47.100691 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2258/6503] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:47 2022] GET /compute/v2.1/servers/19ffe84e-6e41-4bc0-b0b4-0c7c1b9395aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:47:47.105589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:47.106099 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:47.112583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.113086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.113536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.114238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.114761 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.115207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.129418 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 HTTP/1.1 Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e7d01772-9636-4eac-ae93-7d15d92858e3'} Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:47.130995 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2156b1e5-6e6d-461e-99c5-cab65dfe92a3 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 404 len: 111 microversion: 2.1 time: 0.030645 Oct 01 21:47:47.135695 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4246/6504] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:47:47 2022] DELETE /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:47:47.140735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:47.141396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e7d01772-9636-4eac-ae93-7d15d92858e3] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:47.147491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.147989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.148437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.149144 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.149613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.150047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.163538 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 HTTP/1.1 Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e7d01772-9636-4eac-ae93-7d15d92858e3'} Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.165092 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance e7d01772-9636-4eac-ae93-7d15d92858e3 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e298f5e-d3a5-4e19-9ce6-050a5b5ddd9d tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3" status: 404 len: 111 microversion: 2.1 time: 0.029644 Oct 01 21:47:47.170196 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2259/6505] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:47 2022] GET /compute/v2.1/servers/e7d01772-9636-4eac-ae93-7d15d92858e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:47:47.175437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:47.175953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:47.182097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.182636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.183092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.183793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.184264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.184704 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.198613 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 HTTP/1.1 Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '9527b1f5-695e-4e73-acfe-be646ed69669'} Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:47.200148 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d695d9aa-dd51-429e-bdf3-6ab226dbadd4 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 404 len: 111 microversion: 2.1 time: 0.030518 Oct 01 21:47:47.204794 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4247/6506] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:47:47 2022] DELETE /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:47:47.209928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:47.210588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: 9527b1f5-695e-4e73-acfe-be646ed69669] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:47.216656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.217151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.217603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.218342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.218838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.219274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.232754 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 HTTP/1.1 Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '9527b1f5-695e-4e73-acfe-be646ed69669'} Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.234715 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance 9527b1f5-695e-4e73-acfe-be646ed69669 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3d479de2-2e72-4e6d-9581-b02ab3b748e1 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669" status: 404 len: 111 microversion: 2.1 time: 0.030274 Oct 01 21:47:47.240202 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2260/6507] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:47 2022] GET /compute/v2.1/servers/9527b1f5-695e-4e73-acfe-be646ed69669 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:47:47.245660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:47.246174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:47.253095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.253691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.254146 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.254884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.255355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.255796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.273880 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 HTTP/1.1 Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'e397d496-340e-4ec6-9c99-42c52713f796'} Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:47.275403 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-269c6abc-facd-43b1-8ce7-83cedd5d6d01 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 404 len: 111 microversion: 2.1 time: 0.035132 Oct 01 21:47:47.283358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4248/6508] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:47:47 2022] DELETE /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:47:47.288404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:47.289035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] [instance: e397d496-340e-4ec6-9c99-42c52713f796] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:47.295128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.295626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.296079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.296812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:47.297279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:47.297713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:47.312013 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] HTTP exception thrown: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Request method failure captured: Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 HTTP/1.1 Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLRDpEGzYsDr_Go6qjbFqPBm3qtgOUzWJ7nzLrdDLe5cEWiME8DAJu0rK700JhLBDKdmrOnS5-eWLWYDgoMJE2_jxfsrEh5EV63dly51PP29R-KV4P89uS6JUySEQ994Y7C7JER5eTTI4schpc4gW82P790-HK7YO1_UbHI6ERDMwoo Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae55f903ff94436b8d907d865581cffd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae55f903ff94436b8d907d865581cffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae55f903ff94436b8d907d865581cffd"}]}] Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: ae55f903ff94436b8d907d865581cffd Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServerActionsTestJSON-356248320 Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 87e5b194ad2745b6af1f6ad76dd94881 Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServerActionsTestJSON-356248320-project Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'e397d496-340e-4ec6-9c99-42c52713f796'} Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:47:47.313514 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Returning 404 to user: Instance e397d496-340e-4ec6-9c99-42c52713f796 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0e80790a-27f5-48ca-ac8a-524de9639bb8 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796" status: 404 len: 111 microversion: 2.1 time: 0.031654 Oct 01 21:47:47.319057 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2261/6509] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:47 2022] GET /compute/v2.1/servers/e397d496-340e-4ec6-9c99-42c52713f796 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:47:47.324218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a605695c-441d-4b77-8816-189484855990 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] Calling method '.version_select at 0x7f417303af70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:47.346473 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a605695c-441d-4b77-8816-189484855990 tempest-ServerActionsTestJSON-356248320 tempest-ServerActionsTestJSON-356248320-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928138378" status: 202 len: 0 microversion: 2.1 time: 0.026067 Oct 01 21:47:47.347055 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4249/6510] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Oct 1 21:47:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928138378 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:47:56.623523 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-4390539", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "c88eed7e-b580-4acf-acf5-e168b9d9df6d"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:56.677601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] validate_networks() for [('c88eed7e-b580-4acf-acf5-e168b9d9df6d', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:47:57.055325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:47:57.055755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:47:57.056418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:47:57.056841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:47:57.057267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:47:57.067733 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:57.068244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:57.068683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:57.069417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:57.069901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:57.070375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:57.088812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Getting quotas for project 486d273a605a489cb5acd91ef693ec38. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:47:57.094839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Getting quotas for user 309ad5bc59d84e409cc40374b070b2b8 and project 486d273a605a489cb5acd91ef693ec38. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:47:57.108097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:47:57.111174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:47:57.164583 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e9269368-a183-4c7e-bbf3-1ed129e89f45 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663975 Oct 01 21:47:57.165819 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2262/6511] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:47:57.178779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc3e081a-659b-481b-be73-37f43360c1b8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:57.179819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cc3e081a-659b-481b-be73-37f43360c1b8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:57.252782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc3e081a-659b-481b-be73-37f43360c1b8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:57.261545 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc3e081a-659b-481b-be73-37f43360c1b8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1214 microversion: 2.1 time: 0.088713 Oct 01 21:47:57.262436 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4250/6512] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:57 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:58.287221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:58.288075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:58.303137 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:58.305225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:58.305806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:58.306968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:58.307605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:58.308075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:58.400420 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:58.408969 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d12b5c01-0b02-4de3-afc5-5d915fea0e23 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1284 microversion: 2.1 time: 0.127177 Oct 01 21:47:58.426689 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2263/6513] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:58 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:59.433051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:47:59.433688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:47:59.435922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:47:59.443451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:59.444383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:59.445016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:59.445933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:59.446607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:59.447226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:59.682698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:47:59.693686 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ec1a2ec7-3f31-409f-adf5-e4921466118e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1314 microversion: 2.1 time: 0.264782 Oct 01 21:47:59.694287 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4251/6514] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:47:59 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:47:59.778761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-85c89087-356e-4407-a94b-b6541d4d7e85 req-b018f72e-1cb2-4a71-a862-f15350623511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e37742-4061-496a-be84-250319821eda", "tag": "d78b8dff-0379-4e9c-9181-c94dd5208e84"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:47:59.790239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-85c89087-356e-4407-a94b-b6541d4d7e85 req-b018f72e-1cb2-4a71-a862-f15350623511 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:47:59.797304 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-85c89087-356e-4407-a94b-b6541d4d7e85 req-b018f72e-1cb2-4a71-a862-f15350623511 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:47:59.797804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-85c89087-356e-4407-a94b-b6541d4d7e85 req-b018f72e-1cb2-4a71-a862-f15350623511 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:47:59.822621 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-85c89087-356e-4407-a94b-b6541d4d7e85 req-b018f72e-1cb2-4a71-a862-f15350623511 service nova] Creating event network-changed:d78b8dff-0379-4e9c-9181-c94dd5208e84 for instance 72e37742-4061-496a-be84-250319821eda on nch1-master-1 Oct 01 21:47:59.828054 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-85c89087-356e-4407-a94b-b6541d4d7e85 req-b018f72e-1cb2-4a71-a862-f15350623511 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053084 Oct 01 21:47:59.828698 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2264/6515] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:48:00.721300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:00.721944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:00.731249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:00.731766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:00.732231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:00.732950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:00.733435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:00.733888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:00.860217 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:00.868568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-321537fb-aa27-4cd9-99d8-d58358c5b926 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1314 microversion: 2.1 time: 0.151269 Oct 01 21:48:00.869154 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4252/6516] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:00 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:01.892310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:01.893691 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:01.900108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:01.900594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:01.901033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:01.901725 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:01.902183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:01.902647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:02.035071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:02.043088 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-21c12264-7243-4e6f-8584-fbcbbe5dc61e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1314 microversion: 2.1 time: 0.155255 Oct 01 21:48:02.043696 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2265/6517] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:01 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:03.065318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:03.065951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:03.068232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:03.073614 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:03.074113 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:03.074592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:03.075309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:03.075781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:03.076222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:03.214809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:03.223269 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-efba6fe1-df85-473c-91a8-e2a6f368b970 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1314 microversion: 2.1 time: 0.161899 Oct 01 21:48:03.223858 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4253/6518] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:03 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:04.245335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:04.245989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:04.248864 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:04.254232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:04.254749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:04.255197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:04.255897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:04.256361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:04.256793 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:04.261615 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=86 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:04.394670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:04.403237 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6413c138-9905-4e37-9e30-a60290a266a6 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1314 microversion: 2.1 time: 0.161772 Oct 01 21:48:04.403858 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2266/6519] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:04 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:05.268970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-fa60a5aa-fe92-4ff4-a446-6be3c62a8d43 req-8cc981f6-93f4-41cb-8182-8c9f5a975ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e37742-4061-496a-be84-250319821eda", "name": "network-vif-plugged", "status": "completed", "tag": "d78b8dff-0379-4e9c-9181-c94dd5208e84"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:48:05.280990 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fa60a5aa-fe92-4ff4-a446-6be3c62a8d43 req-8cc981f6-93f4-41cb-8182-8c9f5a975ae5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:05.281515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fa60a5aa-fe92-4ff4-a446-6be3c62a8d43 req-8cc981f6-93f4-41cb-8182-8c9f5a975ae5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:05.281978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fa60a5aa-fe92-4ff4-a446-6be3c62a8d43 req-8cc981f6-93f4-41cb-8182-8c9f5a975ae5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:05.293949 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-fa60a5aa-fe92-4ff4-a446-6be3c62a8d43 req-8cc981f6-93f4-41cb-8182-8c9f5a975ae5 service nova] Creating event network-vif-plugged:d78b8dff-0379-4e9c-9181-c94dd5208e84 for instance 72e37742-4061-496a-be84-250319821eda on nch1-master-1 Oct 01 21:48:05.299649 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-fa60a5aa-fe92-4ff4-a446-6be3c62a8d43 req-8cc981f6-93f4-41cb-8182-8c9f5a975ae5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033884 Oct 01 21:48:05.300259 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4254/6520] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:48:05.427547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:05.428168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:05.437503 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:05.438002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:05.438443 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:05.439179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:05.440275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:05.440713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:05.574096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:05.581914 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ba268b96-f379-4fd7-81e2-318d49d0ab63 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1314 microversion: 2.1 time: 0.158988 Oct 01 21:48:05.582527 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2267/6521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:05 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:06.605708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:06.606350 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:06.614465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:06.615002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:06.615540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:06.616342 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:06.616884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:06.617407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:06.752121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:06.760737 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d12c174f-fe78-4434-be89-1bebd76786e3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1503 microversion: 2.1 time: 0.159400 Oct 01 21:48:06.761328 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4255/6522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:06 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:06.828720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-528254979", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "c88eed7e-b580-4acf-acf5-e168b9d9df6d"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:48:06.882001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] validate_networks() for [('c88eed7e-b580-4acf-acf5-e168b9d9df6d', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:48:07.076516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:07.102947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:07.321298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:48:07.321762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:48:07.322253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:48:07.322715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:48:07.323143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:48:07.335683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:07.336187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:07.336637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:07.337388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:07.337857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:07.338297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:07.358355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Getting quotas for project 486d273a605a489cb5acd91ef693ec38. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:48:07.363698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Getting quotas for user 309ad5bc59d84e409cc40374b070b2b8 and project 486d273a605a489cb5acd91ef693ec38. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:48:07.376166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:48:07.378450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:48:07.425487 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0b2b8f30-4b1b-4948-9a53-86765a82aceb tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600572 Oct 01 21:48:07.426164 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2268/6523] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:48:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:48:07.437723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-16e9ea97-0c67-4473-ae4c-33f094388f1b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:07.438971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-16e9ea97-0c67-4473-ae4c-33f094388f1b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:07.442141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:07.497571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-16e9ea97-0c67-4473-ae4c-33f094388f1b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:07.507326 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-16e9ea97-0c67-4473-ae4c-33f094388f1b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1216 microversion: 2.1 time: 0.073706 Oct 01 21:48:07.507943 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4256/6524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:07 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:08.531794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:08.532426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:08.540259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:08.540783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:08.541231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:08.541941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:08.542406 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:08.542873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:08.610367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:08.619135 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-239c0e64-e51a-4993-a582-3b43be6a00de tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1274 microversion: 2.1 time: 0.092187 Oct 01 21:48:08.619637 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2269/6525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:08 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:09.648092 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:09.648727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:09.656344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:09.656850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:09.657409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:09.658004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:09.658475 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:09.658944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:09.754105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-4a0ce581-ebda-4dac-84ae-d2d61278e52e req-bc641f87-619a-4bf8-926d-aa265a547224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa3319b-70cc-4363-a0b6-56d37c4fbfa8", "tag": "aa3203ee-d1e9-41ac-989e-1de8929c00f7"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:48:09.772051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4a0ce581-ebda-4dac-84ae-d2d61278e52e req-bc641f87-619a-4bf8-926d-aa265a547224 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:09.772876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4a0ce581-ebda-4dac-84ae-d2d61278e52e req-bc641f87-619a-4bf8-926d-aa265a547224 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:09.773314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-4a0ce581-ebda-4dac-84ae-d2d61278e52e req-bc641f87-619a-4bf8-926d-aa265a547224 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:09.785555 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-4a0ce581-ebda-4dac-84ae-d2d61278e52e req-bc641f87-619a-4bf8-926d-aa265a547224 service nova] Creating event network-changed:aa3203ee-d1e9-41ac-989e-1de8929c00f7 for instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 on nch2-master-1 Oct 01 21:48:09.790608 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-4a0ce581-ebda-4dac-84ae-d2d61278e52e req-bc641f87-619a-4bf8-926d-aa265a547224 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041711 Oct 01 21:48:09.791227 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2270/6526] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:48:09.806160 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:09.814794 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2f6baf04-2bcc-48ad-9e03-15b46cee914e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1316 microversion: 2.1 time: 0.170561 Oct 01 21:48:09.815940 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4257/6527] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:09 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:10.839485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:10.840233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:10.846591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:10.847091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:10.847539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:10.848249 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:10.848718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:10.849155 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:11.017174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:11.030811 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7e949ef2-93a6-4555-ac64-c953feebaed7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1316 microversion: 2.1 time: 0.191424 Oct 01 21:48:11.031665 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2271/6528] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:10 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:12.053393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:12.054029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:12.061281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:12.061784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:12.062236 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:12.062971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:12.063443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:12.063886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:12.196451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:12.204250 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9841f791-ef55-43b6-abd1-db0044651d35 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1316 microversion: 2.1 time: 0.154805 Oct 01 21:48:12.204839 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4258/6529] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:12 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:13.227437 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:13.228026 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:13.235001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:13.235528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:13.235945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:13.236663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:13.237801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:13.238237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:13.374821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:13.382735 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a0f3bc0b-b000-41c7-a580-4901dfe60cbf tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1316 microversion: 2.1 time: 0.159205 Oct 01 21:48:13.385004 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2272/6530] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:13 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:14.410300 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:14.410891 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:14.417777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:14.418277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:14.418758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:14.419462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:14.419931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:14.420370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:14.548495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:14.557047 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77cd3f7d-77fd-452d-b3e1-054e96062b25 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1316 microversion: 2.1 time: 0.150768 Oct 01 21:48:14.557617 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4259/6531] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:14 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:15.134093 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c2fb19e3-6ee3-4720-8efa-278bb15e0aef req-7ff64212-2d73-4482-83fb-fe4df2ec3405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa3319b-70cc-4363-a0b6-56d37c4fbfa8", "name": "network-vif-plugged", "status": "completed", "tag": "aa3203ee-d1e9-41ac-989e-1de8929c00f7"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:48:15.145074 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c2fb19e3-6ee3-4720-8efa-278bb15e0aef req-7ff64212-2d73-4482-83fb-fe4df2ec3405 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:15.145581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c2fb19e3-6ee3-4720-8efa-278bb15e0aef req-7ff64212-2d73-4482-83fb-fe4df2ec3405 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:15.146012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c2fb19e3-6ee3-4720-8efa-278bb15e0aef req-7ff64212-2d73-4482-83fb-fe4df2ec3405 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:15.157489 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c2fb19e3-6ee3-4720-8efa-278bb15e0aef req-7ff64212-2d73-4482-83fb-fe4df2ec3405 service nova] Creating event network-vif-plugged:aa3203ee-d1e9-41ac-989e-1de8929c00f7 for instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 on nch2-master-1 Oct 01 21:48:15.163080 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c2fb19e3-6ee3-4720-8efa-278bb15e0aef req-7ff64212-2d73-4482-83fb-fe4df2ec3405 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032718 Oct 01 21:48:15.163704 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2273/6532] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:48:15.579864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:15.580416 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:15.588000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:15.588510 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:15.588973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:15.589696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:15.590175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:15.590656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:15.720187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:15.728420 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8d3a6a66-cc46-4779-b238-37a4622e564b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1316 microversion: 2.1 time: 0.152610 Oct 01 21:48:15.729008 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4260/6533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:15 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:16.753677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:16.754374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:16.760611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:16.761094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:16.761532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:16.762220 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:16.762712 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:16.763140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:16.893817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:16.901598 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-531f9e7d-174d-4155-8ce3-54243071e84f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1505 microversion: 2.1 time: 0.153665 Oct 01 21:48:16.902176 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2274/6534] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:16 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:16.924043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:16.924724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:16.931980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:16.932531 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:16.932992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:16.933713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:16.934193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:16.934692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:16.960503 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:48:17.036042 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bb2c630a-ea82-4968-a012-b05c5d8c2d5b tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 204 len: 0 microversion: 2.1 time: 0.115591 Oct 01 21:48:17.036649 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4261/6535] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:48:16 2022] DELETE /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:48:17.044836 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:17.045567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:17.051604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:17.052095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:17.052539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:17.053237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:17.053698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:17.054380 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:17.182020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:17.189795 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-97edf69e-5fad-4af6-b76c-324999bc914f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1511 microversion: 2.1 time: 0.149027 Oct 01 21:48:17.191036 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2275/6536] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:17 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:18.214208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:18.214970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:18.217038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:18.227873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:18.228396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:18.228867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:18.229595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:18.230074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:18.230547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:18.363713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:18.371530 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ff432bd8-7a76-4502-a2b3-fd30d20b082f tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 200 len: 1511 microversion: 2.1 time: 0.161685 Oct 01 21:48:18.372149 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4262/6537] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:18 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:18.795628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f1c5567f-9e26-4911-af15-66765b6ad559 req-80f57e1c-3dd5-43e1-a841-d590b89b6682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa3319b-70cc-4363-a0b6-56d37c4fbfa8", "name": "network-vif-deleted", "tag": "aa3203ee-d1e9-41ac-989e-1de8929c00f7"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:48:18.802142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:18.805487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:18.825651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f1c5567f-9e26-4911-af15-66765b6ad559 req-80f57e1c-3dd5-43e1-a841-d590b89b6682 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:18.826135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f1c5567f-9e26-4911-af15-66765b6ad559 req-80f57e1c-3dd5-43e1-a841-d590b89b6682 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:18.827999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f1c5567f-9e26-4911-af15-66765b6ad559 req-80f57e1c-3dd5-43e1-a841-d590b89b6682 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:18.846122 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f1c5567f-9e26-4911-af15-66765b6ad559 req-80f57e1c-3dd5-43e1-a841-d590b89b6682 service nova] Creating event network-vif-deleted:aa3203ee-d1e9-41ac-989e-1de8929c00f7 for instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 on nch2-master-1 Oct 01 21:48:18.851663 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f1c5567f-9e26-4911-af15-66765b6ad559 req-80f57e1c-3dd5-43e1-a841-d590b89b6682 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063475 Oct 01 21:48:18.852627 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2276/6538] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:48:19.395292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:19.395902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:19.402800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.403305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.403803 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:19.404546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.405024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.405471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:19.420081 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] HTTP exception thrown: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Request method failure captured: Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 HTTP/1.1 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLWMEWJKQQxfsndAVvhm1BxsHRY_KORwsPr-QJ1kZkHYLE_tMkDtgPqGHtEYucSBiJDXYEQJriqjMOA_L9111o5JZsi52fTVCQBSRbgPwDSgvPLPF90DKcl0T28fo8l5MpzG9lhnSlzthuZiFnczFAMeZh-lW-oiPU_yIMHkaWKKhlo Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_486d273a605a489cb5acd91ef693ec38", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}] Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 309ad5bc59d84e409cc40374b070b2b8 Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'cfa3319b-70cc-4363-a0b6-56d37c4fbfa8'} Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:19.421749 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Returning 404 to user: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-30ed4609-b801-4bbd-9289-d0d3b4703524 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 404 len: 111 microversion: 2.1 time: 0.032486 Oct 01 21:48:19.426635 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4263/6539] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:19 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:48:19.436418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:19.437565 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:19.446802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.447542 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.448215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:19.449284 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.449998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.450695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:19.582539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:19.590477 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-00acb15e-ccd4-4d67-a994-ce922d2abea8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1503 microversion: 2.1 time: 0.161235 Oct 01 21:48:19.591080 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2277/6540] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:19 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:19.613124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-65a65dfc-14c3-48c8-b240-f4e6b2f943c8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:48:19.615421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-65a65dfc-14c3-48c8-b240-f4e6b2f943c8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 6b5acd11-1d55-44ec-98ac-233785ba045a] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:19.621035 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-65a65dfc-14c3-48c8-b240-f4e6b2f943c8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] HTTP exception thrown: Instance 6b5acd11-1d55-44ec-98ac-233785ba045a could not be found. Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-65a65dfc-14c3-48c8-b240-f4e6b2f943c8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Request method failure captured: Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/6b5acd11-1d55-44ec-98ac-233785ba045a/action HTTP/1.1 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 32 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLWMEWJKQQxfsndAVvhm1BxsHRY_KORwsPr-QJ1kZkHYLE_tMkDtgPqGHtEYucSBiJDXYEQJriqjMOA_L9111o5JZsi52fTVCQBSRbgPwDSgvPLPF90DKcl0T28fo8l5MpzG9lhnSlzthuZiFnczFAMeZh-lW-oiPU_yIMHkaWKKhlo Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_486d273a605a489cb5acd91ef693ec38", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}] Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 309ad5bc59d84e409cc40374b070b2b8 Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: {"resize": {"flavorRef": "452"}} Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 6b5acd11-1d55-44ec-98ac-233785ba045a could not be found. Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '6b5acd11-1d55-44ec-98ac-233785ba045a', 'body': {'resize': {'flavorRef': '452'}}} Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b5acd11-1d55-44ec-98ac-233785ba045a could not be found. Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:48:19.622668 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b5acd11-1d55-44ec-98ac-233785ba045a could not be found. Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b5acd11-1d55-44ec-98ac-233785ba045a could not be found. Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-65a65dfc-14c3-48c8-b240-f4e6b2f943c8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Returning 404 to user: Instance 6b5acd11-1d55-44ec-98ac-233785ba045a could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-65a65dfc-14c3-48c8-b240-f4e6b2f943c8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "POST /compute/v2.1/servers/6b5acd11-1d55-44ec-98ac-233785ba045a/action" status: 404 len: 111 microversion: 2.1 time: 0.014947 Oct 01 21:48:19.627779 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4264/6541] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:48:19 2022] POST /compute/v2.1/servers/6b5acd11-1d55-44ec-98ac-233785ba045a/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:48:19.632761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:19.633388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:19.639392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.639885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.640331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:19.641038 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.641501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.641932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:19.769898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:19.777990 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-16cbe7c9-e752-4a98-9425-bcfc81b299f3 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1503 microversion: 2.1 time: 0.149021 Oct 01 21:48:19.778624 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2278/6542] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:19 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:48:19.802519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:19.803079 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:19.810313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.810838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.811288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:19.811991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.812459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.812899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:19.938811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:19.947768 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ceb33945-13de-4f25-954d-ee9756f3b850 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1503 microversion: 2.1 time: 0.148876 Oct 01 21:48:19.948781 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4265/6543] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:19 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:19.970993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ce75b7e5-c774-4e52-a0ed-d6bd5494e5e4"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:48:19.973278 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:19.980354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.980847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.981292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:19.981998 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:19.982467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:19.982946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.015585 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:20.021008 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] HTTP exception thrown: Flavor ce75b7e5-c774-4e52-a0ed-d6bd5494e5e4 could not be found. Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Request method failure captured: Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: request: POST /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda/action HTTP/1.1 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 65 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLWMEWJKQQxfsndAVvhm1BxsHRY_KORwsPr-QJ1kZkHYLE_tMkDtgPqGHtEYucSBiJDXYEQJriqjMOA_L9111o5JZsi52fTVCQBSRbgPwDSgvPLPF90DKcl0T28fo8l5MpzG9lhnSlzthuZiFnczFAMeZh-lW-oiPU_yIMHkaWKKhlo Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_486d273a605a489cb5acd91ef693ec38", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}] Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 309ad5bc59d84e409cc40374b070b2b8 Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: {"resize": {"flavorRef": "ce75b7e5-c774-4e52-a0ed-d6bd5494e5e4"}} Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: exception: Flavor ce75b7e5-c774-4e52-a0ed-d6bd5494e5e4 could not be found. Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '72e37742-4061-496a-be84-250319821eda', 'body': {'resize': {'flavorRef': 'ce75b7e5-c774-4e52-a0ed-d6bd5494e5e4'}}} Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:48:20.022946 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ce75b7e5-c774-4e52-a0ed-d6bd5494e5e4 could not be found. Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ce75b7e5-c774-4e52-a0ed-d6bd5494e5e4 could not be found. Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ce75b7e5-c774-4e52-a0ed-d6bd5494e5e4 could not be found. Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Returning 400 to user: Flavor ce75b7e5-c774-4e52-a0ed-d6bd5494e5e4 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-50e77823-39ac-465d-b4e0-59a3eb2c26b2 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "POST /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda/action" status: 400 len: 107 microversion: 2.1 time: 0.057462 Oct 01 21:48:20.027986 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2279/6544] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:48:19 2022] POST /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda/action => generated 107 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:48:20.038540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:20.039186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:20.045277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.045783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.046474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.047016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.047496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.047943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.177813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:20.185970 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3af94bf8-fba3-48bb-8829-20b8a4dc2ee8 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1503 microversion: 2.1 time: 0.151521 Oct 01 21:48:20.186608 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4266/6545] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:20 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:20.210930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:20.211553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:20.218000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.218520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.218959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.219657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.220120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.220550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.354009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:20.362527 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b5eb4164-5743-4eff-bbe7-846b387e4706 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1503 microversion: 2.1 time: 0.155014 Oct 01 21:48:20.363109 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2280/6546] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:20 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:20.385063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f22a514-f271-46c0-8272-20d6b7393214 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f22a514-f271-46c0-8272-20d6b7393214 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Request method failure captured: Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: request: POST /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda/action HTTP/1.1 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 29 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLWMEWJKQQxfsndAVvhm1BxsHRY_KORwsPr-QJ1kZkHYLE_tMkDtgPqGHtEYucSBiJDXYEQJriqjMOA_L9111o5JZsi52fTVCQBSRbgPwDSgvPLPF90DKcl0T28fo8l5MpzG9lhnSlzthuZiFnczFAMeZh-lW-oiPU_yIMHkaWKKhlo Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_486d273a605a489cb5acd91ef693ec38", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}] Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 309ad5bc59d84e409cc40374b070b2b8 Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: {"resize": {"flavorRef": ""}} Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '72e37742-4061-496a-be84-250319821eda', 'body': {'resize': {'flavorRef': ''}}} Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise error Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi '' Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.388591 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f22a514-f271-46c0-8272-20d6b7393214 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f22a514-f271-46c0-8272-20d6b7393214 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "POST /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda/action" status: 400 len: 113 microversion: 2.1 time: 0.009054 Oct 01 21:48:20.393911 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4267/6547] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:48:20 2022] POST /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda/action => generated 113 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 21:48:20.401661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:20.402339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:20.408455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.408921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.409367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.410080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.410556 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.410991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.545165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:20.553666 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-89c4984e-809a-46b6-a71f-7078d6036d64 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1503 microversion: 2.1 time: 0.156024 Oct 01 21:48:20.554530 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2281/6548] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:20 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:20.580058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:20.580639 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:20.587922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.588437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.588901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.589622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.590101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.590582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.604121 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] HTTP exception thrown: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Request method failure captured: Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: request: DELETE /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 HTTP/1.1 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLWMEWJKQQxfsndAVvhm1BxsHRY_KORwsPr-QJ1kZkHYLE_tMkDtgPqGHtEYucSBiJDXYEQJriqjMOA_L9111o5JZsi52fTVCQBSRbgPwDSgvPLPF90DKcl0T28fo8l5MpzG9lhnSlzthuZiFnczFAMeZh-lW-oiPU_yIMHkaWKKhlo Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_486d273a605a489cb5acd91ef693ec38", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}] Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 309ad5bc59d84e409cc40374b070b2b8 Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'cfa3319b-70cc-4363-a0b6-56d37c4fbfa8'} Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:48:20.605688 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Returning 404 to user: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4e8f52d2-8749-4f31-8faf-ecda1ec2891d tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 404 len: 111 microversion: 2.1 time: 0.031898 Oct 01 21:48:20.610371 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4268/6549] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:48:20 2022] DELETE /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:48:20.617158 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:20.617790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: cfa3319b-70cc-4363-a0b6-56d37c4fbfa8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:20.623835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.624322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.624762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.625460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.625917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.626349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.640397 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] HTTP exception thrown: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Request method failure captured: Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 HTTP/1.1 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLWMEWJKQQxfsndAVvhm1BxsHRY_KORwsPr-QJ1kZkHYLE_tMkDtgPqGHtEYucSBiJDXYEQJriqjMOA_L9111o5JZsi52fTVCQBSRbgPwDSgvPLPF90DKcl0T28fo8l5MpzG9lhnSlzthuZiFnczFAMeZh-lW-oiPU_yIMHkaWKKhlo Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_486d273a605a489cb5acd91ef693ec38", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}] Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 309ad5bc59d84e409cc40374b070b2b8 Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'cfa3319b-70cc-4363-a0b6-56d37c4fbfa8'} Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:20.641917 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Returning 404 to user: Instance cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3cc2a13b-fa9a-4265-a282-70e351fb8ac7 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8" status: 404 len: 111 microversion: 2.1 time: 0.030051 Oct 01 21:48:20.647009 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2282/6550] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:20 2022] GET /compute/v2.1/servers/cfa3319b-70cc-4363-a0b6-56d37c4fbfa8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:48:20.651863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:20.652381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:20.658354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.659406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.659858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.660562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.661035 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.661478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.688129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:48:20.722923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:48:20.763854 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9ccee9f5-7a01-4a67-806c-53d9525e5455 tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "DELETE /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 204 len: 0 microversion: 2.1 time: 0.115622 Oct 01 21:48:20.764744 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4269/6551] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:48:20 2022] DELETE /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:48:20.774033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:20.774789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:20.780761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.781243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.781685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.782376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:20.782860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:20.783293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:20.914815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:20.922682 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6c70ea93-0e59-447c-9673-ad17211c3b2e tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1509 microversion: 2.1 time: 0.152727 Oct 01 21:48:20.923253 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2283/6552] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:20 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:21.946167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:21.946919 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:21.953700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:21.954225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:21.954722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:21.955434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:21.955912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:21.956357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:22.089193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309ad5bc59d84e409cc40374b070b2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d273a605a489cb5acd91ef693ec38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:48:22.097610 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c9f0ddf7-b1ee-4f4e-85e8-c0247173422c tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 200 len: 1509 microversion: 2.1 time: 0.155716 Oct 01 21:48:22.098190 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4270/6553] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:21 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:48:22.596766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-8f18bba2-1538-4add-9d56-61060e9b62ba req-2254847e-7475-44a3-b48c-ef9ea23e6f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e37742-4061-496a-be84-250319821eda", "name": "network-vif-deleted", "tag": "d78b8dff-0379-4e9c-9181-c94dd5208e84"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:48:22.607710 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8f18bba2-1538-4add-9d56-61060e9b62ba req-2254847e-7475-44a3-b48c-ef9ea23e6f6a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:22.608204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8f18bba2-1538-4add-9d56-61060e9b62ba req-2254847e-7475-44a3-b48c-ef9ea23e6f6a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:22.608650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-8f18bba2-1538-4add-9d56-61060e9b62ba req-2254847e-7475-44a3-b48c-ef9ea23e6f6a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:22.621955 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-8f18bba2-1538-4add-9d56-61060e9b62ba req-2254847e-7475-44a3-b48c-ef9ea23e6f6a service nova] Creating event network-vif-deleted:d78b8dff-0379-4e9c-9181-c94dd5208e84 for instance 72e37742-4061-496a-be84-250319821eda on nch1-master-1 Oct 01 21:48:22.628029 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-8f18bba2-1538-4add-9d56-61060e9b62ba req-2254847e-7475-44a3-b48c-ef9ea23e6f6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035490 Oct 01 21:48:22.628719 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2284/6554] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:48:23.121918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:48:23.122789 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] [instance: 72e37742-4061-496a-be84-250319821eda] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:48:23.130993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:23.131504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:23.131962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:23.132715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:48:23.133542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:48:23.134165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:48:23.148006 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] HTTP exception thrown: Instance 72e37742-4061-496a-be84-250319821eda could not be found. Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Request method failure captured: Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda HTTP/1.1 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLWMEWJKQQxfsndAVvhm1BxsHRY_KORwsPr-QJ1kZkHYLE_tMkDtgPqGHtEYucSBiJDXYEQJriqjMOA_L9111o5JZsi52fTVCQBSRbgPwDSgvPLPF90DKcl0T28fo8l5MpzG9lhnSlzthuZiFnczFAMeZh-lW-oiPU_yIMHkaWKKhlo Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_486d273a605a489cb5acd91ef693ec38", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/486d273a605a489cb5acd91ef693ec38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486d273a605a489cb5acd91ef693ec38"}]}] Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 486d273a605a489cb5acd91ef693ec38 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1014789277 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 309ad5bc59d84e409cc40374b070b2b8 Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-ServersNegativeTestJSON-1014789277-project Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 72e37742-4061-496a-be84-250319821eda could not be found. Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '72e37742-4061-496a-be84-250319821eda'} Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e37742-4061-496a-be84-250319821eda could not be found. Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e37742-4061-496a-be84-250319821eda could not be found. Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:48:23.149678 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e37742-4061-496a-be84-250319821eda could not be found. Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] Returning 404 to user: Instance 72e37742-4061-496a-be84-250319821eda could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb01e34f-b34a-47e0-aa4b-d64a2fc54caa tempest-ServersNegativeTestJSON-1014789277 tempest-ServersNegativeTestJSON-1014789277-project] 10.222.0.17 "GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda" status: 404 len: 111 microversion: 2.1 time: 0.034032 Oct 01 21:48:23.154049 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4271/6555] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:48:23 2022] GET /compute/v2.1/servers/72e37742-4061-496a-be84-250319821eda => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:49:05.109777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8fca3875-d48b-47f3-a6e0-9a887aba5411 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'create', calling method: .version_select at 0x7f41733263a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-925767579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFQpgJOVozs5DE/uRRGJRn5PRjX3rKoh0lfYuOJ51ocI8u4nD583hKv2UYugqWL+d4LVDmK5iG9/9DXO3xRZ7ELuj23mdl/XAnfo2FzPYYX12dKEVJ1EEmPmTs6hlOZuQ=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:49:05.115870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:49:05.116611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=87 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:49:05.117471 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:49:05.117678 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:49:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.17) !!! Oct 01 21:49:05.134695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8fca3875-d48b-47f3-a6e0-9a887aba5411 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Getting quotas for project f02c2d9ca9fa43bdad1329ff8583b742. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:49:05.143342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-8fca3875-d48b-47f3-a6e0-9a887aba5411 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Getting quotas for user 0d1d8f5e9d074c2a89f5cf7c874392ac and project f02c2d9ca9fa43bdad1329ff8583b742. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:49:05.181366 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8fca3875-d48b-47f3-a6e0-9a887aba5411 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.075860 Oct 01 21:49:05.181978 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2285/6556] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:49:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:49:05.257228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1194038070", "imageRef": "eb6c348b-7eaa-4df6-bf63-7c9dcb672573", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-925767579", "networks": [{"uuid": "e9f0dd04-450f-4460-a4c8-e07fa242d89a"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:49:05.266395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:49:05.267100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:49:05.268651 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:49:05.268793 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:49:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 01 21:49:05.322190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] validate_networks() for [('e9f0dd04-450f-4460-a4c8-e07fa242d89a', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:49:05.828694 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:49:05.829147 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:49:05.829650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:49:05.830795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:49:05.831282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:49:05.842587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:05.843086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:05.843546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:05.844313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:05.844787 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:05.845238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:05.865181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Getting quotas for project f02c2d9ca9fa43bdad1329ff8583b742. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:49:05.870580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Getting quotas for user 0d1d8f5e9d074c2a89f5cf7c874392ac and project f02c2d9ca9fa43bdad1329ff8583b742. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:49:05.883652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:49:05.885955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eb6c348b-7eaa-4df6-bf63-7c9dcb672573',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:49:05.933275 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d3f93371-11e0-4a0d-aa47-ae8d3a429783 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680197 Oct 01 21:49:05.933935 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4272/6557] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:49:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:49:05.945058 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b379399e-7a67-443f-85aa-ca54e00ecab0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:05.945805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b379399e-7a67-443f-85aa-ca54e00ecab0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:06.001174 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b379399e-7a67-443f-85aa-ca54e00ecab0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:06.009569 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b379399e-7a67-443f-85aa-ca54e00ecab0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1258 microversion: 2.1 time: 0.068397 Oct 01 21:49:06.010170 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2286/6558] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:05 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:07.042298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:07.043601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:07.054670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:07.055293 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:07.055786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:07.056495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:07.057139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:07.057592 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:07.150318 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:07.159820 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b424e41e-2f8d-4de8-bc77-76bf43f20701 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1316 microversion: 2.1 time: 0.125811 Oct 01 21:49:07.160444 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4273/6559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:07 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1316 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:08.184400 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:08.185194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:08.194544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:08.195060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:08.195514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:08.196242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:08.196718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:08.197157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:08.336396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:08.344559 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ea52840b-7540-4618-86f5-ac82fdd5ae7d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.164446 Oct 01 21:49:08.345140 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2287/6560] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:08 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:09.368054 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:09.368775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:09.376478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:09.377496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:09.377960 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:09.378732 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:09.379534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:09.379650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:09.552884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:09.561111 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-33831c55-53b2-4220-a55f-aa9282f8d5f7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.197551 Oct 01 21:49:09.561689 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4274/6561] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:09 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:10.593564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:10.594265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:10.602572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:10.603075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:10.603518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:10.604251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:10.604717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:10.605147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:10.764361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:10.773365 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d194f595-636e-4056-941e-11748fe6d958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.183963 Oct 01 21:49:10.773965 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2288/6562] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:10 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:11.801271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:11.802401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:11.816206 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:11.816724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:11.817213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:11.818125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:11.818674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:11.819124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:11.985501 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:11.993879 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac9edd13-e330-4c38-9c9b-907ce28891f4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.199273 Oct 01 21:49:11.994683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4275/6563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:11 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:13.025517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:13.026315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:13.034466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:13.034466 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:13.034941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:13.035664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:13.036127 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:13.036560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:13.181033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:13.189919 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dbca261a-6daa-46f8-9cf9-393968031bec tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.176323 Oct 01 21:49:13.200068 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2289/6564] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:13 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:14.281654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:14.282252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:14.289405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:14.289916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:14.290382 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:14.291133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:14.291655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:14.292106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:14.432687 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:14.441397 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5964efc2-3cf9-4cc0-b251-8c4c50051edf tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.178206 Oct 01 21:49:14.441977 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4276/6565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:14 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:15.465288 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:15.465988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:15.473444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:15.473946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:15.474398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:15.475291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:15.475847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:15.476289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:15.608993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:15.617578 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b87e4ab6-14df-433c-9215-4e16fb5a055b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.156169 Oct 01 21:49:15.618467 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2290/6566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:15 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:15.637062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-dfab7745-fc13-4b93-90dd-7a8c819ceee7 req-bd3cf633-97a2-4354-9933-a9be0a69d91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08677322-e497-4759-8b0e-558daae10589", "tag": "437963a0-767e-448e-a527-184a3b5ed526"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:49:15.649553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dfab7745-fc13-4b93-90dd-7a8c819ceee7 req-bd3cf633-97a2-4354-9933-a9be0a69d91d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:15.650046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dfab7745-fc13-4b93-90dd-7a8c819ceee7 req-bd3cf633-97a2-4354-9933-a9be0a69d91d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:15.650746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-dfab7745-fc13-4b93-90dd-7a8c819ceee7 req-bd3cf633-97a2-4354-9933-a9be0a69d91d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:15.663636 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-dfab7745-fc13-4b93-90dd-7a8c819ceee7 req-bd3cf633-97a2-4354-9933-a9be0a69d91d service nova] Creating event network-changed:437963a0-767e-448e-a527-184a3b5ed526 for instance 08677322-e497-4759-8b0e-558daae10589 on nch1-master-1 Oct 01 21:49:15.668752 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-dfab7745-fc13-4b93-90dd-7a8c819ceee7 req-bd3cf633-97a2-4354-9933-a9be0a69d91d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036993 Oct 01 21:49:15.669367 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4277/6567] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:49:16.641321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:16.642459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:16.644375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:49:16.650381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:16.650915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:16.651352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:16.652077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:16.652534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:16.652962 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:16.784707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:16.792419 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-110deeba-7658-48f7-b0b1-c2fb5a513fa4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.155012 Oct 01 21:49:16.793005 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2291/6568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:16 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:17.816384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:17.817040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:17.819090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:49:17.819791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:49:17.827167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:17.827681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:17.828150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:17.828880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:17.829843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:17.830305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:17.971535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:17.979718 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-af10bc9a-aee7-4f86-9412-c2dd37764325 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.167737 Oct 01 21:49:17.980313 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4278/6569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:17 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:19.003319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:19.003946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:19.010877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:19.011398 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:19.011838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:19.012534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:19.012992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:19.013421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:19.140983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:19.149377 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9b77d8b9-78e9-4970-a49e-be0c4eb36b38 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.150557 Oct 01 21:49:19.149930 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2292/6570] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:18 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:19.643747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-fd5240ac-8754-4b64-9f6e-c78e54e4c4d6 req-eaf14e21-bea5-4638-881c-5ea72c641a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08677322-e497-4759-8b0e-558daae10589", "name": "network-vif-plugged", "status": "completed", "tag": "437963a0-767e-448e-a527-184a3b5ed526"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:49:19.654730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fd5240ac-8754-4b64-9f6e-c78e54e4c4d6 req-eaf14e21-bea5-4638-881c-5ea72c641a8c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:19.655306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fd5240ac-8754-4b64-9f6e-c78e54e4c4d6 req-eaf14e21-bea5-4638-881c-5ea72c641a8c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:19.655756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-fd5240ac-8754-4b64-9f6e-c78e54e4c4d6 req-eaf14e21-bea5-4638-881c-5ea72c641a8c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:19.667079 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-fd5240ac-8754-4b64-9f6e-c78e54e4c4d6 req-eaf14e21-bea5-4638-881c-5ea72c641a8c service nova] Creating event network-vif-plugged:437963a0-767e-448e-a527-184a3b5ed526 for instance 08677322-e497-4759-8b0e-558daae10589 on nch1-master-1 Oct 01 21:49:19.672070 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-fd5240ac-8754-4b64-9f6e-c78e54e4c4d6 req-eaf14e21-bea5-4638-881c-5ea72c641a8c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032202 Oct 01 21:49:19.672669 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4279/6571] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:49:20.172252 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:20.172878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:20.180797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:20.181292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:20.181740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:20.182453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:20.182943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:20.183378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:20.314389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:20.322115 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9daec94f-caeb-45e2-99c5-297a9fd766ee tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1358 microversion: 2.1 time: 0.153872 Oct 01 21:49:20.322735 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2293/6572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:20 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:21.347363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:21.348014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:21.354226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:21.354764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:21.355223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:21.355933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:21.356409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:21.356856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:21.492266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:21.500493 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-00470546-5437-4716-ab98-2238de8ffd09 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1548 microversion: 2.1 time: 0.158898 Oct 01 21:49:21.501091 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4280/6573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:21 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:21.522705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:21.523165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:21.530039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:21.530561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:21.531010 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:21.531721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:21.532183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:21.533130 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:21.665094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:21.673184 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-273688ae-125d-4cc7-9e40-0a90dfb53e02 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1548 microversion: 2.1 time: 0.154474 Oct 01 21:49:21.673815 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2294/6574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:21 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:21.695209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:21.699896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:21.700676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Searching by: {'deleted': False, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742'} {{(pid=140438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 21:49:21.707781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:21.708265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:21.708711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:21.709480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:21.709949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:21.710389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:21.737349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.multi_cell_list [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 21:49:21.763936 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-264b79f1-82a7-421d-802b-d7d8e3dc2ee3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072528 Oct 01 21:49:21.764529 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4281/6575] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 21:49:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:49:21.776779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:21.777424 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:21.784303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:21.784796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:21.785242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:21.785977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:21.786441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:21.786919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:21.919824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:21.927597 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0a1cfce0-1b70-48a1-b593-c5e1c3c22822 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1548 microversion: 2.1 time: 0.154826 Oct 01 21:49:21.928186 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2295/6576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:21 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:23.470935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3b7f1755-376c-4a08-aac6-93ed8d78365f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c5d3990-22f7-4f2d-a4eb-af828a87f071"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:49:23.473312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3b7f1755-376c-4a08-aac6-93ed8d78365f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:23.480266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b7f1755-376c-4a08-aac6-93ed8d78365f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:23.480770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b7f1755-376c-4a08-aac6-93ed8d78365f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:23.481226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b7f1755-376c-4a08-aac6-93ed8d78365f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:23.482012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b7f1755-376c-4a08-aac6-93ed8d78365f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:23.482508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b7f1755-376c-4a08-aac6-93ed8d78365f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:23.482974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3b7f1755-376c-4a08-aac6-93ed8d78365f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:23.717094 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3b7f1755-376c-4a08-aac6-93ed8d78365f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250057 Oct 01 21:49:23.717733 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4282/6577] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:49:23 2022] POST /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:49:28.318440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:28.319087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:28.325940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:28.326425 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:28.326895 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:28.327588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:28.328048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:28.328469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:28.459073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:28.467358 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-75d1f45b-7954-4af6-b404-39e8cf6d1207 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1594 microversion: 2.1 time: 0.153375 Oct 01 21:49:28.467938 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2296/6578] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:28 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:30.376811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-a6e5c313-2894-4898-9770-c5454d098e96 req-63a1da86-33cb-46c2-a813-08e7914cae32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08677322-e497-4759-8b0e-558daae10589", "tag": "437963a0-767e-448e-a527-184a3b5ed526"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:49:30.389383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a6e5c313-2894-4898-9770-c5454d098e96 req-63a1da86-33cb-46c2-a813-08e7914cae32 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:30.390028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a6e5c313-2894-4898-9770-c5454d098e96 req-63a1da86-33cb-46c2-a813-08e7914cae32 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:30.390583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-a6e5c313-2894-4898-9770-c5454d098e96 req-63a1da86-33cb-46c2-a813-08e7914cae32 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:30.404013 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-a6e5c313-2894-4898-9770-c5454d098e96 req-63a1da86-33cb-46c2-a813-08e7914cae32 service nova] Creating event network-changed:437963a0-767e-448e-a527-184a3b5ed526 for instance 08677322-e497-4759-8b0e-558daae10589 on nch1-master-1 Oct 01 21:49:30.409984 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-a6e5c313-2894-4898-9770-c5454d098e96 req-63a1da86-33cb-46c2-a813-08e7914cae32 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037474 Oct 01 21:49:30.411160 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4283/6579] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:49:31.607009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1443727653"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:49:31.608256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:31.615194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:31.615700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:31.616157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:31.616886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:31.617354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:31.617795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:31.757864 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.network.security_group_api [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Adding security group 599e8354-4af9-4dcf-88c2-339d847656f1 to port 437963a0-767e-448e-a527-184a3b5ed526 Oct 01 21:49:32.064739 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-09f98371-5265-4624-967f-8ee17baeeb30 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/action" status: 202 len: 0 microversion: 2.1 time: 0.464273 Oct 01 21:49:32.065819 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2297/6580] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:49:31 2022] POST /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 21:49:32.073983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:49:32.074733 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:49:32.077600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:49:32.084392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:32.084975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:32.085370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:32.086091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:32.086594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:32.087046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:32.235610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:49:32.244203 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-154dcf56-1b6b-42ff-8b6a-72e0ad6ef221 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1760 microversion: 2.1 time: 0.174347 Oct 01 21:49:32.244931 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4284/6581] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:49:32 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:49:32.426223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-81ec9045-949a-46b3-bd34-480acf6c1648 req-84037dca-f89c-4efa-806c-f7caac34dfcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08677322-e497-4759-8b0e-558daae10589", "tag": "437963a0-767e-448e-a527-184a3b5ed526"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:49:32.436088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-81ec9045-949a-46b3-bd34-480acf6c1648 req-84037dca-f89c-4efa-806c-f7caac34dfcf service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:49:32.436571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-81ec9045-949a-46b3-bd34-480acf6c1648 req-84037dca-f89c-4efa-806c-f7caac34dfcf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:49:32.437009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-81ec9045-949a-46b3-bd34-480acf6c1648 req-84037dca-f89c-4efa-806c-f7caac34dfcf service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:49:32.449806 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-81ec9045-949a-46b3-bd34-480acf6c1648 req-84037dca-f89c-4efa-806c-f7caac34dfcf service nova] Creating event network-changed:437963a0-767e-448e-a527-184a3b5ed526 for instance 08677322-e497-4759-8b0e-558daae10589 on nch1-master-1 Oct 01 21:49:32.456093 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-81ec9045-949a-46b3-bd34-480acf6c1648 req-84037dca-f89c-4efa-806c-f7caac34dfcf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032983 Oct 01 21:49:32.456704 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2298/6582] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:51:50.384118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:51:50.384941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:51:50.385781 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:51:50.385921 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:51:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/action (ip 10.222.0.17) !!! Oct 01 21:51:50.387436 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 01 21:51:50.387595 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 21:51:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/action (ip 10.222.0.17) !!! Oct 01 21:51:50.392689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-574200a8-a1d5-4791-be03-fe5dc9258ff6 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:51:50.394923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-574200a8-a1d5-4791-be03-fe5dc9258ff6 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:51:50.410737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-574200a8-a1d5-4791-be03-fe5dc9258ff6 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:51:50.411247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-574200a8-a1d5-4791-be03-fe5dc9258ff6 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:51:50.411712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-574200a8-a1d5-4791-be03-fe5dc9258ff6 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:51:50.413095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-574200a8-a1d5-4791-be03-fe5dc9258ff6 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:51:50.413570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-574200a8-a1d5-4791-be03-fe5dc9258ff6 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:51:50.414012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-574200a8-a1d5-4791-be03-fe5dc9258ff6 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:51:50.488087 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-574200a8-a1d5-4791-be03-fe5dc9258ff6 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/action" status: 202 len: 0 microversion: 2.1 time: 0.105779 Oct 01 21:51:50.491723 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4285/6583] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:51:50 2022] POST /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:51:50.496229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:51:50.496968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=66 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:51:50.498043 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 01 21:51:50.498255 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:51:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 (ip 10.222.0.17) !!! Oct 01 21:51:50.499746 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:51:50.499874 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:51:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 (ip 10.222.0.17) !!! Oct 01 21:51:50.509944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:51:50.510696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:51:50.523040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:51:50.523534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:51:50.523963 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:51:50.524666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:51:50.525168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:51:50.525599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:51:50.673448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:51:50.682210 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5ebc5dbf-260e-4570-af7f-e87b7954bf3c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1762 microversion: 2.1 time: 0.188990 Oct 01 21:51:50.682857 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2299/6584] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:51:50 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1762 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:51:51.707047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:51:51.707765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:51:51.714019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:51:51.714547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:51:51.715015 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:51:51.715725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:51:51.716210 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:51:51.716646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:51:51.869042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:51:51.877310 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-84a1fc52-0cf4-4f67-8a42-a2205f680c65 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1760 microversion: 2.1 time: 0.175646 Oct 01 21:51:51.877883 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4286/6585] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:51:51 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:05.348327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:05.349415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:05.353977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1443727653"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:05.354540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:05.361232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:05.361739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:05.362161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:05.362886 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:05.363348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:05.363780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:05.616635 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.network.security_group_api [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Removing security group 599e8354-4af9-4dcf-88c2-339d847656f1 from port 437963a0-767e-448e-a527-184a3b5ed526 Oct 01 21:53:05.915466 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1b8729b8-1640-43d3-a212-70f2a11c4c5a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/action" status: 202 len: 0 microversion: 2.1 time: 0.568131 Oct 01 21:53:05.920207 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2300/6586] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:53:05 2022] POST /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:53:05.925037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=4 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:05.926587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:05.999703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4007186d-b99e-440d-9995-663356eaffe5 req-424ad266-c9a2-4916-9e01-25fe2bc14750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08677322-e497-4759-8b0e-558daae10589", "tag": "437963a0-767e-448e-a527-184a3b5ed526"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:06.012711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4007186d-b99e-440d-9995-663356eaffe5 req-424ad266-c9a2-4916-9e01-25fe2bc14750 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:06.013675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4007186d-b99e-440d-9995-663356eaffe5 req-424ad266-c9a2-4916-9e01-25fe2bc14750 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:06.014241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4007186d-b99e-440d-9995-663356eaffe5 req-424ad266-c9a2-4916-9e01-25fe2bc14750 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:06.027067 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4007186d-b99e-440d-9995-663356eaffe5 req-424ad266-c9a2-4916-9e01-25fe2bc14750 service nova] Creating event network-changed:437963a0-767e-448e-a527-184a3b5ed526 for instance 08677322-e497-4759-8b0e-558daae10589 on nch1-master-1 Oct 01 21:53:06.032863 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4007186d-b99e-440d-9995-663356eaffe5 req-424ad266-c9a2-4916-9e01-25fe2bc14750 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113586 Oct 01 21:53:06.033771 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4287/6587] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:53:07.082108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:07.082668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:07.088806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:07.089302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:07.089748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:07.090455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:07.091019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:07.091460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:07.174222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lazy-loading 'services' on Instance uuid 08677322-e497-4759-8b0e-558daae10589 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:53:07.251653 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-85c3576b-153c-49aa-a9cf-ef24e6cf21d8 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments/5c5d3990-22f7-4f2d-a4eb-af828a87f071" status: 202 len: 0 microversion: 2.1 time: 0.174251 Oct 01 21:53:07.255415 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2301/6588] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:53:07 2022] DELETE /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments/5c5d3990-22f7-4f2d-a4eb-af828a87f071 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:53:07.264519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-64c44924-c5fd-4ea0-9f43-10e177e8d07b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:07.267251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-64c44924-c5fd-4ea0-9f43-10e177e8d07b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:07.276812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c44924-c5fd-4ea0-9f43-10e177e8d07b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:07.277429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c44924-c5fd-4ea0-9f43-10e177e8d07b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:07.278697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c44924-c5fd-4ea0-9f43-10e177e8d07b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:07.279852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c44924-c5fd-4ea0-9f43-10e177e8d07b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:07.280347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c44924-c5fd-4ea0-9f43-10e177e8d07b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:07.280797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-64c44924-c5fd-4ea0-9f43-10e177e8d07b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:07.321167 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-64c44924-c5fd-4ea0-9f43-10e177e8d07b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062261 Oct 01 21:53:07.321777 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4288/6589] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:53:07 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:53:08.049346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-5eda7bef-2844-4091-9d6e-f88e1e772731 req-98ccf4ce-097c-48cd-b86a-cd02fdfbf216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08677322-e497-4759-8b0e-558daae10589", "tag": "437963a0-767e-448e-a527-184a3b5ed526"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:08.059941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5eda7bef-2844-4091-9d6e-f88e1e772731 req-98ccf4ce-097c-48cd-b86a-cd02fdfbf216 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:08.060551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5eda7bef-2844-4091-9d6e-f88e1e772731 req-98ccf4ce-097c-48cd-b86a-cd02fdfbf216 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:08.061057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5eda7bef-2844-4091-9d6e-f88e1e772731 req-98ccf4ce-097c-48cd-b86a-cd02fdfbf216 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:08.074048 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-5eda7bef-2844-4091-9d6e-f88e1e772731 req-98ccf4ce-097c-48cd-b86a-cd02fdfbf216 service nova] Creating event network-changed:437963a0-767e-448e-a527-184a3b5ed526 for instance 08677322-e497-4759-8b0e-558daae10589 on nch1-master-1 Oct 01 21:53:08.079255 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-5eda7bef-2844-4091-9d6e-f88e1e772731 req-98ccf4ce-097c-48cd-b86a-cd02fdfbf216 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034148 Oct 01 21:53:08.080279 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2302/6590] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:53:08.335082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-beba205e-562d-47a0-9e84-b6caa384be90 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:08.337269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-beba205e-562d-47a0-9e84-b6caa384be90 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:08.344179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beba205e-562d-47a0-9e84-b6caa384be90 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:08.344686 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beba205e-562d-47a0-9e84-b6caa384be90 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:08.345141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beba205e-562d-47a0-9e84-b6caa384be90 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:08.345858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beba205e-562d-47a0-9e84-b6caa384be90 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:08.346329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beba205e-562d-47a0-9e84-b6caa384be90 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:08.346797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-beba205e-562d-47a0-9e84-b6caa384be90 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:08.377298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-beba205e-562d-47a0-9e84-b6caa384be90 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046312 Oct 01 21:53:08.377877 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4289/6591] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:53:08 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:53:08.389759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:08.390410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:08.397361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:08.397854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:08.398308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:08.399023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:08.399489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:08.399919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:08.482844 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] HTTP exception thrown: Instance 08677322-e497-4759-8b0e-558daae10589 is not attached to volume 5c5d3990-22f7-4f2d-a4eb-af828a87f071 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Request method failure captured: Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments/5c5d3990-22f7-4f2d-a4eb-af828a87f071 HTTP/1.1 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLXCWlkmjZQytPddTMOMhZKkNWcNPcISYAsisI6MGKbNqngMQ8-2n_BeoPfqkxu2w6Zew9DixlcBqI06brNc8xDrXYUiHvMQZcUq_-2Y-Rn3Bd1h67qS1TVIiuXOe6r5IOHEUwn-X9d5ZDSAEnhJlxkl81Qy7fHLRToX-AbJh07o9Sk Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: f02c2d9ca9fa43bdad1329ff8583b742 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f02c2d9ca9fa43bdad1329ff8583b742", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f02c2d9ca9fa43bdad1329ff8583b742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f02c2d9ca9fa43bdad1329ff8583b742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f02c2d9ca9fa43bdad1329ff8583b742"}]}] Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: f02c2d9ca9fa43bdad1329ff8583b742 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestMinimumBasicScenario-172740098-project Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 0d1d8f5e9d074c2a89f5cf7c874392ac Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestMinimumBasicScenario-172740098-project Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 08677322-e497-4759-8b0e-558daae10589 is not attached to volume 5c5d3990-22f7-4f2d-a4eb-af828a87f071 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'server_id': '08677322-e497-4759-8b0e-558daae10589', 'id': '5c5d3990-22f7-4f2d-a4eb-af828a87f071'} Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5c5d3990-22f7-4f2d-a4eb-af828a87f071. Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08677322-e497-4759-8b0e-558daae10589 is not attached to volume 5c5d3990-22f7-4f2d-a4eb-af828a87f071 Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:53:08.497215 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:53:08.501599 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:53:08.501599 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:53:08.501599 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08677322-e497-4759-8b0e-558daae10589 is not attached to volume 5c5d3990-22f7-4f2d-a4eb-af828a87f071 Oct 01 21:53:08.501599 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:08.501599 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Returning 404 to user: Instance 08677322-e497-4759-8b0e-558daae10589 is not attached to volume 5c5d3990-22f7-4f2d-a4eb-af828a87f071 {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:53:08.501599 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7849c3f3-f20c-4aea-85e5-714d4a2a4ea4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments/5c5d3990-22f7-4f2d-a4eb-af828a87f071" status: 404 len: 154 microversion: 2.1 time: 0.113555 Oct 01 21:53:08.501599 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2303/6592] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:53:08 2022] DELETE /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589/os-volume_attachments/5c5d3990-22f7-4f2d-a4eb-af828a87f071 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:53:09.649679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:09.650204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:09.657125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:09.657571 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:09.658026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:09.658773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:09.659246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:09.659695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:09.684849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:53:09.763429 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e5f1647d-085c-418a-9884-2b7335d6e30d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 204 len: 0 microversion: 2.1 time: 0.117584 Oct 01 21:53:09.764356 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4290/6593] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:53:09 2022] DELETE /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:53:09.772739 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:09.773364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:09.780230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:09.780718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:09.781187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:09.781916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:09.782372 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:09.782860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:09.914821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:09.922683 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-983364c2-f32c-493f-a1a7-08e86a91de6e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1554 microversion: 2.1 time: 0.153928 Oct 01 21:53:09.923252 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2304/6594] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:09 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:10.947344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:10.948063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:10.954970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:10.955471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:10.955925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:10.956630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:10.957102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:10.957542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:11.144450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:11.152414 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f6e88e4-912e-4281-b3dc-045362778c5b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1554 microversion: 2.1 time: 0.209881 Oct 01 21:53:11.153032 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4291/6595] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:10 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:11.837547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-79522fce-47c8-49a4-87e6-903c6e39da77 req-f21ce5e0-62e0-404d-9a81-f0b691764e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08677322-e497-4759-8b0e-558daae10589", "name": "network-vif-deleted", "tag": "437963a0-767e-448e-a527-184a3b5ed526"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:11.847625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-79522fce-47c8-49a4-87e6-903c6e39da77 req-f21ce5e0-62e0-404d-9a81-f0b691764e44 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:11.848361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-79522fce-47c8-49a4-87e6-903c6e39da77 req-f21ce5e0-62e0-404d-9a81-f0b691764e44 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:11.848805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-79522fce-47c8-49a4-87e6-903c6e39da77 req-f21ce5e0-62e0-404d-9a81-f0b691764e44 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:11.860846 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-79522fce-47c8-49a4-87e6-903c6e39da77 req-f21ce5e0-62e0-404d-9a81-f0b691764e44 service nova] Creating event network-vif-deleted:437963a0-767e-448e-a527-184a3b5ed526 for instance 08677322-e497-4759-8b0e-558daae10589 on nch1-master-1 Oct 01 21:53:11.865718 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-79522fce-47c8-49a4-87e6-903c6e39da77 req-f21ce5e0-62e0-404d-9a81-f0b691764e44 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101289 Oct 01 21:53:11.866344 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2305/6596] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:53:12.178572 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:12.180232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:12.189414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:12.189880 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:12.190337 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:12.191105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:12.192386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:12.193198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:12.231188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:12.231703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:12.232166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:12.232796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lazy-loading 'fault' on Instance uuid 08677322-e497-4759-8b0e-558daae10589 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:53:12.276618 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:12.283771 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-390fe5cc-8a13-4312-add9-c45c3223f1ff tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 200 len: 1348 microversion: 2.1 time: 0.111738 Oct 01 21:53:12.284351 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4292/6597] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:12 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 1348 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:13.309756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:13.310432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 08677322-e497-4759-8b0e-558daae10589] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:13.316697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:13.317191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:13.317636 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:13.318341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:13.318831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:13.319267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:13.332563 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] HTTP exception thrown: Instance 08677322-e497-4759-8b0e-558daae10589 could not be found. Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Request method failure captured: Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 HTTP/1.1 Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLXCWlkmjZQytPddTMOMhZKkNWcNPcISYAsisI6MGKbNqngMQ8-2n_BeoPfqkxu2w6Zew9DixlcBqI06brNc8xDrXYUiHvMQZcUq_-2Y-Rn3Bd1h67qS1TVIiuXOe6r5IOHEUwn-X9d5ZDSAEnhJlxkl81Qy7fHLRToX-AbJh07o9Sk Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: f02c2d9ca9fa43bdad1329ff8583b742 Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f02c2d9ca9fa43bdad1329ff8583b742", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f02c2d9ca9fa43bdad1329ff8583b742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f02c2d9ca9fa43bdad1329ff8583b742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f02c2d9ca9fa43bdad1329ff8583b742"}]}] Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: f02c2d9ca9fa43bdad1329ff8583b742 Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestMinimumBasicScenario-172740098-project Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 0d1d8f5e9d074c2a89f5cf7c874392ac Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestMinimumBasicScenario-172740098-project Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 08677322-e497-4759-8b0e-558daae10589 could not be found. Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '08677322-e497-4759-8b0e-558daae10589'} Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08677322-e497-4759-8b0e-558daae10589 could not be found. Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08677322-e497-4759-8b0e-558daae10589 could not be found. Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:53:13.334164 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08677322-e497-4759-8b0e-558daae10589 could not be found. Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Returning 404 to user: Instance 08677322-e497-4759-8b0e-558daae10589 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2773ee8d-a518-4e37-b6da-96d53cf27528 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589" status: 404 len: 111 microversion: 2.1 time: 0.031949 Oct 01 21:53:13.339143 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2306/6598] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:13 2022] GET /compute/v2.1/servers/08677322-e497-4759-8b0e-558daae10589 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:53:13.344476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-63778700-5f81-487f-b3ef-cf67bbc261bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '.version_select at 0x7f417303af70>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:13.369782 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-63778700-5f81-487f-b3ef-cf67bbc261bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-925767579" status: 202 len: 0 microversion: 2.1 time: 0.029155 Oct 01 21:53:13.370377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4293/6599] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-925767579 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:53:22.764988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d9ef733-dfd8-41b2-a4ad-7e6e6a4e810a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'create', calling method: .version_select at 0x7f4173cd8af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-808688155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuQCfsyKqe6n7l7WFmxtx5iS2V/Tn9jpVtFxmw244AF/jjQQxO4WdqObkAS2pWrodkrqpjVfsnmVoqYrRI8FmsupCZ5LsNWDopeUqwuzY1BNnJQ8q8AZHG1/fBd9IA1eQ=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:22.783025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-3d9ef733-dfd8-41b2-a4ad-7e6e6a4e810a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Getting quotas for project f02c2d9ca9fa43bdad1329ff8583b742. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:53:22.788193 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-3d9ef733-dfd8-41b2-a4ad-7e6e6a4e810a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Getting quotas for user 0d1d8f5e9d074c2a89f5cf7c874392ac and project f02c2d9ca9fa43bdad1329ff8583b742. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:53:22.801222 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d9ef733-dfd8-41b2-a4ad-7e6e6a4e810a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [790f2fdf-bc8b-4f5f-89af-c8dae5c0a9ac] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 21:53:23.323970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:23.808737 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d9ef733-dfd8-41b2-a4ad-7e6e6a4e810a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [790f2fdf-bc8b-4f5f-89af-c8dae5c0a9ac] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58026. Oct 01 21:53:23.822643 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3d9ef733-dfd8-41b2-a4ad-7e6e6a4e810a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.061603 Oct 01 21:53:23.823910 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2307/6600] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:53:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:53:23.870951 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:23.871741 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:23.876272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1957266566", "imageRef": "ffa574b4-c80b-417d-87cf-a418416d7238", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-808688155", "networks": [{"uuid": "e9f0dd04-450f-4460-a4c8-e07fa242d89a"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:23.933024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] validate_networks() for [('e9f0dd04-450f-4460-a4c8-e07fa242d89a', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:53:24.313087 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:53:24.313560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:53:24.314075 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:53:24.314536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:53:24.314980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:53:24.323989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:24.324507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:24.324967 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:24.325726 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:24.326208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:24.326690 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:24.344899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Getting quotas for project f02c2d9ca9fa43bdad1329ff8583b742. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:53:24.350373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Getting quotas for user 0d1d8f5e9d074c2a89f5cf7c874392ac and project f02c2d9ca9fa43bdad1329ff8583b742. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:53:24.363391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:53:24.365600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ffa574b4-c80b-417d-87cf-a418416d7238',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:53:24.408212 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [7905babf-44e8-4c08-be1b-d8329aafde86] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 21:53:25.415798 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [7905babf-44e8-4c08-be1b-d8329aafde86] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58056. Oct 01 21:53:25.420203 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d0d97d6-aa4b-482c-a806-19928d8e4429 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551602 Oct 01 21:53:25.420861 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4294/6601] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:53:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:53:25.433442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eac8f0be-72be-458e-ba91-07a983684e59 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:25.434059 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eac8f0be-72be-458e-ba91-07a983684e59 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:25.486918 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eac8f0be-72be-458e-ba91-07a983684e59 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:25.495352 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eac8f0be-72be-458e-ba91-07a983684e59 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1258 microversion: 2.1 time: 0.066928 Oct 01 21:53:25.496145 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2308/6602] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:25 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:26.519821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee5ba268-30da-4465-8bac-e4e5c7abacad tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:26.520533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ee5ba268-30da-4465-8bac-e4e5c7abacad tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:26.574399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ee5ba268-30da-4465-8bac-e4e5c7abacad tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:26.582000 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ee5ba268-30da-4465-8bac-e4e5c7abacad tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1258 microversion: 2.1 time: 0.067096 Oct 01 21:53:26.582613 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4295/6603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:26 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:27.608980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e6156d13-b536-4736-bd50-623d29fc4913 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:27.609611 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e6156d13-b536-4736-bd50-623d29fc4913 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:27.663590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e6156d13-b536-4736-bd50-623d29fc4913 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:27.671902 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e6156d13-b536-4736-bd50-623d29fc4913 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1258 microversion: 2.1 time: 0.069023 Oct 01 21:53:27.672497 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2309/6604] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:27 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:53:28.695679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1b529e2c-3484-45c3-bc53-e0821340d206 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:28.696313 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1b529e2c-3484-45c3-bc53-e0821340d206 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:28.749692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1b529e2c-3484-45c3-bc53-e0821340d206 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:28.756653 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1b529e2c-3484-45c3-bc53-e0821340d206 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1258 microversion: 2.1 time: 0.065131 Oct 01 21:53:28.757228 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4296/6605] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:28 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:29.780204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:29.780822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:29.788154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:29.788653 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:29.789094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:29.789789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:29.790247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:29.790701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:29.851232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:29.858892 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e1d494a2-29f6-4235-b6ee-87d8117b6958 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1262 microversion: 2.1 time: 0.083093 Oct 01 21:53:29.859469 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2310/6606] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:29 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:30.881783 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:30.882446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:30.890883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:30.899218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:30.900007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:30.901156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:30.911294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:30.912098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:31.436752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:31.450128 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-94a07636-b5d1-4d5b-ab1f-38aa68fb1dcd tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.572140 Oct 01 21:53:31.451699 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4297/6607] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:30 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:32.473447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:32.474231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:32.481768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:32.482277 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:32.482773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:32.483507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:32.483972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:32.484408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:32.652975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:32.661958 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8c2c920b-cacb-4dd4-93da-815eee3141d0 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.192416 Oct 01 21:53:32.662993 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2311/6608] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:32 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:33.686839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:33.687478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:33.693827 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:33.694346 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:33.694841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:33.695573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:33.696288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:33.696920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:33.838898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:33.853203 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d93368f0-b168-499b-b251-676570ba600a tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.171033 Oct 01 21:53:33.856582 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4298/6609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:33 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:34.879719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:34.880650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:34.889358 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:34.889860 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:34.890310 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:34.891060 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:34.891526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:34.891961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:35.031892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:35.044769 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f3fc6346-8ff1-4e26-8c6b-2dec9957b4c7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.169099 Oct 01 21:53:35.045424 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2312/6610] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:34 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:36.069070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:36.069781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:36.071855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:36.078647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:36.079237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:36.079792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:36.080558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:36.081116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:36.081642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:36.227022 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:36.238228 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-200a4481-b403-472a-bb7f-d15761f4487e tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.173024 Oct 01 21:53:36.239224 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4299/6611] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:36 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:53:37.262242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:37.263002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:37.265718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:37.271791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:37.271791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:37.272177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:37.278964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:37.279617 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:37.280078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:37.423842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:37.432326 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bd2e179e-2ada-4514-bd47-4d7cb204cf41 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.174000 Oct 01 21:53:37.433245 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2313/6612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:37 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:38.464859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:38.465585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:38.471903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:38.472406 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:38.472865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:38.473706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:38.474282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:38.474794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:38.609600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:38.619028 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-082e58d6-8f93-4147-8254-add5d6a4eb34 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.165539 Oct 01 21:53:38.619627 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4300/6613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:38 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:39.642790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:39.643495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:39.645399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=8 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:39.652188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:39.652695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:39.653473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:39.654402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:39.654903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:39.655333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:39.786571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:39.795705 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5ffde71d-0b00-4c9f-a1e7-44f19045fbac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.157059 Oct 01 21:53:39.796306 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2314/6614] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:39 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:40.305656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-06d56d83-abce-4b00-a696-2f4c37978a3b req-cb4791fc-8237-45af-bd85-0e2c97e042ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011dc89f-ff8b-41df-abcf-ac6a345924cb", "tag": "02d66234-d299-4e33-95a3-334590392b4e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:40.310898 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=10 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:40.317655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-06d56d83-abce-4b00-a696-2f4c37978a3b req-cb4791fc-8237-45af-bd85-0e2c97e042ca service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:40.318255 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-06d56d83-abce-4b00-a696-2f4c37978a3b req-cb4791fc-8237-45af-bd85-0e2c97e042ca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:40.318812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-06d56d83-abce-4b00-a696-2f4c37978a3b req-cb4791fc-8237-45af-bd85-0e2c97e042ca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:40.330548 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-06d56d83-abce-4b00-a696-2f4c37978a3b req-cb4791fc-8237-45af-bd85-0e2c97e042ca service nova] Creating event network-changed:02d66234-d299-4e33-95a3-334590392b4e for instance 011dc89f-ff8b-41df-abcf-ac6a345924cb on nch1-master-1 Oct 01 21:53:40.335444 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-06d56d83-abce-4b00-a696-2f4c37978a3b req-cb4791fc-8237-45af-bd85-0e2c97e042ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033825 Oct 01 21:53:40.336043 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4301/6615] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:53:40.818756 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:40.819384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:40.826928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:40.827417 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:40.827863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:40.828563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:40.829023 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:40.829453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:40.962071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:40.969911 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5bf8ee0b-b0f3-48a0-94e0-9435f25765f1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.155168 Oct 01 21:53:40.970483 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2315/6616] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:40 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:41.994347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:41.995180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:42.001654 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:42.002165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:42.002655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:42.003371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:42.003844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:42.004287 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:42.137443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:42.145207 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e0778a9c-0153-418f-98a8-1c8b0514f5d1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.155972 Oct 01 21:53:42.145780 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4302/6617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:41 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:43.169488 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:43.170177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:43.177346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:43.177891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:43.178631 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:43.179363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:43.179834 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:43.180273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:43.309529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:43.317389 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-122a6572-6e73-4136-b30e-bb09fa9383bc tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.152534 Oct 01 21:53:43.317979 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2316/6618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:43 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:44.340902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:44.341489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:44.348496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:44.349006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:44.349469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:44.350185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:44.350703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:44.351152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:44.482423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:44.490348 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0f724297-568f-43db-971b-59137bc67e4d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.153517 Oct 01 21:53:44.490955 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4303/6619] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:44 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:44.927032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-fb00fd15-f4b6-4d0c-9543-b404f55fe941 req-5a9653b2-fb3e-4a0d-b8c9-788d3f712c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011dc89f-ff8b-41df-abcf-ac6a345924cb", "name": "network-vif-plugged", "status": "completed", "tag": "02d66234-d299-4e33-95a3-334590392b4e"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:44.936833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fb00fd15-f4b6-4d0c-9543-b404f55fe941 req-5a9653b2-fb3e-4a0d-b8c9-788d3f712c17 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:44.937329 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fb00fd15-f4b6-4d0c-9543-b404f55fe941 req-5a9653b2-fb3e-4a0d-b8c9-788d3f712c17 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:44.937777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-fb00fd15-f4b6-4d0c-9543-b404f55fe941 req-5a9653b2-fb3e-4a0d-b8c9-788d3f712c17 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:44.949461 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-fb00fd15-f4b6-4d0c-9543-b404f55fe941 req-5a9653b2-fb3e-4a0d-b8c9-788d3f712c17 service nova] Creating event network-vif-plugged:02d66234-d299-4e33-95a3-334590392b4e for instance 011dc89f-ff8b-41df-abcf-ac6a345924cb on nch1-master-1 Oct 01 21:53:44.955652 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-fb00fd15-f4b6-4d0c-9543-b404f55fe941 req-5a9653b2-fb3e-4a0d-b8c9-788d3f712c17 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103161 Oct 01 21:53:44.955883 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2317/6620] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:53:45.513811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:45.514460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:45.521271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:45.521776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:45.522229 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:45.522961 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:45.523432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:45.523872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:45.654770 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:45.662511 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6d9e6f64-3299-41ee-88bc-85533029bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1358 microversion: 2.1 time: 0.153256 Oct 01 21:53:45.663146 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4304/6621] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:45 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:46.688015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:46.688656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:46.694966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:46.695456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:46.695899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:46.696604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:46.697065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:46.697497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:46.825844 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:46.833695 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e568a207-76be-4a92-b99e-19c9a2051883 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1549 microversion: 2.1 time: 0.151605 Oct 01 21:53:46.834276 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2318/6622] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:46 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:46.856968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:46.857600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:46.864520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:46.865019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:46.865472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:46.866179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:46.866685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:46.867125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:46.993032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:47.000887 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a2b3bc3d-0c66-453a-b075-39768e7268c9 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1549 microversion: 2.1 time: 0.148407 Oct 01 21:53:47.001468 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4305/6623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:46 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:47.022979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:47.028296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:47.029080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Searching by: {'deleted': False, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742'} {{(pid=140437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 21:53:47.034499 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:47.035011 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:47.035458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:47.036194 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:47.036656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:47.037090 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:47.064701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.multi_cell_list [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 21:53:47.121348 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-966ec9cc-a5ed-4f00-af56-02c303017ce3 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.102526 Oct 01 21:53:47.121950 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2319/6624] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Oct 1 21:53:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:53:47.133697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:47.134355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:47.140921 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:47.141421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:47.141873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:47.142619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:47.143090 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:47.143535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:47.275516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:47.284050 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8594594f-e51a-47aa-bf5c-ca0f6d94a9bb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1549 microversion: 2.1 time: 0.154240 Oct 01 21:53:47.284637 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4306/6625] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:47 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:48.794321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8d6b9f35-d7b3-4728-9f09-9a7997316ac4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a9dd363-c0ba-48a2-96cc-d36b034cc7b9"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:48.796701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8d6b9f35-d7b3-4728-9f09-9a7997316ac4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:48.803736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d6b9f35-d7b3-4728-9f09-9a7997316ac4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:48.804223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d6b9f35-d7b3-4728-9f09-9a7997316ac4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:48.804663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d6b9f35-d7b3-4728-9f09-9a7997316ac4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:48.805357 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d6b9f35-d7b3-4728-9f09-9a7997316ac4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:48.805817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d6b9f35-d7b3-4728-9f09-9a7997316ac4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:48.806243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8d6b9f35-d7b3-4728-9f09-9a7997316ac4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:49.054568 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8d6b9f35-d7b3-4728-9f09-9a7997316ac4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263331 Oct 01 21:53:49.055200 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2320/6626] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Oct 1 21:53:48 2022] POST /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:53:52.416504 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:52.417148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:52.424349 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:52.424861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:52.425351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:52.426077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:52.426595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:52.427045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:52.557266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:52.566315 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7832a3a5-ffde-499f-b9e9-b82f6f0fa2f5 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1595 microversion: 2.1 time: 0.153643 Oct 01 21:53:52.566952 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4307/6627] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:52 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:54.149904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-818d2f74-1781-4813-86fa-ae60651bd988 req-cdc06dd4-920d-40d8-8b60-5ec570822514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011dc89f-ff8b-41df-abcf-ac6a345924cb", "tag": "02d66234-d299-4e33-95a3-334590392b4e"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:54.162446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-818d2f74-1781-4813-86fa-ae60651bd988 req-cdc06dd4-920d-40d8-8b60-5ec570822514 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:54.162972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-818d2f74-1781-4813-86fa-ae60651bd988 req-cdc06dd4-920d-40d8-8b60-5ec570822514 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:54.163410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-818d2f74-1781-4813-86fa-ae60651bd988 req-cdc06dd4-920d-40d8-8b60-5ec570822514 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:54.173642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:54.176159 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-818d2f74-1781-4813-86fa-ae60651bd988 req-cdc06dd4-920d-40d8-8b60-5ec570822514 service nova] Creating event network-changed:02d66234-d299-4e33-95a3-334590392b4e for instance 011dc89f-ff8b-41df-abcf-ac6a345924cb on nch1-master-1 Oct 01 21:53:54.182911 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-818d2f74-1781-4813-86fa-ae60651bd988 req-cdc06dd4-920d-40d8-8b60-5ec570822514 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037113 Oct 01 21:53:54.183532 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2321/6628] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:53:55.117439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-387631469"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:55.118013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:55.121173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:55.128698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:55.129635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:55.130052 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:55.130819 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:55.131302 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:55.131758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:55.137204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=65 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:53:55.275343 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.network.security_group_api [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Adding security group ff78779f-026c-4d76-8365-57e7d908f7c8 to port 02d66234-d299-4e33-95a3-334590392b4e Oct 01 21:53:55.583384 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d8e5fc69-fac2-4e4c-bb00-a4563453969f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/action" status: 202 len: 0 microversion: 2.1 time: 0.469928 Oct 01 21:53:55.584413 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4308/6629] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:53:55 2022] POST /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:53:55.667709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:53:55.668624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:53:55.675827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:55.676423 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:55.676878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:55.677639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:55.678140 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:55.678922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:55.837720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:53:55.846823 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-46d4bb9e-0ffd-4f16-9399-48e7448a4285 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1759 microversion: 2.1 time: 0.258182 Oct 01 21:53:55.847427 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2322/6630] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:53:55 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1759 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:53:56.199316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-02565ba2-f0c2-43f0-8764-55062e363cfb req-dc2f36ea-e292-4651-97cc-620c865f31b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011dc89f-ff8b-41df-abcf-ac6a345924cb", "tag": "02d66234-d299-4e33-95a3-334590392b4e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:53:56.209141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-02565ba2-f0c2-43f0-8764-55062e363cfb req-dc2f36ea-e292-4651-97cc-620c865f31b3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:53:56.209645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-02565ba2-f0c2-43f0-8764-55062e363cfb req-dc2f36ea-e292-4651-97cc-620c865f31b3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:53:56.210109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-02565ba2-f0c2-43f0-8764-55062e363cfb req-dc2f36ea-e292-4651-97cc-620c865f31b3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:53:56.221453 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-02565ba2-f0c2-43f0-8764-55062e363cfb req-dc2f36ea-e292-4651-97cc-620c865f31b3 service nova] Creating event network-changed:02d66234-d299-4e33-95a3-334590392b4e for instance 011dc89f-ff8b-41df-abcf-ac6a345924cb on nch1-master-1 Oct 01 21:53:56.226477 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-02565ba2-f0c2-43f0-8764-55062e363cfb req-dc2f36ea-e292-4651-97cc-620c865f31b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031907 Oct 01 21:53:56.227111 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4309/6631] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:54:21.418812 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 01 21:54:21.422356 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-01641691-6c92-471a-be84-99449a781fd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:54:21.424674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-01641691-6c92-471a-be84-99449a781fd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:21.427073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:54:21.427878 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=19 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:54:21.429000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=7 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:54:21.435892 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01641691-6c92-471a-be84-99449a781fd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:21.436375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01641691-6c92-471a-be84-99449a781fd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:21.436813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01641691-6c92-471a-be84-99449a781fd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:21.437509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01641691-6c92-471a-be84-99449a781fd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:21.437967 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01641691-6c92-471a-be84-99449a781fd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:21.438395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-01641691-6c92-471a-be84-99449a781fd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:21.508907 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-01641691-6c92-471a-be84-99449a781fd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/action" status: 202 len: 0 microversion: 2.1 time: 0.091388 Oct 01 21:54:21.513780 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2323/6632] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:54:21 2022] POST /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:54:21.517482 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74998dba-9c89-4876-a756-a0e4436afa1f] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 21:54:21.518322 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [-] [770c7631-b847-42b2-bd0c-8c7e920b0b1d] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 21:54:21.518859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:54:21.519620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=5 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:54:21.524299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:21.525232 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:21.533872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:21.534388 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:21.534889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:21.536653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:21.537142 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:21.537605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:21.784411 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:21.793896 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0346fd4-8f0d-4d11-adbe-55b8ecceab2b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1751 microversion: 2.1 time: 0.277977 Oct 01 21:54:21.794760 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4310/6633] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:21 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1751 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:22.820532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:22.821248 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:22.829320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:22.829867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:22.830318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:22.831054 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:22.831519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:22.831952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:22.835408 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58264. Oct 01 21:54:22.981661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:22.990297 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2c784c7b-9f9f-4c61-8359-617839abe1ed tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1756 microversion: 2.1 time: 0.175485 Oct 01 21:54:22.990928 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2324/6634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:22 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:24.014805 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:24.015361 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:24.027016 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:24.027556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:24.028019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:24.028775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:24.029252 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:24.029699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:24.039824 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] [74998dba-9c89-4876-a756-a0e4436afa1f] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58284. Oct 01 21:54:24.051670 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] [770c7631-b847-42b2-bd0c-8c7e920b0b1d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58286. Oct 01 21:54:24.178609 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:24.187498 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-afcc3c1d-82fd-4dfa-afe1-075b834edaac tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1756 microversion: 2.1 time: 0.176704 Oct 01 21:54:24.188083 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4311/6635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:24 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:25.211816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:25.212928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:25.219789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:25.220306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:25.220755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:25.221465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:25.221912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:25.222340 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:25.363923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:25.372439 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-86a606c6-973f-4517-a4a6-d61f748b2a7f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1756 microversion: 2.1 time: 0.164734 Oct 01 21:54:25.373014 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2325/6636] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:25 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:26.396454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:26.397020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:26.403985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:26.404490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:26.404948 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:26.405662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:26.406139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:26.406648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:26.552000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:26.560632 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8870d79e-0029-420b-b275-5e433ad1e6fb tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1756 microversion: 2.1 time: 0.168180 Oct 01 21:54:26.561220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4312/6637] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:26 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:27.584004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:27.584623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:27.592036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:27.592519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:27.592958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:27.593659 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:27.594117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:27.594560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:27.738746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:27.747118 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-31f2c9cc-328b-444c-a234-3b0bf6429c0c tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1756 microversion: 2.1 time: 0.167147 Oct 01 21:54:27.747698 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2326/6638] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:27 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:28.771141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:28.771721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:28.779316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:28.779816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:28.780269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:28.780974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:28.781442 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:28.781882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:28.931178 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:28.939708 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-31559bc9-4dde-43d6-b877-f11cdf152d62 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1756 microversion: 2.1 time: 0.172553 Oct 01 21:54:28.940393 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4313/6639] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:28 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:29.963623 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:29.964233 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:29.971135 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:29.971626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:29.972072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:29.972776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:29.973239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:29.973667 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:30.114942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:30.123944 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e66d0a62-d398-41da-b8c4-18b0d567552b tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1756 microversion: 2.1 time: 0.164385 Oct 01 21:54:30.124530 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2327/6640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:29 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:31.148306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:31.148945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:31.157882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:31.158397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:31.158889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:31.159615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:31.160095 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:31.160547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:31.598881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:31.607797 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-25a40968-3e53-403b-8391-1de8848fbe98 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1756 microversion: 2.1 time: 0.463477 Oct 01 21:54:31.608377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4314/6641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:31 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1756 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:32.632088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:32.632713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:32.640014 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:32.640501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:32.640939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:32.641639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:32.642117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:32.642563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:32.787326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:32.795904 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-15085ac3-0a6e-4bc4-820b-930db08b3bd1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1756 microversion: 2.1 time: 0.167908 Oct 01 21:54:32.796494 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2328/6642] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:32 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:54:33.820446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:54:33.821101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:54:33.828564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:33.829064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:33.829515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:33.830223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:54:33.830721 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:54:33.831162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:54:33.972374 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:54:33.980907 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0e3ceb11-1b91-4e0c-bf94-b6bcd494a079 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1759 microversion: 2.1 time: 0.164471 Oct 01 21:54:33.981494 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4315/6643] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:54:33 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:06.797586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-387631469"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:55:06.798306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:06.800497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=12 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:06.801170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:06.807381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:06.807854 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:06.808331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:06.809034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:06.809496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:06.809930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:06.938884 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.network.security_group_api [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Removing security group ff78779f-026c-4d76-8365-57e7d908f7c8 from port 02d66234-d299-4e33-95a3-334590392b4e Oct 01 21:55:07.239849 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2d3a956e-6bbb-4fa4-8ccf-014854a325ba tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "POST /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/action" status: 202 len: 0 microversion: 2.1 time: 0.446265 Oct 01 21:55:07.240677 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2329/6644] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:55:06 2022] POST /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:55:07.269811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3106c919-9d77-488f-9cc9-a5695ad807cb req-6083d275-7a7e-4c64-bcf1-85bb8856a313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011dc89f-ff8b-41df-abcf-ac6a345924cb", "tag": "02d66234-d299-4e33-95a3-334590392b4e"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:55:07.283927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:07.285477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=36 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:07.288846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3106c919-9d77-488f-9cc9-a5695ad807cb req-6083d275-7a7e-4c64-bcf1-85bb8856a313 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:07.290561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3106c919-9d77-488f-9cc9-a5695ad807cb req-6083d275-7a7e-4c64-bcf1-85bb8856a313 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:07.291211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3106c919-9d77-488f-9cc9-a5695ad807cb req-6083d275-7a7e-4c64-bcf1-85bb8856a313 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:07.311175 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3106c919-9d77-488f-9cc9-a5695ad807cb req-6083d275-7a7e-4c64-bcf1-85bb8856a313 service nova] Creating event network-changed:02d66234-d299-4e33-95a3-334590392b4e for instance 011dc89f-ff8b-41df-abcf-ac6a345924cb on nch1-master-1 Oct 01 21:55:07.326751 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3106c919-9d77-488f-9cc9-a5695ad807cb req-6083d275-7a7e-4c64-bcf1-85bb8856a313 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062593 Oct 01 21:55:07.328269 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4316/6645] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:55:08.340411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:08.340951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:08.346990 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:08.347474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:08.347912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:08.348606 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:08.349066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:08.349498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:08.435515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lazy-loading 'services' on Instance uuid 011dc89f-ff8b-41df-abcf-ac6a345924cb {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:55:08.508122 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1574be0f-bbcb-4821-9fe3-16aa75c7bba7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "DELETE /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments/9a9dd363-c0ba-48a2-96cc-d36b034cc7b9" status: 202 len: 0 microversion: 2.1 time: 0.173450 Oct 01 21:55:08.508858 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2330/6646] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:55:08 2022] DELETE /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments/9a9dd363-c0ba-48a2-96cc-d36b034cc7b9 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:55:08.519809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2885e60d-14c3-4960-8bfc-c057f46c04b1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:08.522628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2885e60d-14c3-4960-8bfc-c057f46c04b1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:08.532011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2885e60d-14c3-4960-8bfc-c057f46c04b1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:08.532619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2885e60d-14c3-4960-8bfc-c057f46c04b1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:08.533904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2885e60d-14c3-4960-8bfc-c057f46c04b1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:08.535066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2885e60d-14c3-4960-8bfc-c057f46c04b1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:08.535622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2885e60d-14c3-4960-8bfc-c057f46c04b1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:08.536138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2885e60d-14c3-4960-8bfc-c057f46c04b1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:08.574115 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2885e60d-14c3-4960-8bfc-c057f46c04b1 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058896 Oct 01 21:55:08.574730 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4317/6647] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:55:08 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:55:09.344837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e0d83c25-21af-4b68-af3a-de870519763e req-e6a72ed6-206c-404e-a1f5-8a602449e3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011dc89f-ff8b-41df-abcf-ac6a345924cb", "tag": "02d66234-d299-4e33-95a3-334590392b4e"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:55:09.356378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e0d83c25-21af-4b68-af3a-de870519763e req-e6a72ed6-206c-404e-a1f5-8a602449e3b2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:09.356979 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e0d83c25-21af-4b68-af3a-de870519763e req-e6a72ed6-206c-404e-a1f5-8a602449e3b2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:09.357838 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e0d83c25-21af-4b68-af3a-de870519763e req-e6a72ed6-206c-404e-a1f5-8a602449e3b2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:09.370018 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e0d83c25-21af-4b68-af3a-de870519763e req-e6a72ed6-206c-404e-a1f5-8a602449e3b2 service nova] Creating event network-changed:02d66234-d299-4e33-95a3-334590392b4e for instance 011dc89f-ff8b-41df-abcf-ac6a345924cb on nch1-master-1 Oct 01 21:55:09.375244 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e0d83c25-21af-4b68-af3a-de870519763e req-e6a72ed6-206c-404e-a1f5-8a602449e3b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034761 Oct 01 21:55:09.375873 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2331/6648] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:55:09.586997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a3e1759e-6317-4243-9a93-8e8cead7dcd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:09.589884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a3e1759e-6317-4243-9a93-8e8cead7dcd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:09.596778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3e1759e-6317-4243-9a93-8e8cead7dcd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:09.597295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3e1759e-6317-4243-9a93-8e8cead7dcd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:09.597786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3e1759e-6317-4243-9a93-8e8cead7dcd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:09.598536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3e1759e-6317-4243-9a93-8e8cead7dcd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:09.599039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3e1759e-6317-4243-9a93-8e8cead7dcd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:09.599465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a3e1759e-6317-4243-9a93-8e8cead7dcd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:09.629252 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a3e1759e-6317-4243-9a93-8e8cead7dcd4 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046417 Oct 01 21:55:09.629916 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4318/6649] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Oct 1 21:55:09 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 21:55:09.641762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:09.642591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:09.648906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:09.649401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:09.649845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:09.650589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:09.651051 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:09.652064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:09.729301 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] HTTP exception thrown: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb is not attached to volume 9a9dd363-c0ba-48a2-96cc-d36b034cc7b9 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Request method failure captured: Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: request: DELETE /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments/9a9dd363-c0ba-48a2-96cc-d36b034cc7b9 HTTP/1.1 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLXCWlkmjZQytPddTMOMhZKkNWcNPcISYAsisI6MGKbNqngMQ8-2n_BeoPfqkxu2w6Zew9DixlcBqI06brNc8xDrXYUiHvMQZcUq_-2Y-Rn3Bd1h67qS1TVIiuXOe6r5IOHEUwn-X9d5ZDSAEnhJlxkl81Qy7fHLRToX-AbJh07o9Sk Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: f02c2d9ca9fa43bdad1329ff8583b742 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f02c2d9ca9fa43bdad1329ff8583b742", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f02c2d9ca9fa43bdad1329ff8583b742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f02c2d9ca9fa43bdad1329ff8583b742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f02c2d9ca9fa43bdad1329ff8583b742"}]}] Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: f02c2d9ca9fa43bdad1329ff8583b742 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestMinimumBasicScenario-172740098-project Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 0d1d8f5e9d074c2a89f5cf7c874392ac Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestMinimumBasicScenario-172740098-project Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb is not attached to volume 9a9dd363-c0ba-48a2-96cc-d36b034cc7b9 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'server_id': '011dc89f-ff8b-41df-abcf-ac6a345924cb', 'id': '9a9dd363-c0ba-48a2-96cc-d36b034cc7b9'} Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9a9dd363-c0ba-48a2-96cc-d36b034cc7b9. Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb is not attached to volume 9a9dd363-c0ba-48a2-96cc-d36b034cc7b9 Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:55:09.731025 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:55:09.739958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:55:09.739958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:55:09.739958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb is not attached to volume 9a9dd363-c0ba-48a2-96cc-d36b034cc7b9 Oct 01 21:55:09.739958 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:09.739958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Returning 404 to user: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb is not attached to volume 9a9dd363-c0ba-48a2-96cc-d36b034cc7b9 {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:55:09.739958 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-62b24a0f-1f7e-4d2c-83f3-14a1cc970565 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "DELETE /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments/9a9dd363-c0ba-48a2-96cc-d36b034cc7b9" status: 404 len: 154 microversion: 2.1 time: 0.095189 Oct 01 21:55:09.739958 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2332/6650] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Oct 1 21:55:09 2022] DELETE /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb/os-volume_attachments/9a9dd363-c0ba-48a2-96cc-d36b034cc7b9 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 21:55:10.879695 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:10.880215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:10.887081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:10.887597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:10.888063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:10.888784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:10.889265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:10.889714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:10.914995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:55:10.991700 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b29889d1-5fff-4755-a239-827d95fa190d tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "DELETE /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 204 len: 0 microversion: 2.1 time: 0.115626 Oct 01 21:55:10.992339 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4319/6651] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:55:10 2022] DELETE /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:55:11.000576 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:11.001229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:11.009048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:11.009536 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:11.009978 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:11.011185 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:11.011644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:11.012071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:11.144410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:11.152822 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2b6527f8-7054-4178-9dec-7ae6a01c04a7 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1555 microversion: 2.1 time: 0.156215 Oct 01 21:55:11.153386 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2333/6652] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:10 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:12.176821 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:12.177575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:12.188276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:12.188782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:12.189235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:12.189945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:12.190415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:12.190886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:12.318615 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:12.326370 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5dfd5495-fb51-4348-a82b-d61d7de94650 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1555 microversion: 2.1 time: 0.153839 Oct 01 21:55:12.326977 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4320/6653] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:12 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:13.052055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-33831671-f750-44f7-861b-4133466f3e43 req-e98ea0e3-f722-4812-941a-e016536ff645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011dc89f-ff8b-41df-abcf-ac6a345924cb", "name": "network-vif-deleted", "tag": "02d66234-d299-4e33-95a3-334590392b4e"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:55:13.059148 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:55:13.059328 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:55:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 01 21:55:13.068186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-33831671-f750-44f7-861b-4133466f3e43 req-e98ea0e3-f722-4812-941a-e016536ff645 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:13.068681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-33831671-f750-44f7-861b-4133466f3e43 req-e98ea0e3-f722-4812-941a-e016536ff645 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:13.069116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-33831671-f750-44f7-861b-4133466f3e43 req-e98ea0e3-f722-4812-941a-e016536ff645 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:13.080770 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-33831671-f750-44f7-861b-4133466f3e43 req-e98ea0e3-f722-4812-941a-e016536ff645 service nova] Creating event network-vif-deleted:02d66234-d299-4e33-95a3-334590392b4e for instance 011dc89f-ff8b-41df-abcf-ac6a345924cb on nch1-master-1 Oct 01 21:55:13.085403 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-33831671-f750-44f7-861b-4133466f3e43 req-e98ea0e3-f722-4812-941a-e016536ff645 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037189 Oct 01 21:55:13.086011 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2334/6654] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:55:13.349548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:13.350317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:13.358013 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:13.358546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:13.359005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:13.359736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:13.360307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:13.360944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:13.395399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:13.395903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:13.396355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:13.396826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lazy-loading 'fault' on Instance uuid 011dc89f-ff8b-41df-abcf-ac6a345924cb {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:55:13.443327 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1d8f5e9d074c2a89f5cf7c874392ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02c2d9ca9fa43bdad1329ff8583b742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:13.451328 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-548cd254-2d8a-4d49-87e1-e71ea61cbd3f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 200 len: 1348 microversion: 2.1 time: 0.105732 Oct 01 21:55:13.451913 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4321/6655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:13 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:14.476885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:14.477621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] [instance: 011dc89f-ff8b-41df-abcf-ac6a345924cb] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:14.483897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:14.484395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:14.484837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:14.485543 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:14.486006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:14.486445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:14.500288 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] HTTP exception thrown: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb could not be found. Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Request method failure captured: Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb HTTP/1.1 Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLXCWlkmjZQytPddTMOMhZKkNWcNPcISYAsisI6MGKbNqngMQ8-2n_BeoPfqkxu2w6Zew9DixlcBqI06brNc8xDrXYUiHvMQZcUq_-2Y-Rn3Bd1h67qS1TVIiuXOe6r5IOHEUwn-X9d5ZDSAEnhJlxkl81Qy7fHLRToX-AbJh07o9Sk Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: f02c2d9ca9fa43bdad1329ff8583b742 Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f02c2d9ca9fa43bdad1329ff8583b742", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f02c2d9ca9fa43bdad1329ff8583b742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f02c2d9ca9fa43bdad1329ff8583b742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f02c2d9ca9fa43bdad1329ff8583b742"}]}] Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: f02c2d9ca9fa43bdad1329ff8583b742 Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestMinimumBasicScenario-172740098 Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestMinimumBasicScenario-172740098-project Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 0d1d8f5e9d074c2a89f5cf7c874392ac Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestMinimumBasicScenario-172740098-project Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb could not be found. Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '011dc89f-ff8b-41df-abcf-ac6a345924cb'} Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb could not be found. Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb could not be found. Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:55:14.501916 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb could not be found. Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Returning 404 to user: Instance 011dc89f-ff8b-41df-abcf-ac6a345924cb could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2a297498-9e12-4c20-a57a-0ec128ec182f tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb" status: 404 len: 111 microversion: 2.1 time: 0.031759 Oct 01 21:55:14.507832 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2335/6656] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:14 2022] GET /compute/v2.1/servers/011dc89f-ff8b-41df-abcf-ac6a345924cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:55:14.512747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7565e850-7ebc-4c85-8a0a-c411bfaaa2b2 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] Calling method '.version_select at 0x7f4172b76af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:14.532419 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7565e850-7ebc-4c85-8a0a-c411bfaaa2b2 tempest-TestMinimumBasicScenario-172740098 tempest-TestMinimumBasicScenario-172740098-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-808688155" status: 202 len: 0 microversion: 2.1 time: 0.024213 Oct 01 21:55:14.533004 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4322/6657] 10.222.0.17 () {58 vars in 1269 bytes} [Sat Oct 1 21:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-808688155 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:55:23.782183 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cf50241a-e1a0-4b7d-980c-49a3978453c7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: .version_select at 0x7f41732da940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-426399320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtu5X32RPtXw99st2slwQdpgCnrhWhGdF9Vm6SDl/CkvxkAsd9ViQ/4Zl8sMSGNo2K6TcHJkgxD0DVy/J0nNY/jK4L1KUdSrfnytd3By25CMPWzV3mkaqt/viNuhGieag=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:55:23.800840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-cf50241a-e1a0-4b7d-980c-49a3978453c7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:55:23.807784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-cf50241a-e1a0-4b7d-980c-49a3978453c7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:55:23.832137 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cf50241a-e1a0-4b7d-980c-49a3978453c7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.225845 Oct 01 21:55:23.832753 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2336/6658] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:55:23 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:55:29.784124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:29.785625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:29.797188 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1281996070", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "f4338b85-be5d-4bcf-bb5a-70f36e13b121"}], "key_name": "tempest-TestNetworkAdvancedServerOps-426399320", "security_groups": [{"name": "tempest-secgroup-smoke-1128599508"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:55:29.918399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] validate_networks() for [('f4338b85-be5d-4bcf-bb5a-70f36e13b121', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:55:30.719786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:55:30.720234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:55:30.720735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:55:30.721167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:55:30.721661 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:55:30.731059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:30.731513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:30.731972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:30.732728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:30.733205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:30.733791 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:30.752155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:55:30.757760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:55:30.771060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:55:30.773457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:55:30.829652 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a69a49dc-a0bb-4b22-b946-1a74af109ac4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.050330 Oct 01 21:55:30.830323 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4323/6659] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:55:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:55:30.838700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:30.845376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0e007fba-6cb1-41f4-b451-8d3a46d600cb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:30.846066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0e007fba-6cb1-41f4-b451-8d3a46d600cb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:30.906883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0e007fba-6cb1-41f4-b451-8d3a46d600cb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:30.914451 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0e007fba-6cb1-41f4-b451-8d3a46d600cb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1266 microversion: 2.1 time: 0.076568 Oct 01 21:55:30.915067 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2337/6660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:30 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:31.938785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c0b1a01f-3b1a-4e44-8e20-fd60d00488b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:31.939331 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c0b1a01f-3b1a-4e44-8e20-fd60d00488b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:31.995161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c0b1a01f-3b1a-4e44-8e20-fd60d00488b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:32.002323 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c0b1a01f-3b1a-4e44-8e20-fd60d00488b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1266 microversion: 2.1 time: 0.068394 Oct 01 21:55:32.002994 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4324/6661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:31 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:33.025824 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:33.026529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:33.036432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:33.036940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:33.037381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:33.038126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:33.038587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:33.039024 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:33.112066 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:33.119996 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4881e9fd-2c11-469d-b8df-fa21a7acd45c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1324 microversion: 2.1 time: 0.098240 Oct 01 21:55:33.120579 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2338/6662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:33 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1324 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:34.143233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:34.144065 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:34.151151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:34.151664 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:34.152124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:34.152850 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:34.153330 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:34.153913 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:34.367724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:34.376119 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26e6a8da-6137-48ad-8b43-53762af088e2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1392 microversion: 2.1 time: 0.236807 Oct 01 21:55:34.376730 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4325/6663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:34 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:34.398432 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-a88b3d1a-303e-43bc-99c6-a93a86d4b508 req-01604a95-1e32-4f2f-97ce-72e4f1b1889b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c", "tag": "44aa6c20-dd3c-473d-a7e0-a78432b562c8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:55:34.409477 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a88b3d1a-303e-43bc-99c6-a93a86d4b508 req-01604a95-1e32-4f2f-97ce-72e4f1b1889b service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:34.409966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a88b3d1a-303e-43bc-99c6-a93a86d4b508 req-01604a95-1e32-4f2f-97ce-72e4f1b1889b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:34.410404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-a88b3d1a-303e-43bc-99c6-a93a86d4b508 req-01604a95-1e32-4f2f-97ce-72e4f1b1889b service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:34.423483 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-a88b3d1a-303e-43bc-99c6-a93a86d4b508 req-01604a95-1e32-4f2f-97ce-72e4f1b1889b service nova] Creating event network-changed:44aa6c20-dd3c-473d-a7e0-a78432b562c8 for instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c on nch1-master-1 Oct 01 21:55:34.429476 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-a88b3d1a-303e-43bc-99c6-a93a86d4b508 req-01604a95-1e32-4f2f-97ce-72e4f1b1889b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035546 Oct 01 21:55:34.430110 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2339/6664] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:55:35.399968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:35.400599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:35.407474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:35.407982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:35.408434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:35.409168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:35.409647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:35.410089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:35.544908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:35.553072 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e0ac1038-1ead-476b-b6a8-bb676a0f1d50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1392 microversion: 2.1 time: 0.156743 Oct 01 21:55:35.553604 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4326/6665] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:35 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:36.577894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:36.578686 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:36.584955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:36.585450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:36.585887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:36.586618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:36.587082 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:36.587506 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:36.719818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:36.727859 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0624ac05-e830-4822-ab39-75de6c6b8cfe tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1392 microversion: 2.1 time: 0.155646 Oct 01 21:55:36.728460 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2340/6666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:36 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:37.750941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:37.751574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:37.758611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:37.759119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:37.759577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:37.760291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:37.761149 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:37.761597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:37.898831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:37.907064 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7db931c0-b199-431f-ac99-dd968dc2660c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1392 microversion: 2.1 time: 0.160119 Oct 01 21:55:37.907655 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4327/6667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:37 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:38.930783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:38.931327 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:38.934812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:38.940221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:38.940715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:38.941161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:38.941867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:38.942334 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:38.942799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:39.081808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:39.090344 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f61ff185-301d-46d4-9cde-bd7e1e5dcb15 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1392 microversion: 2.1 time: 0.163846 Oct 01 21:55:39.090956 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2341/6668] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:38 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:40.113660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:40.114315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:40.121713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:40.122211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:40.122692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:40.123400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:40.123872 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:40.124312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:40.254806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:40.262611 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ed5d532-2fc2-4126-bbd0-5c5f4915c5ec tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1392 microversion: 2.1 time: 0.152843 Oct 01 21:55:40.263220 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4328/6669] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:40 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:41.285376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:41.285992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:41.288776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:41.294694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:41.295297 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:41.295784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:41.296515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:41.297017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:41.297577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:41.436430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d605508f-331d-402b-b3aa-205b9e2b46eb req-bd58984c-4306-4fd1-a120-43e5f7037720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c", "name": "network-vif-plugged", "status": "completed", "tag": "44aa6c20-dd3c-473d-a7e0-a78432b562c8"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:55:41.441874 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:41.448836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:41.452316 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c9a9542f-1fbd-4b91-ade4-880b621aa94f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1392 microversion: 2.1 time: 0.170542 Oct 01 21:55:41.453003 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2342/6670] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:41 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:41.469540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d605508f-331d-402b-b3aa-205b9e2b46eb req-bd58984c-4306-4fd1-a120-43e5f7037720 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:41.469976 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d605508f-331d-402b-b3aa-205b9e2b46eb req-bd58984c-4306-4fd1-a120-43e5f7037720 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:41.470426 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d605508f-331d-402b-b3aa-205b9e2b46eb req-bd58984c-4306-4fd1-a120-43e5f7037720 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:41.482906 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d605508f-331d-402b-b3aa-205b9e2b46eb req-bd58984c-4306-4fd1-a120-43e5f7037720 service nova] Creating event network-vif-plugged:44aa6c20-dd3c-473d-a7e0-a78432b562c8 for instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c on nch1-master-1 Oct 01 21:55:41.488249 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d605508f-331d-402b-b3aa-205b9e2b46eb req-bd58984c-4306-4fd1-a120-43e5f7037720 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056127 Oct 01 21:55:41.488861 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4329/6671] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:55:42.479760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:42.480410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:42.487439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:42.487930 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:42.488374 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:42.489067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:42.489526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:42.489955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:42.631802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:42.639834 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9600da0c-021b-44c1-b839-3242ebaafdc3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1392 microversion: 2.1 time: 0.164510 Oct 01 21:55:42.640413 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2343/6672] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:42 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:43.660779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:55:43.665801 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:43.666657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:43.673189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:43.673697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:43.674156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:43.674908 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:43.675383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:43.675829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:43.810116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:43.817915 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f7c0e5ab-1097-458a-8729-3e41d700eeb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1565 microversion: 2.1 time: 0.158215 Oct 01 21:55:43.818499 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4330/6673] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:43 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:43.840675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:43.841293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:43.848173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:43.848660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:43.849101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:43.849795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:43.850253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:43.850720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:43.980747 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:43.988671 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-da560cb1-d715-4355-88c0-8bf9fd05992e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1565 microversion: 2.1 time: 0.151947 Oct 01 21:55:43.989215 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2344/6674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:43 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:55:45.555430 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-592cdf6f-9047-46f4-a839-45d3e5b832a1 req-22dfc8f8-411e-4e17-9903-d4b0a0623d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c", "tag": "44aa6c20-dd3c-473d-a7e0-a78432b562c8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:55:45.565128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:55:45.565764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:55:45.572363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:45.572958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:45.573562 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:45.574290 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:45.578302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-592cdf6f-9047-46f4-a839-45d3e5b832a1 req-22dfc8f8-411e-4e17-9903-d4b0a0623d14 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:55:45.578817 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-592cdf6f-9047-46f4-a839-45d3e5b832a1 req-22dfc8f8-411e-4e17-9903-d4b0a0623d14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:45.579251 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-592cdf6f-9047-46f4-a839-45d3e5b832a1 req-22dfc8f8-411e-4e17-9903-d4b0a0623d14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:45.583343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:55:45.583841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:55:45.595256 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-592cdf6f-9047-46f4-a839-45d3e5b832a1 req-22dfc8f8-411e-4e17-9903-d4b0a0623d14 service nova] Creating event network-changed:44aa6c20-dd3c-473d-a7e0-a78432b562c8 for instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c on nch1-master-1 Oct 01 21:55:45.600357 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-592cdf6f-9047-46f4-a839-45d3e5b832a1 req-22dfc8f8-411e-4e17-9903-d4b0a0623d14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048804 Oct 01 21:55:45.601174 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2345/6675] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:55:45.806985 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:55:45.816879 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cef16ad1-1abe-4db6-9c8f-f60155de1f40 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1565 microversion: 2.1 time: 0.267905 Oct 01 21:55:45.818024 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4331/6676] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:55:45 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1565 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:09.085835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=9 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:09.086639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=40 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:09.090965 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-adc3c3f9-28f7-4f47-ad07-7846ef5effde tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:09.093225 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-adc3c3f9-28f7-4f47-ad07-7846ef5effde tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:09.100258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adc3c3f9-28f7-4f47-ad07-7846ef5effde tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:09.100780 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adc3c3f9-28f7-4f47-ad07-7846ef5effde tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:09.101230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adc3c3f9-28f7-4f47-ad07-7846ef5effde tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:09.101932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adc3c3f9-28f7-4f47-ad07-7846ef5effde tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:09.102405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adc3c3f9-28f7-4f47-ad07-7846ef5effde tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:09.102862 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-adc3c3f9-28f7-4f47-ad07-7846ef5effde tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:09.153055 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-adc3c3f9-28f7-4f47-ad07-7846ef5effde tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action" status: 200 len: 24572 microversion: 2.1 time: 0.069060 Oct 01 21:56:09.153721 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2346/6677] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:56:09 2022] POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action => generated 24572 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:56:15.575312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5ea40726-7f3c-4b82-a143-298b91983b22 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:15.575933 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5ea40726-7f3c-4b82-a143-298b91983b22 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:15.577915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:15.578620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=40 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:15.584280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ea40726-7f3c-4b82-a143-298b91983b22 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:15.584788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ea40726-7f3c-4b82-a143-298b91983b22 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:15.585276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ea40726-7f3c-4b82-a143-298b91983b22 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:15.585993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ea40726-7f3c-4b82-a143-298b91983b22 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:15.586472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ea40726-7f3c-4b82-a143-298b91983b22 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:15.586950 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5ea40726-7f3c-4b82-a143-298b91983b22 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:15.653193 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5ea40726-7f3c-4b82-a143-298b91983b22 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action" status: 202 len: 0 microversion: 2.1 time: 0.082124 Oct 01 21:56:15.653843 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4332/6678] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:56:15 2022] POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:56:15.662621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:15.663332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:15.671394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:15.671904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:15.672323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:15.673080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:15.673538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:15.673961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:15.812001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:15.820247 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-109e5437-2f2b-46ed-9b25-811b4da901ee tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1689 microversion: 2.1 time: 0.161891 Oct 01 21:56:15.820831 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2347/6679] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:15 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:16.848635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:16.849389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:16.855703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:16.856213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:16.856674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:16.857384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:16.857864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:16.858309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:16.992169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:17.000586 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88c58a3f-d96b-44ee-9ab3-3876359937e5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1669 microversion: 2.1 time: 0.157064 Oct 01 21:56:17.001157 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4333/6680] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:16 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:18.092668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-14783c55-14bb-421b-aa57-11fb97a872aa tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:18.094926 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-14783c55-14bb-421b-aa57-11fb97a872aa tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:18.101837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14783c55-14bb-421b-aa57-11fb97a872aa tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:18.102330 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14783c55-14bb-421b-aa57-11fb97a872aa tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:18.102802 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14783c55-14bb-421b-aa57-11fb97a872aa tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:18.103504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14783c55-14bb-421b-aa57-11fb97a872aa tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:18.103961 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14783c55-14bb-421b-aa57-11fb97a872aa tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:18.104392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-14783c55-14bb-421b-aa57-11fb97a872aa tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:18.155463 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-14783c55-14bb-421b-aa57-11fb97a872aa tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action" status: 200 len: 32649 microversion: 2.1 time: 0.066620 Oct 01 21:56:18.156443 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2348/6681] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:56:18 2022] POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action => generated 32649 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:56:18.167808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d141edae-c96b-44e9-8b96-92953a308d55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:18.168366 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d141edae-c96b-44e9-8b96-92953a308d55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:18.175355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d141edae-c96b-44e9-8b96-92953a308d55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:18.175865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d141edae-c96b-44e9-8b96-92953a308d55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:18.176324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d141edae-c96b-44e9-8b96-92953a308d55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:18.177046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d141edae-c96b-44e9-8b96-92953a308d55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:18.177523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d141edae-c96b-44e9-8b96-92953a308d55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:18.178231 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d141edae-c96b-44e9-8b96-92953a308d55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:18.248024 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d141edae-c96b-44e9-8b96-92953a308d55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action" status: 202 len: 0 microversion: 2.1 time: 0.084012 Oct 01 21:56:18.248821 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4334/6682] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:56:18 2022] POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:56:18.257553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:18.258272 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:18.266847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:18.267347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:18.268080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:18.268889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:18.269355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:18.269789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:18.409345 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:18.419276 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-00a3b609-b199-4e0a-b1ac-8759ef918496 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1676 microversion: 2.1 time: 0.165888 Oct 01 21:56:18.419956 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2349/6683] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:18 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:19.445587 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:19.446220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:19.452824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:19.453338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:19.453792 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:19.454560 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:19.455038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:19.455484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:19.588089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:19.596510 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c95a446c-c8d1-4c08-b06f-470b66aaead7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1684 microversion: 2.1 time: 0.156148 Oct 01 21:56:19.597100 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4335/6684] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:19 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:19.692303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0fc31b09-3286-41b4-b9e1-1a05c53243d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:19.694575 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0fc31b09-3286-41b4-b9e1-1a05c53243d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:19.702286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fc31b09-3286-41b4-b9e1-1a05c53243d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:19.702823 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fc31b09-3286-41b4-b9e1-1a05c53243d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:19.703269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fc31b09-3286-41b4-b9e1-1a05c53243d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:19.703975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fc31b09-3286-41b4-b9e1-1a05c53243d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:19.704439 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fc31b09-3286-41b4-b9e1-1a05c53243d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:19.704873 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0fc31b09-3286-41b4-b9e1-1a05c53243d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:19.754956 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0fc31b09-3286-41b4-b9e1-1a05c53243d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action" status: 200 len: 35393 microversion: 2.1 time: 0.066456 Oct 01 21:56:19.755609 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2350/6685] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:56:19 2022] POST /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c/action => generated 35393 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:56:20.743587 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-cf6f724a-42d8-4a31-bbb3-c8de65f4382f req-1dff680d-da4f-4874-97e9-24fe98867e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c", "tag": "44aa6c20-dd3c-473d-a7e0-a78432b562c8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:20.752462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:20.753010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:20.759711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:20.760249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:20.760920 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:20.761935 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:20.762685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:20.763134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:20.763821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cf6f724a-42d8-4a31-bbb3-c8de65f4382f req-1dff680d-da4f-4874-97e9-24fe98867e2d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:20.764320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cf6f724a-42d8-4a31-bbb3-c8de65f4382f req-1dff680d-da4f-4874-97e9-24fe98867e2d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:20.764759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-cf6f724a-42d8-4a31-bbb3-c8de65f4382f req-1dff680d-da4f-4874-97e9-24fe98867e2d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:20.777712 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-cf6f724a-42d8-4a31-bbb3-c8de65f4382f req-1dff680d-da4f-4874-97e9-24fe98867e2d service nova] Creating event network-changed:44aa6c20-dd3c-473d-a7e0-a78432b562c8 for instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c on nch1-master-1 Oct 01 21:56:20.783929 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-cf6f724a-42d8-4a31-bbb3-c8de65f4382f req-1dff680d-da4f-4874-97e9-24fe98867e2d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044145 Oct 01 21:56:20.784660 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2351/6686] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:56:20.793507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:56:20.882004 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7be9f380-b65c-4428-bc4d-3b75ae7b9098 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 204 len: 0 microversion: 2.1 time: 0.145521 Oct 01 21:56:20.883100 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4336/6687] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:56:20 2022] DELETE /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:56:20.892170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:20.892912 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:20.902600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:20.903433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:20.904208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:20.905187 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:20.906021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:20.906825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:21.046569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:21.054772 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6880454f-3ea9-449c-9f8f-e0de272f906c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1690 microversion: 2.1 time: 0.167256 Oct 01 21:56:21.055458 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2352/6688] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:20 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:22.080569 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:22.081288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:22.088155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:22.088660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:22.089112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:22.089820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:22.090296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:22.090766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:22.222939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:22.231792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82eda176-9156-48ba-9c03-9506bc32556d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1690 microversion: 2.1 time: 0.155496 Oct 01 21:56:22.232377 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4337/6689] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:22 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:22.968307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-dcd10758-6281-4944-8f5d-20e22023bf98 req-572a6a52-1a73-4ad9-a9ae-1ee3e5bd73b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c", "name": "network-vif-deleted", "tag": "44aa6c20-dd3c-473d-a7e0-a78432b562c8"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:22.980255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-dcd10758-6281-4944-8f5d-20e22023bf98 req-572a6a52-1a73-4ad9-a9ae-1ee3e5bd73b7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:22.980951 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-dcd10758-6281-4944-8f5d-20e22023bf98 req-572a6a52-1a73-4ad9-a9ae-1ee3e5bd73b7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:22.981405 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-dcd10758-6281-4944-8f5d-20e22023bf98 req-572a6a52-1a73-4ad9-a9ae-1ee3e5bd73b7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:22.996361 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-dcd10758-6281-4944-8f5d-20e22023bf98 req-572a6a52-1a73-4ad9-a9ae-1ee3e5bd73b7 service nova] Creating event network-vif-deleted:44aa6c20-dd3c-473d-a7e0-a78432b562c8 for instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c on nch1-master-1 Oct 01 21:56:23.002744 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-dcd10758-6281-4944-8f5d-20e22023bf98 req-572a6a52-1a73-4ad9-a9ae-1ee3e5bd73b7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038691 Oct 01 21:56:23.003674 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2353/6690] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:56:23.257437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:23.258547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:23.266219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:23.266860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:23.267325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:23.268069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:23.268550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:23.269005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:23.303487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:23.304004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:23.306132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:23.306678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lazy-loading 'fault' on Instance uuid 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:56:23.349610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:23.357764 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7fe9a9fc-c52d-48f2-aa66-3d7ee22a845a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 200 len: 1356 microversion: 2.1 time: 0.105114 Oct 01 21:56:23.358358 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4338/6691] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:23 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:24.382259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:24.382986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:24.390151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:24.390679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:24.391121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:24.391816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:24.392273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:24.392696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:24.409045 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] HTTP exception thrown: Instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c could not be found. Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Request method failure captured: Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c HTTP/1.1 Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLdLv2TZ0B0Xz1wsy4zcJ0yREEX5T1tKKeJCaJEVz9hhs4TxfDjIGHkTIocROXJwvcD4XqZb2bTvELDwG4kyrRJvKyWMnrqlZZgxY1OZFYt2fuzfCCKUwBA1JjXUZ5hIoFH3gUfl_4QIFDIF6NB7DJVsexVj67fTzupdv91tzAaM8Og Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27214fca5a7a4c85bba526c092ac726b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}] Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 5f22070464e045f19acc335de7dd38f3 Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c could not be found. Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c'} Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c could not be found. Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c could not be found. Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:56:24.410694 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c could not be found. Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Returning 404 to user: Instance 4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9edd4b18-126e-40a1-a29b-6e80c774d834 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c" status: 404 len: 111 microversion: 2.1 time: 0.034118 Oct 01 21:56:24.416247 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2354/6692] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:24 2022] GET /compute/v2.1/servers/4d5497d0-4bac-4d7d-b1d5-fb51b89b7c9c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:56:27.679682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-89188b4f-e4ab-4e1f-8367-5e8ec9b87c6c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '.version_select at 0x7f4172a49af0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:27.710774 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-89188b4f-e4ab-4e1f-8367-5e8ec9b87c6c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-426399320" status: 202 len: 0 microversion: 2.1 time: 0.035271 Oct 01 21:56:27.716183 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4339/6693] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Oct 1 21:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-426399320 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:56:27.739583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-694eb251-b503-4879-aada-7a07642ec837 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: .version_select at 0x7f417246aca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1439469877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcFeYrbFX1YQJntswZ3ZZ5p5P6oYDYylzHu9iJbIK3KYiez7wihXQIVgJyr9Lilr1yP9HtWKqDRmDZ9tWz61tdKVXjMfCK//KAkCluDiDtInpxrdA2g2LNlc90vBYVSdg=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:27.759463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-694eb251-b503-4879-aada-7a07642ec837 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:56:27.766664 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-694eb251-b503-4879-aada-7a07642ec837 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:56:27.790697 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-694eb251-b503-4879-aada-7a07642ec837 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055063 Oct 01 21:56:27.791493 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2355/6694] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:56:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:56:33.039298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1269563472", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "4cc220b8-a42b-4226-93f1-17f14458ab40"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1439469877", "security_groups": [{"name": "tempest-secgroup-smoke-1324658341"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:33.354994 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:33.510481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] validate_networks() for [('4cc220b8-a42b-4226-93f1-17f14458ab40', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:56:33.908307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:56:33.908871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:56:33.909433 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:56:33.909861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:56:33.910291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:56:33.919511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:33.920012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:33.920463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:33.921237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:33.921708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:33.922150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:33.939636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:56:33.945073 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:56:33.958093 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:56:33.961069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:56:34.014865 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8f612366-3efb-4489-9d7b-7f3c849682df tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.980654 Oct 01 21:56:34.018649 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4340/6695] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:56:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:56:34.035642 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e87e86b2-e911-4295-aa19-84772bc8d730 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:34.036342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e87e86b2-e911-4295-aa19-84772bc8d730 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:34.100021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e87e86b2-e911-4295-aa19-84772bc8d730 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:34.108065 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e87e86b2-e911-4295-aa19-84772bc8d730 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1267 microversion: 2.1 time: 0.085152 Oct 01 21:56:34.108735 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2356/6696] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:34 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:56:35.133241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:35.133769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:35.140991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:35.141502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:35.141954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:35.142712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:35.143185 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:35.143622 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:35.238643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:35.246811 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f018c1ea-0a37-4724-8d5b-2bb0a864590b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1337 microversion: 2.1 time: 0.118855 Oct 01 21:56:35.247403 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4341/6697] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:35 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1337 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:36.271410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:36.272666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:36.277602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=36 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:36.285936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:36.286578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:36.287036 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:36.287772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:36.288246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:36.288684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:36.494711 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:36.502713 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ff6e3f89-c35e-45cb-8f30-a1a016f686e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1393 microversion: 2.1 time: 0.235334 Oct 01 21:56:36.503310 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2357/6698] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:36 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1393 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:36.633256 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-33293efb-76ab-4125-a9ab-b3d848358bb1 req-d4d5d210-fe6d-496e-8389-45003cf1c3ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ad0403-ffed-4855-b39f-c9367a6cc4d8", "tag": "2638d56c-e943-4b6a-959e-eac535529c0c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:36.645786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-33293efb-76ab-4125-a9ab-b3d848358bb1 req-d4d5d210-fe6d-496e-8389-45003cf1c3ae service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:36.646575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-33293efb-76ab-4125-a9ab-b3d848358bb1 req-d4d5d210-fe6d-496e-8389-45003cf1c3ae service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:36.647067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-33293efb-76ab-4125-a9ab-b3d848358bb1 req-d4d5d210-fe6d-496e-8389-45003cf1c3ae service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:36.661474 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-33293efb-76ab-4125-a9ab-b3d848358bb1 req-d4d5d210-fe6d-496e-8389-45003cf1c3ae service nova] Creating event network-changed:2638d56c-e943-4b6a-959e-eac535529c0c for instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 on nch1-master-1 Oct 01 21:56:36.666900 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-33293efb-76ab-4125-a9ab-b3d848358bb1 req-d4d5d210-fe6d-496e-8389-45003cf1c3ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037424 Oct 01 21:56:36.667540 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4342/6699] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:56:37.526786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:37.527317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:37.534153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:37.534679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:37.535119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:37.535813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:37.536273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:37.536700 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:37.673899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:37.681904 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-30595935-a068-41ae-9c7c-f18fe387a4be tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1393 microversion: 2.1 time: 0.159154 Oct 01 21:56:37.682482 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2358/6700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:37 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:38.707519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:38.708394 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:38.715143 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:38.715691 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:38.716156 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:38.716909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:38.717390 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:38.717840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:38.851917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:38.860231 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ae6632dc-f889-430f-82a9-ce2ea90ba9e4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1393 microversion: 2.1 time: 0.158199 Oct 01 21:56:38.860756 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4343/6701] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:38 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:39.883532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:39.884151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:39.887483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:39.892669 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:39.893152 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:39.893592 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:39.894287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:39.894772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:39.895204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:40.024421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:40.032400 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-40450ef6-8aa6-4b9a-bcb0-a55d60c05cf6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1393 microversion: 2.1 time: 0.152795 Oct 01 21:56:40.032990 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2359/6702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:39 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:41.055766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:41.056400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:41.063369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:41.063882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:41.064396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:41.065066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:41.065549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:41.066001 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:41.193580 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:41.201916 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6e7e8a35-326b-4f98-839f-935bb57d82a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1393 microversion: 2.1 time: 0.150435 Oct 01 21:56:41.202510 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4344/6703] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:41 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:42.225352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:42.225975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:42.233637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:42.234191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:42.234673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:42.235387 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:42.235851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:42.236281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:42.364588 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:42.372349 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-87fc940b-6a5d-44ac-a197-9d51e11f9a31 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1393 microversion: 2.1 time: 0.151048 Oct 01 21:56:42.372929 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2360/6704] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:42 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:43.395392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:43.396037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:43.402953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:43.403464 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:43.403925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:43.404648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:43.405129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:43.405579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:43.533391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:43.541676 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ca3d846e-bc4c-46fa-b0be-4bc8eabd6747 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1393 microversion: 2.1 time: 0.149806 Oct 01 21:56:43.542268 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4345/6705] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:43 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:43.940113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f852a549-6669-4a2f-8628-2b7048b18ff1 req-6e1cc81b-4a9f-453d-9ebc-bf71af605e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ad0403-ffed-4855-b39f-c9367a6cc4d8", "name": "network-vif-plugged", "status": "completed", "tag": "2638d56c-e943-4b6a-959e-eac535529c0c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:43.951651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f852a549-6669-4a2f-8628-2b7048b18ff1 req-6e1cc81b-4a9f-453d-9ebc-bf71af605e06 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:43.952146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f852a549-6669-4a2f-8628-2b7048b18ff1 req-6e1cc81b-4a9f-453d-9ebc-bf71af605e06 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:43.952644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f852a549-6669-4a2f-8628-2b7048b18ff1 req-6e1cc81b-4a9f-453d-9ebc-bf71af605e06 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:43.964700 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f852a549-6669-4a2f-8628-2b7048b18ff1 req-6e1cc81b-4a9f-453d-9ebc-bf71af605e06 service nova] Creating event network-vif-plugged:2638d56c-e943-4b6a-959e-eac535529c0c for instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 on nch1-master-1 Oct 01 21:56:43.969660 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f852a549-6669-4a2f-8628-2b7048b18ff1 req-6e1cc81b-4a9f-453d-9ebc-bf71af605e06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Oct 01 21:56:43.970263 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2361/6706] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:56:44.565170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:44.565799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:44.567836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:44.568574 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:44.575077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:44.575575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:44.576027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:44.576735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:44.577208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:44.577649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:44.710389 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:44.718807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c6b4a28a-bd0d-4d09-b9ab-4cd8a10db1d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1393 microversion: 2.1 time: 0.157495 Oct 01 21:56:44.719387 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4346/6707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:44 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:45.739728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:45.745528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:45.746292 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:45.752859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:45.753351 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:45.753794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:45.754509 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:45.754982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:45.755413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:45.889721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:45.897746 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e091307-8254-4612-ac49-668b0c04592a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1565 microversion: 2.1 time: 0.159023 Oct 01 21:56:45.898334 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2362/6708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:45 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:45.920865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:45.921498 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:45.924260 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:56:45.930168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:45.930351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:45.930834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:45.931557 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:45.932036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:45.932482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:46.067842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:46.075786 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0720c145-1118-4333-8dbb-beec132fc3ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1565 microversion: 2.1 time: 0.158778 Oct 01 21:56:46.076380 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4347/6709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:45 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:56:47.934698 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:56:47.935464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:56:47.936002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-3062b3b8-28d4-40da-b43f-5f9cc5ab953a req-81f7021e-5ec8-4506-8f8e-e51bf3a4e9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ad0403-ffed-4855-b39f-c9367a6cc4d8", "tag": "2638d56c-e943-4b6a-959e-eac535529c0c"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:56:47.942672 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:47.943532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:47.944079 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:47.945037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:47.945764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:47.946416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:47.947529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3062b3b8-28d4-40da-b43f-5f9cc5ab953a req-81f7021e-5ec8-4506-8f8e-e51bf3a4e9f7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:56:47.948032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3062b3b8-28d4-40da-b43f-5f9cc5ab953a req-81f7021e-5ec8-4506-8f8e-e51bf3a4e9f7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:56:47.948482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-3062b3b8-28d4-40da-b43f-5f9cc5ab953a req-81f7021e-5ec8-4506-8f8e-e51bf3a4e9f7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:56:47.959940 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-3062b3b8-28d4-40da-b43f-5f9cc5ab953a req-81f7021e-5ec8-4506-8f8e-e51bf3a4e9f7 service nova] Creating event network-changed:2638d56c-e943-4b6a-959e-eac535529c0c for instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 on nch1-master-1 Oct 01 21:56:47.966092 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-3062b3b8-28d4-40da-b43f-5f9cc5ab953a req-81f7021e-5ec8-4506-8f8e-e51bf3a4e9f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034085 Oct 01 21:56:47.967066 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4348/6710] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:56:48.173822 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:56:48.183188 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8b8a926b-66a2-4689-830c-6ff69c9107e1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1565 microversion: 2.1 time: 0.253459 Oct 01 21:56:48.194822 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2363/6711] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:56:47 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1565 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:11.435927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:57:11.436681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=42 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:57:11.440866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-dede5af6-4337-4aca-aac6-5c79d8f68552 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:57:11.443165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-dede5af6-4337-4aca-aac6-5c79d8f68552 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:11.451437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dede5af6-4337-4aca-aac6-5c79d8f68552 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:11.452076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dede5af6-4337-4aca-aac6-5c79d8f68552 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:11.452545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dede5af6-4337-4aca-aac6-5c79d8f68552 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:11.453294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dede5af6-4337-4aca-aac6-5c79d8f68552 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:11.453824 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dede5af6-4337-4aca-aac6-5c79d8f68552 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:11.454477 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-dede5af6-4337-4aca-aac6-5c79d8f68552 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:11.505026 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-dede5af6-4337-4aca-aac6-5c79d8f68552 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8/action" status: 200 len: 24570 microversion: 2.1 time: 0.071376 Oct 01 21:57:11.505705 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4349/6712] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:57:11 2022] POST /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:57:17.931124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d55ffacd-e6cd-4fb5-a9a8-96f0abe60e5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:57:17.933384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d55ffacd-e6cd-4fb5-a9a8-96f0abe60e5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:17.936307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=9 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:57:17.936991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=38 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:57:17.943386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d55ffacd-e6cd-4fb5-a9a8-96f0abe60e5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:17.943885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d55ffacd-e6cd-4fb5-a9a8-96f0abe60e5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:17.944331 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d55ffacd-e6cd-4fb5-a9a8-96f0abe60e5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:17.945047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d55ffacd-e6cd-4fb5-a9a8-96f0abe60e5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:17.945518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d55ffacd-e6cd-4fb5-a9a8-96f0abe60e5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:17.945950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d55ffacd-e6cd-4fb5-a9a8-96f0abe60e5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:18.021782 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d55ffacd-e6cd-4fb5-a9a8-96f0abe60e5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8/action" status: 202 len: 0 microversion: 2.1 time: 0.094931 Oct 01 21:57:18.022470 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2364/6713] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:57:17 2022] POST /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:57:18.031530 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:18.032620 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:18.040779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:18.041377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:18.041937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:18.043019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:18.043507 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:18.043962 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:18.184070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:18.193667 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-567bfedf-85cd-41d2-9680-f5dc5c2737f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1676 microversion: 2.1 time: 0.166327 Oct 01 21:57:18.194284 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4350/6714] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:18 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:19.218399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:19.219141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:19.226116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:19.226641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:19.227084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:19.227775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:19.228234 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:19.228660 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:19.358200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:19.365981 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-060ebdf5-98e0-4f8e-991a-b757c4c09911 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1681 microversion: 2.1 time: 0.152545 Oct 01 21:57:19.366577 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2365/6715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:19 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:20.390705 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:20.391295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:20.399128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:20.399633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:20.400086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:20.400793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:20.401269 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:20.402234 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:20.543436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:20.551641 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e743cb85-c42e-44e4-9c6e-558eb4054f00 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1681 microversion: 2.1 time: 0.164855 Oct 01 21:57:20.552222 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4351/6716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:20 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:21.575959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:21.576581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:21.583607 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:21.584096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:21.584534 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:21.585226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:21.585682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:21.586107 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:21.720560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:21.728466 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f8711beb-fc90-4241-a8a6-425d95ca3fcb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1681 microversion: 2.1 time: 0.156447 Oct 01 21:57:21.729046 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2366/6717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:21 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:22.752288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:22.752928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:22.760171 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:22.760672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:22.761916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:22.761916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:22.762305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:22.763392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:22.894428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:22.902588 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7eee1745-c784-4762-9b1d-4603b67e2a73 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1681 microversion: 2.1 time: 0.154270 Oct 01 21:57:22.903254 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4352/6718] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:22 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:57:23.927801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:23.929134 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:23.936091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:23.936595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:23.937043 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:23.937764 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:23.938354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:23.938821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:24.071637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:24.080048 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-070811b6-7579-4163-9150-66e81a71fe21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1681 microversion: 2.1 time: 0.156634 Oct 01 21:57:24.080634 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2367/6719] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:23 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:25.103601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:25.104238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:25.111469 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:25.111983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:25.112444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:25.113165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:25.113646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:25.114102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:25.246336 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:25.254230 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2991a10a-6753-4d56-ae35-dd5fd29f9aef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1681 microversion: 2.1 time: 0.154763 Oct 01 21:57:25.254845 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4353/6720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:25 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:26.278448 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:26.279099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:26.286392 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:26.286917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:26.287364 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:26.288126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:26.288589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:26.289020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:26.421413 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:26.429554 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0cd94e9b-0f24-412b-85bf-f142d820320c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1681 microversion: 2.1 time: 0.155541 Oct 01 21:57:26.430132 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2368/6721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:26 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:27.452884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:27.453523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:27.460548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:27.461058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:27.461521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:27.462242 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:27.462762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:27.463215 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:27.600312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:27.608758 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a0fd690-f124-42fe-ad5d-88ca63ffb482 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1681 microversion: 2.1 time: 0.159853 Oct 01 21:57:27.609346 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4354/6722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:27 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:28.632369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:28.632996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:28.641668 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:28.642165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:28.642645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:28.643355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:28.643821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:28.644257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:28.780339 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:28.788363 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8bc0e625-a363-4b06-a7c1-e51b27f732dd tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1681 microversion: 2.1 time: 0.159836 Oct 01 21:57:28.788935 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2369/6723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:28 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:29.812599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:57:29.813233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:29.820144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:29.820643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:29.821104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:29.821813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:29.822283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:29.822755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:29.952633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:57:29.960512 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cf05bd2a-f128-4f33-99c6-f11ad06409f4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1684 microversion: 2.1 time: 0.152490 Oct 01 21:57:29.961095 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4355/6724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:57:29 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:57:54.177281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4ce5ba50-3f48-45a6-bf8a-96065c78857f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:57:54.179808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4ce5ba50-3f48-45a6-bf8a-96065c78857f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:57:54.182004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=12 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:57:54.182707 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:57:54.188995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce5ba50-3f48-45a6-bf8a-96065c78857f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:54.189489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce5ba50-3f48-45a6-bf8a-96065c78857f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:54.189943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce5ba50-3f48-45a6-bf8a-96065c78857f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:54.190674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce5ba50-3f48-45a6-bf8a-96065c78857f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:57:54.191145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce5ba50-3f48-45a6-bf8a-96065c78857f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:57:54.191583 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4ce5ba50-3f48-45a6-bf8a-96065c78857f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:57:54.250750 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4ce5ba50-3f48-45a6-bf8a-96065c78857f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8/action" status: 200 len: 69101 microversion: 2.1 time: 0.077593 Oct 01 21:57:54.251408 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2370/6725] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:57:54 2022] POST /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8/action => generated 69101 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:58:01.248516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:01.254473 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-5ede3050-f193-4475-9a82-cf292c097005 req-d0338e25-18d7-4275-8f3a-305f8be09a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ad0403-ffed-4855-b39f-c9367a6cc4d8", "tag": "2638d56c-e943-4b6a-959e-eac535529c0c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:58:01.255033 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:01.265966 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5ede3050-f193-4475-9a82-cf292c097005 req-d0338e25-18d7-4275-8f3a-305f8be09a9c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:01.266569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5ede3050-f193-4475-9a82-cf292c097005 req-d0338e25-18d7-4275-8f3a-305f8be09a9c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:01.267085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5ede3050-f193-4475-9a82-cf292c097005 req-d0338e25-18d7-4275-8f3a-305f8be09a9c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:01.268971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=14 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:01.269823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=40 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:01.275744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:01.276264 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:01.277314 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:01.278207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:01.278723 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:01.279167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:01.280496 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-5ede3050-f193-4475-9a82-cf292c097005 req-d0338e25-18d7-4275-8f3a-305f8be09a9c service nova] Creating event network-changed:2638d56c-e943-4b6a-959e-eac535529c0c for instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 on nch1-master-1 Oct 01 21:58:01.286928 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-5ede3050-f193-4475-9a82-cf292c097005 req-d0338e25-18d7-4275-8f3a-305f8be09a9c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035781 Oct 01 21:58:01.287120 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2371/6726] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:58:01.310643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:58:01.412305 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-962d5ba2-3d5d-4f10-97d9-576688a121f0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 204 len: 0 microversion: 2.1 time: 0.167542 Oct 01 21:58:01.413498 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4356/6727] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:58:01 2022] DELETE /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:58:01.422773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:01.423498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:01.430007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:01.430577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:01.431030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:01.431752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:01.432221 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:01.432684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:01.569594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:01.578002 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-eae9daf3-d0b5-4716-a64e-00e7e53c53a2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1690 microversion: 2.1 time: 0.159950 Oct 01 21:58:01.578611 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2372/6728] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:01 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:02.602018 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:02.602767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:02.609776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:02.610289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:02.610804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:02.611519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:02.611991 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:02.612453 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:02.754611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:02.763509 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ade31f57-3e1d-4ba7-bf3e-c685ee260bf5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1690 microversion: 2.1 time: 0.165727 Oct 01 21:58:02.764121 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4357/6729] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:02 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:03.332871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-80db2d17-2e06-4dd5-b5e5-69a35ffa03a6 req-441f0aee-1cc1-498d-bf2a-512c5969ede7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ad0403-ffed-4855-b39f-c9367a6cc4d8", "name": "network-vif-deleted", "tag": "2638d56c-e943-4b6a-959e-eac535529c0c"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:58:03.343353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80db2d17-2e06-4dd5-b5e5-69a35ffa03a6 req-441f0aee-1cc1-498d-bf2a-512c5969ede7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:03.343884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80db2d17-2e06-4dd5-b5e5-69a35ffa03a6 req-441f0aee-1cc1-498d-bf2a-512c5969ede7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:03.344348 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80db2d17-2e06-4dd5-b5e5-69a35ffa03a6 req-441f0aee-1cc1-498d-bf2a-512c5969ede7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:03.356458 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-80db2d17-2e06-4dd5-b5e5-69a35ffa03a6 req-441f0aee-1cc1-498d-bf2a-512c5969ede7 service nova] Creating event network-vif-deleted:2638d56c-e943-4b6a-959e-eac535529c0c for instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 on nch1-master-1 Oct 01 21:58:03.361821 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-80db2d17-2e06-4dd5-b5e5-69a35ffa03a6 req-441f0aee-1cc1-498d-bf2a-512c5969ede7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032687 Oct 01 21:58:03.362434 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2373/6730] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:58:03.788497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:03.797228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:03.810599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:03.811118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:03.811575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:03.812344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:03.813014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:03.813582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:03.849744 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:03.850183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:03.850676 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:03.851155 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lazy-loading 'fault' on Instance uuid 62ad0403-ffed-4855-b39f-c9367a6cc4d8 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 21:58:03.891859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:03.899052 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-652c30c0-d82b-45b9-9c2a-5e21d831b706 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 200 len: 1357 microversion: 2.1 time: 0.114805 Oct 01 21:58:03.899636 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4358/6731] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:03 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 1357 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:04.925594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:04.926300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 62ad0403-ffed-4855-b39f-c9367a6cc4d8] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:04.933434 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:04.933923 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:04.934363 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:04.935083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:04.935545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:04.935977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:04.949267 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] HTTP exception thrown: Instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 could not be found. Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Request method failure captured: Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 HTTP/1.1 Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLdLv2TZ0B0Xz1wsy4zcJ0yREEX5T1tKKeJCaJEVz9hhs4TxfDjIGHkTIocROXJwvcD4XqZb2bTvELDwG4kyrRJvKyWMnrqlZZgxY1OZFYt2fuzfCCKUwBA1JjXUZ5hIoFH3gUfl_4QIFDIF6NB7DJVsexVj67fTzupdv91tzAaM8Og Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27214fca5a7a4c85bba526c092ac726b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}] Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 5f22070464e045f19acc335de7dd38f3 Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 could not be found. Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '62ad0403-ffed-4855-b39f-c9367a6cc4d8'} Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 could not be found. Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 could not be found. Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:58:04.950885 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 could not be found. Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Returning 404 to user: Instance 62ad0403-ffed-4855-b39f-c9367a6cc4d8 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-25fe8aba-87a9-458c-b69f-ef43dbfb6615 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8" status: 404 len: 111 microversion: 2.1 time: 0.031864 Oct 01 21:58:04.956399 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2374/6732] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:04 2022] GET /compute/v2.1/servers/62ad0403-ffed-4855-b39f-c9367a6cc4d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:58:07.900369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b15799f-37b5-444b-88c3-6cd8cd8e5359 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '.version_select at 0x7f4178298700>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:07.920127 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7b15799f-37b5-444b-88c3-6cd8cd8e5359 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1439469877" status: 202 len: 0 microversion: 2.1 time: 0.023671 Oct 01 21:58:07.920837 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4359/6733] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Oct 1 21:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1439469877 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:58:07.947532 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9f083f8a-7cd4-4d76-9da6-fc585994bdbb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: .version_select at 0x7f41723b1040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-214803038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdz4sY0nLmGoSCjDXmLkEXCM4cP58GcKSxJPdhChttlv63MWZPoORYYIv0qhhTAdWtU7BXfWu05kcpmAXSdUYmp5pAmIgtlPV6sQpmm5WL67fH0Ud0a9lMhRnh3P3B/bA=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:58:07.966800 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-9f083f8a-7cd4-4d76-9da6-fc585994bdbb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:58:07.972009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-9f083f8a-7cd4-4d76-9da6-fc585994bdbb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:58:07.995622 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9f083f8a-7cd4-4d76-9da6-fc585994bdbb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052004 Oct 01 21:58:07.996170 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2375/6734] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:58:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:58:13.986200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:13.991136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-258819150", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "c54cb878-74c3-43e2-8bd8-07e8b41753f0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-214803038", "security_groups": [{"name": "tempest-secgroup-smoke-796986685"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:58:14.254320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] validate_networks() for [('c54cb878-74c3-43e2-8bd8-07e8b41753f0', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 21:58:14.664353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:58:14.664795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:58:14.665294 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:58:14.665728 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:58:14.666159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:58:14.675722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:14.676959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:14.676959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:14.677923 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:14.679713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:14.680380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:14.702105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:58:14.708909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:58:14.729983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 21:58:14.732371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 21:58:14.780110 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-391e48c8-61c6-43de-ad58-06199e133d86 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.796152 Oct 01 21:58:14.781152 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4360/6735] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:58:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 21:58:14.793122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-67c6d990-71c9-4070-9480-bdfdf52c7000 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:14.795841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-67c6d990-71c9-4070-9480-bdfdf52c7000 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:14.940829 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-67c6d990-71c9-4070-9480-bdfdf52c7000 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:14.947175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=16 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:14.949403 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-67c6d990-71c9-4070-9480-bdfdf52c7000 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1265 microversion: 2.1 time: 0.160798 Oct 01 21:58:14.951041 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2376/6736] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:14 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:15.975649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:15.977603 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:15.985525 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:15.986161 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:15.987277 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:15.988129 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:15.988802 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:15.989684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:16.074548 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:16.083807 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6a530bda-586f-4fce-aa21-fc124693058b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1323 microversion: 2.1 time: 0.114022 Oct 01 21:58:16.084399 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4361/6737] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:15 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1323 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:17.107490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:17.108113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:17.117494 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:17.117992 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:17.118431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:17.119222 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:17.119682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:17.120113 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:17.262008 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:17.270074 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-99a6fb22-0f71-4796-82fe-3794791b622b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1390 microversion: 2.1 time: 0.166701 Oct 01 21:58:17.270785 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2377/6738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:17 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:17.430401 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-176136fa-293c-4820-828e-082938960d7c req-bc5edae7-4e6d-4744-aa19-931865d372be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b422b6-8be2-4a02-b3d8-abc8bdb1b97d", "tag": "6edc2a3c-b4b1-43d6-827c-d96bc4c8375a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:58:17.440955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-176136fa-293c-4820-828e-082938960d7c req-bc5edae7-4e6d-4744-aa19-931865d372be service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:17.441485 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-176136fa-293c-4820-828e-082938960d7c req-bc5edae7-4e6d-4744-aa19-931865d372be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:17.441915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-176136fa-293c-4820-828e-082938960d7c req-bc5edae7-4e6d-4744-aa19-931865d372be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:17.453974 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-176136fa-293c-4820-828e-082938960d7c req-bc5edae7-4e6d-4744-aa19-931865d372be service nova] Creating event network-changed:6edc2a3c-b4b1-43d6-827c-d96bc4c8375a for instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d on nch1-master-1 Oct 01 21:58:17.459083 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-176136fa-293c-4820-828e-082938960d7c req-bc5edae7-4e6d-4744-aa19-931865d372be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127505 Oct 01 21:58:17.459700 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4362/6739] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:58:18.293410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:18.294037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:18.300973 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:18.301408 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:18.301852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:18.302835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:18.303298 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:18.303730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:18.434147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:18.441893 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cae3bdfb-6a88-4c77-bb5d-8294fbe677ce tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1390 microversion: 2.1 time: 0.152602 Oct 01 21:58:18.442472 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2378/6740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:18 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:19.467452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:19.468836 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:19.475725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:19.476306 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:19.476907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:19.477814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:19.478305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:19.478784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:19.618089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:19.626870 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-54807d1d-1204-40cc-b2f7-5c6e92e835ff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1390 microversion: 2.1 time: 0.166580 Oct 01 21:58:19.627458 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4363/6741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:19 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:20.650755 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:20.651942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:20.658913 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:20.659407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:20.659856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:20.660582 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:20.661048 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:20.661480 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:20.789988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:20.797928 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4676734a-7c83-4bdc-954f-2995e498ae57 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1390 microversion: 2.1 time: 0.151294 Oct 01 21:58:20.798517 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2379/6742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:20 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:21.820195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:21.820825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:21.827856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:21.828370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:21.828929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:21.829655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:21.830127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:21.830589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:21.960835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:21.969506 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-840625c7-e466-44fd-becf-e8fc1421e0b2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1390 microversion: 2.1 time: 0.153265 Oct 01 21:58:21.970082 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4364/6743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:21 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:22.993282 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:22.993904 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:23.002009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:23.002528 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:23.002982 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:23.003697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:23.004162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:23.004602 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:23.140675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:23.148363 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-55749b76-148e-493f-a486-748b9dddedef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1390 microversion: 2.1 time: 0.159397 Oct 01 21:58:23.148953 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2380/6744] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:22 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:24.171443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:24.172137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:24.179158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:24.179559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:24.180024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:24.180755 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:24.181244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:24.181696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:24.213704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c5213edc-ec74-4696-a906-7224f5dd4e18 req-9e59cd1e-d09b-4c36-a0bc-b99bcb786b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b422b6-8be2-4a02-b3d8-abc8bdb1b97d", "name": "network-vif-plugged", "status": "completed", "tag": "6edc2a3c-b4b1-43d6-827c-d96bc4c8375a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:58:24.219705 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:24.227727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c5213edc-ec74-4696-a906-7224f5dd4e18 req-9e59cd1e-d09b-4c36-a0bc-b99bcb786b88 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:24.228616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c5213edc-ec74-4696-a906-7224f5dd4e18 req-9e59cd1e-d09b-4c36-a0bc-b99bcb786b88 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:24.229067 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c5213edc-ec74-4696-a906-7224f5dd4e18 req-9e59cd1e-d09b-4c36-a0bc-b99bcb786b88 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:24.241348 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c5213edc-ec74-4696-a906-7224f5dd4e18 req-9e59cd1e-d09b-4c36-a0bc-b99bcb786b88 service nova] Creating event network-vif-plugged:6edc2a3c-b4b1-43d6-827c-d96bc4c8375a for instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d on nch1-master-1 Oct 01 21:58:24.247758 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c5213edc-ec74-4696-a906-7224f5dd4e18 req-9e59cd1e-d09b-4c36-a0bc-b99bcb786b88 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037914 Oct 01 21:58:24.248569 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2381/6745] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:58:24.333752 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:24.345319 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7a346609-9107-4dac-93aa-586c97f27b4e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1390 microversion: 2.1 time: 0.177834 Oct 01 21:58:24.346592 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4365/6746] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:24 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:25.370458 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:25.371204 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:25.373267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:25.379799 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:25.380301 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:25.380752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:25.381476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:25.381946 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:25.382396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:25.526748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:25.535392 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-89482f73-283d-47dc-a9ed-723bab1c38ac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1390 microversion: 2.1 time: 0.169764 Oct 01 21:58:25.536007 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2382/6747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:25 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:26.559735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:26.560315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:26.562343 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:26.563203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:26.570152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:26.570698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:26.571166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:26.571914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:26.572398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:26.573425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:26.702588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:26.710614 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-88212c88-aa4c-4c64-a848-004156c8956e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1562 microversion: 2.1 time: 0.155375 Oct 01 21:58:26.711254 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4366/6748] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:26 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:26.733661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:26.734407 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:26.741450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:26.741947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:26.742394 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:26.743142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:26.743609 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:26.744045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:26.878689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:26.886622 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e0ee25ea-5dfe-49d2-a907-eda9ede4cade tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1562 microversion: 2.1 time: 0.157592 Oct 01 21:58:26.887206 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2383/6749] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:26 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:28.755601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:28.756109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:28.764196 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:28.764383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b632ffea-0570-46fc-8eee-62560d31cab4 req-617de431-01e5-49ed-a669-6a9a359cf5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b422b6-8be2-4a02-b3d8-abc8bdb1b97d", "tag": "6edc2a3c-b4b1-43d6-827c-d96bc4c8375a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:58:28.765461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:28.766000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:28.767452 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:28.768012 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:28.768549 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:28.778261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b632ffea-0570-46fc-8eee-62560d31cab4 req-617de431-01e5-49ed-a669-6a9a359cf5b0 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:28.778785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b632ffea-0570-46fc-8eee-62560d31cab4 req-617de431-01e5-49ed-a669-6a9a359cf5b0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:28.779223 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b632ffea-0570-46fc-8eee-62560d31cab4 req-617de431-01e5-49ed-a669-6a9a359cf5b0 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:28.794210 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b632ffea-0570-46fc-8eee-62560d31cab4 req-617de431-01e5-49ed-a669-6a9a359cf5b0 service nova] Creating event network-changed:6edc2a3c-b4b1-43d6-827c-d96bc4c8375a for instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d on nch1-master-1 Oct 01 21:58:28.799471 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b632ffea-0570-46fc-8eee-62560d31cab4 req-617de431-01e5-49ed-a669-6a9a359cf5b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038676 Oct 01 21:58:28.800097 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2384/6750] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:58:28.925528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:28.934454 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0a4bf503-e9c7-4403-9bba-820fc74ed6f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1562 microversion: 2.1 time: 0.183190 Oct 01 21:58:28.935369 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4367/6751] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:28 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1562 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:52.181777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=7 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:52.182558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=40 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:52.186997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d54e117-71bd-42a9-a32c-01510a0e7f56 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:58:52.189320 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3d54e117-71bd-42a9-a32c-01510a0e7f56 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:52.196360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d54e117-71bd-42a9-a32c-01510a0e7f56 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:52.197343 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d54e117-71bd-42a9-a32c-01510a0e7f56 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:52.197790 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d54e117-71bd-42a9-a32c-01510a0e7f56 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:52.198521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d54e117-71bd-42a9-a32c-01510a0e7f56 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:52.198995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d54e117-71bd-42a9-a32c-01510a0e7f56 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:52.199426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d54e117-71bd-42a9-a32c-01510a0e7f56 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:52.249992 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3d54e117-71bd-42a9-a32c-01510a0e7f56 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d/action" status: 200 len: 24574 microversion: 2.1 time: 0.069950 Oct 01 21:58:52.250656 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2385/6752] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:58:52 2022] POST /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d/action => generated 24574 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:58:58.591806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:58:58.594047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:58.596323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:58.597017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=40 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:58:58.604449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:58.608393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:58.608884 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:58.609631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:58.611006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:58.611467 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:58.654538 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:58.660652 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Old instance type m1.heat2, new instance type m1.heat {{(pid=140438) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 01 21:58:58.667480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 21:58:58.667928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 21:58:58.668425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 21:58:58.668853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 21:58:58.669305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 21:58:58.732847 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-caa3659d-e411-4ef1-b863-e1edf3fefb29 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d/action" status: 202 len: 0 microversion: 2.1 time: 0.145150 Oct 01 21:58:58.733471 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4368/6753] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:58:58 2022] POST /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:58:58.742153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:58.742988 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:58.746614 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 21:58:58.746748 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 21:58:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d (ip 10.222.0.17) !!! Oct 01 21:58:58.753670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:58.754157 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:58.754628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:58.755342 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:58.755808 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:58.756242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:58.928597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:58:58.937272 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4d339dd2-1d90-4074-adb7-97241da65955 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1690 microversion: 2.1 time: 0.199313 Oct 01 21:58:58.937856 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2386/6754] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:58 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:58:59.961945 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:58:59.963203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:58:59.970611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:59.971195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:59.971725 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:58:59.972509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:58:59.973051 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:58:59.973583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:00.109992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:00.117963 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ed6e1428-d2f8-4135-84d3-09c14c4ac494 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1690 microversion: 2.1 time: 0.161152 Oct 01 21:59:00.119084 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4369/6755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:58:59 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:01.145035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:01.145656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:01.153146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:01.153635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:01.154080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:01.154810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:01.155300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:01.155728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:01.286885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:01.295639 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e123a6ff-e1d3-4a7e-bcd3-87790ac7914d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.154552 Oct 01 21:59:01.296268 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2387/6756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:01 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:02.319621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:02.320182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:02.327209 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:02.327720 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:02.328181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:02.328905 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:02.329387 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:02.329846 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:02.458638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:02.467024 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-098619e5-dbab-408d-a0b9-19aa670efcac tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.151408 Oct 01 21:59:02.467607 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4370/6757] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:02 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:03.491189 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:03.491805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:03.499748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:03.500237 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:03.500679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:03.501369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:03.501826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:03.502257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:03.632449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:03.640480 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5c4add87-3432-4dd6-8d21-00048a1a7c0d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.153209 Oct 01 21:59:03.641051 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2388/6758] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:03 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:04.664216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:04.664848 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:04.672494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:04.673004 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:04.673465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:04.674187 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:04.674696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:04.675144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:04.807378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:04.815584 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ccaf178c-45b1-4b25-a164-20f4d82e1b50 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.155419 Oct 01 21:59:04.816166 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4371/6759] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:04 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 21:59:05.839261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:05.839959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:05.848073 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:05.848568 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:05.849012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:05.849719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:05.850182 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:05.850646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:05.985558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:05.993350 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3626b2c2-db2c-40c9-b059-c915a95b49e9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.157996 Oct 01 21:59:05.993931 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2389/6760] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:05 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:07.016645 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:07.017283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:07.024251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:07.024757 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:07.025225 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:07.025947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:07.026428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:07.026975 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:07.157312 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:07.165165 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d2b245d-da27-4e9f-b4d9-82e689e454ef tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.152496 Oct 01 21:59:07.166231 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4372/6761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:07 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:08.189964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:08.190626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:08.198101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:08.198621 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:08.199080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:08.199785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:08.200247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:08.200678 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:08.330433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:08.338273 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a70c484f-2af7-4864-bc58-8ff92a1baa07 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.152262 Oct 01 21:59:08.338886 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2390/6762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:08 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:09.361535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:09.362170 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:09.369227 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:09.369736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:09.370214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:09.370943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:09.371445 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:09.371892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:09.504829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:09.513414 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a63868a7-ca61-4a42-a343-2281d07a05d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.155747 Oct 01 21:59:09.514013 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4373/6763] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:09 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:10.538944 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:10.539562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:10.547227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:10.547719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:10.548165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:10.548869 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:10.549336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:10.549771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:10.688231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:10.696131 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cfe30914-eec2-4d54-9645-b1eb81d15aff tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.161157 Oct 01 21:59:10.696718 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2391/6764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:10 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:11.719461 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:11.720121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:11.727020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:11.727524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:11.728472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:11.729207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:11.729688 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:11.730133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:11.866037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:11.874786 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-fd2a6b76-6db7-449e-bce7-4e218a7a05b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1695 microversion: 2.1 time: 0.159223 Oct 01 21:59:11.875396 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4374/6765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:11 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:12.898250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:12.898885 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:12.905768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:12.906266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:12.906745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:12.907451 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:12.907916 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:12.908381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:13.141479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:13.149300 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-42a4cd2c-9b00-4509-8d01-61ca49b06882 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1694 microversion: 2.1 time: 0.255019 Oct 01 21:59:13.149881 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2392/6766] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:12 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1694 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:13.279084 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-4836f1f3-0156-4eab-88b1-2e0b949c8824 req-79def892-31eb-4cfa-8a6e-4898c5459414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b422b6-8be2-4a02-b3d8-abc8bdb1b97d", "name": "network-vif-unplugged", "status": "completed", "tag": "6edc2a3c-b4b1-43d6-827c-d96bc4c8375a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:59:13.289134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4836f1f3-0156-4eab-88b1-2e0b949c8824 req-79def892-31eb-4cfa-8a6e-4898c5459414 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:13.289613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4836f1f3-0156-4eab-88b1-2e0b949c8824 req-79def892-31eb-4cfa-8a6e-4898c5459414 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:13.290036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-4836f1f3-0156-4eab-88b1-2e0b949c8824 req-79def892-31eb-4cfa-8a6e-4898c5459414 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:13.302755 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-4836f1f3-0156-4eab-88b1-2e0b949c8824 req-79def892-31eb-4cfa-8a6e-4898c5459414 service nova] Creating event network-vif-unplugged:6edc2a3c-b4b1-43d6-827c-d96bc4c8375a for instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d on nch2-master-1 Oct 01 21:59:13.308953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-4836f1f3-0156-4eab-88b1-2e0b949c8824 req-79def892-31eb-4cfa-8a6e-4898c5459414 service nova] Instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:59:13.319976 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-4836f1f3-0156-4eab-88b1-2e0b949c8824 req-79def892-31eb-4cfa-8a6e-4898c5459414 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100229 Oct 01 21:59:13.320593 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4375/6767] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:59:14.173840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:14.174469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:14.182603 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:14.183167 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:14.183673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:14.184482 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:14.185057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:14.185449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:14.326171 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:14.334226 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-dc2cb142-75c3-4689-94d6-279fbf319a12 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1694 microversion: 2.1 time: 0.164289 Oct 01 21:59:14.334842 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2393/6768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:14 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:15.339100 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9bed9ff9-184f-4713-856c-825fcd6320a8 req-ca53164f-2cdd-49b5-9fde-d9d3cfab637f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b422b6-8be2-4a02-b3d8-abc8bdb1b97d", "tag": "6edc2a3c-b4b1-43d6-827c-d96bc4c8375a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:59:15.348637 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9bed9ff9-184f-4713-856c-825fcd6320a8 req-ca53164f-2cdd-49b5-9fde-d9d3cfab637f service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:15.349134 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9bed9ff9-184f-4713-856c-825fcd6320a8 req-ca53164f-2cdd-49b5-9fde-d9d3cfab637f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:15.349675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9bed9ff9-184f-4713-856c-825fcd6320a8 req-ca53164f-2cdd-49b5-9fde-d9d3cfab637f service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:15.357726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:15.358561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:15.361608 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9bed9ff9-184f-4713-856c-825fcd6320a8 req-ca53164f-2cdd-49b5-9fde-d9d3cfab637f service nova] Creating event network-changed:6edc2a3c-b4b1-43d6-827c-d96bc4c8375a for instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d on nch2-master-1 Oct 01 21:59:15.365267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:15.365751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:15.366191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:15.366940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:15.367399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:15.367534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [req-9bed9ff9-184f-4713-856c-825fcd6320a8 req-ca53164f-2cdd-49b5-9fde-d9d3cfab637f service nova] Instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140438) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 01 21:59:15.367828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:15.379841 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9bed9ff9-184f-4713-856c-825fcd6320a8 req-ca53164f-2cdd-49b5-9fde-d9d3cfab637f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046322 Oct 01 21:59:15.380502 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4376/6769] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:59:15.595928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:15.604730 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0773e470-a87b-4974-87d2-db843e15c582 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1692 microversion: 2.1 time: 0.250976 Oct 01 21:59:15.605327 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2394/6770] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:15 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1692 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:16.631036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:16.631718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:16.638036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:16.638575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:16.639042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:16.639764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:16.640247 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:16.640699 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:16.773588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:16.782129 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0bb99f91-fec2-4562-9218-15e2c85b252d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1689 microversion: 2.1 time: 0.156641 Oct 01 21:59:16.782751 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4377/6771] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:16 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:16.805504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e1c97c19-a0c3-4e0b-a7f6-1220a32bb2f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:59:16.806323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e1c97c19-a0c3-4e0b-a7f6-1220a32bb2f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:16.812850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1c97c19-a0c3-4e0b-a7f6-1220a32bb2f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:16.813337 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1c97c19-a0c3-4e0b-a7f6-1220a32bb2f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:16.813774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1c97c19-a0c3-4e0b-a7f6-1220a32bb2f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:16.814468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1c97c19-a0c3-4e0b-a7f6-1220a32bb2f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:16.814948 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1c97c19-a0c3-4e0b-a7f6-1220a32bb2f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:16.815378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e1c97c19-a0c3-4e0b-a7f6-1220a32bb2f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:16.872561 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e1c97c19-a0c3-4e0b-a7f6-1220a32bb2f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d/action" status: 204 len: 0 microversion: 2.1 time: 0.070972 Oct 01 21:59:16.873200 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2395/6772] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:59:16 2022] POST /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:59:16.881529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:16.882266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:16.888970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:16.889959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:16.890713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:16.891655 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:16.892415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:16.893141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:17.105042 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:17.113017 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ac3ef543-c4c8-4181-8b87-c1aac6f14261 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1689 microversion: 2.1 time: 0.235597 Oct 01 21:59:17.113605 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4378/6773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:16 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1689 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:17.136690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:17.137319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:17.143517 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:17.144003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:17.144442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:17.145139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:17.145596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:17.146032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:17.301087 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:17.310331 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cd00f23d-fc9c-4ab5-91bc-4049d6fbd76b tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1689 microversion: 2.1 time: 0.178724 Oct 01 21:59:17.310950 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2396/6774] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:17 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:18.335190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:18.335829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:18.343434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:18.343954 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:18.344417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:18.345151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:18.345631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:18.346081 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:18.488610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:18.497457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3f5d62a6-d95c-4a18-b788-88e18391ca43 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1681 microversion: 2.1 time: 0.166195 Oct 01 21:59:18.498048 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4379/6775] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:18 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:20.131906 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e8ac1499-727b-40b1-9e36-5445022992bc req-23fa2d05-3d96-4b4e-9429-ff8853d801ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b422b6-8be2-4a02-b3d8-abc8bdb1b97d", "name": "network-vif-plugged", "status": "completed", "tag": "6edc2a3c-b4b1-43d6-827c-d96bc4c8375a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:59:20.142163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e8ac1499-727b-40b1-9e36-5445022992bc req-23fa2d05-3d96-4b4e-9429-ff8853d801ca service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:20.142682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e8ac1499-727b-40b1-9e36-5445022992bc req-23fa2d05-3d96-4b4e-9429-ff8853d801ca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:20.143120 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e8ac1499-727b-40b1-9e36-5445022992bc req-23fa2d05-3d96-4b4e-9429-ff8853d801ca service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:20.157398 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e8ac1499-727b-40b1-9e36-5445022992bc req-23fa2d05-3d96-4b4e-9429-ff8853d801ca service nova] Creating event network-vif-plugged:6edc2a3c-b4b1-43d6-827c-d96bc4c8375a for instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d on nch2-master-1 Oct 01 21:59:20.162432 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e8ac1499-727b-40b1-9e36-5445022992bc req-23fa2d05-3d96-4b4e-9429-ff8853d801ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093404 Oct 01 21:59:20.163056 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2397/6776] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 21:59:40.674417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1a37e637-5591-4a61-bfe0-2d497369b685 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:59:40.676754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1a37e637-5591-4a61-bfe0-2d497369b685 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:40.679439 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=28 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:59:40.680226 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:59:40.686476 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a37e637-5591-4a61-bfe0-2d497369b685 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:40.687000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a37e637-5591-4a61-bfe0-2d497369b685 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:40.687454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a37e637-5591-4a61-bfe0-2d497369b685 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:40.688173 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a37e637-5591-4a61-bfe0-2d497369b685 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:40.688646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a37e637-5591-4a61-bfe0-2d497369b685 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:40.689123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1a37e637-5591-4a61-bfe0-2d497369b685 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:40.747334 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1a37e637-5591-4a61-bfe0-2d497369b685 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d/action" status: 200 len: 24580 microversion: 2.1 time: 0.077043 Oct 01 21:59:40.747986 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4380/6777] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 21:59:40 2022] POST /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d/action => generated 24580 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 21:59:47.730125 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=26 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:59:47.731305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:59:47.735115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-9584d53f-fdae-4e66-b186-617c72e4de6d req-d521ed15-5131-4ce1-b721-f6115adbc009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b422b6-8be2-4a02-b3d8-abc8bdb1b97d", "tag": "6edc2a3c-b4b1-43d6-827c-d96bc4c8375a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:59:47.736450 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:47.737319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:47.745047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:47.745547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:47.745984 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:47.746740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:47.747618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:47.747618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:47.747825 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9584d53f-fdae-4e66-b186-617c72e4de6d req-d521ed15-5131-4ce1-b721-f6115adbc009 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:47.748323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9584d53f-fdae-4e66-b186-617c72e4de6d req-d521ed15-5131-4ce1-b721-f6115adbc009 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:47.748875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-9584d53f-fdae-4e66-b186-617c72e4de6d req-d521ed15-5131-4ce1-b721-f6115adbc009 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:47.765775 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-9584d53f-fdae-4e66-b186-617c72e4de6d req-d521ed15-5131-4ce1-b721-f6115adbc009 service nova] Creating event network-changed:6edc2a3c-b4b1-43d6-827c-d96bc4c8375a for instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d on nch2-master-1 Oct 01 21:59:47.771188 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-9584d53f-fdae-4e66-b186-617c72e4de6d req-d521ed15-5131-4ce1-b721-f6115adbc009 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040603 Oct 01 21:59:47.772066 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4381/6778] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:59:47.777472 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 21:59:47.865849 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f5d6087e-5f20-420b-9aa8-ee5327fd892d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 204 len: 0 microversion: 2.1 time: 0.137486 Oct 01 21:59:47.869778 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2398/6779] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 21:59:47 2022] DELETE /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 21:59:47.877856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:47.878634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:47.886128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:47.886677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:47.887421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:47.888169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:47.888640 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:47.889276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:48.033195 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:48.042033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-09012b4e-f658-4cba-9896-4eee08ac6b21 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1687 microversion: 2.1 time: 0.169420 Oct 01 21:59:48.042938 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4382/6780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:47 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:49.067214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:49.067925 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:49.075156 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:49.075647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:49.076091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:49.077412 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:49.077876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:49.078306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:49.286959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 21:59:49.296072 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e37b9668-f73f-4067-bc40-a4a7b92204e0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 200 len: 1687 microversion: 2.1 time: 0.232923 Oct 01 21:59:49.296580 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2399/6781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:49 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 1687 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 21:59:49.578817 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-d8a9f026-1c95-45d7-bfda-4f87293ce287 req-11cb1d1d-df4d-4991-b275-d74daa0f4495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b422b6-8be2-4a02-b3d8-abc8bdb1b97d", "name": "network-vif-deleted", "tag": "6edc2a3c-b4b1-43d6-827c-d96bc4c8375a"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:59:49.590153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8a9f026-1c95-45d7-bfda-4f87293ce287 req-11cb1d1d-df4d-4991-b275-d74daa0f4495 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:49.590679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8a9f026-1c95-45d7-bfda-4f87293ce287 req-11cb1d1d-df4d-4991-b275-d74daa0f4495 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:49.591132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-d8a9f026-1c95-45d7-bfda-4f87293ce287 req-11cb1d1d-df4d-4991-b275-d74daa0f4495 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:49.603064 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-d8a9f026-1c95-45d7-bfda-4f87293ce287 req-11cb1d1d-df4d-4991-b275-d74daa0f4495 service nova] Creating event network-vif-deleted:6edc2a3c-b4b1-43d6-827c-d96bc4c8375a for instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d on nch2-master-1 Oct 01 21:59:49.607809 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-d8a9f026-1c95-45d7-bfda-4f87293ce287 req-11cb1d1d-df4d-4991-b275-d74daa0f4495 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032842 Oct 01 21:59:49.608414 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4383/6782] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 21:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:59:50.319825 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:50.320468 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 21:59:50.327429 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:50.327922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:50.328369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:50.329068 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 21:59:50.329529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 21:59:50.329958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 21:59:50.343812 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] HTTP exception thrown: Instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d could not be found. Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Request method failure captured: Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d HTTP/1.1 Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLdLv2TZ0B0Xz1wsy4zcJ0yREEX5T1tKKeJCaJEVz9hhs4TxfDjIGHkTIocROXJwvcD4XqZb2bTvELDwG4kyrRJvKyWMnrqlZZgxY1OZFYt2fuzfCCKUwBA1JjXUZ5hIoFH3gUfl_4QIFDIF6NB7DJVsexVj67fTzupdv91tzAaM8Og Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27214fca5a7a4c85bba526c092ac726b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}] Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 5f22070464e045f19acc335de7dd38f3 Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d could not be found. Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '95b422b6-8be2-4a02-b3d8-abc8bdb1b97d'} Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d could not be found. Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d could not be found. Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:59:50.345445 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d could not be found. Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Returning 404 to user: Instance 95b422b6-8be2-4a02-b3d8-abc8bdb1b97d could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-2e363b5d-3b78-4dae-b931-a1012bcfe0a8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d" status: 404 len: 111 microversion: 2.1 time: 0.030942 Oct 01 21:59:50.350762 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2400/6783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 21:59:50 2022] GET /compute/v2.1/servers/95b422b6-8be2-4a02-b3d8-abc8bdb1b97d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 21:59:53.571515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-952d1d87-f3fa-41f5-80f8-8812e71078da tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '.version_select at 0x7f41725c31f0>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 21:59:53.600033 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-952d1d87-f3fa-41f5-80f8-8812e71078da tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-214803038" status: 202 len: 0 microversion: 2.1 time: 0.034372 Oct 01 21:59:53.605499 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4384/6784] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Oct 1 21:59:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-214803038 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 21:59:53.627584 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c141f03-cc11-4407-9c01-f15dcb7f4ffc tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: .version_select at 0x7f4172455d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1735913510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2j5vzPMqCz3SYF0pL99FyMSEDspzORWHpryv0UM93gJqb9oHtg7Q52Y3Hu2KeLoLLGV1rq7HsjVu9bQ2rDytndvIOHW9qc4GNk5AUY++4CG0iSCOQoKMsA56WwUmx2YA=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:59:53.647094 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-6c141f03-cc11-4407-9c01-f15dcb7f4ffc tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 21:59:53.653597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-6c141f03-cc11-4407-9c01-f15dcb7f4ffc tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 21:59:53.680637 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6c141f03-cc11-4407-9c01-f15dcb7f4ffc tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056594 Oct 01 21:59:53.686563 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2401/6785] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 21:59:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 21:59:59.470324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2146235972", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "804adec5-af20-4b09-8c2a-27cdb1ce2d66"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1735913510", "security_groups": [{"name": "tempest-secgroup-smoke-1766495936"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 21:59:59.596465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=14 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 21:59:59.615235 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] validate_networks() for [('804adec5-af20-4b09-8c2a-27cdb1ce2d66', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 22:00:00.021814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 22:00:00.022295 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 22:00:00.022828 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 22:00:00.023455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 22:00:00.023883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 22:00:00.034249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:00.034784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:00.035239 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:00.035980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:00.036446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:00.036889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:00.055984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:00:00.062597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:00:00.079068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 22:00:00.081585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 22:00:00.135547 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-16781ef5-ef43-4f9a-ac65-f6c23bf8b6e8 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.669719 Oct 01 22:00:00.143422 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4385/6786] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 21:59:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 22:00:00.149713 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-cf2ddd39-064b-49b8-99fe-b37668399ed2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:00.150600 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-cf2ddd39-064b-49b8-99fe-b37668399ed2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:00.224229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-cf2ddd39-064b-49b8-99fe-b37668399ed2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:00.233038 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-cf2ddd39-064b-49b8-99fe-b37668399ed2 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1267 microversion: 2.1 time: 0.088442 Oct 01 22:00:00.234359 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2402/6787] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:00 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:01.260031 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:01.261383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:01.270360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:01.271198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:01.271749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:01.272718 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:01.273371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:01.273822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:01.373395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:01.386675 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f9b7525a-455e-45ff-8e12-1c799be76f24 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1325 microversion: 2.1 time: 0.134076 Oct 01 22:00:01.387734 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4386/6788] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:01 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1325 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 22:00:02.409720 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:02.410338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:02.412564 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:00:02.421553 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:02.422163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:02.422637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:02.423573 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:02.424035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:02.424469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:02.570613 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:02.578430 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f12ebeb3-405d-4b70-a641-eb27a98260a9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1393 microversion: 2.1 time: 0.172795 Oct 01 22:00:02.579037 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2403/6789] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:02 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:02.711796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b5de5b8c-4f79-4cf1-9414-de2dd719c3f0 req-8394bb48-a7ef-4c43-a4ce-e1bde514ab53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81ae405-bd58-4d32-8172-891d03e0429b", "tag": "1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:00:02.724348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b5de5b8c-4f79-4cf1-9414-de2dd719c3f0 req-8394bb48-a7ef-4c43-a4ce-e1bde514ab53 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:02.725222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b5de5b8c-4f79-4cf1-9414-de2dd719c3f0 req-8394bb48-a7ef-4c43-a4ce-e1bde514ab53 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:02.725746 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b5de5b8c-4f79-4cf1-9414-de2dd719c3f0 req-8394bb48-a7ef-4c43-a4ce-e1bde514ab53 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:02.737275 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b5de5b8c-4f79-4cf1-9414-de2dd719c3f0 req-8394bb48-a7ef-4c43-a4ce-e1bde514ab53 service nova] Creating event network-changed:1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9 for instance a81ae405-bd58-4d32-8172-891d03e0429b on nch1-master-1 Oct 01 22:00:02.742475 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b5de5b8c-4f79-4cf1-9414-de2dd719c3f0 req-8394bb48-a7ef-4c43-a4ce-e1bde514ab53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049136 Oct 01 22:00:02.743778 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4387/6790] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:00:03.601259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:03.601887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:03.608964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:03.609459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:03.609897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:03.610656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:03.611117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:03.611540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:03.740287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:03.748665 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b6385a73-fc5e-498c-a870-38eb04593ba6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1393 microversion: 2.1 time: 0.151315 Oct 01 22:00:03.749338 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2404/6791] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:03 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:04.772777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:04.774040 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:04.781145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:04.781649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:04.782106 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:04.782856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:04.783335 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:04.783780 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:04.914097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:04.921838 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-76250d6b-784c-47be-b4da-21c673103f2d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1393 microversion: 2.1 time: 0.153441 Oct 01 22:00:04.922416 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4388/6792] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:04 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:05.944980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:05.946232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:05.953170 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:05.953654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:05.954092 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:05.954807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:05.955267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:05.955690 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:06.091017 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:06.099158 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e4f8e354-c531-4592-ae4f-9a008d2a9a98 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1393 microversion: 2.1 time: 0.158159 Oct 01 22:00:06.099766 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2405/6793] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:05 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:07.122472 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:07.123120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:07.130067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:07.130604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:07.131059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:07.131764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:07.132233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:07.132679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:07.271109 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:07.278928 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d06276d9-1d65-416a-bfe1-3815236deb41 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1393 microversion: 2.1 time: 0.160469 Oct 01 22:00:07.279527 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4389/6794] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:07 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:08.303002 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:08.303547 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:08.310316 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:08.310850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:08.311294 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:08.311991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:08.312455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:08.312884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:08.444401 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:08.452374 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ddc7c94e-c070-4b4f-9cb9-3ada3d6e13a7 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1393 microversion: 2.1 time: 0.153699 Oct 01 22:00:08.452957 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2406/6795] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:08 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:08.627063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c97ed728-ca12-4670-ac7e-a84c05a381ea req-f767bced-5276-4d75-84f3-c4db5342297e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81ae405-bd58-4d32-8172-891d03e0429b", "name": "network-vif-plugged", "status": "completed", "tag": "1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:00:08.638854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c97ed728-ca12-4670-ac7e-a84c05a381ea req-f767bced-5276-4d75-84f3-c4db5342297e service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:08.639352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c97ed728-ca12-4670-ac7e-a84c05a381ea req-f767bced-5276-4d75-84f3-c4db5342297e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:08.639957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c97ed728-ca12-4670-ac7e-a84c05a381ea req-f767bced-5276-4d75-84f3-c4db5342297e service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:08.651767 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c97ed728-ca12-4670-ac7e-a84c05a381ea req-f767bced-5276-4d75-84f3-c4db5342297e service nova] Creating event network-vif-plugged:1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9 for instance a81ae405-bd58-4d32-8172-891d03e0429b on nch1-master-1 Oct 01 22:00:08.656817 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c97ed728-ca12-4670-ac7e-a84c05a381ea req-f767bced-5276-4d75-84f3-c4db5342297e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033696 Oct 01 22:00:08.657434 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4390/6796] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:00:09.475177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:09.475812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:09.483255 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:09.483726 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:09.484161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:09.484857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:09.485311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:09.485736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:09.620795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:09.628618 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-62ec9bde-c583-41f2-9974-f36b9de0d2e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1393 microversion: 2.1 time: 0.157259 Oct 01 22:00:09.629151 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2407/6797] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:09 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:10.649904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:00:10.650738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:00:10.655107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:10.655844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:10.663003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:10.663515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:10.664625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:10.665348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:10.665831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:10.666285 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:10.799635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:10.807805 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a0fb928b-3a90-48d3-a641-a8da70cd1351 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1565 microversion: 2.1 time: 0.160228 Oct 01 22:00:10.808390 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4391/6798] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:10 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:10.830383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:10.831031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:10.832964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:00:10.843009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:10.843009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:10.843009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:10.843009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:10.843498 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:10.843646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:10.973108 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:10.980890 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bf082437-32d2-4f82-bd27-30b338c237f1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1565 microversion: 2.1 time: 0.154487 Oct 01 22:00:10.981465 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2408/6799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:10 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:12.542340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:12.543003 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:12.545242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-aec41568-fbfd-4080-a275-4483676897a2 req-57b4866a-05ab-4f79-b38b-4c6597afaa8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81ae405-bd58-4d32-8172-891d03e0429b", "tag": "1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:00:12.545804 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:00:12.551320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:12.552086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:12.552543 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:12.553266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:12.553739 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:12.554180 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:12.557040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-aec41568-fbfd-4080-a275-4483676897a2 req-57b4866a-05ab-4f79-b38b-4c6597afaa8a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:12.557715 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-aec41568-fbfd-4080-a275-4483676897a2 req-57b4866a-05ab-4f79-b38b-4c6597afaa8a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:12.558153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-aec41568-fbfd-4080-a275-4483676897a2 req-57b4866a-05ab-4f79-b38b-4c6597afaa8a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:12.570672 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-aec41568-fbfd-4080-a275-4483676897a2 req-57b4866a-05ab-4f79-b38b-4c6597afaa8a service nova] Creating event network-changed:1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9 for instance a81ae405-bd58-4d32-8172-891d03e0429b on nch1-master-1 Oct 01 22:00:12.575806 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-aec41568-fbfd-4080-a275-4483676897a2 req-57b4866a-05ab-4f79-b38b-4c6597afaa8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034391 Oct 01 22:00:12.576594 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2409/6800] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:00:12.783835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:12.793301 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-77f701ff-ed2b-4b25-a318-b8bc21f304d5 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1565 microversion: 2.1 time: 0.255273 Oct 01 22:00:12.793899 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4392/6801] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:12 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:36.040578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:00:36.041354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=38 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:00:36.091891 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8dab048b-fb7c-4865-8846-e3709197df68 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:00:36.094324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8dab048b-fb7c-4865-8846-e3709197df68 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:36.100569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dab048b-fb7c-4865-8846-e3709197df68 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:36.101055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dab048b-fb7c-4865-8846-e3709197df68 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:36.101495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dab048b-fb7c-4865-8846-e3709197df68 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:36.102199 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dab048b-fb7c-4865-8846-e3709197df68 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:36.102693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dab048b-fb7c-4865-8846-e3709197df68 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:36.103126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8dab048b-fb7c-4865-8846-e3709197df68 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:36.153022 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8dab048b-fb7c-4865-8846-e3709197df68 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action" status: 200 len: 24566 microversion: 2.1 time: 0.114328 Oct 01 22:00:36.153629 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2410/6802] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:00:36 2022] POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action => generated 24566 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 22:00:42.589520 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a62f91f6-d4a0-4ad2-ab90-4740051142b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:00:42.591986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:00:42.592650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=36 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:00:42.599194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62f91f6-d4a0-4ad2-ab90-4740051142b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:42.599649 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62f91f6-d4a0-4ad2-ab90-4740051142b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:42.600136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a62f91f6-d4a0-4ad2-ab90-4740051142b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:42.624813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a62f91f6-d4a0-4ad2-ab90-4740051142b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Going to try to stop instance {{(pid=140438) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 22:00:42.668612 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a62f91f6-d4a0-4ad2-ab90-4740051142b9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action" status: 202 len: 0 microversion: 2.1 time: 0.082876 Oct 01 22:00:42.669230 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4393/6803] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:00:42 2022] POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:00:42.678782 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:42.679560 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:42.689730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:42.690238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:42.690729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:42.691453 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:42.691920 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:42.692355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:42.826833 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:42.834839 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d3c1ebb7-f824-4141-bb74-7d66e021d56a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1694 microversion: 2.1 time: 0.160499 Oct 01 22:00:42.835433 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2411/6804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:42 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 22:00:43.859094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:43.859811 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:43.868564 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:43.869070 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:43.869529 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:43.870250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:43.870751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:43.871194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:44.005009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:44.012822 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26d9d513-88f8-4c85-b420-5adcd56e36a0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1694 microversion: 2.1 time: 0.158049 Oct 01 22:00:44.013405 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4394/6805] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:43 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:45.037192 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:45.037816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:45.048491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:45.048996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:45.049442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:45.050149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:45.050646 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:45.051083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:45.181771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:45.189616 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bc921317-5195-48e8-a9d1-b2a36b971584 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1694 microversion: 2.1 time: 0.156328 Oct 01 22:00:45.190201 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2412/6806] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:45 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:46.213646 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:46.214296 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:46.221246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:46.221747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:46.222204 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:46.222938 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:46.223409 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:46.223849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:46.356150 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:46.364035 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1229c642-7d2f-4983-9933-17c65a04cd1d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1694 microversion: 2.1 time: 0.155008 Oct 01 22:00:46.364613 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4395/6807] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:46 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:47.387548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:47.388102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:47.396589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:47.396589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:47.396589 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:47.397209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:47.397302 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:47.397736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:47.530964 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:47.539392 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6eaaec50-1633-467e-9473-8cbf1db2a413 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1694 microversion: 2.1 time: 0.155219 Oct 01 22:00:47.539969 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2413/6808] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:47 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:48.562859 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:48.563584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:48.570383 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:48.570915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:48.571370 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:48.572076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:48.572545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:48.572989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:48.701707 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:48.709581 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ffecc858-0f91-474b-8fb3-e373d5a0e14a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1694 microversion: 2.1 time: 0.150711 Oct 01 22:00:48.710156 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4396/6809] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:48 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:49.733460 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:49.734086 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:49.740980 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:49.741481 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:49.742435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:49.743168 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:49.743638 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:49.744076 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:49.874201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:49.882142 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0f646dfb-6e11-4164-b593-3d30d42c49d9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1694 microversion: 2.1 time: 0.152668 Oct 01 22:00:49.882755 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2414/6810] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:49 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:50.905400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:50.905946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:50.912881 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:50.913392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:50.913858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:50.914616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:50.915102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:50.915558 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:51.049809 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:51.058483 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05b4711b-097e-44af-9d53-b6faa2d6e5fb tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1694 microversion: 2.1 time: 0.157202 Oct 01 22:00:51.059080 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4397/6811] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:50 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:52.082275 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:52.082936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:52.090397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:52.090917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:52.091353 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:52.092055 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:52.092512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:52.092942 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:52.226013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:52.234690 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e370211c-b49a-4bf9-81c5-18e2e8c8b6ea tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1694 microversion: 2.1 time: 0.156225 Oct 01 22:00:52.235296 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2415/6812] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:52 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:53.257183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:53.257818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:53.264820 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:53.265320 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:53.265774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:53.266482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:53.266978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:53.267421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:53.397714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:53.406220 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6f189817-dbf1-470b-bcc8-e684b8066e3f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1671 microversion: 2.1 time: 0.152977 Oct 01 22:00:53.406825 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4398/6813] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:53 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:54.500296 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-286ea1c4-47a2-4ba7-824c-c8cad07a8ede tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:00:54.502657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-286ea1c4-47a2-4ba7-824c-c8cad07a8ede tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:54.509191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-286ea1c4-47a2-4ba7-824c-c8cad07a8ede tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:54.509688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-286ea1c4-47a2-4ba7-824c-c8cad07a8ede tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:54.510139 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-286ea1c4-47a2-4ba7-824c-c8cad07a8ede tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:54.510894 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-286ea1c4-47a2-4ba7-824c-c8cad07a8ede tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:54.511366 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-286ea1c4-47a2-4ba7-824c-c8cad07a8ede tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:54.511801 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-286ea1c4-47a2-4ba7-824c-c8cad07a8ede tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:54.561061 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-286ea1c4-47a2-4ba7-824c-c8cad07a8ede tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action" status: 200 len: 34928 microversion: 2.1 time: 0.064749 Oct 01 22:00:54.561700 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2416/6814] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:00:54 2022] POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action => generated 34928 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 22:00:54.573930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7ac01286-c849-49fc-9ffc-e93cace796f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:00:54.580298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ac01286-c849-49fc-9ffc-e93cace796f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:54.580812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ac01286-c849-49fc-9ffc-e93cace796f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:54.581266 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7ac01286-c849-49fc-9ffc-e93cace796f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:54.603421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7ac01286-c849-49fc-9ffc-e93cace796f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Going to try to start instance {{(pid=140438) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 01 22:00:54.644610 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7ac01286-c849-49fc-9ffc-e93cace796f6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action" status: 202 len: 0 microversion: 2.1 time: 0.074847 Oct 01 22:00:54.645221 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4399/6815] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:00:54 2022] POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:00:54.655004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:54.655723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:54.662917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:54.663415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:54.663868 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:54.665218 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:54.665688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:54.666124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:54.801117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:54.809532 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b7ecba3b-9236-4a7d-8734-98ff1e1d1099 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1680 microversion: 2.1 time: 0.159144 Oct 01 22:00:54.810121 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2417/6816] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:54 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:00:55.833837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:00:55.834595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:00:55.842593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:55.843128 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:55.843589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:55.844310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:00:55.844788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:00:55.845257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:00:55.983593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:00:55.991525 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c993911f-6d4a-4d87-80d1-dd4cf10fe60d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1684 microversion: 2.1 time: 0.162011 Oct 01 22:00:55.992102 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4400/6817] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:00:55 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:22.184257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3c72d961-a632-42f2-ac56-e8b0346a19a6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:01:22.186449 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3c72d961-a632-42f2-ac56-e8b0346a19a6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:22.189504 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=16 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:22.190166 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=44 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:22.197752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c72d961-a632-42f2-ac56-e8b0346a19a6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:22.198245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c72d961-a632-42f2-ac56-e8b0346a19a6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:22.198721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c72d961-a632-42f2-ac56-e8b0346a19a6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:22.199540 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c72d961-a632-42f2-ac56-e8b0346a19a6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:22.200004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c72d961-a632-42f2-ac56-e8b0346a19a6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:22.200433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3c72d961-a632-42f2-ac56-e8b0346a19a6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:22.255929 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3c72d961-a632-42f2-ac56-e8b0346a19a6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action" status: 200 len: 59488 microversion: 2.1 time: 0.076106 Oct 01 22:01:22.256595 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2418/6818] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:01:22 2022] POST /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b/action => generated 59488 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 22:01:29.556205 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:29.557308 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:29.558577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-3afcb636-df00-4133-a393-fe658a7b75ab req-8806e81b-65fb-4d5b-aa29-460acb35db6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81ae405-bd58-4d32-8172-891d03e0429b", "tag": "1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:01:29.560830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=16 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:29.561696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:29.565841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:29.566522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:29.567159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:29.568005 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:29.568481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:29.568926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:29.570109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3afcb636-df00-4133-a393-fe658a7b75ab req-8806e81b-65fb-4d5b-aa29-460acb35db6d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:29.570709 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3afcb636-df00-4133-a393-fe658a7b75ab req-8806e81b-65fb-4d5b-aa29-460acb35db6d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:29.571871 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3afcb636-df00-4133-a393-fe658a7b75ab req-8806e81b-65fb-4d5b-aa29-460acb35db6d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:29.584311 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-3afcb636-df00-4133-a393-fe658a7b75ab req-8806e81b-65fb-4d5b-aa29-460acb35db6d service nova] Creating event network-changed:1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9 for instance a81ae405-bd58-4d32-8172-891d03e0429b on nch1-master-1 Oct 01 22:01:29.589940 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-3afcb636-df00-4133-a393-fe658a7b75ab req-8806e81b-65fb-4d5b-aa29-460acb35db6d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035832 Oct 01 22:01:29.593647 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2419/6819] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:01:29.618309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 22:01:29.709350 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-26c9be41-11bc-4a2a-8272-faa023acf201 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 204 len: 0 microversion: 2.1 time: 0.158142 Oct 01 22:01:29.710529 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4401/6820] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 22:01:29 2022] DELETE /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 22:01:29.719507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:29.720612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:29.728578 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:29.729325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:29.729809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:29.730666 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:29.731242 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:29.731683 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:29.872889 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:29.880897 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1ec74b03-3d65-4858-975a-b8596e139d34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1690 microversion: 2.1 time: 0.166108 Oct 01 22:01:29.881793 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2420/6821] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:29 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 22:01:30.906404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:30.907078 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:30.914259 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:30.914849 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:30.915310 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:30.916023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:30.916502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:30.916947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:31.059116 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:31.066999 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d6321adc-b85f-422c-961f-210d9572595e tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1690 microversion: 2.1 time: 0.165017 Oct 01 22:01:31.067613 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4402/6822] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:30 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:31.688775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-80850d44-98c0-49f4-8d64-6b4b1f5e8612 req-d2a5dba9-b682-45d7-8673-9679ea8aa970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81ae405-bd58-4d32-8172-891d03e0429b", "name": "network-vif-deleted", "tag": "1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:01:31.699072 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80850d44-98c0-49f4-8d64-6b4b1f5e8612 req-d2a5dba9-b682-45d7-8673-9679ea8aa970 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:31.699563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80850d44-98c0-49f4-8d64-6b4b1f5e8612 req-d2a5dba9-b682-45d7-8673-9679ea8aa970 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:31.700013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80850d44-98c0-49f4-8d64-6b4b1f5e8612 req-d2a5dba9-b682-45d7-8673-9679ea8aa970 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:31.711162 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-80850d44-98c0-49f4-8d64-6b4b1f5e8612 req-d2a5dba9-b682-45d7-8673-9679ea8aa970 service nova] Creating event network-vif-deleted:1cebcc79-0d8c-4b24-8fe2-6a0a5ea0f5a9 for instance a81ae405-bd58-4d32-8172-891d03e0429b on nch1-master-1 Oct 01 22:01:31.716189 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-80850d44-98c0-49f4-8d64-6b4b1f5e8612 req-d2a5dba9-b682-45d7-8673-9679ea8aa970 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031369 Oct 01 22:01:31.716781 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2421/6823] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:01:32.092541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:32.093278 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:32.100420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:32.100930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:32.101415 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:32.102781 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:32.103281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:32.103727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:32.135521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:32.136023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:32.136478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:32.136946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lazy-loading 'fault' on Instance uuid a81ae405-bd58-4d32-8172-891d03e0429b {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 22:01:32.180993 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:32.188912 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9ea981d-a823-4061-9fde-20b23e7c01f3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 200 len: 1357 microversion: 2.1 time: 0.100317 Oct 01 22:01:32.189489 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4403/6824] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:32 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:33.216861 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:33.217594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: a81ae405-bd58-4d32-8172-891d03e0429b] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:33.223841 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:33.224335 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:33.224779 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:33.225479 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:33.225943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:33.226376 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:33.240080 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] HTTP exception thrown: Instance a81ae405-bd58-4d32-8172-891d03e0429b could not be found. Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Request method failure captured: Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b HTTP/1.1 Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLdLv2TZ0B0Xz1wsy4zcJ0yREEX5T1tKKeJCaJEVz9hhs4TxfDjIGHkTIocROXJwvcD4XqZb2bTvELDwG4kyrRJvKyWMnrqlZZgxY1OZFYt2fuzfCCKUwBA1JjXUZ5hIoFH3gUfl_4QIFDIF6NB7DJVsexVj67fTzupdv91tzAaM8Og Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27214fca5a7a4c85bba526c092ac726b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}] Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 5f22070464e045f19acc335de7dd38f3 Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance a81ae405-bd58-4d32-8172-891d03e0429b could not be found. Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'a81ae405-bd58-4d32-8172-891d03e0429b'} Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81ae405-bd58-4d32-8172-891d03e0429b could not be found. Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81ae405-bd58-4d32-8172-891d03e0429b could not be found. Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:01:33.241682 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81ae405-bd58-4d32-8172-891d03e0429b could not be found. Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Returning 404 to user: Instance a81ae405-bd58-4d32-8172-891d03e0429b could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-73cd2e53-8928-432c-a3ff-12399298fe1c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b" status: 404 len: 111 microversion: 2.1 time: 0.032287 Oct 01 22:01:33.248007 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2422/6825] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:33 2022] GET /compute/v2.1/servers/a81ae405-bd58-4d32-8172-891d03e0429b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 22:01:36.510708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a5da67b3-fa9c-42d3-bba3-0b6d90b24ea9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '.version_select at 0x7f4173f35790>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:36.535075 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a5da67b3-fa9c-42d3-bba3-0b6d90b24ea9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1735913510" status: 202 len: 0 microversion: 2.1 time: 0.027666 Oct 01 22:01:36.539201 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4404/6826] 10.222.0.17 () {58 vars in 1284 bytes} [Sat Oct 1 22:01:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1735913510 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:01:36.566307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-40bd197d-4238-4eeb-93dc-d0b413cdd48d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: .version_select at 0x7f41723e0670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-489473887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0SnJFOCY/oRa9/Hl5Xq7pIPkUkXMvvm42DrQPjXK2rfbhSmqFao/A+NOj078VnR58ZiSvMI1K9yyFGcCT1FuXU36wtZGcQhxqtsAZw4mweD47MbzxB7AR1iSL4QPdfag=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:01:36.583172 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-40bd197d-4238-4eeb-93dc-d0b413cdd48d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:01:36.588784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-40bd197d-4238-4eeb-93dc-d0b413cdd48d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:01:36.613224 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-40bd197d-4238-4eeb-93dc-d0b413cdd48d tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051056 Oct 01 22:01:36.613827 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2423/6827] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 22:01:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:01:42.329519 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1007168969", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "networks": [{"uuid": "56853f40-1115-42ab-8fe5-12f8900eda98"}], "key_name": "tempest-TestNetworkAdvancedServerOps-489473887", "security_groups": [{"name": "tempest-secgroup-smoke-628988165"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:01:42.340845 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:42.442324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] validate_networks() for [('56853f40-1115-42ab-8fe5-12f8900eda98', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 22:01:42.909198 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 22:01:42.910254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 22:01:42.911082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 22:01:42.912371 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 22:01:42.913098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 22:01:42.928299 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:42.928907 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:42.929607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:42.930724 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:42.935537 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:42.936110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:42.956570 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:01:42.963123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Getting quotas for user 5f22070464e045f19acc335de7dd38f3 and project 27214fca5a7a4c85bba526c092ac726b. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:01:42.977443 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 22:01:42.981878 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 22:01:43.049071 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1fff031d-52df-431e-9d65-bf3d8ea455d1 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.723493 Oct 01 22:01:43.050956 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4405/6828] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 22:01:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 22:01:43.063085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-04c33f43-9432-4e0c-8ddf-397c1b2c6117 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:43.063723 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-04c33f43-9432-4e0c-8ddf-397c1b2c6117 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:43.143404 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-04c33f43-9432-4e0c-8ddf-397c1b2c6117 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:43.151851 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-04c33f43-9432-4e0c-8ddf-397c1b2c6117 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1266 microversion: 2.1 time: 0.093762 Oct 01 22:01:43.162544 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2424/6829] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:43 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:44.182717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:44.183414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:44.202589 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:44.203397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:44.203861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:44.204822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:44.205482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:44.205931 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:44.284048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:44.293432 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9330281d-abf3-457c-a602-169ff3209877 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1326 microversion: 2.1 time: 0.115708 Oct 01 22:01:44.307484 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4406/6830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:44 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:45.319263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:45.320427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:45.322772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=16 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:45.337681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:45.338577 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:45.339040 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:45.339937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:45.341109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:45.341549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:45.611859 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:45.621016 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a89ebb61-f4b5-4c2c-a7af-755985fcb1d0 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1391 microversion: 2.1 time: 0.305585 Oct 01 22:01:45.621989 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2425/6831] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:45 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:45.769175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-93302a81-e6a1-4e23-8aa1-06c5705af578 req-d52e8437-aa37-416e-8017-e88413718ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09", "tag": "3533e831-6464-4083-9026-371ea49be066"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:01:45.782273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-93302a81-e6a1-4e23-8aa1-06c5705af578 req-d52e8437-aa37-416e-8017-e88413718ee1 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:45.783200 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-93302a81-e6a1-4e23-8aa1-06c5705af578 req-d52e8437-aa37-416e-8017-e88413718ee1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:45.783882 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-93302a81-e6a1-4e23-8aa1-06c5705af578 req-d52e8437-aa37-416e-8017-e88413718ee1 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:45.796233 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-93302a81-e6a1-4e23-8aa1-06c5705af578 req-d52e8437-aa37-416e-8017-e88413718ee1 service nova] Creating event network-changed:3533e831-6464-4083-9026-371ea49be066 for instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 on nch1-master-1 Oct 01 22:01:45.802204 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-93302a81-e6a1-4e23-8aa1-06c5705af578 req-d52e8437-aa37-416e-8017-e88413718ee1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037582 Oct 01 22:01:45.803451 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4407/6832] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:01:46.645805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:46.646427 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:46.653849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:46.654355 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:46.654806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:46.655507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:46.655968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:46.656399 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:46.791033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:46.798785 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5978f9ed-11a7-4cc1-81f7-2302734c87d4 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1391 microversion: 2.1 time: 0.156947 Oct 01 22:01:46.799363 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2426/6833] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:46 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:47.824458 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:47.825175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:47.831497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:47.831995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:47.832450 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:47.833152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:47.833626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:47.834066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:47.968265 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:47.976193 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7d1d933-aed1-4adb-8d1c-981697d5cd4a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1391 microversion: 2.1 time: 0.157656 Oct 01 22:01:47.977353 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4408/6834] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:47 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:48.999507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:49.000213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:49.007235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:49.007818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:49.008969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:49.009751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:49.010227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:49.010730 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:49.149994 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:49.157842 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a186292f-3f15-4c7c-ae68-a59380e85cad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1391 microversion: 2.1 time: 0.162382 Oct 01 22:01:49.158432 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2427/6835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:48 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:50.182130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:50.182764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:50.189610 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:50.190130 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:50.190626 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:50.191348 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:50.191830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:50.192276 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:50.321354 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:50.329298 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b0fef153-3350-46cd-b96e-16138bb56978 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1391 microversion: 2.1 time: 0.151739 Oct 01 22:01:50.329897 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4409/6836] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:50 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:51.069057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-070f7bb8-24f1-49d0-a6b9-e87064816e3d req-9622295b-86a3-44a1-ad57-dd7edec11452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09", "name": "network-vif-plugged", "status": "completed", "tag": "3533e831-6464-4083-9026-371ea49be066"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:01:51.087350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-070f7bb8-24f1-49d0-a6b9-e87064816e3d req-9622295b-86a3-44a1-ad57-dd7edec11452 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:51.088109 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-070f7bb8-24f1-49d0-a6b9-e87064816e3d req-9622295b-86a3-44a1-ad57-dd7edec11452 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:51.088740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-070f7bb8-24f1-49d0-a6b9-e87064816e3d req-9622295b-86a3-44a1-ad57-dd7edec11452 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:51.100946 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-070f7bb8-24f1-49d0-a6b9-e87064816e3d req-9622295b-86a3-44a1-ad57-dd7edec11452 service nova] Creating event network-vif-plugged:3533e831-6464-4083-9026-371ea49be066 for instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 on nch1-master-1 Oct 01 22:01:51.110310 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-070f7bb8-24f1-49d0-a6b9-e87064816e3d req-9622295b-86a3-44a1-ad57-dd7edec11452 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045149 Oct 01 22:01:51.111657 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2428/6837] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:01:51.352527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:51.353168 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:51.360224 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:51.360736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:51.361208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:51.361929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:51.362414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:51.362916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:51.496203 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:51.504108 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1e030e3e-8c87-4d45-bea3-acbb451a76af tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1391 microversion: 2.1 time: 0.155710 Oct 01 22:01:51.504683 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4410/6838] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:51 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:52.528463 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:52.529179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:52.532099 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:52.538151 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:52.538688 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:52.539136 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:52.539847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:52.540312 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:52.540750 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:52.672245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:52.680320 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-38f1e8c5-ea36-4643-bcdf-e84455931980 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1564 microversion: 2.1 time: 0.156872 Oct 01 22:01:52.680906 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2429/6839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:52 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:52.703662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:52.704298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:52.711807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:52.712316 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:52.712776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:52.713495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:52.713972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:52.714420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:52.847730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:52.855714 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cc873a61-5125-4f8b-ab50-79b701252860 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1564 microversion: 2.1 time: 0.156011 Oct 01 22:01:52.856292 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4411/6840] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:52 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:01:54.726214 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:01:54.727384 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:01:54.730435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:54.735436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b37da843-110b-4d4d-bb06-8ba16516e48f req-3ad567f2-2b12-493e-b034-5ec8ba50a2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09", "tag": "3533e831-6464-4083-9026-371ea49be066"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:01:54.740928 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:54.741793 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:01:54.745835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:54.746338 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:54.747052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:54.748161 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:54.748785 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:54.748932 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b37da843-110b-4d4d-bb06-8ba16516e48f req-3ad567f2-2b12-493e-b034-5ec8ba50a2f3 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:01:54.749219 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:54.749352 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b37da843-110b-4d4d-bb06-8ba16516e48f req-3ad567f2-2b12-493e-b034-5ec8ba50a2f3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:01:54.749759 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b37da843-110b-4d4d-bb06-8ba16516e48f req-3ad567f2-2b12-493e-b034-5ec8ba50a2f3 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:01:54.761389 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b37da843-110b-4d4d-bb06-8ba16516e48f req-3ad567f2-2b12-493e-b034-5ec8ba50a2f3 service nova] Creating event network-changed:3533e831-6464-4083-9026-371ea49be066 for instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 on nch1-master-1 Oct 01 22:01:54.767116 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b37da843-110b-4d4d-bb06-8ba16516e48f req-3ad567f2-2b12-493e-b034-5ec8ba50a2f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035264 Oct 01 22:01:54.767944 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4412/6841] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:01:54.977940 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:01:54.985902 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-70849a4f-5ded-4d60-bc6c-f0d4fba0f276 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1564 microversion: 2.1 time: 0.263561 Oct 01 22:01:54.986798 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2430/6842] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:01:54 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1564 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:18.242747 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:02:18.244137 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=36 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:02:18.248428 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-624f6e5e-044a-4212-bf8e-15d6835d71e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:18.250760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-624f6e5e-044a-4212-bf8e-15d6835d71e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:18.258026 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-624f6e5e-044a-4212-bf8e-15d6835d71e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:18.258565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-624f6e5e-044a-4212-bf8e-15d6835d71e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:18.259025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-624f6e5e-044a-4212-bf8e-15d6835d71e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:18.260323 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-624f6e5e-044a-4212-bf8e-15d6835d71e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:18.260800 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-624f6e5e-044a-4212-bf8e-15d6835d71e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:18.261249 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-624f6e5e-044a-4212-bf8e-15d6835d71e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:18.314522 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-624f6e5e-044a-4212-bf8e-15d6835d71e6 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action" status: 200 len: 24572 microversion: 2.1 time: 0.073324 Oct 01 22:02:18.315112 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4413/6843] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:02:18 2022] POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action => generated 24572 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 22:02:24.713995 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:24.714626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:24.716529 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:02:24.717250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=32 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:02:24.718403 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 22:02:24.718567 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 22:02:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action (ip 10.222.0.17) !!! Oct 01 22:02:24.726018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:24.726535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:24.726986 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:24.727697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:24.728162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:24.728596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:24.752325 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lazy-loading 'flavor' on Instance uuid 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 22:02:24.818178 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-7cf18adf-a2f8-4cf1-ae45-5721f6f93a34 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action" status: 202 len: 0 microversion: 2.1 time: 0.108921 Oct 01 22:02:24.820228 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2431/6844] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:02:24 2022] POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:02:24.828459 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:24.829270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:24.837912 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:24.838404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:24.838887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:24.839644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:24.840121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:24.840565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:24.971765 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:24.980150 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-29049a31-7508-468e-878d-2ef08e339f55 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1691 microversion: 2.1 time: 0.155994 Oct 01 22:02:24.980721 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4414/6845] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:24 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:26.005736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:26.006444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:26.013250 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:26.013745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:26.014188 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:26.014919 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:26.015381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:26.015815 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:26.146053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:26.154889 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-90e891c5-70cd-4f21-9a6d-36c9e392c9d3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1674 microversion: 2.1 time: 0.154405 Oct 01 22:02:26.155460 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2432/6846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:25 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:27.247679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f064a174-4224-48a7-8e11-4ce05b0c8fae tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:27.249877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f064a174-4224-48a7-8e11-4ce05b0c8fae tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:27.260199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f064a174-4224-48a7-8e11-4ce05b0c8fae tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:27.260713 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f064a174-4224-48a7-8e11-4ce05b0c8fae tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:27.261174 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f064a174-4224-48a7-8e11-4ce05b0c8fae tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:27.261901 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f064a174-4224-48a7-8e11-4ce05b0c8fae tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:27.262384 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f064a174-4224-48a7-8e11-4ce05b0c8fae tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:27.262861 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f064a174-4224-48a7-8e11-4ce05b0c8fae tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:27.312637 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f064a174-4224-48a7-8e11-4ce05b0c8fae tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action" status: 200 len: 35612 microversion: 2.1 time: 0.068621 Oct 01 22:02:27.313228 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4415/6847] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:02:27 2022] POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action => generated 35612 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 22:02:27.324968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ea51303b-26a8-429b-8547-8a2b7fffa44f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:27.325511 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ea51303b-26a8-429b-8547-8a2b7fffa44f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:27.332393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea51303b-26a8-429b-8547-8a2b7fffa44f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:27.332883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea51303b-26a8-429b-8547-8a2b7fffa44f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:27.333323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea51303b-26a8-429b-8547-8a2b7fffa44f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:27.334039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea51303b-26a8-429b-8547-8a2b7fffa44f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:27.334478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea51303b-26a8-429b-8547-8a2b7fffa44f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:27.334928 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea51303b-26a8-429b-8547-8a2b7fffa44f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:27.402932 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ea51303b-26a8-429b-8547-8a2b7fffa44f tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action" status: 202 len: 0 microversion: 2.1 time: 0.081655 Oct 01 22:02:27.403551 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2433/6848] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:02:27 2022] POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:02:27.412634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:27.413502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:27.421420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:27.421934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:27.422397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:27.423177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:27.423659 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:27.424110 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:27.562797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:27.570881 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-05317fcf-38b8-4225-8139-30969a13ba99 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1680 microversion: 2.1 time: 0.162602 Oct 01 22:02:27.571474 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4416/6849] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:27 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 22:02:28.598361 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:28.599121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:28.605809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:28.606281 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:28.606752 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:28.607447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:28.607902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:28.608336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:28.748635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:28.757298 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4570b5d1-e543-4d67-9b0c-cad04909dae3 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1680 microversion: 2.1 time: 0.163964 Oct 01 22:02:28.758961 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2434/6850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:28 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:29.782103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:29.782760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:29.789700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:29.790199 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:29.790685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:29.791395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:29.792468 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:29.792914 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:29.926126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:29.934872 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7b66b2e5-dde7-48f0-bd24-762d4b78191a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1683 microversion: 2.1 time: 0.156837 Oct 01 22:02:29.935443 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4417/6851] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:29 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:30.031121 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d2f2bbd2-9069-43f1-8a5d-cb311a7655ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:30.033383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d2f2bbd2-9069-43f1-8a5d-cb311a7655ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:30.040322 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2f2bbd2-9069-43f1-8a5d-cb311a7655ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:30.040814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2f2bbd2-9069-43f1-8a5d-cb311a7655ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:30.041253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2f2bbd2-9069-43f1-8a5d-cb311a7655ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:30.042455 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2f2bbd2-9069-43f1-8a5d-cb311a7655ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:30.042938 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2f2bbd2-9069-43f1-8a5d-cb311a7655ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:30.043409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d2f2bbd2-9069-43f1-8a5d-cb311a7655ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:30.086946 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d2f2bbd2-9069-43f1-8a5d-cb311a7655ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action" status: 200 len: 35612 microversion: 2.1 time: 0.059547 Oct 01 22:02:30.087604 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2435/6852] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:02:30 2022] POST /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09/action => generated 35612 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 22:02:31.111153 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:31.111685 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:31.114034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-12a04743-bcc9-4ddd-9868-bc6ced641ca5 req-c9e865f4-a27f-4b87-9407-9b463c3ec884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09", "tag": "3533e831-6464-4083-9026-371ea49be066"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:31.119214 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:31.120493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:31.121220 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:31.121957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:31.122606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:31.123063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:31.125633 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-12a04743-bcc9-4ddd-9868-bc6ced641ca5 req-c9e865f4-a27f-4b87-9407-9b463c3ec884 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:31.126433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-12a04743-bcc9-4ddd-9868-bc6ced641ca5 req-c9e865f4-a27f-4b87-9407-9b463c3ec884 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:31.127116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-12a04743-bcc9-4ddd-9868-bc6ced641ca5 req-c9e865f4-a27f-4b87-9407-9b463c3ec884 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:31.139699 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-12a04743-bcc9-4ddd-9868-bc6ced641ca5 req-c9e865f4-a27f-4b87-9407-9b463c3ec884 service nova] Creating event network-changed:3533e831-6464-4083-9026-371ea49be066 for instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 on nch1-master-1 Oct 01 22:02:31.145210 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-12a04743-bcc9-4ddd-9868-bc6ced641ca5 req-c9e865f4-a27f-4b87-9407-9b463c3ec884 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035196 Oct 01 22:02:31.145826 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2436/6853] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:02:31.151077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 22:02:31.239683 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-cb5ef86d-59bc-425d-a883-f5081cab61ad tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 204 len: 0 microversion: 2.1 time: 0.131770 Oct 01 22:02:31.240720 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4418/6854] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 22:02:31 2022] DELETE /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 22:02:31.252285 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:31.253402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:31.265381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:31.265901 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:31.266341 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:31.267124 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:31.267595 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:31.268034 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:31.417305 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:31.425577 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f2dd796a-a46a-4e50-95a9-80cafccc9506 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1689 microversion: 2.1 time: 0.177908 Oct 01 22:02:31.426155 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2437/6855] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:31 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:32.452506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:32.453372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:32.459642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:32.460152 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:32.460607 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:32.461325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:32.461799 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:32.462244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:32.596737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:32.604618 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7fba949f-7c54-40d6-baf3-15ae55a81b5c tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1689 microversion: 2.1 time: 0.158175 Oct 01 22:02:32.605177 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4419/6856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:32 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:33.572175 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f9f64d91-d7ce-4481-a110-03b32328f331 req-0f60d8a4-0eb0-4aeb-8661-a335cf9da889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09", "name": "network-vif-deleted", "tag": "3533e831-6464-4083-9026-371ea49be066"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:33.584996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f9f64d91-d7ce-4481-a110-03b32328f331 req-0f60d8a4-0eb0-4aeb-8661-a335cf9da889 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:33.586433 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f9f64d91-d7ce-4481-a110-03b32328f331 req-0f60d8a4-0eb0-4aeb-8661-a335cf9da889 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:33.587126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f9f64d91-d7ce-4481-a110-03b32328f331 req-0f60d8a4-0eb0-4aeb-8661-a335cf9da889 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:33.599278 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f9f64d91-d7ce-4481-a110-03b32328f331 req-0f60d8a4-0eb0-4aeb-8661-a335cf9da889 service nova] Creating event network-vif-deleted:3533e831-6464-4083-9026-371ea49be066 for instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 on nch1-master-1 Oct 01 22:02:33.604166 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f9f64d91-d7ce-4481-a110-03b32328f331 req-0f60d8a4-0eb0-4aeb-8661-a335cf9da889 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036218 Oct 01 22:02:33.604917 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2438/6857] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:02:33.627867 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:33.628509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:33.635717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:33.636238 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:33.636700 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:33.641127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:33.641633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:33.642534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:33.684588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:33.685233 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:33.685697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:33.686177 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lazy-loading 'fault' on Instance uuid 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 22:02:33.729734 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f22070464e045f19acc335de7dd38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27214fca5a7a4c85bba526c092ac726b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:33.738030 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e49cfa2f-0ac8-499c-97f6-d2d5c3d07638 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 200 len: 1356 microversion: 2.1 time: 0.114012 Oct 01 22:02:33.738639 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4420/6858] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:33 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 1356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:34.763989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:34.764689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] [instance: 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:34.770900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:34.771390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:34.771856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:34.772558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:34.773012 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:34.773440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:34.787175 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] HTTP exception thrown: Instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 could not be found. Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Request method failure captured: Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 HTTP/1.1 Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLdLv2TZ0B0Xz1wsy4zcJ0yREEX5T1tKKeJCaJEVz9hhs4TxfDjIGHkTIocROXJwvcD4XqZb2bTvELDwG4kyrRJvKyWMnrqlZZgxY1OZFYt2fuzfCCKUwBA1JjXUZ5hIoFH3gUfl_4QIFDIF6NB7DJVsexVj67fTzupdv91tzAaM8Og Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27214fca5a7a4c85bba526c092ac726b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27214fca5a7a4c85bba526c092ac726b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27214fca5a7a4c85bba526c092ac726b"}]}] Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 27214fca5a7a4c85bba526c092ac726b Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952322673 Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 5f22070464e045f19acc335de7dd38f3 Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952322673-project Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 could not be found. Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09'} Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 could not be found. Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 could not be found. Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:02:34.788820 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 could not be found. Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Returning 404 to user: Instance 2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-06184612-eef3-4daf-be09-c8cc484c1bb9 tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09" status: 404 len: 111 microversion: 2.1 time: 0.032125 Oct 01 22:02:34.793835 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2439/6859] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:34 2022] GET /compute/v2.1/servers/2c7c8bfa-0a4e-4c8b-9adf-42953d3d3c09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 22:02:38.333125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-65673890-2e1a-4cf1-a29b-9b2fc5bdd10a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] Calling method '.version_select at 0x7f41725c3c10>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:38.354266 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-65673890-2e1a-4cf1-a29b-9b2fc5bdd10a tempest-TestNetworkAdvancedServerOps-952322673 tempest-TestNetworkAdvancedServerOps-952322673-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-489473887" status: 202 len: 0 microversion: 2.1 time: 0.024350 Oct 01 22:02:38.355036 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4421/6860] 10.222.0.17 () {58 vars in 1281 bytes} [Sat Oct 1 22:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-489473887 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:02:49.398354 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=18 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:02:49.399350 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:02:49.627333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-62b78ce3-e601-4a55-b4d1-b3182f9f283d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Action: 'create', calling method: .version_select at 0x7f41723b6550>, body: {"keypair": {"name": "tempest-TestShelveInstance-799146840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMCjSIFp9FGK51eBNe37I85U6g89q/CZawskzj/9wVK4C8TMvQ54vJF8URrh9zbwZVpiNRh3D7LX3YljrFHgrOanNqGaClFOLxFNrVphFyMOlY5GhlOtHBxnbFhwcQlyw=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:49.652806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-62b78ce3-e601-4a55-b4d1-b3182f9f283d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Getting quotas for project b904f70d6c7144db99dd4897d62ec567. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:02:49.658186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-62b78ce3-e601-4a55-b4d1-b3182f9f283d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Getting quotas for user c145fd00464c4dd1bb9e48320d8e916b and project b904f70d6c7144db99dd4897d62ec567. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:02:49.688618 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-62b78ce3-e601-4a55-b4d1-b3182f9f283d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.296798 Oct 01 22:02:49.690007 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2440/6861] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 22:02:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:02:50.706865 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:02:50.707635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:02:50.711812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1966130200", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-799146840", "security_groups": [{"name": "tempest-secgroup-smoke-1311732159"}], "networks": [{"uuid": "27c40dda-554e-46e3-b4f6-fdf5d14f7bd5"}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:50.821077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] validate_networks() for [('27c40dda-554e-46e3-b4f6-fdf5d14f7bd5', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 22:02:51.207058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 22:02:51.208127 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 22:02:51.208631 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 22:02:51.209062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 22:02:51.209493 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 22:02:51.219321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:51.219839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:51.220298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:51.221061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:51.221544 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:51.221995 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:51.239363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Getting quotas for project b904f70d6c7144db99dd4897d62ec567. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:02:51.245250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Getting quotas for user c145fd00464c4dd1bb9e48320d8e916b and project b904f70d6c7144db99dd4897d62ec567. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:02:51.257837 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 22:02:51.260917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 22:02:51.308916 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eae3aa2c-9395-4432-a33c-378ca131e50c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.603519 Oct 01 22:02:51.315607 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4422/6862] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 22:02:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 22:02:51.320943 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b180aa78-a1fe-449d-9e88-22ed67d83f38 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:51.322444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b180aa78-a1fe-449d-9e88-22ed67d83f38 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:51.384231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b180aa78-a1fe-449d-9e88-22ed67d83f38 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:51.393282 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b180aa78-a1fe-449d-9e88-22ed67d83f38 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1246 microversion: 2.1 time: 0.076267 Oct 01 22:02:51.394311 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2441/6863] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:51 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:52.417573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:52.418218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:52.425911 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:52.426856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:52.427288 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:52.428057 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:52.428630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:52.429344 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:52.558624 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:52.569641 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4f692e27-9a2b-4a9a-ab66-1437b7f9e471 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1306 microversion: 2.1 time: 0.156744 Oct 01 22:02:52.570427 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4423/6864] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:52 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1306 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:53.595977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:53.596771 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:53.608064 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:53.608728 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:53.609324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:53.610163 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:53.610795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:53.611383 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:53.828945 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:53.839278 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-21258918-54c2-4e00-978c-66c0335a3f2b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1372 microversion: 2.1 time: 0.248845 Oct 01 22:02:53.839875 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2442/6865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:53 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:54.426043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-213e6a25-b766-4ed3-81b6-3fd02419c9d3 req-288390f7-3e66-4f7b-984c-255e035a5203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6263fbf7-52b7-411e-956f-54006c8e1f26", "tag": "25bdde49-92c6-4675-b076-026913040307"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:54.439522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-213e6a25-b766-4ed3-81b6-3fd02419c9d3 req-288390f7-3e66-4f7b-984c-255e035a5203 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:54.440019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-213e6a25-b766-4ed3-81b6-3fd02419c9d3 req-288390f7-3e66-4f7b-984c-255e035a5203 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:54.440863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-213e6a25-b766-4ed3-81b6-3fd02419c9d3 req-288390f7-3e66-4f7b-984c-255e035a5203 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:54.454369 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-213e6a25-b766-4ed3-81b6-3fd02419c9d3 req-288390f7-3e66-4f7b-984c-255e035a5203 service nova] Creating event network-changed:25bdde49-92c6-4675-b076-026913040307 for instance 6263fbf7-52b7-411e-956f-54006c8e1f26 on nch1-master-1 Oct 01 22:02:54.459594 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-213e6a25-b766-4ed3-81b6-3fd02419c9d3 req-288390f7-3e66-4f7b-984c-255e035a5203 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037884 Oct 01 22:02:54.460291 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4424/6866] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:02:54.862049 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:54.862640 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:54.870045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:54.870563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:54.871037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:54.871737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:54.872197 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:54.872626 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:55.011381 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:55.019623 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a5cc1e80-053c-4dff-a199-eb60ffa07ec4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1372 microversion: 2.1 time: 0.161552 Oct 01 22:02:55.020331 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2443/6867] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:54 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:56.048132 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:56.048854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:56.056902 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:56.057405 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:56.057858 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:56.058594 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:56.059068 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:56.059518 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:56.196788 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:56.204667 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c50a329-91c2-4d7b-bb13-784e3fbd13fd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1372 microversion: 2.1 time: 0.160969 Oct 01 22:02:56.205241 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4425/6868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:56 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:57.227618 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:57.228262 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:57.235153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:57.235648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:57.236095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:57.236807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:57.237274 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:57.237714 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:57.371743 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:57.379613 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-890c980c-b5e2-45f1-a94d-6d49cc659f8d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1372 microversion: 2.1 time: 0.155972 Oct 01 22:02:57.380199 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2444/6869] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:57 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:58.403486 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:58.404077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:58.411125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:58.411635 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:58.412097 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:58.412816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:58.413298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:58.413749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:58.546363 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:58.554912 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-19cc58c1-c40c-47a8-bfa7-588086350ff0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1372 microversion: 2.1 time: 0.155970 Oct 01 22:02:58.555526 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4426/6870] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:58 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:02:59.393535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-5119f295-65b0-498c-be2f-e944e074d778 req-ad99af93-e049-4af8-8159-bd1825d161f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6263fbf7-52b7-411e-956f-54006c8e1f26", "name": "network-vif-plugged", "status": "completed", "tag": "25bdde49-92c6-4675-b076-026913040307"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:02:59.405650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5119f295-65b0-498c-be2f-e944e074d778 req-ad99af93-e049-4af8-8159-bd1825d161f4 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:59.406290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5119f295-65b0-498c-be2f-e944e074d778 req-ad99af93-e049-4af8-8159-bd1825d161f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:59.406857 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-5119f295-65b0-498c-be2f-e944e074d778 req-ad99af93-e049-4af8-8159-bd1825d161f4 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:59.419877 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-5119f295-65b0-498c-be2f-e944e074d778 req-ad99af93-e049-4af8-8159-bd1825d161f4 service nova] Creating event network-vif-plugged:25bdde49-92c6-4675-b076-026913040307 for instance 6263fbf7-52b7-411e-956f-54006c8e1f26 on nch1-master-1 Oct 01 22:02:59.425077 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-5119f295-65b0-498c-be2f-e944e074d778 req-ad99af93-e049-4af8-8159-bd1825d161f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034966 Oct 01 22:02:59.425733 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2445/6871] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:02:59.577240 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:02:59.577903 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:02:59.586784 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:59.588172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:59.588943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:59.589717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:02:59.590194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:02:59.590677 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:02:59.719870 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:02:59.728249 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e7de0ba5-3fe1-42a1-9eb4-89212c18b238 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1372 microversion: 2.1 time: 0.154363 Oct 01 22:02:59.728867 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4427/6872] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:02:59 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:03:00.752470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:03:00.753261 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:03:00.759539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:03:00.760032 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:03:00.760476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:03:00.761181 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:03:00.761645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:03:00.762078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:03:00.896105 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:03:00.904464 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-87842ac4-7ada-4c24-aa4c-85ad058121f2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1557 microversion: 2.1 time: 0.157219 Oct 01 22:03:00.905047 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2446/6873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:03:00 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:03:01.000332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:03:01.000986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:03:01.008107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:03:01.008550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:03:01.009028 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:03:01.009737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:03:01.010213 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:03:01.010682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:03:01.146007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:03:01.154405 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-01004e30-13b7-4a26-8a23-c20534fcc239 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1557 microversion: 2.1 time: 0.157960 Oct 01 22:03:01.155119 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4428/6874] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:03:00 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:03:02.776813 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-c8537a07-43da-483e-a7e2-4ca7b2858d9b req-7473e469-f787-4f75-a6e0-86c1ebcb9f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6263fbf7-52b7-411e-956f-54006c8e1f26", "tag": "25bdde49-92c6-4675-b076-026913040307"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:03:02.782839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:03:02.787884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8537a07-43da-483e-a7e2-4ca7b2858d9b req-7473e469-f787-4f75-a6e0-86c1ebcb9f1a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:03:02.788368 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8537a07-43da-483e-a7e2-4ca7b2858d9b req-7473e469-f787-4f75-a6e0-86c1ebcb9f1a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:03:02.788804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-c8537a07-43da-483e-a7e2-4ca7b2858d9b req-7473e469-f787-4f75-a6e0-86c1ebcb9f1a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:03:02.800665 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-c8537a07-43da-483e-a7e2-4ca7b2858d9b req-7473e469-f787-4f75-a6e0-86c1ebcb9f1a service nova] Creating event network-changed:25bdde49-92c6-4675-b076-026913040307 for instance 6263fbf7-52b7-411e-956f-54006c8e1f26 on nch1-master-1 Oct 01 22:03:02.805653 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-c8537a07-43da-483e-a7e2-4ca7b2858d9b req-7473e469-f787-4f75-a6e0-86c1ebcb9f1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033663 Oct 01 22:03:02.806383 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2447/6875] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:04:58.912059 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:04:58.913427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:04:58.914049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:04:58.914736 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=34 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:04:58.916043 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 01 22:04:58.916217 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 22:04:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26/action (ip 10.222.0.17) !!! Oct 01 22:04:58.921479 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:04:58.922037 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:04:58.932165 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:04:58.932669 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:04:58.933121 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:04:58.933838 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:04:58.934309 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:04:58.934786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:04:58.958496 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lazy-loading 'flavor' on Instance uuid 6263fbf7-52b7-411e-956f-54006c8e1f26 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 22:04:59.288575 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1d1b7a73-aa24-4520-8733-00366716d151 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "POST /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26/action" status: 202 len: 0 microversion: 2.1 time: 0.378349 Oct 01 22:04:59.289179 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4429/6876] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:04:58 2022] POST /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:04:59.296818 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 01 22:04:59.297362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:04:59.298567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:04:59.304201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:04:59.304909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:04:59.312461 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:04:59.312949 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:04:59.313484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:04:59.314195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:04:59.314684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:04:59.315112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:04:59.497768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:04:59.505600 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-074890dc-0ac8-4267-a686-2aedc6480d5b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.211507 Oct 01 22:04:59.506167 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2448/6877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:04:59 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:00.531101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:00.531834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:00.539136 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:00.539657 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:00.540120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:00.540897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:00.541381 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:00.541834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:00.973756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:00.981722 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7c8e5982-57f7-4de5-bdcf-cc94029d4014 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.456098 Oct 01 22:05:00.982305 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4430/6878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:00 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:02.005444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:02.006063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:02.019814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:02.020323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:02.020772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:02.021487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:02.022637 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:02.023083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:02.023717 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 59828. Oct 01 22:05:02.157352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:02.165217 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-bb08e4ee-562a-423a-b8ee-2c245189dd3a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.163971 Oct 01 22:05:02.165805 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2449/6879] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:02 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:03.189491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:03.190162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:03.197555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:03.198107 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:03.198621 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:03.199482 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:03.199972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:03.200492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:03.336982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:03.344853 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7fde3ec2-f38b-4492-bc0b-15dfac01c45d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.159512 Oct 01 22:05:03.345436 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4431/6880] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:03 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:04.370110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:04.370761 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:04.377590 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:04.378091 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:04.378572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:04.379279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:04.379746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:04.380177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:04.514827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:04.522686 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-48ba45ac-ae04-48f5-a703-a585e66cb35f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.157079 Oct 01 22:05:04.523267 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2450/6881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:04 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:05.546855 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:05.547497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:05.555268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:05.555777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:05.556237 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:05.556955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:05.557436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:05.557886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:05.689505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:05.697457 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aac5d4da-5c3e-4864-bf67-3ac2f08f2410 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.154644 Oct 01 22:05:05.698042 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4432/6882] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:05 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:06.721153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:06.721794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:06.728554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:06.729037 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:06.729476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:06.730169 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:06.730654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:06.731083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:06.865326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:06.873662 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4671d7cf-47db-4cfe-b17f-06e74f606d7e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.156442 Oct 01 22:05:06.874240 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2451/6883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:06 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:07.897380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:07.897937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:07.904764 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:07.905268 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:07.905717 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:07.906425 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:07.906949 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:07.907393 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:08.036048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:08.045440 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-223fdda6-1a41-4339-ba11-464382252078 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.152056 Oct 01 22:05:08.046557 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4433/6884] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:07 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:09.069524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:09.070132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:09.077101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:09.077596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:09.078042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:09.078775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:09.079240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:09.079676 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:09.214122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:09.222208 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-debc9d6a-1069-4b64-9c36-0e18ce3c9d2d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.156588 Oct 01 22:05:09.222825 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2452/6885] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:09 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:10.246797 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:10.247463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:10.254509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:10.255027 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:10.255491 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:10.256211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:10.256681 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:10.257126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:10.391083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:10.398857 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9cfa5867-e762-4cd0-ba54-8698796a1381 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1703 microversion: 2.1 time: 0.156044 Oct 01 22:05:10.399456 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4434/6886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:10 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1703 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:11.423224 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:11.423812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:11.431332 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:11.431821 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:11.432265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:11.432975 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:11.433441 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:11.433877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:11.563777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:11.572197 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-219b3fe8-4663-4e8e-aeb2-8124ee16f254 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1703 microversion: 2.1 time: 0.153244 Oct 01 22:05:11.572784 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2453/6887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:11 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1703 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:12.596076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:12.597455 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:12.604782 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:12.605298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:12.605762 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:12.606513 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:12.606999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:12.607446 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:12.746159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:12.754206 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-98effcb1-ed4c-4cb6-bedd-0ef2a1901357 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1698 microversion: 2.1 time: 0.162057 Oct 01 22:05:12.759276 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4435/6888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:12 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:13.781467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:13.782020 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:13.789514 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:13.790009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:13.790452 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:13.791179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:13.791842 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:13.792594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:13.954629 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:13.964201 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-75349748-b884-4d20-ba73-7ec70e1642fc tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1698 microversion: 2.1 time: 0.186675 Oct 01 22:05:13.979784 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2454/6889] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:13 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1698 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:14.101053 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-5752825c-8e51-436d-a8ef-a22f761ab22f req-88154ee6-98f9-4f60-96bf-4f591c17a4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6263fbf7-52b7-411e-956f-54006c8e1f26", "name": "network-vif-plugged", "status": "completed", "tag": "25bdde49-92c6-4675-b076-026913040307"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:05:14.111842 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5752825c-8e51-436d-a8ef-a22f761ab22f req-88154ee6-98f9-4f60-96bf-4f591c17a4d7 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:14.112575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5752825c-8e51-436d-a8ef-a22f761ab22f req-88154ee6-98f9-4f60-96bf-4f591c17a4d7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:14.113373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-5752825c-8e51-436d-a8ef-a22f761ab22f req-88154ee6-98f9-4f60-96bf-4f591c17a4d7 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:14.126153 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-5752825c-8e51-436d-a8ef-a22f761ab22f req-88154ee6-98f9-4f60-96bf-4f591c17a4d7 service nova] Creating event network-vif-plugged:25bdde49-92c6-4675-b076-026913040307 for instance 6263fbf7-52b7-411e-956f-54006c8e1f26 on nch1-master-1 Oct 01 22:05:14.131707 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-5752825c-8e51-436d-a8ef-a22f761ab22f req-88154ee6-98f9-4f60-96bf-4f591c17a4d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110554 Oct 01 22:05:14.132515 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4436/6890] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:05:14.990552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:14.991783 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:14.998644 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:14.999142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:14.999591 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:15.000349 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:15.000865 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:15.001386 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:15.158457 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:15.167584 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-164d4287-0691-4d2d-84db-be6fd6ecbc45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1698 microversion: 2.1 time: 0.180932 Oct 01 22:05:15.168279 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2455/6891] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:14 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1698 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:16.195937 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:16.197593 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:16.204289 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:16.204807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:16.205509 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:16.206228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:16.206839 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:16.207585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:16.347946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:16.357088 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bd1ee355-f521-4e7a-a42f-1d5907dd239e tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1698 microversion: 2.1 time: 0.167007 Oct 01 22:05:16.357881 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4437/6892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:16 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:17.381474 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:17.382057 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:17.389496 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:17.389993 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:17.390435 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:17.391190 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:17.391649 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:17.392075 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:17.538655 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:17.546436 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c5b30a67-a65c-4b2e-99ef-26751efe8c18 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1698 microversion: 2.1 time: 0.169186 Oct 01 22:05:17.547047 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2456/6893] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:17 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:18.570111 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:18.570779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:18.578480 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:18.579124 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:18.579735 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:18.580535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:18.581019 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:18.581499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:18.733082 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:18.741959 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-eb88bdaa-54d3-4dd8-a7e9-20cee09bc31c tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1698 microversion: 2.1 time: 0.176247 Oct 01 22:05:18.758120 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4438/6894] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:18 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1698 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:19.765314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:19.766896 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:19.776539 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:19.777336 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:19.777791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:19.778708 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:19.779184 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:19.779774 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:19.940229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:19.949444 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-53a83ef3-98b2-436a-9e91-bcbe9a5dfe14 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1698 microversion: 2.1 time: 0.187944 Oct 01 22:05:19.950055 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2457/6895] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:19 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1698 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:20.974115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:20.974779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:20.982897 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:20.983417 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:20.983877 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:20.984596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:20.985098 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:20.985542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:21.118684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:21.126657 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d0284810-b6ea-4d76-9d68-76378fbbe84d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1698 microversion: 2.1 time: 0.156387 Oct 01 22:05:21.127232 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4439/6896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:20 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:22.150677 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:22.151326 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:22.158266 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:22.158796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:22.159240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:22.159937 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:22.160418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:22.160846 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:22.294005 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:22.302176 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8f57db49-4b47-42d7-8287-f03febc78bc2 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1680 microversion: 2.1 time: 0.155485 Oct 01 22:05:22.302713 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2458/6897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:22 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:23.325958 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:23.326619 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:23.333722 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:23.334283 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:23.334774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:23.335490 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:23.335971 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:23.336418 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:23.474630 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:23.482763 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-f8ae200c-d477-4ea5-b73f-b7256a20423b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1680 microversion: 2.1 time: 0.160686 Oct 01 22:05:23.483988 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4440/6898] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:23 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:24.507648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:24.508268 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:24.515173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:24.515662 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:24.516101 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:24.516795 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:24.517256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:24.517681 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:24.651465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:24.659528 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b6169e93-6b29-4e7d-91f6-fd2c8eb8febd tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1623 microversion: 2.1 time: 0.156332 Oct 01 22:05:24.660103 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2459/6899] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:24 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1623 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:24.682421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:05:24.683058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:24.689194 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:24.689697 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:24.690151 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:24.690890 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:24.691364 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:24.691806 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:24.736871 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140438) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 22:05:24.810132 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ad42d1db-409f-43f0-abc9-675a0a7896b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "POST /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26/action" status: 202 len: 0 microversion: 2.1 time: 0.131577 Oct 01 22:05:24.811158 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4441/6900] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:05:24 2022] POST /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:05:24.820084 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:24.820741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:24.827238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:24.827740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:24.828195 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:24.828917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:24.829377 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:24.829818 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:24.965915 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:24.974015 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-098e25a5-8d40-4d9f-969f-bd3d9115e34b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1631 microversion: 2.1 time: 0.158509 Oct 01 22:05:24.975085 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2460/6901] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:24 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1631 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 22:05:25.961540 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-7c09283c-ad12-459e-95eb-cae39138b385 req-82495d9a-9f50-4a0f-84ef-fdf21eca6de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6263fbf7-52b7-411e-956f-54006c8e1f26", "name": "network-vif-unplugged", "status": "completed", "tag": "25bdde49-92c6-4675-b076-026913040307"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:05:25.971934 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c09283c-ad12-459e-95eb-cae39138b385 req-82495d9a-9f50-4a0f-84ef-fdf21eca6de5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:25.972521 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c09283c-ad12-459e-95eb-cae39138b385 req-82495d9a-9f50-4a0f-84ef-fdf21eca6de5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:25.972984 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-7c09283c-ad12-459e-95eb-cae39138b385 req-82495d9a-9f50-4a0f-84ef-fdf21eca6de5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:25.984971 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-7c09283c-ad12-459e-95eb-cae39138b385 req-82495d9a-9f50-4a0f-84ef-fdf21eca6de5 service nova] Creating event network-vif-unplugged:25bdde49-92c6-4675-b076-026913040307 for instance 6263fbf7-52b7-411e-956f-54006c8e1f26 on nch2-master-1 Oct 01 22:05:25.990522 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-7c09283c-ad12-459e-95eb-cae39138b385 req-82495d9a-9f50-4a0f-84ef-fdf21eca6de5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034328 Oct 01 22:05:25.992535 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4442/6902] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:05:25.998009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:25.998680 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:26.005411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:26.005907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:26.007501 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:26.008228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:26.008702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:26.009142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:26.146045 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:26.154578 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-35b529bd-c92a-4567-a87f-3ec8290bd7d0 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.160654 Oct 01 22:05:26.155155 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2461/6903] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:25 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 22:05:27.021115 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-21d7b81b-ee2e-4e15-9c63-ae7fcbbe2666 req-1c768d61-9bce-4411-ac5d-3c3b5e8720bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6263fbf7-52b7-411e-956f-54006c8e1f26", "tag": "25bdde49-92c6-4675-b076-026913040307"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:05:27.032009 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-21d7b81b-ee2e-4e15-9c63-ae7fcbbe2666 req-1c768d61-9bce-4411-ac5d-3c3b5e8720bb service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:27.032524 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-21d7b81b-ee2e-4e15-9c63-ae7fcbbe2666 req-1c768d61-9bce-4411-ac5d-3c3b5e8720bb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:27.032974 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-21d7b81b-ee2e-4e15-9c63-ae7fcbbe2666 req-1c768d61-9bce-4411-ac5d-3c3b5e8720bb service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:27.046712 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-21d7b81b-ee2e-4e15-9c63-ae7fcbbe2666 req-1c768d61-9bce-4411-ac5d-3c3b5e8720bb service nova] Creating event network-changed:25bdde49-92c6-4675-b076-026913040307 for instance 6263fbf7-52b7-411e-956f-54006c8e1f26 on nch2-master-1 Oct 01 22:05:27.052561 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-21d7b81b-ee2e-4e15-9c63-ae7fcbbe2666 req-1c768d61-9bce-4411-ac5d-3c3b5e8720bb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094219 Oct 01 22:05:27.053433 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4443/6904] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:05:27.177520 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:27.178123 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:27.185119 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:27.185628 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:27.186071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:27.186804 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:27.187273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:27.187704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:27.320385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:27.328182 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f3e45829-20b0-4a39-8d9c-813df77dbe45 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.154676 Oct 01 22:05:27.328933 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2462/6905] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:27 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:28.353977 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:28.354680 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:28.362353 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:28.362922 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:28.363378 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:28.364112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:28.364588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:28.365032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:28.384347 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:05:28.522511 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:28.531952 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a9a6964e-8486-4c6e-af3c-cae697909199 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.183374 Oct 01 22:05:28.532551 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4444/6906] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:28 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:29.555041 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:29.555665 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:29.558393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=31 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:05:29.563883 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:29.564382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:29.564839 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:29.565548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:29.566018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:29.566459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:29.570661 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=91 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:05:29.713740 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:29.723601 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ffc95c27-0a53-4eed-9892-2700fbf3bf1f tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.172395 Oct 01 22:05:29.724511 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2463/6907] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:29 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:30.747777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:30.748407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:30.751166 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:05:30.756775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:30.757257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:30.757711 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:30.758421 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:30.758916 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:30.759355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:30.909430 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:30.918082 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8b944953-2176-4bc3-938d-69ffc4e873e3 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.174203 Oct 01 22:05:30.918691 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4445/6908] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:30 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:31.944096 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:31.945908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:31.953077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:31.953581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:31.954053 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:31.954840 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:31.955370 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:31.955805 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:32.136581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:32.145604 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-627db8ac-d1ec-49f7-9f15-b8f0489cb309 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.207025 Oct 01 22:05:32.146472 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2464/6909] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:31 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:33.169391 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:33.170010 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:33.177392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:33.177896 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:33.178351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:33.179600 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:33.180074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:33.180522 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:33.331841 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:33.339701 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3cdb58b9-0fc7-4de2-ac82-6628259ffe93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.174420 Oct 01 22:05:33.340293 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4446/6910] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:33 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:34.363141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:34.363786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:34.370832 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:34.371328 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:34.371776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:34.372508 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:34.372977 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:34.373416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:34.524812 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:34.532806 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4949517b-04b7-45c9-9e20-876e1f8d1a95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.173570 Oct 01 22:05:34.533388 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2465/6911] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:34 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:35.556398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:35.557060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:35.571769 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:35.572579 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:35.573114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:35.574011 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:35.574692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:35.575186 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:35.746517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:35.755540 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3d5ff8d8-9179-49b5-94e9-a13f028c21ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.203082 Oct 01 22:05:35.771538 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4447/6912] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:35 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:36.780910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:36.781574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:36.788411 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:36.788908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:36.790042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:36.790773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:36.791246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:36.791679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:36.921035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:36.929106 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3fb9b144-e55f-49a8-8b17-ed3f47a402db tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.152172 Oct 01 22:05:36.929689 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2466/6913] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:36 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:37.952176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:37.952808 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:37.959775 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:37.960284 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:37.960740 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:37.961451 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:37.961926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:37.962402 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:38.097133 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:38.105448 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-7aee8c6f-759e-49a9-8f46-b9d7372a5a96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.157171 Oct 01 22:05:38.106033 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4448/6914] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:37 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:39.129258 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:39.129875 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:39.137385 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:39.137870 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:39.138314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:39.139027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:39.139484 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:39.139910 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:39.272545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:39.280555 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f791b883-1dc8-4026-8839-14e36faab3c6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.155126 Oct 01 22:05:39.281265 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2467/6915] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:39 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:40.304980 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:40.305528 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:40.312435 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:40.312942 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:40.313396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:40.314101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:40.314601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:40.315048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:40.448843 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:40.458213 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-15d76426-70bd-411f-a966-3d5f05ef4734 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.156364 Oct 01 22:05:40.458213 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4449/6916] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:40 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:41.483286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:41.483922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:41.490852 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:41.491346 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:41.491810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:41.492493 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:41.492957 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:41.493390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:41.626324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:41.634665 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ec7787ce-b8db-496d-9406-a1ef2c6a30b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.155302 Oct 01 22:05:41.635239 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2468/6917] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:41 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:42.659983 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:42.660768 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:42.668534 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:42.668719 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:42.669183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:42.669909 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:42.670379 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:42.670853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:42.899250 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:42.907568 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-830466f6-7915-4cb8-82af-e866bca15c21 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.251558 Oct 01 22:05:42.908150 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4450/6918] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:42 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:43.811684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e7786efd-e8f0-42b2-9127-a9671927421d req-0cfc65c5-ce2e-4f96-8a7c-ec42cd950c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6263fbf7-52b7-411e-956f-54006c8e1f26", "name": "network-vif-plugged", "status": "completed", "tag": "25bdde49-92c6-4675-b076-026913040307"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:05:43.823657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e7786efd-e8f0-42b2-9127-a9671927421d req-0cfc65c5-ce2e-4f96-8a7c-ec42cd950c06 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:43.824147 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e7786efd-e8f0-42b2-9127-a9671927421d req-0cfc65c5-ce2e-4f96-8a7c-ec42cd950c06 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:43.824759 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e7786efd-e8f0-42b2-9127-a9671927421d req-0cfc65c5-ce2e-4f96-8a7c-ec42cd950c06 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:43.837390 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e7786efd-e8f0-42b2-9127-a9671927421d req-0cfc65c5-ce2e-4f96-8a7c-ec42cd950c06 service nova] Creating event network-vif-plugged:25bdde49-92c6-4675-b076-026913040307 for instance 6263fbf7-52b7-411e-956f-54006c8e1f26 on nch2-master-1 Oct 01 22:05:43.843190 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e7786efd-e8f0-42b2-9127-a9671927421d req-0cfc65c5-ce2e-4f96-8a7c-ec42cd950c06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034990 Oct 01 22:05:43.843897 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2469/6919] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:05:43.936023 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:43.937876 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:43.946641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:43.947429 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:43.947957 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:43.948682 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:43.949159 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:43.949599 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:44.131925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:44.139850 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1310fbae-5f32-453e-b85a-2e657f6d922d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.212394 Oct 01 22:05:44.140425 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4451/6920] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:43 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:45.163030 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:45.163748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:45.171177 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:45.171673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:45.172397 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:45.173052 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:45.173513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:45.173939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:45.317492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:45.326199 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6c0aff5e-eb0a-402b-b864-16bf21a28444 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1689 microversion: 2.1 time: 0.167489 Oct 01 22:05:45.328528 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2470/6921] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:45 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:05:46.349497 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:05:46.350086 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:05:46.357101 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:46.357605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:46.358058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:46.358794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:05:46.359271 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:05:46.359714 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:05:46.501049 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:05:46.509583 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0ae835cd-05dc-4594-af6c-610730e20534 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1676 microversion: 2.1 time: 0.164046 Oct 01 22:05:46.510165 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4452/6922] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:05:46 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:06:57.329466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-8701e60a-61c9-46f3-9038-c6343d0c4313 req-d31d051d-2766-4ebd-9c7d-06f34e952fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6263fbf7-52b7-411e-956f-54006c8e1f26", "tag": "25bdde49-92c6-4675-b076-026913040307"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:06:57.334695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:06:57.335182 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=15 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:06:57.335644 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=50 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:06:57.335897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:06:57.338612 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=15 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:06:57.339491 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=43 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:06:57.340512 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 22:06:57.340651 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 22:06:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 (ip 10.222.0.17) !!! Oct 01 22:06:57.343211 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 22:06:57.343360 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 22:06:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 (ip 10.222.0.17) !!! Oct 01 22:06:57.344595 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8701e60a-61c9-46f3-9038-c6343d0c4313 req-d31d051d-2766-4ebd-9c7d-06f34e952fe8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:57.345139 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8701e60a-61c9-46f3-9038-c6343d0c4313 req-d31d051d-2766-4ebd-9c7d-06f34e952fe8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:57.345763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-8701e60a-61c9-46f3-9038-c6343d0c4313 req-d31d051d-2766-4ebd-9c7d-06f34e952fe8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:57.359030 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-8701e60a-61c9-46f3-9038-c6343d0c4313 req-d31d051d-2766-4ebd-9c7d-06f34e952fe8 service nova] Creating event network-changed:25bdde49-92c6-4675-b076-026913040307 for instance 6263fbf7-52b7-411e-956f-54006c8e1f26 on nch2-master-1 Oct 01 22:06:57.363003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:57.363518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:57.363972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:57.364105 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-8701e60a-61c9-46f3-9038-c6343d0c4313 req-d31d051d-2766-4ebd-9c7d-06f34e952fe8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040003 Oct 01 22:06:57.364832 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4453/6923] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:06:57.364968 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:57.365265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:57.365704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:57.394877 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 22:06:57.486445 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8baca8ca-420b-4c94-a4b6-2f7bb57e3c3d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 204 len: 0 microversion: 2.1 time: 0.164700 Oct 01 22:06:57.487372 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2471/6924] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 22:06:57 2022] DELETE /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 22:06:57.496936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:06:57.497917 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:06:57.504462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:57.504964 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:57.505665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:57.506457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:57.506953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:57.507636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:57.653506 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:06:57.661654 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ce665675-5ae9-4eaa-9c8b-7e25e0b46ec8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.168943 Oct 01 22:06:57.662240 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4454/6925] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:06:57 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:06:58.686939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:06:58.687651 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:06:58.695286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:58.695784 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:58.696226 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:58.696933 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:58.697421 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:58.697850 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:58.899097 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:06:58.907096 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-64b2e112-e0b5-4f24-a5f5-8cfb82efa109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 200 len: 1682 microversion: 2.1 time: 0.224712 Oct 01 22:06:58.907703 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2472/6926] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:06:58 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:06:59.340181 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-b55babcc-da28-4fe2-8f67-766ee2729319 req-5de9a4bb-da91-46bb-a60c-66cfd3271323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6263fbf7-52b7-411e-956f-54006c8e1f26", "name": "network-vif-deleted", "tag": "25bdde49-92c6-4675-b076-026913040307"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:06:59.349947 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b55babcc-da28-4fe2-8f67-766ee2729319 req-5de9a4bb-da91-46bb-a60c-66cfd3271323 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:59.350448 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b55babcc-da28-4fe2-8f67-766ee2729319 req-5de9a4bb-da91-46bb-a60c-66cfd3271323 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:59.351536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-b55babcc-da28-4fe2-8f67-766ee2729319 req-5de9a4bb-da91-46bb-a60c-66cfd3271323 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:59.362710 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-b55babcc-da28-4fe2-8f67-766ee2729319 req-5de9a4bb-da91-46bb-a60c-66cfd3271323 service nova] Creating event network-vif-deleted:25bdde49-92c6-4675-b076-026913040307 for instance 6263fbf7-52b7-411e-956f-54006c8e1f26 on nch2-master-1 Oct 01 22:06:59.367497 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-b55babcc-da28-4fe2-8f67-766ee2729319 req-5de9a4bb-da91-46bb-a60c-66cfd3271323 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089980 Oct 01 22:06:59.368333 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4455/6927] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:06:59.931574 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:06:59.932129 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 6263fbf7-52b7-411e-956f-54006c8e1f26] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:06:59.938872 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:59.939359 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:59.939796 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:59.940490 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:06:59.940956 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:06:59.941373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:06:59.955501 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] HTTP exception thrown: Instance 6263fbf7-52b7-411e-956f-54006c8e1f26 could not be found. Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Request method failure captured: Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 HTTP/1.1 Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLkE4ItUkV-i79aJX_ZGOR5KRFSBdVSQt9nKJcVWFbYtAl8vicQe_-G-rcjMipW5ATyZNqlveQJ0fgA60VqWjPtvmghBs9Get7IwM3yeUcxDrC6YWwzB9ilx0jVoGI6LuuwMaDy-XkJkUO7m7db3uovcyHwT8cl5MnzWri5vuFZQzGo Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: b904f70d6c7144db99dd4897d62ec567 Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestShelveInstance-1011857455 Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b904f70d6c7144db99dd4897d62ec567", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b904f70d6c7144db99dd4897d62ec567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b904f70d6c7144db99dd4897d62ec567"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b904f70d6c7144db99dd4897d62ec567"}]}] Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestShelveInstance-1011857455 Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: b904f70d6c7144db99dd4897d62ec567 Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestShelveInstance-1011857455 Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestShelveInstance-1011857455-project Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: c145fd00464c4dd1bb9e48320d8e916b Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestShelveInstance-1011857455-project Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance 6263fbf7-52b7-411e-956f-54006c8e1f26 could not be found. Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': '6263fbf7-52b7-411e-956f-54006c8e1f26'} Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6263fbf7-52b7-411e-956f-54006c8e1f26 could not be found. Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6263fbf7-52b7-411e-956f-54006c8e1f26 could not be found. Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:06:59.957110 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6263fbf7-52b7-411e-956f-54006c8e1f26 could not be found. Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Returning 404 to user: Instance 6263fbf7-52b7-411e-956f-54006c8e1f26 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5755e75c-c337-4000-a654-b3b70cfac604 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26" status: 404 len: 111 microversion: 2.1 time: 0.031457 Oct 01 22:06:59.963031 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2473/6928] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:06:59 2022] GET /compute/v2.1/servers/6263fbf7-52b7-411e-956f-54006c8e1f26 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 22:07:00.123088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a275d408-3c25-4698-937e-8478d829c109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '.version_select at 0x7f4172869820>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:00.153654 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a275d408-3c25-4698-937e-8478d829c109 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-799146840" status: 202 len: 0 microversion: 2.1 time: 0.034935 Oct 01 22:07:00.154276 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4456/6929] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Oct 1 22:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-799146840 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:07:00.178375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b07d6e85-08f9-419a-ade2-b240ca116fbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Action: 'create', calling method: .version_select at 0x7f417279c790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1402645684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyvLQ79nbss7RMP3eALST2KmYGTTWZ8ONVode/rXtuwrjiPVQ4vp+DkU2bUmN2yWbAI4/IaRDZpb7z7Pv0ek8ZV2GBVQL7kNNQnGONrcob3A10xiO57XtIfU6U8EhfwdQ=="}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:07:00.194396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-b07d6e85-08f9-419a-ade2-b240ca116fbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Getting quotas for project b904f70d6c7144db99dd4897d62ec567. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:07:00.203876 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-b07d6e85-08f9-419a-ade2-b240ca116fbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Getting quotas for user c145fd00464c4dd1bb9e48320d8e916b and project b904f70d6c7144db99dd4897d62ec567. Resources: {'key_pairs'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:07:00.231127 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b07d6e85-08f9-419a-ade2-b240ca116fbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.056622 Oct 01 22:07:00.231736 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2474/6930] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 22:07:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:07:02.643340 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2127528482", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1402645684", "security_groups": [{"name": "tempest-secgroup-smoke-837830907"}], "networks": [{"uuid": "27c40dda-554e-46e3-b4f6-fdf5d14f7bd5"}], "block_device_mapping_v2": [{"uuid": "223aaf60-9290-4c78-830a-bd61587db2a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:07:02.754822 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.network.neutron [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] validate_networks() for [('27c40dda-554e-46e3-b4f6-fdf5d14f7bd5', None, None, None, None, None)] {{(pid=140438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 22:07:03.170275 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Flavor limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 22:07:03.170760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Image limits 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 22:07:03.171516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Flavor pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 22:07:03.171943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Image pref 0:0:0 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 22:07:03.172372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.virt.hardware [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 22:07:03.181689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:03.182311 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:03.182807 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:03.183550 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:03.184020 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:03.184460 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:03.201559 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Getting quotas for project b904f70d6c7144db99dd4897d62ec567. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:07:03.206831 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Getting quotas for user c145fd00464c4dd1bb9e48320d8e916b and project b904f70d6c7144db99dd4897d62ec567. Resources: {'instances', 'ram', 'cores'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:07:03.264581 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Going to run 1 instances... {{(pid=140438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 22:07:03.266955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='223aaf60-9290-4c78-830a-bd61587db2a6',volume_size=None,volume_type=None)] {{(pid=140438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 22:07:03.394425 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a32b4054-55bb-49e1-a377-f0877e12d4a4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.755792 Oct 01 22:07:03.395144 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4457/6931] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 22:07:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 22:07:03.406663 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d6f8d18f-3cc2-4c8e-a63b-0e5ac6b653b6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:03.407290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d6f8d18f-3cc2-4c8e-a63b-0e5ac6b653b6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:03.462047 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d6f8d18f-3cc2-4c8e-a63b-0e5ac6b653b6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:03.469040 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d6f8d18f-3cc2-4c8e-a63b-0e5ac6b653b6 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1089 microversion: 2.1 time: 0.066433 Oct 01 22:07:03.469806 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2475/6932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:03 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:04.493372 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:04.494261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:04.502918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:04.503675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:04.504263 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:04.505088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:04.505834 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:04.506565 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:04.588547 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:04.597320 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c7dbe6df-f7b0-4918-9f3b-38d6c3e70930 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1205 microversion: 2.1 time: 0.108963 Oct 01 22:07:04.599036 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4458/6933] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:04 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1205 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:05.622693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:05.623657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:05.634440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:05.635245 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:05.635931 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:05.637019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:05.637746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:05.638415 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:05.771007 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:05.781730 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d41a8921-2c34-411a-bf7a-c0110cf27769 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1260 microversion: 2.1 time: 0.164949 Oct 01 22:07:05.795145 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2476/6934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:05 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:05.795272 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-65cc9481-b114-4279-9979-47517e527e91 req-6814d602-9bc6-40dd-b49d-10be8e03dba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539bacd5-9a55-4f89-831b-c1844a638644", "tag": "ce81c03f-c0bd-40aa-ab21-ebe2339348ce"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:07:05.807047 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-65cc9481-b114-4279-9979-47517e527e91 req-6814d602-9bc6-40dd-b49d-10be8e03dba8 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:05.807555 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-65cc9481-b114-4279-9979-47517e527e91 req-6814d602-9bc6-40dd-b49d-10be8e03dba8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:05.808025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-65cc9481-b114-4279-9979-47517e527e91 req-6814d602-9bc6-40dd-b49d-10be8e03dba8 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:05.821758 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-65cc9481-b114-4279-9979-47517e527e91 req-6814d602-9bc6-40dd-b49d-10be8e03dba8 service nova] Creating event network-changed:ce81c03f-c0bd-40aa-ab21-ebe2339348ce for instance 539bacd5-9a55-4f89-831b-c1844a638644 on nch1-master-1 Oct 01 22:07:05.826806 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-65cc9481-b114-4279-9979-47517e527e91 req-6814d602-9bc6-40dd-b49d-10be8e03dba8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036155 Oct 01 22:07:05.828097 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4459/6935] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:07:06.806900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:06.807544 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:06.814395 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:06.814924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:06.815360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:06.816063 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:06.816522 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:06.816950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:06.951689 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:06.959522 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-d6b287a1-23d1-4d0f-b965-f926a94e4670 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1260 microversion: 2.1 time: 0.156621 Oct 01 22:07:06.960102 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2477/6936] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:06 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:07.984556 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:07.985273 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:07.991514 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:07.992668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:07.993125 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:07.993830 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:07.994305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:07.994766 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:08.128866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:08.137069 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ba00259f-c3e7-4aa9-a5a6-f416a48e81bb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1260 microversion: 2.1 time: 0.157577 Oct 01 22:07:08.137689 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4460/6937] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:07 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:09.160497 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:09.161154 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:09.168209 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:09.168704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:09.169149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:09.169848 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:09.170309 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:09.170777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:09.301200 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:09.309767 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6544322a-2169-44e3-b41a-889f73acc03d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1260 microversion: 2.1 time: 0.153162 Oct 01 22:07:09.310450 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2478/6938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:09 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:10.333662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:10.334228 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:10.341730 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:10.342533 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:10.342737 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:10.343462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:10.343944 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:10.344399 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:10.485616 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:10.494378 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-97a28bef-5428-49f8-9a4d-7d06bbcc253a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1260 microversion: 2.1 time: 0.164927 Oct 01 22:07:10.495031 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4461/6939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:10 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 22:07:11.518042 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:11.518717 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:11.526229 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:11.526757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:11.527206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:11.527909 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:11.528375 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:11.528811 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:11.669847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:11.677996 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-c08dc375-41e9-4c9e-83cf-23f64d9a18fe tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1260 microversion: 2.1 time: 0.164012 Oct 01 22:07:11.678596 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2479/6940] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:11 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:12.398853 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-cc3bf720-2450-4d66-bfe2-9d6c3121a754 req-f6ecf6c5-e757-41f5-ae64-2a651beb7dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539bacd5-9a55-4f89-831b-c1844a638644", "name": "network-vif-plugged", "status": "completed", "tag": "ce81c03f-c0bd-40aa-ab21-ebe2339348ce"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:07:12.410395 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cc3bf720-2450-4d66-bfe2-9d6c3121a754 req-f6ecf6c5-e757-41f5-ae64-2a651beb7dd5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:12.410929 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cc3bf720-2450-4d66-bfe2-9d6c3121a754 req-f6ecf6c5-e757-41f5-ae64-2a651beb7dd5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:12.411738 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-cc3bf720-2450-4d66-bfe2-9d6c3121a754 req-f6ecf6c5-e757-41f5-ae64-2a651beb7dd5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:12.423691 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-cc3bf720-2450-4d66-bfe2-9d6c3121a754 req-f6ecf6c5-e757-41f5-ae64-2a651beb7dd5 service nova] Creating event network-vif-plugged:ce81c03f-c0bd-40aa-ab21-ebe2339348ce for instance 539bacd5-9a55-4f89-831b-c1844a638644 on nch1-master-1 Oct 01 22:07:12.429798 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-cc3bf720-2450-4d66-bfe2-9d6c3121a754 req-f6ecf6c5-e757-41f5-ae64-2a651beb7dd5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034043 Oct 01 22:07:12.430659 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4462/6941] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:07:12.700695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:12.701321 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:12.708160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:12.708650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:12.709095 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:12.709786 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:12.710766 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:12.711198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:12.842518 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:12.850434 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fdc7697f-cdb9-451d-bd77-b2b0f227eb2a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1260 microversion: 2.1 time: 0.153661 Oct 01 22:07:12.851757 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2480/6942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:12 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:13.874141 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:13.874814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:13.876796 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:07:13.877638 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=6 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:07:13.884692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:13.885286 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:13.885773 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:13.886517 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:13.886982 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:13.887427 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:14.019826 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:14.027865 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-22b1cfbd-8dba-4e4b-a549-d0cc1ad6ceac tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1445 microversion: 2.1 time: 0.157997 Oct 01 22:07:14.028520 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4463/6943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:13 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:14.050789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:07:14.051656 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:07:14.054768 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:07:14.061256 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:14.061810 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:14.062362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:14.063122 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:14.063580 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:14.064006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:14.194887 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:07:14.202797 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-5b779d84-8832-4106-8c57-4397e58b9d65 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1445 microversion: 2.1 time: 0.156029 Oct 01 22:07:14.203397 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2481/6944] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:07:14 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:07:15.751906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-c01e4535-e944-4723-ae55-6d0c0f837719 req-d36a1dc7-cf80-4b9a-a71e-22d9902d40b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539bacd5-9a55-4f89-831b-c1844a638644", "tag": "ce81c03f-c0bd-40aa-ab21-ebe2339348ce"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:07:15.762758 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c01e4535-e944-4723-ae55-6d0c0f837719 req-d36a1dc7-cf80-4b9a-a71e-22d9902d40b6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:07:15.763254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c01e4535-e944-4723-ae55-6d0c0f837719 req-d36a1dc7-cf80-4b9a-a71e-22d9902d40b6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:07:15.763918 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-c01e4535-e944-4723-ae55-6d0c0f837719 req-d36a1dc7-cf80-4b9a-a71e-22d9902d40b6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:07:15.775221 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-c01e4535-e944-4723-ae55-6d0c0f837719 req-d36a1dc7-cf80-4b9a-a71e-22d9902d40b6 service nova] Creating event network-changed:ce81c03f-c0bd-40aa-ab21-ebe2339348ce for instance 539bacd5-9a55-4f89-831b-c1844a638644 on nch1-master-1 Oct 01 22:07:15.780244 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-c01e4535-e944-4723-ae55-6d0c0f837719 req-d36a1dc7-cf80-4b9a-a71e-22d9902d40b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032122 Oct 01 22:07:15.780841 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4464/6945] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:09:21.435053 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6cf13eb0-b69c-4965-a7b8-83d512cc6864] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 01 22:09:21.435999 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 01 22:09:21.436650 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:09:21.437289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:09:21.499062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:09:21.499605 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:21.505999 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:21.506510 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:21.506947 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:21.507639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:21.508102 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:21.508530 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:21.531775 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lazy-loading 'flavor' on Instance uuid 539bacd5-9a55-4f89-831b-c1844a638644 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 22:09:21.602837 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-37f38c8e-fd70-4001-aa6a-98706d72099b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "POST /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644/action" status: 202 len: 0 microversion: 2.1 time: 0.173259 Oct 01 22:09:21.603442 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2482/6946] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:09:21 2022] POST /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:09:21.610214 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74998dba-9c89-4876-a756-a0e4436afa1f] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 01 22:09:21.611276 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [-] [770c7631-b847-42b2-bd0c-8c7e920b0b1d] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 01 22:09:21.611883 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:09:21.613138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=42 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:09:21.618523 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:21.619281 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:21.627499 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:21.628633 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:21.629102 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:21.629889 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:21.630410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:21.630888 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:21.769423 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:21.777380 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-b7358fbf-9523-4583-ba51-158dc1000510 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.169173 Oct 01 22:09:21.777953 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4465/6947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:21 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:22.803198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:22.803903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:22.814462 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:22.815009 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:22.816000 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:22.816702 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:22.817165 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:22.817596 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:22.823871 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60380. Oct 01 22:09:22.824595 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] [6cf13eb0-b69c-4965-a7b8-83d512cc6864] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60378. Oct 01 22:09:22.950941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:22.960329 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-89b270fe-2e7d-436e-a929-ca64c62ba921 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.163440 Oct 01 22:09:22.961045 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2483/6948] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:22 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:23.983863 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:23.984494 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:23.993045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:23.993551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:23.994034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:23.994778 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:23.995258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:23.995703 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:24.016521 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] [74998dba-9c89-4876-a756-a0e4436afa1f] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60402. Oct 01 22:09:24.017344 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] [770c7631-b847-42b2-bd0c-8c7e920b0b1d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60404. Oct 01 22:09:24.130332 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:24.138301 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-4ccf2172-4e00-4717-ae75-58dae3081a89 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.158481 Oct 01 22:09:24.138921 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4466/6949] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:23 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:25.161819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:25.162440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:25.169308 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:25.170062 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:25.170515 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:25.171228 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:25.171685 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:25.172112 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:25.303191 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:25.310991 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-642441a6-b86a-45c0-b75e-5ed941efb793 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.153689 Oct 01 22:09:25.311562 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2484/6950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:25 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:26.335145 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:26.335596 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:26.342812 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:26.343319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:26.343776 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:26.344575 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:26.345108 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:26.345553 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:26.478189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:26.486044 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6ccc7e3a-fa24-49b3-a74e-c402690e28cf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.155456 Oct 01 22:09:26.486650 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4467/6951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:26 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:27.510526 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:27.511149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:27.518369 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:27.519950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:27.520561 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:27.521267 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:27.521729 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:27.522159 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:27.657604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:27.665591 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9590a717-c1f5-4f87-8320-b6ed9b242c96 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.158993 Oct 01 22:09:27.666161 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2485/6952] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:27 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:28.689437 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:28.690077 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:28.697628 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:28.698138 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:28.698647 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:28.699368 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:28.699852 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:28.700305 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:28.832495 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:28.840377 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-60e2b76a-9638-4e14-ae15-6c0436ace7b7 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.155004 Oct 01 22:09:28.840983 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4468/6953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:28 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:29.864820 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:29.865440 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:29.872396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:29.872884 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:29.874162 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:29.875247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:29.875718 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:29.876149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:30.012639 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:30.020430 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-306dce4a-ba2f-4413-80a9-7e3b799eeae4 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.160009 Oct 01 22:09:30.021002 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2486/6954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:29 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:31.043662 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:31.044668 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:31.051774 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:31.052282 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:31.052771 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:31.053535 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:31.054014 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:31.054463 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:31.187329 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:31.195683 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9da6234e-95d0-403a-9653-345c84fdc99b tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.156019 Oct 01 22:09:31.196268 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4469/6955] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:31 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:32.220173 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:32.220837 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:32.229016 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:32.229635 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:32.230078 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:32.230826 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:32.231291 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:32.231719 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:32.370616 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:32.378516 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-08969601-98a7-4607-8613-b3df386e9d5a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.162362 Oct 01 22:09:32.379105 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2487/6956] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:32 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:33.402955 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:33.403505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:33.411034 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:33.411536 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:33.411989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:33.412693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:33.413162 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:33.413605 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:33.548241 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:33.556792 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-89567020-a8ec-4cbf-bf6b-58da9b520cbb tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.157892 Oct 01 22:09:33.557403 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4470/6957] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:33 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:34.580131 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:34.580741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:34.587594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:34.588019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:34.588456 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:34.589150 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:34.589604 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:34.590029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:34.724240 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:34.732138 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-fa8bcb32-ee01-4439-9c78-b581d887ba95 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1570 microversion: 2.1 time: 0.155931 Oct 01 22:09:34.732715 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2488/6958] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:34 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:34.755030 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:09:34.755653 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:34.762470 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:34.763006 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:34.763471 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:34.764184 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:34.764663 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:34.765114 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:34.793583 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140438) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 22:09:34.856025 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [7905babf-44e8-4c08-be1b-d8329aafde86] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 22:09:35.863405 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [7905babf-44e8-4c08-be1b-d8329aafde86] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60430. Oct 01 22:09:35.866884 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-468ffc46-caf4-4d86-936a-1f10336654df tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "POST /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644/action" status: 202 len: 0 microversion: 2.1 time: 1.115727 Oct 01 22:09:35.867522 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4471/6959] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:09:34 2022] POST /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644/action => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 22:09:35.875675 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:35.876307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:35.884751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:35.884751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:35.884751 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:35.885563 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:35.886069 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:35.886586 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:36.039003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:36.047633 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4b5bcb8e-040f-48b5-8581-d9c61fd41b86 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1518 microversion: 2.1 time: 0.175835 Oct 01 22:09:36.048230 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2489/6960] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:35 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:37.072692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:37.073319 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:37.080432 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:37.080943 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:37.081397 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:37.082112 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:37.082613 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:37.083061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:37.212749 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:37.221593 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-39cc187f-d9ff-47a3-994c-e870828d7895 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1518 microversion: 2.1 time: 0.153119 Oct 01 22:09:37.222178 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4472/6961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:37 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:38.244941 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:38.245692 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:38.252269 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:38.253507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:38.254115 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:38.255027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:38.255492 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:38.256004 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:38.394279 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:38.402250 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ea743b1f-fd94-4f5e-84ab-c39161d14762 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1518 microversion: 2.1 time: 0.161077 Oct 01 22:09:38.402866 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2490/6962] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:38 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:38.945502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-14b9f7f1-2d8b-4a36-b440-a9bd563cb6e1 req-a26807b9-7d9d-41b9-bc46-40eed5b3f165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539bacd5-9a55-4f89-831b-c1844a638644", "name": "network-vif-unplugged", "status": "completed", "tag": "ce81c03f-c0bd-40aa-ab21-ebe2339348ce"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:09:38.957414 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-14b9f7f1-2d8b-4a36-b440-a9bd563cb6e1 req-a26807b9-7d9d-41b9-bc46-40eed5b3f165 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:38.958060 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-14b9f7f1-2d8b-4a36-b440-a9bd563cb6e1 req-a26807b9-7d9d-41b9-bc46-40eed5b3f165 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:38.958516 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-14b9f7f1-2d8b-4a36-b440-a9bd563cb6e1 req-a26807b9-7d9d-41b9-bc46-40eed5b3f165 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:38.971854 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.compute.server_external_events [req-14b9f7f1-2d8b-4a36-b440-a9bd563cb6e1 req-a26807b9-7d9d-41b9-bc46-40eed5b3f165 service nova] Unable to find a host for instance 539bacd5-9a55-4f89-831b-c1844a638644. Dropping event network-vif-unplugged {{(pid=140438) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 01 22:09:38.972759 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-14b9f7f1-2d8b-4a36-b440-a9bd563cb6e1 req-a26807b9-7d9d-41b9-bc46-40eed5b3f165 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031224 Oct 01 22:09:38.973352 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4473/6963] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 01 22:09:39.425035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:39.425654 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:39.432471 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:39.432959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:39.433396 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:39.434088 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:39.434571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:39.435001 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:39.564648 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:39.572980 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-1c4b67e2-7a08-4e65-a840-690c16a544c5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1518 microversion: 2.1 time: 0.151856 Oct 01 22:09:39.573560 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2491/6964] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:39 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:40.596706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:40.597856 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:40.604874 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:40.605386 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:40.605844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:40.606588 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:40.607069 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:40.607512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:40.743487 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:40.751459 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0fed26e9-dfd7-484a-b7d8-4f44734325ba tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1520 microversion: 2.1 time: 0.158857 Oct 01 22:09:40.752046 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4474/6965] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:40 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:41.775551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:41.776208 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:41.783735 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:41.784239 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:41.785253 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:41.785989 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:41.786478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:41.786932 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:41.933039 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:41.942314 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0eb0c3a7-fd7c-4386-974a-19481d481a55 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1576 microversion: 2.1 time: 0.170727 Oct 01 22:09:41.943180 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2492/6966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:41 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:42.965978 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:42.966665 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:42.974072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:42.974602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:42.975066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:42.975777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:42.976254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:42.976696 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:43.107756 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:43.116271 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8c85074d-0cbe-4248-b4df-72df8d6169d9 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1576 microversion: 2.1 time: 0.154278 Oct 01 22:09:43.116851 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4475/6967] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:42 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:44.138722 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:44.139273 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:44.146217 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:44.146748 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:44.147206 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:44.147898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:44.148352 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:44.148776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:44.281259 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:44.289157 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-78a67d71-0fba-44ca-ae97-87234ef323be tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1576 microversion: 2.1 time: 0.154456 Oct 01 22:09:44.289745 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2493/6968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:44 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:45.313123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:45.313750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:45.321261 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:45.321767 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:45.322223 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:45.322969 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:45.323444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:45.323886 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:45.464298 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:45.472482 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-6fcad412-51b0-4deb-a8a9-2657c2b900de tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1576 microversion: 2.1 time: 0.163320 Oct 01 22:09:45.473110 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4476/6969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:45 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:46.496148 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:46.496794 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:46.503749 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:46.504235 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:46.504670 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:46.505360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:46.505814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:46.506244 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:46.635464 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:46.643224 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-222759b2-8e0d-45d0-b211-949408c4b911 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1576 microversion: 2.1 time: 0.151075 Oct 01 22:09:46.644285 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2494/6970] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:46 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:47.013208 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-04fa8b03-9184-434c-976b-732ca91d14da req-8b711edc-78bc-4ff0-bd12-2bd87dea1d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539bacd5-9a55-4f89-831b-c1844a638644", "name": "network-vif-plugged", "status": "completed", "tag": "ce81c03f-c0bd-40aa-ab21-ebe2339348ce"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:09:47.024407 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-04fa8b03-9184-434c-976b-732ca91d14da req-8b711edc-78bc-4ff0-bd12-2bd87dea1d04 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:47.024939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-04fa8b03-9184-434c-976b-732ca91d14da req-8b711edc-78bc-4ff0-bd12-2bd87dea1d04 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:47.025424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-04fa8b03-9184-434c-976b-732ca91d14da req-8b711edc-78bc-4ff0-bd12-2bd87dea1d04 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:47.037344 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-04fa8b03-9184-434c-976b-732ca91d14da req-8b711edc-78bc-4ff0-bd12-2bd87dea1d04 service nova] Creating event network-vif-plugged:ce81c03f-c0bd-40aa-ab21-ebe2339348ce for instance 539bacd5-9a55-4f89-831b-c1844a638644 on nch1-master-1 Oct 01 22:09:47.042511 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-04fa8b03-9184-434c-976b-732ca91d14da req-8b711edc-78bc-4ff0-bd12-2bd87dea1d04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032972 Oct 01 22:09:47.043308 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4477/6971] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:09:47.667186 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:47.667809 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:47.674601 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:47.675679 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:47.676117 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:47.676807 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:47.677263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:47.677687 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:47.810845 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:47.818752 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-62835184-70bf-4cad-ba0e-e1b31f39b62a tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1576 microversion: 2.1 time: 0.155492 Oct 01 22:09:47.819323 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2495/6972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:47 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:09:48.843999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:09:48.844751 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:09:48.851038 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:48.851542 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:48.851997 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:48.852708 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:09:48.853190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:09:48.853634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:09:48.988367 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:09:48.996239 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-52ddf5d1-d028-42b3-afb8-409a748cfa4d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1563 microversion: 2.1 time: 0.157432 Oct 01 22:09:48.996823 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4478/6973] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:09:48 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:09.983029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=28 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:09.984143 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:09.985497 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 22:11:09.986186 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 22:11:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 (ip 10.222.0.17) !!! Oct 01 22:11:09.986325 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:09.986986 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:09.988319 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 22:11:09.988701 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 22:11:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 01 22:11:09.992046 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 22:11:09.992298 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 22:11:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 (ip 10.222.0.17) !!! Oct 01 22:11:09.993864 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-67ef763b-aa3c-416f-95ed-65b280a730cf req-967147a6-e436-4b1f-a1de-7533eb631ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539bacd5-9a55-4f89-831b-c1844a638644", "tag": "ce81c03f-c0bd-40aa-ab21-ebe2339348ce"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:11:10.006818 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-67ef763b-aa3c-416f-95ed-65b280a730cf req-967147a6-e436-4b1f-a1de-7533eb631ca6 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:10.007317 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-67ef763b-aa3c-416f-95ed-65b280a730cf req-967147a6-e436-4b1f-a1de-7533eb631ca6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:10.007973 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-67ef763b-aa3c-416f-95ed-65b280a730cf req-967147a6-e436-4b1f-a1de-7533eb631ca6 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:10.010132 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:10.010741 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:10.022084 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-67ef763b-aa3c-416f-95ed-65b280a730cf req-967147a6-e436-4b1f-a1de-7533eb631ca6 service nova] Creating event network-changed:ce81c03f-c0bd-40aa-ab21-ebe2339348ce for instance 539bacd5-9a55-4f89-831b-c1844a638644 on nch1-master-1 Oct 01 22:11:10.027318 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:10.027917 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:10.028303 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-67ef763b-aa3c-416f-95ed-65b280a730cf req-967147a6-e436-4b1f-a1de-7533eb631ca6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044191 Oct 01 22:11:10.028470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:10.029270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:10.029581 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4479/6974] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:11:10.030393 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:10.031029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:10.062673 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Going to try to terminate instance {{(pid=140437) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 22:11:10.151963 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-8af4c296-2a4f-4cf3-81b6-47f27d868ac8 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "DELETE /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 204 len: 0 microversion: 2.1 time: 0.169059 Oct 01 22:11:10.153150 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2496/6975] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 22:11:09 2022] DELETE /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 22:11:10.162193 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:10.163244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:10.170444 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:10.170992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:10.171454 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:10.172175 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:10.172651 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:10.173280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:10.362291 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:10.370442 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d499932f-d659-4b99-9b15-54da92367adf tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.212412 Oct 01 22:11:10.371054 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4480/6976] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:10 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:11.395230 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:11.395939 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:11.403772 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:11.404265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:11.404706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:11.405402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:11.405856 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:11.406280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:11.584243 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:11.592696 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b25a8a08-85b0-44bd-8d58-4037081a0015 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1569 microversion: 2.1 time: 0.201895 Oct 01 22:11:11.593278 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2497/6977] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:11 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:12.246763 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-aa289436-507f-420e-9461-ec463c4fdaae req-5dff80b6-f76d-4c19-a15b-4f49679ae586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539bacd5-9a55-4f89-831b-c1844a638644", "name": "network-vif-deleted", "tag": "ce81c03f-c0bd-40aa-ab21-ebe2339348ce"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:11:12.256436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-aa289436-507f-420e-9461-ec463c4fdaae req-5dff80b6-f76d-4c19-a15b-4f49679ae586 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:12.256925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-aa289436-507f-420e-9461-ec463c4fdaae req-5dff80b6-f76d-4c19-a15b-4f49679ae586 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:12.257597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-aa289436-507f-420e-9461-ec463c4fdaae req-5dff80b6-f76d-4c19-a15b-4f49679ae586 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:12.269631 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-aa289436-507f-420e-9461-ec463c4fdaae req-5dff80b6-f76d-4c19-a15b-4f49679ae586 service nova] Creating event network-vif-deleted:ce81c03f-c0bd-40aa-ab21-ebe2339348ce for instance 539bacd5-9a55-4f89-831b-c1844a638644 on nch1-master-1 Oct 01 22:11:12.274262 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-aa289436-507f-420e-9461-ec463c4fdaae req-5dff80b6-f76d-4c19-a15b-4f49679ae586 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083099 Oct 01 22:11:12.278647 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4481/6978] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:11:12.617103 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:12.617704 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:12.625160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:12.626142 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:12.626684 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:12.627521 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:12.627983 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:12.628410 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:12.667569 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:12.668071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:12.668773 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:12.669232 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.objects.instance [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lazy-loading 'fault' on Instance uuid 539bacd5-9a55-4f89-831b-c1844a638644 {{(pid=140437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 22:11:12.717507 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c145fd00464c4dd1bb9e48320d8e916b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b904f70d6c7144db99dd4897d62ec567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:12.726943 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-3d9594b1-904f-43e9-856c-6635da33057d tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 200 len: 1225 microversion: 2.1 time: 0.113179 Oct 01 22:11:12.727552 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2498/6979] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:12 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:13.753024 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:13.753754 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] [instance: 539bacd5-9a55-4f89-831b-c1844a638644] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:13.760094 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:13.760604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:13.761063 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:13.761777 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:13.762253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:13.762727 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:13.775879 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] HTTP exception thrown: Instance 539bacd5-9a55-4f89-831b-c1844a638644 could not be found. Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Request method failure captured: Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 HTTP/1.1 Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLkE4ItUkV-i79aJX_ZGOR5KRFSBdVSQt9nKJcVWFbYtAl8vicQe_-G-rcjMipW5ATyZNqlveQJ0fgA60VqWjPtvmghBs9Get7IwM3yeUcxDrC6YWwzB9ilx0jVoGI6LuuwMaDy-XkJkUO7m7db3uovcyHwT8cl5MnzWri5vuFZQzGo Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: b904f70d6c7144db99dd4897d62ec567 Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestShelveInstance-1011857455 Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b904f70d6c7144db99dd4897d62ec567", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b904f70d6c7144db99dd4897d62ec567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b904f70d6c7144db99dd4897d62ec567"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b904f70d6c7144db99dd4897d62ec567"}]}] Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestShelveInstance-1011857455 Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: b904f70d6c7144db99dd4897d62ec567 Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestShelveInstance-1011857455 Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestShelveInstance-1011857455-project Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: c145fd00464c4dd1bb9e48320d8e916b Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestShelveInstance-1011857455-project Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance 539bacd5-9a55-4f89-831b-c1844a638644 could not be found. Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': '539bacd5-9a55-4f89-831b-c1844a638644'} Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 539bacd5-9a55-4f89-831b-c1844a638644 could not be found. Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 539bacd5-9a55-4f89-831b-c1844a638644 could not be found. Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:11:13.777489 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 539bacd5-9a55-4f89-831b-c1844a638644 could not be found. Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Returning 404 to user: Instance 539bacd5-9a55-4f89-831b-c1844a638644 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c1b78d0b-3855-42b2-8250-22a5f98fbc93 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644" status: 404 len: 111 microversion: 2.1 time: 0.031067 Oct 01 22:11:13.783992 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4482/6980] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:13 2022] GET /compute/v2.1/servers/539bacd5-9a55-4f89-831b-c1844a638644 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 22:11:13.940319 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f11639c2-ca48-4aa1-ba0f-48e79059d0b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] Calling method '.version_select at 0x7f4172360700>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:13.971534 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f11639c2-ca48-4aa1-ba0f-48e79059d0b5 tempest-TestShelveInstance-1011857455 tempest-TestShelveInstance-1011857455-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1402645684" status: 202 len: 0 microversion: 2.1 time: 0.035032 Oct 01 22:11:13.972426 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2499/6981] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Oct 1 22:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1402645684 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 22:11:31.125105 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:31.126404 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=12 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:31.293551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-0467e380-74f3-4539-a110-c6b854234f1a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Action: 'create', calling method: .version_select at 0x7f41725ccb80>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-974134804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsDCVZfULNMiBbpePiQb2gnbASZxYMi9Bw8HUNAtDXyXeZ16chmcxVNOUPiddkvmerjlDowLeVU1iqcH8AqElthCb/TkmmFd61xiiB16yNLg+9S8LdUKc/tSQ3bwh9ZjQ=="}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:11:31.309868 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-0467e380-74f3-4539-a110-c6b854234f1a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Getting quotas for project 89e39a085b9f4755b8d41bfd12f03b3b. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:11:31.316050 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.quota [None req-0467e380-74f3-4539-a110-c6b854234f1a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Getting quotas for user 902d38ae2b914ea99dcf232ec6461d55 and project 89e39a085b9f4755b8d41bfd12f03b3b. Resources: {'key_pairs'} {{(pid=140438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:11:31.344557 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-0467e380-74f3-4539-a110-c6b854234f1a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.224895 Oct 01 22:11:31.345178 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4483/6982] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Oct 1 22:11:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:11:32.324828 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:32.325958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:32.333745 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-167295466", "imageRef": "90f3f35e-76ec-4c31-b581-329b315fe607", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-974134804", "security_groups": [{"name": "tempest-secgroup-smoke-286168437"}], "networks": [{"uuid": "dbc08271-b661-4956-a4c9-8e77868ff5ea"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:11:32.449538 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] validate_networks() for [('dbc08271-b661-4956-a4c9-8e77868ff5ea', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 22:11:32.929293 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 22:11:32.929806 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 22:11:32.930373 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 22:11:32.930907 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 22:11:32.931478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 22:11:32.940697 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:32.941271 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:32.941797 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:32.942570 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:32.943046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:32.943487 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:32.963141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Getting quotas for project 89e39a085b9f4755b8d41bfd12f03b3b. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:11:32.968572 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Getting quotas for user 902d38ae2b914ea99dcf232ec6461d55 and project 89e39a085b9f4755b8d41bfd12f03b3b. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:11:32.981701 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 22:11:32.984306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90f3f35e-76ec-4c31-b581-329b315fe607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 22:11:33.032898 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-f0fb27b4-54c0-46fd-b841-5c45a848af60 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710990 Oct 01 22:11:33.033749 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2500/6983] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 22:11:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 22:11:33.046029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-97423ed5-a791-43a7-a961-6dd46c4988a4 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:33.047835 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-97423ed5-a791-43a7-a961-6dd46c4988a4 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:33.103211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-97423ed5-a791-43a7-a961-6dd46c4988a4 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:33.110666 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-97423ed5-a791-43a7-a961-6dd46c4988a4 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1247 microversion: 2.1 time: 0.069627 Oct 01 22:11:33.111737 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4484/6984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:33 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:34.135900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-14e0eb04-a5dd-4a14-af45-ad9f18d8e7c3 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:34.136470 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-14e0eb04-a5dd-4a14-af45-ad9f18d8e7c3 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:34.195495 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-14e0eb04-a5dd-4a14-af45-ad9f18d8e7c3 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:34.203917 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-14e0eb04-a5dd-4a14-af45-ad9f18d8e7c3 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1247 microversion: 2.1 time: 0.074466 Oct 01 22:11:34.211046 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2501/6985] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:34 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:35.226566 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-82362b4c-9c15-4125-ae94-b5a0051e89ac tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:35.227202 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-82362b4c-9c15-4125-ae94-b5a0051e89ac tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:35.280545 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-82362b4c-9c15-4125-ae94-b5a0051e89ac tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:35.288744 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-82362b4c-9c15-4125-ae94-b5a0051e89ac tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1247 microversion: 2.1 time: 0.066193 Oct 01 22:11:35.289318 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4485/6986] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:35 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1247 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:36.311970 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a398cdd7-9ba4-4445-9ab8-ef3d38dc6a78 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:36.312594 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a398cdd7-9ba4-4445-9ab8-ef3d38dc6a78 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:36.366021 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a398cdd7-9ba4-4445-9ab8-ef3d38dc6a78 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:36.373015 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a398cdd7-9ba4-4445-9ab8-ef3d38dc6a78 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1247 microversion: 2.1 time: 0.064993 Oct 01 22:11:36.374584 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2502/6987] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:36 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1247 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:37.396972 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:37.397617 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:37.404844 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:37.405355 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:37.405816 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:37.406582 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:37.407067 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:37.407512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:37.470670 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:37.478978 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-68f61c5e-ab7d-4b5e-ba5d-ed51547770f7 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1251 microversion: 2.1 time: 0.086298 Oct 01 22:11:37.479565 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4486/6988] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:37 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1251 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:38.504422 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:38.505056 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:38.517548 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:38.518254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:38.518727 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:38.519442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:38.519905 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:38.520416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:38.589552 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:38.597584 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-88ca4343-75b8-4d1c-839a-80dee6412572 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1305 microversion: 2.1 time: 0.098838 Oct 01 22:11:38.598178 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2503/6989] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:38 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:39.635244 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:39.635829 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:39.636083 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-80194f4b-0205-4142-a23c-cc9ca776f732 req-bc1889b4-88e4-4c79-a043-2ef7cd0a1289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52a3cb1-c6fd-4932-a306-fa9f21a53005", "tag": "bf99ae1c-a22d-483f-8622-9004c0147a47"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:11:39.652908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80194f4b-0205-4142-a23c-cc9ca776f732 req-bc1889b4-88e4-4c79-a043-2ef7cd0a1289 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:39.653442 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80194f4b-0205-4142-a23c-cc9ca776f732 req-bc1889b4-88e4-4c79-a043-2ef7cd0a1289 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:39.654077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-80194f4b-0205-4142-a23c-cc9ca776f732 req-bc1889b4-88e4-4c79-a043-2ef7cd0a1289 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:39.656207 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:39.657410 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:39.657959 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:39.658693 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:39.659462 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:39.660064 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:39.668262 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-80194f4b-0205-4142-a23c-cc9ca776f732 req-bc1889b4-88e4-4c79-a043-2ef7cd0a1289 service nova] Creating event network-changed:bf99ae1c-a22d-483f-8622-9004c0147a47 for instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 on nch1-master-1 Oct 01 22:11:39.673758 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-80194f4b-0205-4142-a23c-cc9ca776f732 req-bc1889b4-88e4-4c79-a043-2ef7cd0a1289 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052771 Oct 01 22:11:39.674610 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2504/6990] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:11:39.890887 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:39.898703 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-8f97da79-9228-401f-9126-92074815fb6d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1372 microversion: 2.1 time: 0.280987 Oct 01 22:11:39.899297 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4487/6991] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:39 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1372 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:40.924238 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:40.924952 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:40.931431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:40.931934 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:40.932378 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:40.933098 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:40.933562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:40.933997 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:41.406280 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:41.414106 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b19f243a-b132-4866-96b1-95469712cc89 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1372 microversion: 2.1 time: 0.495303 Oct 01 22:11:41.414714 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2505/6992] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:40 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1372 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:42.437894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:42.438692 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:42.446061 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:42.447211 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:42.447672 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:42.448474 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:42.448953 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:42.449398 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:42.593500 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:42.601272 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-d8295afc-b4f4-4c86-9604-9ae61ee3fdf2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1372 microversion: 2.1 time: 0.167428 Oct 01 22:11:42.601852 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4488/6993] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:42 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:43.570647 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:43.625466 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:43.626183 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:43.630311 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-60f137a9-1dc6-46f4-98a3-5fc3b67ba2a4 req-2713b5c5-f603-45d5-8e73-cc7952ca795c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52a3cb1-c6fd-4932-a306-fa9f21a53005", "name": "network-vif-plugged", "status": "completed", "tag": "bf99ae1c-a22d-483f-8622-9004c0147a47"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:11:43.634999 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:43.635515 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:43.635970 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:43.637089 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:43.637189 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:43.637577 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:43.640519 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-60f137a9-1dc6-46f4-98a3-5fc3b67ba2a4 req-2713b5c5-f603-45d5-8e73-cc7952ca795c service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:43.641203 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-60f137a9-1dc6-46f4-98a3-5fc3b67ba2a4 req-2713b5c5-f603-45d5-8e73-cc7952ca795c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:43.641645 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-60f137a9-1dc6-46f4-98a3-5fc3b67ba2a4 req-2713b5c5-f603-45d5-8e73-cc7952ca795c service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:43.653243 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-60f137a9-1dc6-46f4-98a3-5fc3b67ba2a4 req-2713b5c5-f603-45d5-8e73-cc7952ca795c service nova] Creating event network-vif-plugged:bf99ae1c-a22d-483f-8622-9004c0147a47 for instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 on nch1-master-1 Oct 01 22:11:43.658216 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-60f137a9-1dc6-46f4-98a3-5fc3b67ba2a4 req-2713b5c5-f603-45d5-8e73-cc7952ca795c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093456 Oct 01 22:11:43.659025 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2506/6994] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:11:43.818679 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:43.827093 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-298c727b-687c-4cb4-a385-3fe3833835b1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1372 microversion: 2.1 time: 0.205811 Oct 01 22:11:43.827675 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4489/6995] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:43 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 22:11:44.851760 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:44.853065 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:44.859367 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:44.859858 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:44.860303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:44.861003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:44.861469 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:44.861898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:44.996418 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:45.004570 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-6ce39a00-fd71-4e28-a754-41fb5d830dde tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1372 microversion: 2.1 time: 0.158647 Oct 01 22:11:45.005151 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2507/6996] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:44 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:46.028190 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:46.028833 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:46.031561 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=8 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:11:46.037438 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:46.037946 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:46.038434 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:46.039179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:46.039656 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:46.040684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:46.175056 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:46.183017 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c56a7db4-e7ed-4456-8605-94ee0f65f938 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1558 microversion: 2.1 time: 0.159077 Oct 01 22:11:46.183589 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4490/6997] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:46 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:46.205003 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:11:46.205625 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:11:46.212922 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:46.213409 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:46.213849 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:46.214567 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:46.215027 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:46.215459 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:46.348641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:11:46.358352 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ab92e3f7-21a4-43b9-9b80-4eb53e3b3579 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1558 microversion: 2.1 time: 0.157155 Oct 01 22:11:46.358981 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2508/6998] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:11:46 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:11:47.951091 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-843f9b3e-b109-422e-9b8b-267c4b6ecb1d req-821022b8-c200-4d0f-a1ad-242f63dde2be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52a3cb1-c6fd-4932-a306-fa9f21a53005", "tag": "bf99ae1c-a22d-483f-8622-9004c0147a47"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:11:47.963179 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-843f9b3e-b109-422e-9b8b-267c4b6ecb1d req-821022b8-c200-4d0f-a1ad-242f63dde2be service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:11:47.963968 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-843f9b3e-b109-422e-9b8b-267c4b6ecb1d req-821022b8-c200-4d0f-a1ad-242f63dde2be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:11:47.964601 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-843f9b3e-b109-422e-9b8b-267c4b6ecb1d req-821022b8-c200-4d0f-a1ad-242f63dde2be service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:11:47.976459 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-843f9b3e-b109-422e-9b8b-267c4b6ecb1d req-821022b8-c200-4d0f-a1ad-242f63dde2be service nova] Creating event network-changed:bf99ae1c-a22d-483f-8622-9004c0147a47 for instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 on nch1-master-1 Oct 01 22:11:47.981922 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-843f9b3e-b109-422e-9b8b-267c4b6ecb1d req-821022b8-c200-4d0f-a1ad-242f63dde2be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Oct 01 22:11:47.982558 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4491/6999] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:13:45.533007 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6cf13eb0-b69c-4965-a7b8-83d512cc6864] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 01 22:13:45.533929 ncdv-master-1 devstack@n-api.service[140437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 01 22:13:45.534557 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=10 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:13:45.535444 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:13:45.536201 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=30 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:13:45.541767 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-b761a356-ba89-4de1-a8a0-8e959d2e11ca tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-70455225"}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:13:45.544317 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-b761a356-ba89-4de1-a8a0-8e959d2e11ca tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:13:45.552969 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b761a356-ba89-4de1-a8a0-8e959d2e11ca tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:13:45.553489 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b761a356-ba89-4de1-a8a0-8e959d2e11ca tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:13:45.553929 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b761a356-ba89-4de1-a8a0-8e959d2e11ca tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:13:45.554693 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b761a356-ba89-4de1-a8a0-8e959d2e11ca tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:13:45.555153 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b761a356-ba89-4de1-a8a0-8e959d2e11ca tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:13:45.555610 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-b761a356-ba89-4de1-a8a0-8e959d2e11ca tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:13:45.751546 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-b761a356-ba89-4de1-a8a0-8e959d2e11ca tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "POST /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005/action" status: 202 len: 0 microversion: 2.1 time: 0.220158 Oct 01 22:13:45.752233 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2509/7000] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:13:45 2022] POST /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 22:13:50.194383 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74998dba-9c89-4876-a756-a0e4436afa1f] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 22:13:50.197026 ncdv-master-1 devstack@n-api.service[140438]: ERROR oslo.messaging._drivers.impl_rabbit [-] [770c7631-b847-42b2-bd0c-8c7e920b0b1d] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 01 22:13:50.197892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:13:50.199222 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=32 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:13:50.200467 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 22:13:50.200790 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 22:13:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 01 22:13:50.209062 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [req-60b0923d-1b7a-42d0-bda8-38ec5b5f43d2 req-2ec438ba-e9e9-4a83-b5eb-ace0b1d0d1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52a3cb1-c6fd-4932-a306-fa9f21a53005", "name": "network-vif-plugged", "status": "completed", "tag": "bf99ae1c-a22d-483f-8622-9004c0147a47"}]} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:13:50.231338 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60b0923d-1b7a-42d0-bda8-38ec5b5f43d2 req-2ec438ba-e9e9-4a83-b5eb-ace0b1d0d1b2 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:13:50.232066 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60b0923d-1b7a-42d0-bda8-38ec5b5f43d2 req-2ec438ba-e9e9-4a83-b5eb-ace0b1d0d1b2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:13:50.232794 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [req-60b0923d-1b7a-42d0-bda8-38ec5b5f43d2 req-2ec438ba-e9e9-4a83-b5eb-ace0b1d0d1b2 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:13:50.250293 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.compute.server_external_events [req-60b0923d-1b7a-42d0-bda8-38ec5b5f43d2 req-2ec438ba-e9e9-4a83-b5eb-ace0b1d0d1b2 service nova] Creating event network-vif-plugged:bf99ae1c-a22d-483f-8622-9004c0147a47 for instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 on nch1-master-1 Oct 01 22:13:50.256274 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [req-60b0923d-1b7a-42d0-bda8-38ec5b5f43d2 req-2ec438ba-e9e9-4a83-b5eb-ace0b1d0d1b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065952 Oct 01 22:13:50.257642 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4492/7001] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:13:59.298903 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:13:59.299935 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:13:59.304290 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1503167530", "imageRef": "c7ee79c5-e6fd-4fcb-870e-2c99503fee14", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-974134804", "security_groups": [{"name": "tempest-secgroup-smoke-286168437"}], "networks": [{"uuid": "dbc08271-b661-4956-a4c9-8e77868ff5ea"}]}} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:13:59.330918 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] [6cf13eb0-b69c-4965-a7b8-83d512cc6864] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60990. Oct 01 22:13:59.331641 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] [4800d12d-9f8b-47ec-ad20-17e48b16d846] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60992. Oct 01 22:13:59.416061 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.network.neutron [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] validate_networks() for [('dbc08271-b661-4956-a4c9-8e77868ff5ea', None, None, None, None, None)] {{(pid=140437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 22:13:59.778446 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Flavor limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 22:13:59.778972 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Image limits 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 22:13:59.779483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Flavor pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 22:13:59.779908 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Image pref 0:0:0 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 22:13:59.780333 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.virt.hardware [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 22:13:59.789814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:13:59.790303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:13:59.790789 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:13:59.791535 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:13:59.792300 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:13:59.792736 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:13:59.809757 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Getting quotas for project 89e39a085b9f4755b8d41bfd12f03b3b. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 22:13:59.815138 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.quota [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Getting quotas for user 902d38ae2b914ea99dcf232ec6461d55 and project 89e39a085b9f4755b8d41bfd12f03b3b. Resources: {'instances', 'ram', 'cores'} {{(pid=140437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 22:13:59.827624 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Going to run 1 instances... {{(pid=140437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 22:13:59.830674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ee79c5-e6fd-4fcb-870e-2c99503fee14',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 22:13:59.877266 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9941c5db-d96a-4df8-b21c-dfa845fa005a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.581071 Oct 01 22:13:59.877833 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2510/7002] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Oct 1 22:13:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 22:13:59.889585 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-bb665c93-6ada-477c-be59-08fb66caf4d4 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:13:59.890321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-bb665c93-6ada-477c-be59-08fb66caf4d4 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:13:59.912321 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] [74998dba-9c89-4876-a756-a0e4436afa1f] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 32774. Oct 01 22:13:59.913563 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] [770c7631-b847-42b2-bd0c-8c7e920b0b1d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 32776. Oct 01 22:13:59.964551 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-bb665c93-6ada-477c-be59-08fb66caf4d4 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:13:59.975569 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-bb665c93-6ada-477c-be59-08fb66caf4d4 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1248 microversion: 2.1 time: 0.090188 Oct 01 22:13:59.976144 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4493/7003] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:13:59 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:00.999936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:01.001210 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:01.008141 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:01.008641 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:01.009080 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:01.009991 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:01.010436 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:01.010921 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:01.098382 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:01.107846 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-acbdc56a-71f8-4b04-9126-e16967c33de8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1318 microversion: 2.1 time: 0.112806 Oct 01 22:14:01.114372 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2511/7004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:00 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1318 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:02.132779 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:02.133365 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:02.135351 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:14:02.146036 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:02.147041 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:02.147689 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:02.148508 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:02.149058 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:02.149576 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:02.230046 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-3de380d8-5eba-4ce2-ba37-de7b472d43e6 req-79011128-3080-44d2-b67d-3f408e7dd36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52a3cb1-c6fd-4932-a306-fa9f21a53005", "name": "network-vif-unplugged", "status": "completed", "tag": "bf99ae1c-a22d-483f-8622-9004c0147a47"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:14:02.245924 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3de380d8-5eba-4ce2-ba37-de7b472d43e6 req-79011128-3080-44d2-b67d-3f408e7dd36d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:02.247006 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3de380d8-5eba-4ce2-ba37-de7b472d43e6 req-79011128-3080-44d2-b67d-3f408e7dd36d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:02.247816 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3de380d8-5eba-4ce2-ba37-de7b472d43e6 req-79011128-3080-44d2-b67d-3f408e7dd36d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:02.267896 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-3de380d8-5eba-4ce2-ba37-de7b472d43e6 req-79011128-3080-44d2-b67d-3f408e7dd36d service nova] Creating event network-vif-unplugged:bf99ae1c-a22d-483f-8622-9004c0147a47 for instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 on nch1-master-1 Oct 01 22:14:02.274869 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-3de380d8-5eba-4ce2-ba37-de7b472d43e6 req-79011128-3080-44d2-b67d-3f408e7dd36d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048985 Oct 01 22:14:02.276155 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2512/7005] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:14:02.305380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:02.317948 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-af6c8abb-d1af-4c99-a28a-ee477ce5b93f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.189014 Oct 01 22:14:02.319142 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4494/7006] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:02 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:03.346485 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:03.347257 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:03.355018 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:03.355512 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:03.355958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:03.356657 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:03.357116 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:03.357545 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:03.515270 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:03.524018 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-a88577e2-6b6d-4a8d-9fcc-68f5fe3f4ceb tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.182243 Oct 01 22:14:03.524615 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2513/7007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:03 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:04.548873 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:04.549505 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:04.556573 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:04.557251 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:04.557712 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:04.558481 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:04.559000 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:04.559584 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:04.699245 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:04.709095 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-9c566713-ef2c-4049-a6c7-595de8295133 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.164702 Oct 01 22:14:04.719045 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4495/7008] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:04 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:05.732831 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:05.733483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:05.740571 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:05.741071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:05.741516 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:05.742227 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:05.742721 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:05.743149 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:05.885549 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:05.894336 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-49ae66a0-cf9c-4533-bbbc-6ae18a4cfaaf tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.165321 Oct 01 22:14:05.894967 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2514/7009] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:05 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:06.919118 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:06.919750 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:06.927315 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:06.927823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:06.928280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:06.929119 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:06.929678 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:06.930219 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:07.075046 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:07.085042 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5224bfbf-9edc-4188-8d9a-a0bf601e9fdd tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.170124 Oct 01 22:14:07.085884 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4496/7010] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:06 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:08.111013 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:08.112791 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:08.123179 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:08.124085 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:08.124674 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:08.125554 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:08.126019 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:08.126483 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:08.285362 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:08.293648 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9b5ad00d-dfc5-4383-8f47-0111fae42385 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.187921 Oct 01 22:14:08.294235 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2515/7011] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:08 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:09.319380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:09.320007 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:09.326925 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:09.327449 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:09.327899 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:09.328606 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:09.329085 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:09.329527 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:09.462017 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:09.470045 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-54782fe4-8d71-46cf-9b28-9e3d14badf5f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.155516 Oct 01 22:14:09.470860 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4497/7012] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:09 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:10.417306 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=2 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:14:10.418145 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell0:SELECT=6 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:14:10.480263 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-f5924b21-21a3-4bb4-a892-033e929904a5 req-41583842-671b-4c85-82ae-ab7248a8477d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba528c0-11ee-4a47-a0ae-66a004ed53c0", "tag": "15db2e3d-002b-4612-9850-fa4c27a4406a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:14:10.492265 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f5924b21-21a3-4bb4-a892-033e929904a5 req-41583842-671b-4c85-82ae-ab7248a8477d service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:10.492753 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f5924b21-21a3-4bb4-a892-033e929904a5 req-41583842-671b-4c85-82ae-ab7248a8477d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:10.493424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:10.493880 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-f5924b21-21a3-4bb4-a892-033e929904a5 req-41583842-671b-4c85-82ae-ab7248a8477d service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:10.494074 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:10.496048 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell0:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:14:10.503447 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:10.504176 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:10.504636 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:10.505541 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:10.506032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:10.506363 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-f5924b21-21a3-4bb4-a892-033e929904a5 req-41583842-671b-4c85-82ae-ab7248a8477d service nova] Creating event network-changed:15db2e3d-002b-4612-9850-fa4c27a4406a for instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 on nch2-master-1 Oct 01 22:14:10.506484 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:10.512047 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-f5924b21-21a3-4bb4-a892-033e929904a5 req-41583842-671b-4c85-82ae-ab7248a8477d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100845 Oct 01 22:14:10.512674 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2516/7013] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:14:10.647591 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:10.655535 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-873f546b-237e-4c22-9860-9421358ccd24 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.166184 Oct 01 22:14:10.656400 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4498/7014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:10 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 22:14:11.680426 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:11.681146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:11.688360 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:11.688863 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:11.689314 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:11.690029 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:11.691081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:11.691524 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:11.908465 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:11.917865 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-e9b639f1-fdf6-4598-b659-5ac651534ee9 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.241655 Oct 01 22:14:11.918382 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2517/7015] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:11 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:12.942025 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:12.942715 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:12.949650 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:12.950158 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:12.950643 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:12.951360 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:12.951840 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:12.952307 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:13.090270 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:13.098156 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-ee088ea3-1ddd-423f-823e-ecfe04367126 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.160541 Oct 01 22:14:13.098785 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4499/7016] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:12 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:14.121289 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:14.121897 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:14.128814 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:14.129307 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:14.129746 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:14.130447 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:14.130958 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:14.131389 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:14.264562 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:14.272829 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-ec35edde-995c-4552-ae65-1255acb98a76 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.155501 Oct 01 22:14:14.273429 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2518/7017] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:14 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:15.296373 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:15.296926 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:15.304441 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:15.304941 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:15.305396 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:15.306103 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:15.306602 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:15.307045 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:15.434927 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:15.442674 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-3186bb63-abdf-4d32-945c-6845c5c82cc8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.150282 Oct 01 22:14:15.443256 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4500/7018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:15 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:16.217402 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-e8d923ed-26db-4a07-b0c7-85b306953bb1 req-000028cb-1ad7-427d-bf3e-0edde475e619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba528c0-11ee-4a47-a0ae-66a004ed53c0", "name": "network-vif-plugged", "status": "completed", "tag": "15db2e3d-002b-4612-9850-fa4c27a4406a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:14:16.229207 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e8d923ed-26db-4a07-b0c7-85b306953bb1 req-000028cb-1ad7-427d-bf3e-0edde475e619 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:16.230550 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e8d923ed-26db-4a07-b0c7-85b306953bb1 req-000028cb-1ad7-427d-bf3e-0edde475e619 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:16.230996 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-e8d923ed-26db-4a07-b0c7-85b306953bb1 req-000028cb-1ad7-427d-bf3e-0edde475e619 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:16.243118 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-e8d923ed-26db-4a07-b0c7-85b306953bb1 req-000028cb-1ad7-427d-bf3e-0edde475e619 service nova] Creating event network-vif-plugged:15db2e3d-002b-4612-9850-fa4c27a4406a for instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 on nch2-master-1 Oct 01 22:14:16.248373 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-e8d923ed-26db-4a07-b0c7-85b306953bb1 req-000028cb-1ad7-427d-bf3e-0edde475e619 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034909 Oct 01 22:14:16.248980 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2519/7019] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:14:16.465292 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:16.465915 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:16.473413 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:16.473936 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:16.474392 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:16.475126 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:16.475597 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:16.476043 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:16.610875 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:16.619324 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-5220bd3e-b0d4-4410-bde2-b562d623571f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1373 microversion: 2.1 time: 0.157969 Oct 01 22:14:16.619905 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4501/7020] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:16 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:17.642246 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:17.642902 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:17.651247 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:17.651737 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:17.652180 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:17.652881 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:17.653347 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:17.653776 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:17.784513 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:17.792681 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-4f0c416d-bee5-4c80-bfaf-2a834e6ee431 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1558 microversion: 2.1 time: 0.155119 Oct 01 22:14:17.793265 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2520/7021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:17 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:17.815424 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:14:17.816039 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:14:17.823502 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:17.824002 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:17.824457 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:17.825172 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:17.825642 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:17.826083 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:17.955546 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:14:17.963437 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-1559c2da-eec7-4196-acce-787f865f3911 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1558 microversion: 2.1 time: 0.151873 Oct 01 22:14:17.964010 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4502/7022] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:14:17 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:14:19.852695 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-b6c88f35-2155-4a3c-ac54-024846cabc95 req-0c09afbe-31fa-43ed-8aad-d207140b3a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba528c0-11ee-4a47-a0ae-66a004ed53c0", "tag": "15db2e3d-002b-4612-9850-fa4c27a4406a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:14:19.862950 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b6c88f35-2155-4a3c-ac54-024846cabc95 req-0c09afbe-31fa-43ed-8aad-d207140b3a2a service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:14:19.863467 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b6c88f35-2155-4a3c-ac54-024846cabc95 req-0c09afbe-31fa-43ed-8aad-d207140b3a2a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:14:19.863936 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-b6c88f35-2155-4a3c-ac54-024846cabc95 req-0c09afbe-31fa-43ed-8aad-d207140b3a2a service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:14:19.875039 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-b6c88f35-2155-4a3c-ac54-024846cabc95 req-0c09afbe-31fa-43ed-8aad-d207140b3a2a service nova] Creating event network-changed:15db2e3d-002b-4612-9850-fa4c27a4406a for instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 on nch2-master-1 Oct 01 22:14:19.880070 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-b6c88f35-2155-4a3c-ac54-024846cabc95 req-0c09afbe-31fa-43ed-8aad-d207140b3a2a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031097 Oct 01 22:14:19.880667 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2521/7023] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:15:50.585032 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=24 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:15:50.585813 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=54 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:15:50.586912 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 01 22:15:50.587094 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 22:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0/action (ip 10.222.0.17) !!! Oct 01 22:15:50.588167 ncdv-master-1 devstack@n-api.service[140438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 22:15:50.588280 ncdv-master-1 devstack@n-api.service[140438]: Sat Oct 1 22:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0/action (ip 10.222.0.17) !!! Oct 01 22:15:50.593324 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-aa96b609-20c7-42fd-bf0d-c3ea431abaab tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1923420673"}} {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:15:50.595674 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-aa96b609-20c7-42fd-bf0d-c3ea431abaab tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:15:50.605400 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa96b609-20c7-42fd-bf0d-c3ea431abaab tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:15:50.605906 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa96b609-20c7-42fd-bf0d-c3ea431abaab tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:15:50.606369 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa96b609-20c7-42fd-bf0d-c3ea431abaab tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:15:50.607120 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa96b609-20c7-42fd-bf0d-c3ea431abaab tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:15:50.607629 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa96b609-20c7-42fd-bf0d-c3ea431abaab tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:15:50.608076 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-aa96b609-20c7-42fd-bf0d-c3ea431abaab tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:15:50.810961 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-aa96b609-20c7-42fd-bf0d-c3ea431abaab tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "POST /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0/action" status: 202 len: 0 microversion: 2.1 time: 0.227621 Oct 01 22:15:50.811642 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4503/7024] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Oct 1 22:15:50 2022] POST /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 01 22:15:56.872323 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:15:56.873777 ncdv-master-1 devstack@n-api.service[140437]: DEBUG dbcounter [-] [140437] Writing DB stats nova_cell1:SELECT=52 {{(pid=140437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:15:56.875136 ncdv-master-1 devstack@n-api.service[140437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 22:15:56.875283 ncdv-master-1 devstack@n-api.service[140437]: Sat Oct 1 22:15:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 01 22:15:56.886888 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-50213151-b1c6-46ef-891e-65217c079d7f req-9d63b6a8-9189-4fef-9771-f035ec79fc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba528c0-11ee-4a47-a0ae-66a004ed53c0", "name": "network-vif-plugged", "status": "completed", "tag": "15db2e3d-002b-4612-9850-fa4c27a4406a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:15:56.913126 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-50213151-b1c6-46ef-891e-65217c079d7f req-9d63b6a8-9189-4fef-9771-f035ec79fc14 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:15:56.913867 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-50213151-b1c6-46ef-891e-65217c079d7f req-9d63b6a8-9189-4fef-9771-f035ec79fc14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:15:56.914476 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-50213151-b1c6-46ef-891e-65217c079d7f req-9d63b6a8-9189-4fef-9771-f035ec79fc14 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:15:56.926613 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-50213151-b1c6-46ef-891e-65217c079d7f req-9d63b6a8-9189-4fef-9771-f035ec79fc14 service nova] Creating event network-vif-plugged:15db2e3d-002b-4612-9850-fa4c27a4406a for instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 on nch2-master-1 Oct 01 22:15:56.933509 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-50213151-b1c6-46ef-891e-65217c079d7f req-9d63b6a8-9189-4fef-9771-f035ec79fc14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064959 Oct 01 22:15:56.935282 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2522/7025] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:16:04.431436 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_api:SELECT=2 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:16:04.432879 ncdv-master-1 devstack@n-api.service[140438]: DEBUG dbcounter [-] [140438] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 22:16:04.437478 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:04.437898 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-7c0df9ea-fed5-40a3-9119-a7d1526c353e req-fbff5964-b29e-40e2-b61b-3f2292a47545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba528c0-11ee-4a47-a0ae-66a004ed53c0", "tag": "15db2e3d-002b-4612-9850-fa4c27a4406a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:16:04.439465 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:16:04.448611 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:04.449258 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:04.449823 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:04.450303 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7c0df9ea-fed5-40a3-9119-a7d1526c353e req-fbff5964-b29e-40e2-b61b-3f2292a47545 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:04.450785 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:04.450899 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7c0df9ea-fed5-40a3-9119-a7d1526c353e req-fbff5964-b29e-40e2-b61b-3f2292a47545 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:04.451231 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-7c0df9ea-fed5-40a3-9119-a7d1526c353e req-fbff5964-b29e-40e2-b61b-3f2292a47545 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:04.451706 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:04.452257 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:04.469697 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-7c0df9ea-fed5-40a3-9119-a7d1526c353e req-fbff5964-b29e-40e2-b61b-3f2292a47545 service nova] Creating event network-changed:15db2e3d-002b-4612-9850-fa4c27a4406a for instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 on nch2-master-1 Oct 01 22:16:04.475158 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-7c0df9ea-fed5-40a3-9119-a7d1526c353e req-fbff5964-b29e-40e2-b61b-3f2292a47545 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043458 Oct 01 22:16:04.476055 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2523/7026] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:16:04.482860 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 22:16:04.569806 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-81dc377b-3a8c-40a4-b4e7-3a9a88a4c08a tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 204 len: 0 microversion: 2.1 time: 0.140493 Oct 01 22:16:04.570431 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4504/7027] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 22:16:04 2022] DELETE /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 22:16:04.581579 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:04.582315 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:16:04.590033 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:04.590551 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:04.591213 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:04.591955 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:04.592388 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:04.592819 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:04.759694 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:16:04.768416 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-0d961300-0005-4bd8-a85e-7bf1f61e435d tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1683 microversion: 2.1 time: 0.192841 Oct 01 22:16:04.769003 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2524/7028] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:16:04 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:16:05.792634 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:05.793357 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:16:05.800253 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:05.800760 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:05.801218 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:05.801939 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:05.802420 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:05.802892 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:05.938104 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:16:05.946040 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-c4833098-5d99-49c0-804c-73467fb544ce tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1683 microversion: 2.1 time: 0.157986 Oct 01 22:16:05.946641 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4505/7029] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:16:05 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:16:06.535851 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-3d9cbf7d-802e-415c-a07e-a9ce155c37dd req-ed27a98b-e7f1-43f8-996e-85ea211f35b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba528c0-11ee-4a47-a0ae-66a004ed53c0", "name": "network-vif-deleted", "tag": "15db2e3d-002b-4612-9850-fa4c27a4406a"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:16:06.546900 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3d9cbf7d-802e-415c-a07e-a9ce155c37dd req-ed27a98b-e7f1-43f8-996e-85ea211f35b5 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:06.547391 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3d9cbf7d-802e-415c-a07e-a9ce155c37dd req-ed27a98b-e7f1-43f8-996e-85ea211f35b5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:06.547847 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-3d9cbf7d-802e-415c-a07e-a9ce155c37dd req-ed27a98b-e7f1-43f8-996e-85ea211f35b5 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:06.559892 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-3d9cbf7d-802e-415c-a07e-a9ce155c37dd req-ed27a98b-e7f1-43f8-996e-85ea211f35b5 service nova] Creating event network-vif-deleted:15db2e3d-002b-4612-9850-fa4c27a4406a for instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 on nch2-master-1 Oct 01 22:16:06.564488 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-3d9cbf7d-802e-415c-a07e-a9ce155c37dd req-ed27a98b-e7f1-43f8-996e-85ea211f35b5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Oct 01 22:16:06.565096 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2525/7030] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:16:06.969795 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:06.970512 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:16:06.977930 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:06.979029 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:06.979492 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:06.980216 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:06.980698 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:06.981169 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:07.020167 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:07.021675 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:07.022144 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:07.022648 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.objects.instance [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lazy-loading 'fault' on Instance uuid eba528c0-11ee-4a47-a0ae-66a004ed53c0 {{(pid=140438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 22:16:07.071684 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:16:07.079380 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-07d18006-76a5-4c7c-88d7-0d3fef80858b tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 200 len: 1338 microversion: 2.1 time: 0.113605 Oct 01 22:16:07.079950 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4506/7031] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:16:06 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:16:08.105597 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:08.106299 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: eba528c0-11ee-4a47-a0ae-66a004ed53c0] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:16:08.112581 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:08.113071 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:08.113632 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:08.114390 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:08.114827 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:08.115254 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:08.129302 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.wsgi [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] HTTP exception thrown: Instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 could not be found. Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Request method failure captured: Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: request: GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 HTTP/1.1 Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: Accept: application/json Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: Accept-Encoding: identity Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: Connection: close Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: Content-Length: 0 Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: Content-Type: application/json Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: Host: 10.222.0.17 Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: Openstack-System-Scope: None Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: User-Agent: python-urllib3/1.26.12 Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Auth-Token: gAAAAABjOLsNvMOVvEjObcS-SjfmZl6hdmFKzXKwOJoOisNHxYJm3ail4bx_6fHM-wi_-bMTaC5E-mRKsrsUBo4c65DJVW8wvizSI0v7ZCllqlV3bNEFYz1Gai8fG6EZ8Bhh6PV7EMVDUWOab0NzIxfq_VRQYvIccM5ONo1h6nOcUGHd-QWc1qY Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Id: None Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Domain-Name: None Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Identity-Status: Confirmed Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Is-Admin-Project: True Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Id: default Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Domain-Name: Default Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Id: 89e39a085b9f4755b8d41bfd12f03b3b Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Project-Name: tempest-TestSnapshotPattern-1391310086 Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Role: member,reader Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Roles: member,reader Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_89e39a085b9f4755b8d41bfd12f03b3b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89e39a085b9f4755b8d41bfd12f03b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/89e39a085b9f4755b8d41bfd12f03b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89e39a085b9f4755b8d41bfd12f03b3b"}]}] Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant: tempest-TestSnapshotPattern-1391310086 Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Id: 89e39a085b9f4755b8d41bfd12f03b3b Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-Tenant-Name: tempest-TestSnapshotPattern-1391310086 Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-User: tempest-TestSnapshotPattern-1391310086-project Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Id: default Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-User-Domain-Name: Default Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-User-Id: 902d38ae2b914ea99dcf232ec6461d55 Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: X-User-Name: tempest-TestSnapshotPattern-1391310086-project Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: method: > Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: exception: Instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 could not be found. Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: action_args: {'id': 'eba528c0-11ee-4a47-a0ae-66a004ed53c0'} Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 could not be found. Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 could not be found. Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:16:08.130959 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 could not be found. Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: ERROR nova.api.openstack.wsgi Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Returning 404 to user: Instance eba528c0-11ee-4a47-a0ae-66a004ed53c0 could not be found. {{(pid=140437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-37ce6503-1328-4b83-9bbe-57b1a7437059 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0" status: 404 len: 111 microversion: 2.1 time: 0.032447 Oct 01 22:16:08.134754 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2526/7032] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:16:08 2022] GET /compute/v2.1/servers/eba528c0-11ee-4a47-a0ae-66a004ed53c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 22:16:09.754080 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:09.754627 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:16:09.756160 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-9910378b-9f86-4550-8b10-a00266654049 req-0ba29805-c8fd-4dee-ae5d-1fe6762bfa84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52a3cb1-c6fd-4932-a306-fa9f21a53005", "tag": "bf99ae1c-a22d-483f-8622-9004c0147a47"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:16:09.764072 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:09.764814 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:09.765866 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:09.766148 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:09.766641 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:09.767088 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:09.767324 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9910378b-9f86-4550-8b10-a00266654049 req-0ba29805-c8fd-4dee-ae5d-1fe6762bfa84 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:09.768035 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9910378b-9f86-4550-8b10-a00266654049 req-0ba29805-c8fd-4dee-ae5d-1fe6762bfa84 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:09.768478 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-9910378b-9f86-4550-8b10-a00266654049 req-0ba29805-c8fd-4dee-ae5d-1fe6762bfa84 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:09.781241 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-9910378b-9f86-4550-8b10-a00266654049 req-0ba29805-c8fd-4dee-ae5d-1fe6762bfa84 service nova] Creating event network-changed:bf99ae1c-a22d-483f-8622-9004c0147a47 for instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 on nch1-master-1 Oct 01 22:16:09.786880 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-9910378b-9f86-4550-8b10-a00266654049 req-0ba29805-c8fd-4dee-ae5d-1fe6762bfa84 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034657 Oct 01 22:16:09.787495 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2527/7033] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 22:16:09.797598 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Going to try to terminate instance {{(pid=140438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 22:16:09.894972 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-2e1a6dfb-e89e-4ba8-ac32-3a9a7183563f tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 204 len: 0 microversion: 2.1 time: 0.144505 Oct 01 22:16:09.895869 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4507/7034] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Oct 1 22:16:09 2022] DELETE /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 22:16:09.905416 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:09.906146 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.compute.api [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140437) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:16:09.912696 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:09.913365 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:09.914015 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:09.915081 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:09.915706 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:09.916198 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:10.067287 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.policy [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140437) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:16:10.075598 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-91734a7f-7f09-48e9-b932-5ea2fb8a66c2 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1682 microversion: 2.1 time: 0.175115 Oct 01 22:16:10.076174 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2528/7035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:16:09 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:16:11.100660 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:11.101380 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:16:11.108280 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:11.108786 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:11.109246 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:11.109956 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:11.110431 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:11.110900 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:11.381140 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.policy [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d38ae2b914ea99dcf232ec6461d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e39a085b9f4755b8d41bfd12f03b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 22:16:11.389663 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-a968b085-0bfd-48fe-865d-78a958ecb8e1 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 200 len: 1682 microversion: 2.1 time: 0.293316 Oct 01 22:16:11.390253 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4508/7036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:16:11 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 22:16:11.882431 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [req-12e72cfc-5dd6-455c-b609-2a230287fd85 req-2a025088-158e-4e05-89b7-4a57e72a6054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52a3cb1-c6fd-4932-a306-fa9f21a53005", "name": "network-vif-deleted", "tag": "bf99ae1c-a22d-483f-8622-9004c0147a47"}]} {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 22:16:11.893128 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-12e72cfc-5dd6-455c-b609-2a230287fd85 req-2a025088-158e-4e05-89b7-4a57e72a6054 service nova] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:11.893558 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-12e72cfc-5dd6-455c-b609-2a230287fd85 req-2a025088-158e-4e05-89b7-4a57e72a6054 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:11.894077 ncdv-master-1 devstack@n-api.service[140437]: DEBUG oslo_concurrency.lockutils [req-12e72cfc-5dd6-455c-b609-2a230287fd85 req-2a025088-158e-4e05-89b7-4a57e72a6054 service nova] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:11.905542 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.compute.server_external_events [req-12e72cfc-5dd6-455c-b609-2a230287fd85 req-2a025088-158e-4e05-89b7-4a57e72a6054 service nova] Creating event network-vif-deleted:bf99ae1c-a22d-483f-8622-9004c0147a47 for instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 on nch1-master-1 Oct 01 22:16:11.910434 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [req-12e72cfc-5dd6-455c-b609-2a230287fd85 req-2a025088-158e-4e05-89b7-4a57e72a6054 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031750 Oct 01 22:16:11.911068 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2529/7037] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Oct 1 22:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 22:16:12.413377 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '>' {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:12.413904 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.compute.api [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] [instance: b52a3cb1-c6fd-4932-a306-fa9f21a53005] Fetching instance by UUID {{(pid=140438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 22:16:12.421625 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:12.422123 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:12.422604 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:12.423321 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Acquiring lock "2663fce6-13d1-4945-900e-d818f7f389c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 22:16:12.423815 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 22:16:12.424254 ncdv-master-1 devstack@n-api.service[140438]: DEBUG oslo_concurrency.lockutils [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Lock "2663fce6-13d1-4945-900e-d818f7f389c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 22:16:12.438284 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.wsgi [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] HTTP exception thrown: Instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 could not be found. Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Request method failure captured: Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: request: GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 HTTP/1.1 Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: Accept: application/json Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: Accept-Encoding: identity Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: Connection: close Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: Content-Length: 0 Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: Content-Type: application/json Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: Host: 10.222.0.17 Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: Openstack-System-Scope: None Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: User-Agent: python-urllib3/1.26.12 Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Auth-Token: gAAAAABjOLsNvMOVvEjObcS-SjfmZl6hdmFKzXKwOJoOisNHxYJm3ail4bx_6fHM-wi_-bMTaC5E-mRKsrsUBo4c65DJVW8wvizSI0v7ZCllqlV3bNEFYz1Gai8fG6EZ8Bhh6PV7EMVDUWOab0NzIxfq_VRQYvIccM5ONo1h6nOcUGHd-QWc1qY Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Id: None Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Domain-Name: None Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Identity-Status: Confirmed Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Is-Admin-Project: True Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Id: default Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Domain-Name: Default Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Id: 89e39a085b9f4755b8d41bfd12f03b3b Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Project-Name: tempest-TestSnapshotPattern-1391310086 Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Role: member,reader Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Roles: member,reader Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_89e39a085b9f4755b8d41bfd12f03b3b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89e39a085b9f4755b8d41bfd12f03b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/89e39a085b9f4755b8d41bfd12f03b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/89e39a085b9f4755b8d41bfd12f03b3b"}]}] Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant: tempest-TestSnapshotPattern-1391310086 Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Id: 89e39a085b9f4755b8d41bfd12f03b3b Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-Tenant-Name: tempest-TestSnapshotPattern-1391310086 Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-User: tempest-TestSnapshotPattern-1391310086-project Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Id: default Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-User-Domain-Name: Default Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-User-Id: 902d38ae2b914ea99dcf232ec6461d55 Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: X-User-Name: tempest-TestSnapshotPattern-1391310086-project Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: method: > Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: exception: Instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 could not be found. Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: action_args: {'id': 'b52a3cb1-c6fd-4932-a306-fa9f21a53005'} Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: {{(pid=140438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 could not be found. Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 could not be found. Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 22:16:12.439989 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 could not be found. Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: ERROR nova.api.openstack.wsgi Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: DEBUG nova.api.openstack.wsgi [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Returning 404 to user: Instance b52a3cb1-c6fd-4932-a306-fa9f21a53005 could not be found. {{(pid=140438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: INFO nova.api.openstack.requestlog [None req-e2163707-0113-495d-b468-180a6736b6c8 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005" status: 404 len: 111 microversion: 2.1 time: 0.032141 Oct 01 22:16:12.443894 ncdv-master-1 devstack@n-api.service[140438]: [pid: 140438|app: 0|req: 4509/7038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Oct 1 22:16:12 2022] GET /compute/v2.1/servers/b52a3cb1-c6fd-4932-a306-fa9f21a53005 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 22:16:12.605286 ncdv-master-1 devstack@n-api.service[140437]: DEBUG nova.api.openstack.wsgi [None req-9512b075-112a-4c05-83e7-9fa4eadc7914 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] Calling method '.version_select at 0x7f41722cba60>' {{(pid=140437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 22:16:12.629115 ncdv-master-1 devstack@n-api.service[140437]: INFO nova.api.openstack.requestlog [None req-9512b075-112a-4c05-83e7-9fa4eadc7914 tempest-TestSnapshotPattern-1391310086 tempest-TestSnapshotPattern-1391310086-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-974134804" status: 202 len: 0 microversion: 2.1 time: 0.028531 Oct 01 22:16:12.629625 ncdv-master-1 devstack@n-api.service[140437]: [pid: 140437|app: 0|req: 2530/7039] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Oct 1 22:16:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-974134804 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)